A challenge of large-scale oral communication assessments is to feasibly assess a broad construct that includes interactional competence. One possible approach in addressing this challenge is to use a spoken dialog system (SDS), with the computer acting as a peer to elicit a ratable speech sample. With this aim, an SDS was built and four trained…

As a result of the Japanese Ministry of Education's recent edict that students' written and spoken English should be assessed in university entrance exams, there is an urgent need for tools to help teachers and students prepare for these exams. Although some commercial tools already exist, they are generally expensive and inflexible. To address…

In this work, we explore the differences between proctored and unproctored Internet administration for a Basque language low-stakes test considering demographic factors such as age, gender, and knowledge level in the subject. To this aim, we have developed an ad hoc application that allows us to establish a set of filters and techniques that…

The rating of proficiency tests that use the Inter-agency Roundtable (ILR) and American Council on the Teaching of Foreign Languages (ACTFL) guidelines claims that each major level is based on hierarchal linguistic functions that require mastery of multidimensional traits in such a way that each level subsumes the levels beneath it. These…

In two visual-world eye-tracking experiments, we explore the extent to which conflicting first-language (L1) based grammatical parses influence second-language (L2) learners' on-line and off-line interpretation of sentences in the L2. We used cross-linguistic structural priming to potentially boost competition from the L1 grammar during the…

The present study investigated the effects of text-based and audio-based dynamic glosses on L2 vocabulary learning within a sociocultural approach. Dynamic glosses were operationalised as a set of incrementally ordered prompts, provided during text-based and audio-based interactions that guided the participants to identify the meaning of unknown…

This article reports on two studies, testing how three different types of input (skewed first, skewed random and balanced) affect second language (L2) learning of English present counterfactual (IF-Is) and past counterfactual (IF-IIs) conditionals, two constructions differing in complexity. The experiment included a proficiency test, a pretest, a…

This article reviews recent literature (2011-present) on the automated scoring (AS) of writing and speaking. Its purpose is to first survey the current research on automated scoring of language, then highlight how automated scoring impacts the present and future of assessment, teaching, and learning. The article begins by outlining the general…

Prompted by Taiwanese university students' increasing demand for English proficiency assessment, the absence of a test designed specifically for this demographic subgroup, and the lack of a localized and freely-accessible proficiency measure, this project set out to develop and validate a computerized adaptive English proficiency testing (E-CAT)…

The study examines the effects of using computer delivered Processing Instruction (PI) to teach English reflexives. Thirty intermediate ESL learners participated in the pretest-treatment-posttest study. Participants received the input-based PI activities. Gains were assessed by traditional offline tasks such as sentence interpretation and…

Administration of high-stakes language proficiency tests has been disrupted in many parts of the world as a result of the 2019 novel coronavirus pandemic. Institutions that rely on test scores have been forced to adapt, and in many cases this means using scores from a different test, or a new online version of an existing test, that can be taken…

This paper compares and analyzes a selection of popular multilevel tests used for quick accreditation of English as a foreign language worldwide. The paper begins by stating the current need of accreditation of English language competence for both academic and professional matters. It then looks at their defining features and differences. After,…

In the paper, we deal with the comparison of the evaluation of students' language skills in two environments, on-site and online. Testing took place through the moodle platform, where we used e-test, during the first and second waves of the pandemic. The main aim of the research was to find out what impact the environment in which the testing…

The inclusion of students with disabilities in the education system results in content or assessment accommodations to suit the students' special needs and to ensure they have acquired the objectives listed in the curriculum. In this paper, we aim at proposing different ways to accommodate a university English language test to a partially blind…

Severity and centrality are two main kinds of rater effects posing threats to the validity and fairness of performance assessments. Adopting Jin and Wang's (2018) extended facets modeling approach, we separately estimated the magnitude of rater severity and centrality effects in the web-based TestDaF (Test of German as a Foreign Language) writing…