This paper explores what the measures of utterance fluency typically employed in Automatic Speech Evaluation (ASE), i.e. automated speaking assessments, tell us about oral proficiency. 60 Chinese learners of English completed the second part of the speaking section of IELTS and six tasks designed to measure the linguistic knowledge and processing…

Many English-medium universities employ a compensatory model to establish cutscores on English language proficiency tests for student admissions. In this model, students can have different scores on different sections of the test provided their overall score meets the admission cutscore. This practice raises questions regarding potential variation…

The implicit sociocultural functioning of the "content" of high-stakes English language proficiency tests is a rarely-explored concern in language assessment. This study attempts to bring critical views of language testing and critical discourse studies together to examine the content of IELTS preparation materials in search of topics…

Drawing on the framework of invariant measurement from Rasch measurement theory, the purpose of this study is to psychometrically evaluate the 20 language and teaching skill domains of the International Teaching Assistant (ITA) Test using the many-facet Rasch model and to empirically explore performance differences between females and males in…

This mixed methods study compared IELTS examiners' scores when assessing spoken performances under live and two 'non-live' testing conditions using audio and video recordings. Six IELTS examiners assessed 36 test-takers' performances under the live, audio, and video rating conditions. Scores in the three rating modes were calibrated using the…

There has been much debate in assessment research about the inclusion of Global English accents in high-stakes listening tests. This study explored test-takers' attitudes toward the inclusion of different English accents in the Duolingo English Test (DET) 2021 test version and their associations with listening test scores. One hundred sixty…

The number of internationally mobile students pursuing higher education increases each year, with 8 million students expected to study abroad globally by 2025 (Farrugia, 2014). Many English-dominant universities require international applicants to provide standardized test scores as evidence of English proficiency. Accordingly, millions of…

The Common European Framework of Reference for Languages (CEFR) is widely used in setting language proficiency requirements, including for international students seeking access to university courses taught in English. When different language examinations have been related to the CEFR, the process is claimed to help score users, such as university…

An assumption underlying speaking tests is that scores reflect the ability to produce online, non-rehearsed speech. Speech produced in testing situations may, however, be less spontaneous if extensive test preparation takes place, resulting in memorized or rehearsed responses. If raters detect these patterns, they may conceptualize speech as…

To examine the effects of listening test preparation, we had three groups, two experimental and one control (63 learners total), partake in three types of instruction sandwiched between two equally difficult listening tests (pretests and posttests). The first experimental group took four practice tests and received "explicit"…

This research explores how Internet-based video-conferencing technology can be used to deliver and conduct a speaking test, and what similarities and differences can be discerned between the standard and computer-mediated face-to-face modes. The context of the study is a high-stakes speaking test, and the motivation for the research is the need…