Recent literature in the field of L2 vocabulary assessment has advocated for the development of written receptive vocabulary tests such as Vocabulary Levels Tests (VLTs) that use: (a) meaning-recall item formats, (b) a minimum of 40 item counts per 1,000-frequency band to improve level estimates, and (c) lemmas (not word-families) as the lexical…

This paper will deal, firstly, with the South African context, that cries out for attention to responsible language assessment. The renewed interest in language testing in South Africa is well illustrated in assessments of language ability for educational purposes generally, and more specifically in the assessment of academic literacy. Secondly,…

Grammar assessment has long been a pivotal and regular component of almost all high-stakes English tests in China. In writing grammar items, however, test developers tend to depend largely on their individual knowledge of grammar, or even intuition, without much reference to the typicality or de facto uses of the language. To address this problem…

Pragmatics has been a key component of language competence frameworks. While the majority of second/foreign language (L2) pragmatics tests have targeted productive skills, the assessment of receptive pragmatic skills remains a developing field. This study explores validation evidence for a test of receptive L2 pragmatic ability called the American…

When the COVID-19 pandemic made it impossible to do in-person, on campus testing, we were forced to create a new system to screen International Teaching Assistants (ITA) for Temple university. We used this opportunity to address many of the concerns and problems that we had identified with the previous test, and created a new test that could be…

Prompted by Taiwanese university students' increasing demand for English proficiency assessment, the absence of a test designed specifically for this demographic subgroup, and the lack of a localized and freely-accessible proficiency measure, this project set out to develop and validate a computerized adaptive English proficiency testing (E-CAT)…

This study determines the fine-grained bottom-up linguistic features involved in successful second language (L2) English academic group oral tutorial discussion through the use of a spoken learner corpus composed of more than 20 hrs of L2 production. Student performances were graded by teacher-raters using a can-do rating scale, which assessed…

L2 test developers often use scripted spoken texts in their L2 listening tests, because it is efficient and practical to create scripted spoken texts that meet predetermined test specifications. But because scripted spoken texts differ in a number of fundamental ways from unscripted spoken language, there are potential threats to validity when…

This article describes the steps we went through in designing and validating an item bank to diagnose linguistic problems in the English academic writing of university students in Hong Kong. Test items adopt traditional item formats (e.g., MCQ, grammatical judgment tasks, and error correction) but are based on authentic language materials…

The purpose of diagnostic language assessment is to identify learner strengths and weaknesses so that subsequent learning activity can be planned according to learner needs, a purpose which aligns with pedagogical recommendations to individualize instruction. Indeed, the extent to which diagnostic assessment can inform the selection of…

This article describes and reviews the Singapore-Cambridge General Certificate of Education Advanced Level General Paper (GP) examination. As a written test that is administered to preuniversity students, the GP examination is internationally recognised and accepted by universities and employers as proof of English competence. In this article, the…

One major threat to validity in high-stakes testing is construct-irrelevant variance. In this study we explored whether the transition from a paper-and-pencil to a computer-based test mode in a high-stakes test in China, the College English Test, has brought about variance irrelevant to the construct being assessed in this test. Analyses of the…

This study investigates the relationship between performances on the speaking component of the TOEFL iBTTM with performances on academic oral assessment tasks. For the academic tasks, we recorded and transcribed the performances of five local and five high-achieving international undergraduate students on oral assessment tasks in core first-year…

In this article, we report on our development of a translanguaged French/English listening task as part of the revision of a test for professors in a bilingual Canadian university. The primary objective in revising the test was to more authentically represent the target language use domain, which regularly includes translanguaging. We describe the…

Washback and fairness are interrelated in validity research, and thus an investigation into washback inevitably involves fairness. This article reports Phase One of a washback study of "Test for English Majors for Grade Eight" (TEM8). Phase One was a questionnaire survey administered to university program administrators. Two research…