The continuous disparities in reading test scores between Black and White students remain a substantial problem in education. This study examines the historical disparity by investigating how the Georgia Milestones English Language Arts (ELA) End of Grade (EOG) Assessment incorporates cultural relevance. Employing the theoretical frameworks of…

Many different elements have a significant impact on the effectiveness of both teaching and assessment. The ever-expanding body of research on assessment has provided an overview of several cognitive, social, and emotional aspects that impact the academic accomplishment of learners in either a direct or indirect manner. In spite of the promising…

Following the burgeoning growth of artificial intelligence (AI) and machine learning (ML) applications in language assessment in recent years, the meteoric rise of ChatGPT and its sweeping applications in almost every sector have left us in awe, scrambling to catch up by developing theories and best practices. This special issue features studies…

J.D. Brown (JD) served as the author of an instructional column titled "Statistics Corner" in the "Shiken": JALT "Testing & Evaluation SIG Newsletter" for an extensive period spanning over two decades, from 1997 to 2019. This publication was under the auspices of the Testing and Evaluation Special Interest Group,…

In the test-centric Thai education system, results on national exams are often viewed as indicators of educational success. These exams use multiple-choice which can have detrimental effects on students' attitudes and learning. If school assessments also rely on multiple-choice exams, the situation would be worrying, yet there is little data…

This paper recapitulates the aims of the CEFR and highlights three aspects of good practice in exploiting it: firstly, taking as a starting point the real-world language ability that is the aim of all modern language learners; secondly, the exploitation of good descriptors as transparent learning objectives in order to involve and empower the…

Feedback to the test taker is a defining characteristic of diagnostic language testing (Alderson, 2005). This article reports on a study that investigated how much and in what ways students at a Taiwan university perceived the feedback to be useful on an online multiple-choice diagnostic English grammar test, both in general and by students of…

The General English Proficiency Test (GEPT) is a 5-level, criterion-referenced English as a Foreign Language (EFL) testing system implemented in Taiwan to assess the general English proficiency of EFL learners. In 1999, with the aim of encouraging the general study of English and to result in beneficial washback effects on the teaching and…

This piece makes a case for using assessment to understand and identify the needs of learners and introduces the three reprints that follow: "Twenty Common Testing Mistakes for EFL Teachers to Avoid," "Coming to Grips with Progress Testing: Some Guidelines for Its Design," and "Purposeful Language Assessment: Selecting the Right Alternative Test."

Background: Numerous studies show clear evidence that children display typicality effects during early word learning. However, little is known of the typicality of stimuli used by standardized language tests to assess children's language development. Aims: To examine the typicality of stimuli used by the Reynell Developmental Language Scales--III…

This article presents the author's response to Xiaoming Xi's paper titled "How do we go about investigating test fairness?" In the paper, Xi offers "a means to fully integrate fairness investigations and practice". Given the current importance accorded to fairness in the language testing community, Xi makes a case for viewing fairness as an aspect…

In language programs, it is crucial to place incoming students into appropriate levels to ensure that course curriculum and materials are well targeted to their learning needs. Deciding how and where to set cutscores on placement tests is thus of central importance to programs, but previous studies in educational measurement disagree as to which…

This paper examines the quality of tests that Hong Kong teachers of English as a Foreign Language (EFL) produce for their own EFL students. The paper examines the effects on graduate teachers of a language testing programme where participants produced objective tests, proceeding through the stages of test specification, moderation, and item…

We conduct a randomized evaluation of a school library program on children's language skills. We find that the program had little impact on students' scores on a language test administered 16 months after implementation. The estimates are sufficiently precise to rule out effects larger than 0.13 and 0.11 standard deviations based on the 95 and 90…

This article presents the authors' response on the two commentators' (Fred Davidson and Charles Alderson) reviews of the 2009 Special Issue of "Language Assessment Quarterly" on "Cognitive Diagnosis and Q-matrices in Language Assessment." The Special Issue represents several years of research work on cognitive diagnosis approaches (CDA) carried…