This study applied the Mixed Rasch Model (MRM) to the listening comprehension section of the International English Language Testing System (IELTS) to detect latent class differential item functioning (DIF) by exploring multiple profiles of second/foreign language listeners. Item responses of 462 examinees to an IELTS listening test were subjected…

This paper explores the role of language testing in English education, focusing on its theoretical foundations, methodologies and practical applications. It analyzes how language tests fulfill various purposes, such as placement, progress monitoring, achievement evaluation and diagnostic feedback, underlining the importance of a critical…

Though dynamic assessment (DA) has gained strong theoretical and empirical support over the last decades, second language (L2) practitioners have blamed it for its applicability in large classes. To ameliorate this limitation, peer-dynamic assessment (peer-DA), rooted in the conceptualization of zone of proximal development (ZPD), can be…

J.D. Brown (JD) served as the author of an instructional column titled "Statistics Corner" in the "Shiken": JALT "Testing & Evaluation SIG Newsletter" for an extensive period spanning over two decades, from 1997 to 2019. This publication was under the auspices of the Testing and Evaluation Special Interest Group,…

The growing diversity among test takers in second or foreign language (L2) assessments makes the importance of fairness front and center. This systematic review aimed to examine how fairness in L2 assessments was evaluated through differential item functioning (DIF) analysis. A total of 83 articles from 27 journals were included in a systematic…

In order to address the needs of the continually growing number of Chinese language learners, the present study developed and presented initial validation of a 100-item Chinese vocabulary proficiency test (CVPT) for learners of Chinese as a second/foreign language (CS/FL) using Item Response Theory among 170 CS/FL learners from Indonesia and 354…

Foreign language testing is a multi-dimensional phenomenon and obtaining objective and error-free scores on learners' language skills is often problematic. While assessing foreign language performance on high-stakes tests, using different testing approaches including Classical Test Theory (CTT), Generalizability Theory (GT) and/or Item Response…

While language aptitude and motivation are considered to be important contributors to second language (L2) attainment, two major gaps in the past research have been (1) a lack of nonlinear models stemming from a naive and tacit assumption that learning outcomes are linearly related to their predictors, and (2) a lack of unified and integrative…

This study investigates the effects of four online vocabulary tasks on second language (L2) vocabulary acquisition among learners of different proficiency levels. While tasks are widely used to support L2 vocabulary learning, the efficacy of a task depends on the interplay between task and learner factors. Thus, choosing an appropriate task…

Language teachers are expected to engage in classroom assessment practices and report on learners' progress aligned with proficiency standards, as well as prepare learners for external examinations. The term "language assessment literacy" (LAL) describes what the constituency of language instructors needs to know about assessment…

Though our technical imagination is not restricted to the aesthetic, analogies of the latter in the former do give pause to consider anew the role of creativity and invention in language intervention design. On the norm side, aesthetic anticipations in the technical sphere appeal to the designers of language interventions to bring their solutions…

Reading aloud is recommended as a simple technique to measure speaking ability (Hughes & Hughes, 2020; Madsen, 1983). Reading aloud is currently used in the Pearson Test of English and a couple of other international English as a second language proficiency tests. Due to the simplicity of the technique, it can be used in conjunction with other…

This controlled experimental study investigated the interaction of variables associated with rating the pronunciation component of high-stakes English-language-speaking tests such as IELTS and TOEFL iBT. One hundred experienced raters who were all either familiar or unfamiliar with Brazilian-accented English or Papua New Guinean Tok Pisin-accented…

Background: Many studies (especially cross-sectional ones) have shown significant links between two of these three constructs-achievement, self-concept and anxiety. Objectives: Unlike past longitudinal studies that examined only two of these three constructs, this study examines all three, grounded in self-determination theory, control-value…

C-tests are gap-filling tests mainly used as rough and economical measures of second-language proficiency for placement and research purposes. A C-test usually consists of several short independent passages where the second half of every other word is deleted. Owing to their interdependent structure, C-test items violate the local independence…