Because of the need to provide fine-grained longitudinal diagnostic feedback, longitudinal cognitive diagnosis is an emerging approach that integrates cross-sectional cognitive diagnosis models (CDM) with longitudinal data analysis techniques. By adopting the generalized longitudinal higher-order log-linear CDM, this study attempted to track the…

There is a lack of tests available for assessing sign language proficiency among L2 learners. We have therefore developed a sign repetition test, SignRepL2, with a specific focus on the phonological features of signs. This paper describes the two phases of developing this test. In the first phase, content was developed in the form of 50 items with…

Research has postulated a link between teachers' beliefs and agentic decisions. This study sought to investigate 215 Iranian EFL preservice teachers' conceptions of assessment, assessment agency, and the interrelationship between these two constructs. Using structural equation modeling, the results revealed that collaboration and reflection…

This quasi-experimental study examines the impact of a diagnosis-based pedagogical intervention on the development of micro English as a foreign language (EFL) reading abilities over time. Specifically, 105 first-year graduate students in a Chinese university completed three diagnostic reading assessments at the beginning, middle, and end of a…

This study introduces the first Arabic Vocabulary Levels Test (Arabic-VLT), created for foreign learners of Arabic. We present compelling evidence to substantiate its validity and reliability. The Arabic-VLT was developed according to five levels, beginning with the most frequently used words (Level 1) to the least frequently used ones (Level 5),…

The ACTFL Assessment of Performance Toward Proficiency in Languages (AAPPL, https://www.actfl.n.d.org/assessments/k-12-assessments/aappl) assesses proficiency in 11 languages for students in grades 3 to 12 and is often used to award the Seal of Biliteracy. While arguments for the valid interpretation and uses of the AAPPL have previously been…

Despite the growing interest in AI for language assessment, there remains a significant research gap regarding its usefulness for assessing less proficient language skills, particularly those of learners of English as a second or foreign language (S/FL). AI models often prioritize proficient writing, neglecting the intricacies of learner language.…

The Korean College Scholastic Ability Test (CSAT) aims to assess Korean high school students' scholastic ability required for college readiness. As a high-stakes test, the examination serves as a pivotal hurdle for university admission and exerts a strong washback effect on the educational system in Korea. The present study set out to investigate…

The use of four-skills language exams to support the achievement of curriculum goals in Japan is an under-researched yet critical topic. This study focuses on washback from the Cambridge B1 Preliminary and B2 First exams, which were used as fixed-point tests at a senior high school. A mixed-methods approach was adopted, utilizing data from…

The construct of "learning potential" has been proposed to capture differences between learner independent performance and performance during Dynamic Assessment (DA). This paper introduces a new LPS formula implemented in a DA study involving Pakistani learners of L2 Chinese. Learners were randomly assigned to a control or experimental…

Recent literature in the field of L2 vocabulary assessment has advocated for the development of written receptive vocabulary tests such as Vocabulary Levels Tests (VLTs) that use: (a) meaning-recall item formats, (b) a minimum of 40 item counts per 1,000-frequency band to improve level estimates, and (c) lemmas (not word-families) as the lexical…

In this commentary, we describe the English language placement adaptations we were required to make due to the world-wide COVID-19 pandemic. It includes a brief description of our placement test battery which was adapted to address our institution's move to a remote teaching/learning mode. A discussion of the major challenges we experienced, their…

Drawing on the framework of invariant measurement from Rasch measurement theory, the purpose of this study is to psychometrically evaluate the 20 language and teaching skill domains of the International Teaching Assistant (ITA) Test using the many-facet Rasch model and to empirically explore performance differences between females and males in…

Jessica Wu is Research and Development Program Director at the Language Training and Testing Center (LTTC) in Taipei, Taiwan. Jessica has been deeply involved in the development and validation of the General English Proficiency Test (GEPT) in addition to a number of other foreign language testing programs. Her research focuses on speaking…

Thinking skills play a critical role in determining language performance. Recent advancement in cognitive diagnostic modelling (CDM) provides a powerful tool for obtaining fine-grained information regarding these thinking skills during reading. Studies are scant, however, exploring the relations between thinking skills and language performance,…