Stakeholders in exam-driven countries are responsible for developing test-related tasks to assess the quality of English as a Foreign Language (EFL) teaching and learning. Hence, the language assessment literacy (LAL) of different stakeholders has to be investigated. This mixed-methods study explored the required LAL competencies among two groups…

A large number of children are exposed to more than one language. One well-established method of assessing early vocabulary development in monolingual children is parent report; however, its use in bilingual/multilingual contexts is less established and brings unique challenges. In this methodological scoping review, we reviewed studies of early…

The TOEFL Junior® tests are designed to evaluate young language students' English reading, listening, speaking, and writing skills in an English-medium secondary instructional context. This paper articulates a validity argument constructed to support the use and interpretation of the TOEFL Junior test scores for the purpose of placement, progress…

J.D. Brown (JD) served as the author of an instructional column titled "Statistics Corner" in the "Shiken": JALT "Testing & Evaluation SIG Newsletter" for an extensive period spanning over two decades, from 1997 to 2019. This publication was under the auspices of the Testing and Evaluation Special Interest Group,…

The growing diversity among test takers in second or foreign language (L2) assessments makes the importance of fairness front and center. This systematic review aimed to examine how fairness in L2 assessments was evaluated through differential item functioning (DIF) analysis. A total of 83 articles from 27 journals were included in a systematic…

The TOEIC has emerged as the benchmark for assessing the English language proficiency and communication abilities of individuals whose first language is not English. Achieving a high score on this examination may prove challenging for them. While there have been numerous studies into metacognitive strategies towards reading comprehension, in the…

The International English Language Testing System (IELTS) is a high-stakes exam where Writing Task 2 significantly influences the overall scores, requiring reliable evaluation. While trained human raters perform this task, concerns about subjectivity and inconsistency have led to growing interest in artificial intelligence (AI)-based assessment…

Aural lexical knowledge (ALK) is crucial for second language (L2) listening. Despite its importance, there is scant research that has validly explored the relationship between ALK and L2 listening across different English as a Foreign Language (EFL) contexts. In an effort to broaden this research base, the current study closely replicates a…

This study investigated how questioning strategies impact language learner performance. Specifically, it explored how questioning strategies influence (i) verb production and subject-verb agreement in the target language, and (ii) learner confidence in completing tasks without translation software. Sixty-eight novice language learners enrolled in…

In order to address the needs of the continually growing number of Chinese language learners, the present study developed and presented initial validation of a 100-item Chinese vocabulary proficiency test (CVPT) for learners of Chinese as a second/foreign language (CS/FL) using Item Response Theory among 170 CS/FL learners from Indonesia and 354…

The extent to which writing modality (i.e., hand-writing vs. keyboarding) impacts second-language (L2) writing assessment scores remains unclear. For alphabetic languages like English, research shows mixed results, documenting both equivalent and divergent scores between typed and handwritten tests (e.g., Barkaoui & Knouzi, 2018). However, for…

This paper investigated the effect of a Collaborative Online International Learning (COIL) project on English as a Foreign Language (EFL) learners' self-perceived communication competence (SPCC), communication anxiety (CA), and soft skills. The participants were 157 university students from Japan, Türkiye, and Spain who completed various tasks and…

Background/purpose: This study aims to analyze the need for local wisdom-based Indonesian as a Foreign Language (BIPA) evaluation materials for Thai students and propose a design to enhance language proficiency and cultural awareness. The growing interest in learning Indonesian stems from diverse purposes, including business, academics, and…

In assessment contexts, the domain definition inference requires accurate documentation of linguistic demands in a specific target domain for precise measurement. The present study examines several aspects of repetitions in academic lecture settings to offer the domain definition inference for academic listening tests. To do this, I analyzed the…

Chinese learners of English often experience difficulty with English tense presumably because their native language is tenseless. We showed that this difficulty relates to their incomplete conceptual representations for tense rather than their poor grammatical rule knowledge. Participants made acceptability judgments on sentences describing…