This study evaluated the efficacy of two proposed methods in an operational standard-setting study conducted for a high-stakes language proficiency test of the U.S. government. The goal was to seek low-cost modifications to the existing Yes/No Angoff method to increase the validity and reliability of the recommended cut scores using a convergent…

Background/purpose: This study aims to analyze the need for local wisdom-based Indonesian as a Foreign Language (BIPA) evaluation materials for Thai students and propose a design to enhance language proficiency and cultural awareness. The growing interest in learning Indonesian stems from diverse purposes, including business, academics, and…

The recent surge in the popularity of Large Language Models (LLM) for language assessment underscores the growing significance of cost-effective language evaluation in our increasingly digitalized society. This paper posits that the application of computational psychometrics can enable the incorporation of technology into language assessment,…

Intercultural Competence Assessment (ICA) has recently become a central issue in applied linguistics in general, and language testing and assessment in particular. The present paper aims to investigate the difference between native and non-native assessment experts' beliefs about incorporating ICA in the Language Proficiency Assessment (LPA).…

It is widely believed that raters' cognition is an important aspect of writing assessment, as it has both logical and temporal priority over scores. Based on a critical review of previous research in this area, it is found that raters' cognition can be boiled to two fundamental issues: building text images and strategies for articulating scores.…

Since the 2017-2018 academic year, Montgomery Public Schools (MCPS) has invested in the Two-Way Immersion (TWI) program, across six elementary schools, aiming to cultivate bilingualism, biliteracy, and biculturalism among students from Kindergarten through Grade 5. As part of this initiative, this comprehensive study assessed the implementation…

The rising status of English as a global language prompts a call for a paradigm shift in English language teaching in order to correspond to the new sociolinguistic landscape. However, studies related to English language assessment, which can catalyze the transformation especially in a test-oriented context like Thailand, remain limited. This…

In order to assess the accuracy and validity of proficiency diagnostic tests in Second Language (L2), specifically regarding the linguistic (orthographic, semantic, syntactic, lexical) and cognitive (verbal reasoning, lexical decision) components for the immigrant population in Portugal, a study of cut-off points of 6 tests was conducted. This…

Vocabulary assessment is an important part of measuring language proficiency in both monolingual and bilingual children. The LITMUS Cross-Linguistic Lexical Tasks (CLT) provides a framework for assessing the vocabulary of monolingual and bilingual children using a standardized procedure and comparable stimuli across languages. All language…

The main objective of this Methods Showcase Article is to show how the technique of adaptive comparative judgment, coupled with a crowdsourcing approach, can offer practical solutions to reliability issues as well as to address the time and cost difficulties associated with a text-based approach to proficiency assessment in L2 research. We…

In spite of the resurgence of interest in teachers' language assessment literacy (LAL), teachers' critical language assessment literacy (CLAL) has not garnered satisfactory prominence. This constitutes a substantial void in the extant corpus of literature that this study will address. To this illumination, a cross-sectional survey research…

Language assessment knowledge, the capacity of language instructors to skillfully design, construct, and assess language evaluations, is pivotal for effective language education. This study investigates the language assessment knowledge, encompassing both general and skill-specific aspects, of in-service language educators from Europe and Türkiye.…

Researchers have used different measures to examine participants' second-language (L2) proficiency, yet it remains unclear how these different measures influence research results on the effect of L2 proficiency on the target variable. The present research explored the modulation effect of four different measures of L2 Chinese proficiency on…

The all-encompassing term "Medical Spanish" references the Spanish used by healthcare professionals. Medical Spanish courses have gained traction as the Spanish-speaking population in the U.S. continues to grow. Consequently, demand for courses in Medical Spanish and other areas of Spanish for Specific Purposes (SSP), a subfield of…

Nearly all multidimensional models of communication competence have pragmatic competence at their core. Proper assessment of second language (L2) pragmatics makes many demands on L2 teachers, both in terms of understanding the construct and in language test development. Therefore, being assessment literate helps teachers in developing effective…