This study evaluated the efficacy of two proposed methods in an operational standard-setting study conducted for a high-stakes language proficiency test of the U.S. government. The goal was to seek low-cost modifications to the existing Yes/No Angoff method to increase the validity and reliability of the recommended cut scores using a convergent…

The recent surge in the popularity of Large Language Models (LLM) for language assessment underscores the growing significance of cost-effective language evaluation in our increasingly digitalized society. This paper posits that the application of computational psychometrics can enable the incorporation of technology into language assessment,…

Intercultural Competence Assessment (ICA) has recently become a central issue in applied linguistics in general, and language testing and assessment in particular. The present paper aims to investigate the difference between native and non-native assessment experts' beliefs about incorporating ICA in the Language Proficiency Assessment (LPA).…

It is widely believed that raters' cognition is an important aspect of writing assessment, as it has both logical and temporal priority over scores. Based on a critical review of previous research in this area, it is found that raters' cognition can be boiled to two fundamental issues: building text images and strategies for articulating scores.…

The rising status of English as a global language prompts a call for a paradigm shift in English language teaching in order to correspond to the new sociolinguistic landscape. However, studies related to English language assessment, which can catalyze the transformation especially in a test-oriented context like Thailand, remain limited. This…

In order to assess the accuracy and validity of proficiency diagnostic tests in Second Language (L2), specifically regarding the linguistic (orthographic, semantic, syntactic, lexical) and cognitive (verbal reasoning, lexical decision) components for the immigrant population in Portugal, a study of cut-off points of 6 tests was conducted. This…

The main objective of this Methods Showcase Article is to show how the technique of adaptive comparative judgment, coupled with a crowdsourcing approach, can offer practical solutions to reliability issues as well as to address the time and cost difficulties associated with a text-based approach to proficiency assessment in L2 research. We…

In spite of the resurgence of interest in teachers' language assessment literacy (LAL), teachers' critical language assessment literacy (CLAL) has not garnered satisfactory prominence. This constitutes a substantial void in the extant corpus of literature that this study will address. To this illumination, a cross-sectional survey research…

Language assessment knowledge, the capacity of language instructors to skillfully design, construct, and assess language evaluations, is pivotal for effective language education. This study investigates the language assessment knowledge, encompassing both general and skill-specific aspects, of in-service language educators from Europe and Türkiye.…

Researchers have used different measures to examine participants' second-language (L2) proficiency, yet it remains unclear how these different measures influence research results on the effect of L2 proficiency on the target variable. The present research explored the modulation effect of four different measures of L2 Chinese proficiency on…

The all-encompassing term "Medical Spanish" references the Spanish used by healthcare professionals. Medical Spanish courses have gained traction as the Spanish-speaking population in the U.S. continues to grow. Consequently, demand for courses in Medical Spanish and other areas of Spanish for Specific Purposes (SSP), a subfield of…

Nearly all multidimensional models of communication competence have pragmatic competence at their core. Proper assessment of second language (L2) pragmatics makes many demands on L2 teachers, both in terms of understanding the construct and in language test development. Therefore, being assessment literate helps teachers in developing effective…

Though dynamic assessment (DA) has gained strong theoretical and empirical support over the last decades, second language (L2) practitioners have blamed it for its applicability in large classes. To ameliorate this limitation, peer-dynamic assessment (peer-DA), rooted in the conceptualization of zone of proximal development (ZPD), can be…

Language proficiency diagnosis is essential to extract fine-grained information about the linguistic knowledge states and skill mastery levels of test takers based on their performance on language tests. Different from comprehensive standardized tests, many language learning apps often revolve around word-level questions. Therefore, knowledge…

Thinking skills play a critical role in determining language performance. Recent advancement in cognitive diagnostic modelling (CDM) provides a powerful tool for obtaining fine-grained information regarding these thinking skills during reading. Studies are scant, however, exploring the relations between thinking skills and language performance,…