The way in which validity has been conceptualized has changed throughout the years. The focus in validation studies shifted from evaluating distinct components of validity to developing a comprehensive argument for the use and interpretations of test scores. The argument-based approach to validity incorporates the distinct types of the…

C-Test is a gap-filling test designed to measure first and second language proficiency. Over the past four decades, researchers have shown the fit of C-Test data to parametric item response theory (IRT) models, but no study so far has shown the fit of C-Tests to nonparametric IRT models. The purpose of this study is to contribute to the ongoing…

In this digital age, digital multimodal composing (DMC) has permeated the L2 classroom as a technology-enhanced L2 writing task. Despite the learning potential of DMC for L2 students, instruments that measure L2 students' DMC competence are rare. As such, the present study sought to develop and validate an L2 student DMC competence scale in the…

Drawing on a growing body of research on the interface between corpus linguistics and second/foreign language testing and assessment, we adopted "Peykare," a large-scale, annotated, Persian written language resource to evaluate the content (i.e., coverage and typicality) and construct validity of a Persian language proficiency test…

Studies have shown that raising L2 learners' metaphor awareness contributes to the acquisition of figurative language, which fosters students' development of language skills. However, the instruments measuring metaphor awareness, in the majority of relevant research, did not seem to have undergone proper methodological procedures for checking…

The Pearson Test of English Academic (PTE-A), a widely used high-stakes language proficiency test for university admissions and migration purposes, underwent a notable change from a three-hour to a two-hour version in November 2021. The implementation of the new version has prompted inquiries into the washback effects on various stakeholders.…

This study offers methodological synergy in the examination of factorial structure in second language (L2) research. It illustrates the effectiveness and flexibility of the recently developed exploratory structural equation modeling (ESEM) method, which integrates the advantages of exploratory factor analysis (EFA) and confirmatory factor analysis…

With recent technological advances, researchers have begun to explore the potential use of spoken dialog systems (SDSs) for L2 oral communication assessment. While several studies support the feasibility of building these systems for various types of oral tasks, research on the construct validity of SDS-delivered tasks is still limited. Thus, this…

With the increasing interest in Positive Psychology within the realm of L2 learning, the role of positive emotions, particularly Foreign Language Enjoyment (FLE) has garnered attention in Second Language Acquisition research (Dewaele & MacIntyre, 2014). Despite the growing interest in FLE in Turkey, the widely used Foreign Language Enjoyment…

This article draws on argument-based validation to gather and evaluate construct-related evidence (i.e., the explanation inference) of a high-stakes test. The data stemmed from the listening component of a French test used for immigration to Canada through the province of Quebec. An expert panel with varied backgrounds in applied linguistics…

Apart from providing a bird's eye view of a given domain of inquiry (Ioannidis et al., 2015), systematic reviews such as methodological syntheses offer a magnifying glass on prevalent existing problems in primary research and furnish empirically grounded solutions to rectify these issues (Page et al., 2021). As survey research in second language…

This study examined whether the five scales of the MUSIC Model of Academic Motivation Inventory produced valid scores when used in university English language courses across four different countries. We surveyed 1,147 students in English language courses in Iran, Mexico, China, and Egypt and analyzed their responses by performing measurement…

Construct validity and building validity arguments are some of the main challenges facing the language assessment community. The notion of construct validity and validity arguments arose from research in psychological assessment and developed into the gold standard of validation/validity research in language assessment. At a theoretical level,…

Recent literature in the field of L2 vocabulary assessment has advocated for the development of written receptive vocabulary tests such as Vocabulary Levels Tests (VLTs) that use: (a) meaning-recall item formats, (b) a minimum of 40 item counts per 1,000-frequency band to improve level estimates, and (c) lemmas (not word-families) as the lexical…

This study examines how second/foreign language (L2) word difficulty estimates derived from item response theory (IRT) and classical test theory (CTT) frameworks are virtually identical in the context of vocabulary testing. This conclusion is reached via a two-stage process: (a) psychometric assessments of both approaches and (b) L2 word…