This study examines how second/foreign language (L2) word difficulty estimates derived from item response theory (IRT) and classical test theory (CTT) frameworks are virtually identical in the context of vocabulary testing. This conclusion is reached via a two-stage process: (a) psychometric assessments of both approaches and (b) L2 word…

The research note focuses on the alignment aspect of English language proficiency (ELP) assessments, one of the required types of validity evidence for the federal peer review process of states' assessment systems. A basic tenant of current U.S. education policy is the alignment between what a test assesses and what content has been determined as…

Much of applied linguistics research has been concerned with classroom-based second language (L2) development as it offers an ideal setting for examining the institutional ecology of L2 learning and teaching. However, scholars have continued to call for greater attention to the operationalization of constructs, selection of valid assessments, and…

This article reviews a selected sample of 70 empirical studies in journal articles and doctoral dissertations on language assessment in China between 2011 and 2018. Following a brief introduction to the history and current state of language assessment in China, the article presents a critical review of language assessment research on six themes…

Artificial language learning (ALL) experiments have become an important tool in exploring principles of language and language learning. A persistent question in all of this work, however, is whether ALL engages the linguistic system and whether ALL studies are ecologically valid assessments of natural language ability. In the present study, we…

Elicited imitation (EI) has been widely used to examine second language (L2) proficiency and development and was an especially popular method in the 1970s and early 1980s. However, as the field embraced more communicative approaches to both instruction and assessment, the use of EI diminished, and the construct-related validity of EI scores as a…

Implicit and explicit knowledge of the second language (L2) are two central constructs in the field of second language acquisition (SLA). In recent years, there has been a renewed interest in obtaining valid and reliable measures of L2 learners' implicit and explicit knowledge (e.g., Bowles, 2011; R. Ellis, 2005). The purpose of the present study…

Due to the lack of span test for the use in language-specific and cross-language studies, this study provides L1 and L2 researchers with a reliable language-independent span test (math span test) for the measurement of working memory capacity. It also describes the development, validation, and scoring method of this test. This test included 70…

The Guidelines for Good Practice of the European Association for Language Testing and Assessment (EALTA) stress the importance of collaboration between all parties involved in the process of developing instruments, activities and programmes for testing and assessment. Collaboration is considered to be as important as validity and reliability,…

This study examined the second language (L2) development of adult learners of Spanish at three levels of proficiency during and after a semester of instruction. A fundamental goal was to identify cognitive and psychosocial individual differences (IDs) that can explain between-learner variation over time in order to expand our understanding of the…

This article reports on a case study of negotiation that occurred in peer group oral interactions under assessment conditions. Discourse analysis was used to illustrate how participants negotiated and co-constructed the assessment format itself as well as meaning exchange sequences. Analyses of the data point to the advantage of using peer group…

Correlational studies establishing the validity of language skill tests have traditionally described how well the tests have converged, that is, yielded equivalent results. Convergent and discriminant validation is a logical extension of these traditional procedures. However, since it requires evidence of discriminant as well as convergent…

Reviews research on the use of the "T-Unit" as a measure of language ability, demonstrating that the measure has limited utility in the case of second language, since it bases itself solely on syntax and does not reward speakers for sophistication in such areas as vocabulary. (Author/CB)

Supports use of multiple paradigms for the measurement of individual differences in the search for explanations of natural language. Rather than a single paradigm discipline, they offer a wider scope of inquiry--phenomena of interest, types of questions, and forms of explanations, as well as opening the discipline to inspiration and analogy from…

Presents study designed to examine trait structure of a cloze test using confirmatory factor analysis. Results suggest that a modified cloze passage, using rational deletions, is capable of measuring syntactic- and discourse-level relationships in a text, and this advantage may outweigh considerations of reduced redundancy which underlie random…