This study proposes a classification method for multiple text reading test formats in English language proficiency tests. A preliminary study involving 11 proficiency tests revealed two tests that fit the scope of the main study. Results show that multiple text reading test formats use complementary texts rather than conflicting texts. As for…

Various stakeholders, such as policymakers and educators, require diagnostic feedback and actionable test results. One particular context in which fine-grained test results are of utmost importance is English language proficiency (ELP) assessments as they are used for critical decisions for students. Diagnostic classification models (DCMs) afford…

The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

This quantitative correlational non-experimental study examined the predictable relationship between the ACCESS for English Language Learners scale score and the Georgia Milestones English Language Arts (GMAS-ELA) standardized assessment for reclassified fifth-grade English language learners during the 2018-2019 school year. The problem addressed…

In 2006-2007, California revised its English language proficiency (ELP) assessment, the California English Language Development Test (CELDT), which resulted in more stringent criteria and higher cut scores for meeting proficiency. Using regression discontinuity designs and a difference-in-differences approach, this study examines the effects of…

This study sought to find if the implementation of the strategy of goal setting and reflective portfolios would improve reading comprehension among long-term English learners (LTELs), which in turn would impact their FastBridge aReading scores. LTELs have difficulty reclassifying, resulting in negative outcomes regarding graduation rates and…

Although Diagnostic Classification Models (DCMs) were introduced to education system decades ago, it seems that these models were not employed for the original aims upon which they had been designed. Using DCMs has been mostly common in analyzing large-scale non-diagnostic tests and these models have been rarely used in developing Cognitive…

Given the significant global influence of the Common European Framework of Reference for Languages: Teaching, Learning, and Assessment (CEFR) on English language education, this study deals with aligning a university's academic reading tests to the CEFR. It aimed at validating the test construct of the academic reading tests in relation to the…

In this study, we present the development of individualized feedback for a large-scale listening assessment by combining standard setting and cognitive diagnostic assessment (CDA) approaches. We used the performance data from 3,358 students' item-level responses to a field test of a national EFL test primarily intended for tertiary-level EFL…

California's K-12 funding and instructional policies for English learners (ELs) have changed significantly over the past 2 decades. The major policy shifts held the potential to change student learning outcome patterns for ELs. As a first step in identifying the potential impacts of these policy shifts, this report describes changes over time in…

Long-term English learners (LTELs) are students who were identified as English learners (EL) when they entered U.S. schools and continue to be ELs for 5 or more years. Although many factors influence LTEL status, student performance on standardized language and achievement tests particularly shape their trajectory through school. Yet, little is…

The documentation of test takers' achievements has been accomplished through large-scale assessments to find general information about students' language ability. To remove subjectivity, Cognitive Diagnostic Assessment (CDA) has recently played a crucial role in perceiving candidates' latent attribute patterns to find multi-diagnostic information…

This paper focuses on the most significant empirical studies on the topic of challenges facing the communicative language teaching approach in Saudi Arabia. The communicative language teaching method has been used for more than two decades in Saudi Arabia and research conducted during this period offers some insight into the main challenges of the…

Bilingual children's dominance can predict a variety of language and cognitive outcomes. The purpose of this study was to test the validity of parents' classifications of 3- to 6-year-old bilingual children's dominance against relative receptive vocabulary scores. In Study 1, the parents' classifications of Mandarin-English bilingual children's…

The present study examined the performance of the bi-factor multidimensional item response theory (MIRT) model and higher-order (HO) cognitive diagnostic models (CDM) in providing diagnostic information and general ability estimation simultaneously in a listening test. The data used were 1,611 examinees' item-level responses to an in-house EFL…