In cognitive diagnostic assessment, multiple fine-grained attributes are measured simultaneously. Attribute hierarchies are considered important structural features of cognitive diagnostic models (CDMs) that provide useful information about the nature of attributes. Templin and Bradshaw first introduced a hierarchical diagnostic classification…

This study proposes a classification method for multiple text reading test formats in English language proficiency tests. A preliminary study involving 11 proficiency tests revealed two tests that fit the scope of the main study. Results show that multiple text reading test formats use complementary texts rather than conflicting texts. As for…

Assessments with a large amount of small, similar, or often repetitive tasks are being used in educational, neurocognitive, and psychological contexts. For example, respondents are asked to recognize numbers or letters from a large pool of those and the number of correct answers is a count variable. In 1960, George Rasch developed the Rasch…

Background: Differentiating typical language development (TD) and developmental language disorder (DLD) in a bilingual context is difficult. The societal language is often the only mutual language of the child and the SLT. It has been shown that when assessing second language (L2) performance using tools developed for monolingual children,…

Sometimes a treatment, such as receiving a high school diploma, is assigned to students if their scores on two inputs (e.g., math and English test scores) are above established cutoffs. This forms a multidimensional regression discontinuity design (RDD) to analyze the effect of the educational treatment where there are two running variables…

When a student enrolls in Miami-Dade County Public Schools (M-DCPS) for the first time, the student's parents/guardians complete a Home Language Survey. This survey inquires whether a student's first language is a language other than English, whether a student's primary language is one other than English, and whether a language other than English…

Diagnostic classification models (DCMs) have recently become very popular both for research purposes and for real testing endeavors for student assessment. A plethora of DCM models give researchers and practitioners a wide range of options for student diagnosis and classification. One intriguing option that some DCM models offer is the possibility…

This study reviewed conceptualizations and operationalizations of second language (L2) listening constructs. A total of 157 peer-reviewed papers published in 19 journals in applied linguistics were coded for (1) publication year, author, source title, location, language, and reliability and (2) listening subskills, cognitive processes, attributes,…

This study investigates the relationship between motivation and language proficiency, with a specific focus on the speaking abilities of Iranian intermediate-level management students. This group was chosen because effective communication skills are essential for success in management roles, and understanding the factors influencing their language…

Various stakeholders, such as policymakers and educators, require diagnostic feedback and actionable test results. One particular context in which fine-grained test results are of utmost importance is English language proficiency (ELP) assessments as they are used for critical decisions for students. Diagnostic classification models (DCMs) afford…

This corpus-based study investigates lexical bundles of keywords found in online news articles, aiming to equip high school students in Thailand with the linguistic tools necessary for English admission exams. The primary objectives of this investigation are twofold: (1) to compile a list of 100 essential exam preparation keywords from the…

The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

The goal of this study is to provide better empirical insight into the licensing conditions of a large set of NPIs in German so that they can be used as reliable diagnostics in future research on negation-related phenomena. Experiment 1 tests the acceptability of 60 NPIs under semantic operators that are expected to license superstrong, strong,…

This quantitative correlational non-experimental study examined the predictable relationship between the ACCESS for English Language Learners scale score and the Georgia Milestones English Language Arts (GMAS-ELA) standardized assessment for reclassified fifth-grade English language learners during the 2018-2019 school year. The problem addressed…

In 2006-2007, California revised its English language proficiency (ELP) assessment, the California English Language Development Test (CELDT), which resulted in more stringent criteria and higher cut scores for meeting proficiency. Using regression discontinuity designs and a difference-in-differences approach, this study examines the effects of…