Although the generalized deterministic inputs, noisy "and" gate model (G-DINA; de la Torre, 2011) is a general cognitive diagnosis model (CDM), it does not account for the heterogeneity that is rooted from the existing latent groups in the population of examinees. To address this, this study proposes the mixture G-DINA model, a CDM that…

Words read correctly per minute (WCPM) is the reporting score metric in oral reading fluency (ORF) assessments, which is popularly utilized as part of curriculum-based measurements to screen at-risk readers and to monitor progress of students who receive interventions. Just like other types of assessments with multiple forms, equating would be…

An efficient assessment cycle is a necessary component of early literacy instruction. To support student growth, educators must screen, diagnose, and monitor student progress. Diagnostic assessments provide critical information that can empower educators to address student needs. Using information from diagnostic assessments requires educators to…

When analyzing treatment effects on test scores, researchers face many choices and competing guidance for scoring tests and modeling results. This study examines the impact of scoring choices through simulation and an empirical application. Results show that estimates from multiple methods applied to the same data will vary because two-step models…

Because of the need to provide fine-grained longitudinal diagnostic feedback, longitudinal cognitive diagnosis is an emerging approach that integrates cross-sectional cognitive diagnosis models (CDM) with longitudinal data analysis techniques. By adopting the generalized longitudinal higher-order log-linear CDM, this study attempted to track the…

Despite the growing interest in incorporating response time data into item response models, there has been a lack of research investigating how the effect of speed on the probability of a correct response varies across different groups (e.g., experimental conditions) for various items (i.e., differential response time item analysis). Furthermore,…

Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses.…

Despite the growing interest in incorporating response time data into item response models, there has been a lack of research investigating how the effect of speed on the probability of a correct response varies across different groups (e.g., experimental conditions) for various items (i.e., differential response time item analysis). Furthermore,…

The ongoing literacy crisis in the U.S. highlights an urgent need for effective, scalable literacy instruction. REED Charitable Foundation (RCF) is a non-profit organization that provides structured literacy training informed by Orton-Gillingham, along with ongoing professional coaching and comprehensive implementation support to help all students…

Analyzing heterogeneous treatment effects (HTEs) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and preintervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

In this article, we extend Liao's test for across-group comparisons of the fixed effects from the generalized linear model to the fixed and random effects of the generalized linear mixed model (GLMM). Using as our basis the Wald statistic, we developed an asymptotic test statistic for across-group comparisons of these effects. The test can be…

Analyzing heterogeneous treatment effects (HTE) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and pre-intervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

Purpose: This study investigated the reading profiles of middle school Spanish-speaking emergent bilinguals (EBs) with significantly below grade level reading comprehension and whether these profiles varied in their reading comprehension performance over time. Method: Latent profile analyses were used to classify Grade 6 and 7 Hispanic EBs (n =…

Districts nationwide have increased the frequency of teacher evaluations. Yet, we know little about the role of evaluator feedback for teacher improvement. Using unique classroom observation-level data, we use evaluator ratings and teacher self-assessments of teacher performance to rigorously examine (positive and negative) feedback valence from…

Background: Observation Studies, Unmeasured Confounding, and Sensitivity Analysis: An important part of educational research is identifying important, potentially causal, factors that influence children's learning from observational studies. However, it is well-known that discovering such factors from observational studies can be biased due to…