When analyzing treatment effects on test scores, researchers face many choices and competing guidance for scoring tests and modeling results. This study examines the impact of scoring choices through simulation and an empirical application. Results show that estimates from multiple methods applied to the same data will vary because two-step models…

This simulation study examines the characteristics of the Explanatory Item Response Model (EIRM) when estimating treatment effects when compared to classical test theory (CTT) sum and mean scores and item response theory (IRT)-based theta scores. Results show that the EIRM and IRT theta scores provide generally equivalent bias and false positive…

The present study aims to examine gender differential item functioning (DIF) in the reading comprehension section of a high stakes test using cognitive diagnosis models. Based on the multiple-group generalized deterministic, noisy "and" gate (MG G-DINA) model, the Wald test and likelihood ratio test are used to detect DIF. The flagged…

Since the 1990's, schools across the United States have been held accountable for increased student learning. Increased use of growth-based accountability models and a lack of clarity on what each model measures have resulted in a need for additional research focused on the real-world implications for teacher agency and school accountability. The…

In "Progress in International Reading Literacy Study" (PIRLS) educational inequalities are measured, amongst others, through the relationship between students' reading achievements and the home resource for learning (HRL) scale. By applying the partial credit model and using the WLE estimates for the person parameters it is accepted that…

Although letter naming fluency (LNF) and letter sound fluency (LSF) measures are widely available to educators for assessing early literacy skills of kindergarten children, better understanding of the contributions of these skills to reading development can help improve the interpretation of LNF and LSF data for instructional decisions. This study…

Position effects may occur in both paper--pencil tests and computerized assessments when examinees respond to the same test items located in different positions on the test. To examine position effects in large-scale assessments, previous studies often used multilevel item response models within the generalized linear mixed modeling framework.…

Objective: Accurate estimation of developmental trajectories can inform instruction and intervention. We compared the fit of linear, quadratic, and piecewise mixed-effects models of reading development among students with learning disabilities relative to their typically developing peers. Method: We drew an analytic sample of 1,990 students from…

The purposes of this research are to find out, (1) whether C-ID, R2D2 model is effective to be implemented on learning Reading comprehension, (2) college students' activity during the implementation of C-ID, R2D2 model on learning Reading comprehension, and 3) college students' learning achievement during the implementation of C-ID, R2D2 model on…

Cognitive Diagnostic Assessment (CDA) is a type of educational assessment that is designed to measure specific knowledge structures and processing skills in students so as to provide information about their cognitive strengths and weaknesses (Leighton & Gierl, 2007). CDA has been instrumental in turning the attention of practitioners to more…

An emerging body of research has evaluated the role of growth mindset in educational achievement, yet little work has focused on the unique role of mindset to standardized reading outcomes. Our study presents 4 key outcomes in a sample of 195 fourth-grade students. First, we evaluated the dimensionality of general and reading-specific mindset and…

Cognitive diagnostic models (CDMs) have great promise for providing diagnostic information to aid learning and instruction, and a large number of CDMs have been proposed. However, the assumptions and performances of different CDMs and their applications in regard to reading comprehension tests are not fully understood. In the present study, we…

Methods for detecting differential item functioning (DIF) and item bias are typically used in the process of item analysis when developing new measures; adapting existing measures for different populations, languages, or cultures; or more generally validating test score inferences. In 2007 in "Language Assessment Quarterly," Zumbo…

Visual processes in Grade 1 were examined for their predictive influences in nonalphanumeric and alphanumeric rapid naming (RAN) in 51 poor early and 69 typical readers. In a lagged design, children were followed longitudinally from Grade 1 to Grade 3 over 5 testing occasions. RAN outcomes in early Grade 2 were predicted by speeded and nonspeeded…

Applications of traditional unidimensional item response theory models to passage-based reading comprehension assessment data have been criticized based on potential violations of local independence. However, simple rules for determining dependency, such as including all items associated with a particular passage, may overestimate the dependency…