When analyzing treatment effects on test scores, researchers face many choices and competing guidance for scoring tests and modeling results. This study examines the impact of scoring choices through simulation and an empirical application. Results show that estimates from multiple methods applied to the same data will vary because two-step models…

This simulation study examines the characteristics of the Explanatory Item Response Model (EIRM) when estimating treatment effects when compared to classical test theory (CTT) sum and mean scores and item response theory (IRT)-based theta scores. Results show that the EIRM and IRT theta scores provide generally equivalent bias and false positive…

The present study aims to examine gender differential item functioning (DIF) in the reading comprehension section of a high stakes test using cognitive diagnosis models. Based on the multiple-group generalized deterministic, noisy "and" gate (MG G-DINA) model, the Wald test and likelihood ratio test are used to detect DIF. The flagged…

Since the 1990's, schools across the United States have been held accountable for increased student learning. Increased use of growth-based accountability models and a lack of clarity on what each model measures have resulted in a need for additional research focused on the real-world implications for teacher agency and school accountability. The…

In "Progress in International Reading Literacy Study" (PIRLS) educational inequalities are measured, amongst others, through the relationship between students' reading achievements and the home resource for learning (HRL) scale. By applying the partial credit model and using the WLE estimates for the person parameters it is accepted that…

Objective: Accurate estimation of developmental trajectories can inform instruction and intervention. We compared the fit of linear, quadratic, and piecewise mixed-effects models of reading development among students with learning disabilities relative to their typically developing peers. Method: We drew an analytic sample of 1,990 students from…

The purposes of this research are to find out, (1) whether C-ID, R2D2 model is effective to be implemented on learning Reading comprehension, (2) college students' activity during the implementation of C-ID, R2D2 model on learning Reading comprehension, and 3) college students' learning achievement during the implementation of C-ID, R2D2 model on…

Cognitive Diagnostic Assessment (CDA) is a type of educational assessment that is designed to measure specific knowledge structures and processing skills in students so as to provide information about their cognitive strengths and weaknesses (Leighton & Gierl, 2007). CDA has been instrumental in turning the attention of practitioners to more…

Cognitive diagnostic models (CDMs) have great promise for providing diagnostic information to aid learning and instruction, and a large number of CDMs have been proposed. However, the assumptions and performances of different CDMs and their applications in regard to reading comprehension tests are not fully understood. In the present study, we…

Methods for detecting differential item functioning (DIF) and item bias are typically used in the process of item analysis when developing new measures; adapting existing measures for different populations, languages, or cultures; or more generally validating test score inferences. In 2007 in "Language Assessment Quarterly," Zumbo…

Applications of traditional unidimensional item response theory models to passage-based reading comprehension assessment data have been criticized based on potential violations of local independence. However, simple rules for determining dependency, such as including all items associated with a particular passage, may overestimate the dependency…

When dealing with missing responses, two types of omissions can be discerned: items can be skipped or not reached by the test taker. When the occurrence of these omissions is related to the proficiency process the missingness is nonignorable. The purpose of this article is to present a tree-based IRT framework for modeling responses and omissions…

This study makes an attempt to investigate the correlations between manifold aspects, namely both syntagmatic and paradigmatic relations, the four major derivative word forms, which represented morphological knowledge, six dimensions of analytic relations (i.e. component-integral, member-collection, portion-mass, stuff-object, feature-activity,…

Wolf and Bowers (1999) described a model in which phonological awareness (PA) and naming speed (NS) make independent contributions to reading ability. We tested this model in a sample of 201 Grade 3 Arabic-speaking children in Dubai, United Arab Emirates. Measures of general cognitive ability, vocabulary, PA, NS, word reading, and reading…

The authors investigated the mediating effects of general academic and science-specific vocabulary on science reading comprehension among English learners (ELs) of varied proficiency. The sample included 169 regular education Grade 7 students (86 current ELs; 83 former ELs) enrolled in 1 urban school in Pacific Northwest region of the United…