
ERIC Number: ED380495
Record Type: Non-Journal
Publication Date: 1994-May
Pages: 40
Abstractor: N/A
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Effect of Rasch Calibration on Ability and DIF Estimation in Computer-Adaptive Tests. Research Report RR-94-32.
Zwick, Rebecca; And Others
A previous simulation study of methods for assessing item functioning (DIF) in computer-adaptive tests (CATs) showed that modified versions of the Mantel-Haenszel and standardization methods work well with CAT data. In that study, data were generated using the three-parameter logistic (3PL) model, and this same model was assumed in obtaining item parameter estimates. In the current study, 3PL item response data are used, but the Rasch model is assumed in obtaining item parameter estimates. Rasch-based expected true scores are obtained for each examinee. As in the previous study, DIF statistics are highly correlated with the generating DIF, and the means and standard deviations across items are close to their nominal values. There is, however, a tendency for DIF statistics to be slightly smaller in magnitude than in the 3PL analysis, resulting in a lower probability of detecting items with extreme DIF. Expected true scores from the Rasch-based CAT tend to be biased downward, particularly for lower ability examinees. Unlike Rasch CAT scores, Rasch expected true scores based on nonadaptive administration of all pool items behave well, as do nonadaptive and CAT-based expected true scores obtained using the 3PL model. Eight tables and two figures present analysis information. (Contains 16 references.) (Author/SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Grant or Contract Numbers: N/A
Author Affiliations: N/A