ERIC Number: ED572337
Record Type: Non-Journal
Publication Date: 2016
Pages: 29
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
A Comparison Study of Item Exposure Control Strategies in MCAT
Mao, Xiuzhen; Ozdemir, Burhanettin; Wang, Yating; Xiu, Tao
Online Submission
Four item selection indexes with and without exposure control are evaluated and compared in multidimensional computerized adaptive testing (CAT). The four item selection indices are D-optimality, Posterior expectation Kullback-Leibler information (KLP), the minimized error variance of the linear combination score with equal weight (V1), and the minimized error variance of the composite score with optimized weight (V2). The maximum priority index (MPI) method for unidimensional CAT and two item exposure control methods (the restrictive threshold (RT) method and restrictive progressive (RPG) method, originally proposed for cognitive diagnostic CAT) are adopted. The results show that: (1) KLP, D-optimality, and V1 perform well in recovering domain scores, and all outperform V2 in psychometric precision; (2) KLP, D-optimality, V1, and V2 produce an unbalanced distribution of item exposure rates, although V1 and V2 offer improved item pool usage rates; (3) all the exposure control strategies improve the exposure uniformity greatly and with very little loss in psychometric precision; (4) RPG and MPI perform similarly in exposure control, and are both better than RT.
Publication Type: Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A