ERIC Number: EJ1305177
Record Type: Journal
Publication Date: 2021
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1536-6367
EISSN: N/A
Available Date: N/A
An Investigation of Item Calibration Methods in Multistage Testing
Cai, Liuhan; Albano, Anthony D.; Roussos, Louis A.
Measurement: Interdisciplinary Research and Perspectives, v19 n3 p163-178 2021
Multistage testing (MST), an adaptive test delivery mode that involves algorithmic selection of predefined item modules rather than individual items, offers a practical alternative to linear and fully computerized adaptive testing. However, interactions across stages between item modules and examinee groups can lead to challenges in item calibration with MST. This study used simulated data based on an operational program to investigate the performance of four item calibration methods under a 1-3 MST design. Conditions included routing module length, routing rule, and sample size. Calibration methods were evaluated based on item and person parameter recovery and classification accuracy. Results indicated that calibration with fixed common item parameters and concurrent calibration assuming a single ability distribution similarly outperformed both separate calibration with linking and concurrent calibration with the multiple-group procedure.
Descriptors: Adaptive Testing, Test Items, Item Response Theory, Test Construction, Simulation, Sample Size, Accuracy, Classification
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A