NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1352160
Record Type: Journal
Publication Date: 2022
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2618-6586
Available Date: N/A
The Effect of Item Pool and Selection Algorithms on Computerized Classification Testing (CCT) Performance
Journal of Educational Technology and Online Learning, v5 n3 p573-584 2022
The purpose of this research was to evaluate the effect of item pool and selection algorithms on computerized classification testing (CCT) performance in terms of some classification evaluation metrics. For this purpose, 1000 examinees' response patterns using the R package were generated and eight item pools with 150, 300, 450, and 600 items having different distributions were formed. A total of 100 iterations were performed for each research condition. The results indicated that average classification accuracy (ACA) was partially lower, but average test length (ATL) was higher in item pools having a broad distribution. It was determined that the observed differences were more apparent in the item pool with 150 items, and that item selection methods gave similar results in terms of ACA and ATL. The Sympson-Hetter method indicated advantages in terms of test efficiency, while the item eligibility method offered an improvement in terms of item exposure control. The modified multinomial model, on the other hand, was more effective in terms of content balancing.
Journal of Educational Technology and Online Learning. Necatibey Faculty of Education, Balikesir University, Balikesir, 10100, Turkey. Web site: dergipark.org.tr/en/pub/jetol
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A