ERIC Number: EJ1478968
Record Type: Journal
Publication Date: 2025-Aug
Pages: 23
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1935-9772
EISSN: EISSN-1935-9780
Available Date: 2025-07-15
Evaluation of Exam Questions Using Bootstrapping: Practical Applications in R and SPSS with a Case Study
Changiz Mohiyeddini1
Anatomical Sciences Education, v18 n8 p858-880 2025
This article presents a step-by-step guide to using R and SPSS to bootstrap exam questions. Bootstrapping, a versatile nonparametric analytical technique, can help to improve the psychometric qualities of exam questions in the process of quality assurance. Bootstrapping is particularly useful in disciplines such as medical education, where student cohorts are normally too small to reliably use parametric analysis to evaluate the quality of exam questions. Traditional parametric approaches need large samples; otherwise, they can yield unreliable estimates of metrics such as item difficulty and point-biserial correlations with small cohorts, potentially misleading the evaluation of exam questions and consequently leading to flawed assessments. By employing bootstrapping, educators can resample data to obtain robust confidence intervals for key metrics. This allows for a more accurate evaluation of question quality. This guide provides a step-by-step approach using R and SPSS, along with explaining the necessary code to bootstrap exam question means, standard deviations, item difficulty, and point-biserial correlations. In addition, the code includes automated visualizations and the capability to export results in reader-friendly tables, enhancing time efficiency and streamlining both data analysis and presentation processes. Furthermore, this article includes a case study in which the code is applied and the results are discussed to showcase how bootstrapping can inform decisions regarding exam question revisions.
Descriptors: Test Items, Sampling, Statistical Inference, Nonparametric Statistics, Difficulty Level, Correlation, Test Construction
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Department of Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Rochester, Michigan, USA