ERIC Number: EJ1477279
Record Type: Journal
Publication Date: 2025
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1648-3898
EISSN: EISSN-2538-7138
Available Date: 0000-00-00
Psychometric Validation of an Analytical Skills Test in Physics Using the Rasch Model
Journal of Baltic Science Education, v24 n3 p522-537 2025
The accurate assessment of analytical thinking in physics, particularly in magnetism, poses substantial challenges due to the limitations of conventional tools in measuring higher-order cognitive skills. This study aimed to validate an analytical skills test in physics, based on Bloom's Revised Taxonomy, with an emphasis on the dimensions of differentiating, organizing, and attributing within the subject of magnetism. The assessment instrument, comprising 15 multiple-choice items, was administered to a sample of 84 twelfth-grade students. A psychometric evaluation was conducted utilizing the Rasch Model, which included analyses of item fit, reliability, unidimensionality, and gender fairness through Differential Item Functioning (DIF). The results indicated strong internal consistency, with a Cronbach's alpha of 0.91, and high item reliability at 0.94. Furthermore, the item-person distribution showed a well-aligned outcome. Principal Component Analysis (PCA) confirmed the unidimensionality of the test, while the DIF analysis revealed several items exhibiting gender-related response patterns, thereby suggesting a need for refinement to achieve fairness. The findings endorse the application of this validated instrument for assessing higher-order analytical thinking in the field of physics and highlight the significance of equitable assessment practices within STEM education.
Descriptors: Physics, Science Tests, Science Instruction, Thinking Skills, Taxonomy, Scientific Concepts, Multiple Choice Tests, Grade 12, High School Students, Psychometrics, Sex Fairness, Test Items, Factor Analysis, Item Analysis, Test Reliability, Gender Differences, STEM Education, Barriers, Item Response Theory, Construct Validity, Foreign Countries
Scientia Socialis Ltd. 29 K. Donelaicio Street, LT-78115 Siauliai, Republic of Lithuania. e-mail: scientia@scientiasocialis.lt; e-mail: mail.jbse@gmail.com; Web site: http://www.scientiasocialis.lt/jbse/
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 12; High Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Indonesia
Grant or Contract Numbers: N/A
Author Affiliations: N/A