The Force Concept Inventory (FCI) is one of the research-based assessments established by the physics education research community to measure students' understanding of Newtonian mechanics. Former works have often recorded the notion of gendered mean FCI scores favoring male students notably in the North American (NA) based studies. Nevertheless,…

This article provides a process to carefully evaluate the suitability of a content domain for which diagnostic classification models (DCMs) could be applicable and then optimized steps for constructing a test blueprint for applying DCMs and a real-life example illustrating this process. The content domains were carefully evaluated using a set of…

The study outlines the early-stage development of a free-response General Relativity Concept Inventory (GRCI), an educational instrument designed to test for conceptual understanding of General Relativity. Data were collected for the study by having 26 participants from General Relativity courses work through the questions on the GRCI. Interviews…

[This paper is part of the Focused Collection on Qualitative Methods in PER: A Critical Examination.] Identifying student ideas about particular physics topics is one of the earliest and longest-standing foci of physics education research. This paper presents a method for identifying common conceptual resources for understanding physics, using…

This study explores the use of artificial intelligence in grading high-stakes physics exams, emphasizing the application of psychometric methods, particularly item response theory, to evaluate the reliability of AI-assisted grading. We examine how grading rubrics can be iteratively refined and how threshold parameters can determine when…

This study examines the feasibility and potential advantages of using large language models, in particular GPT-4o, to perform partial credit grading of large numbers of student written responses to introductory level physics problems. Students were instructed to write down verbal explanations of their reasoning process when solving one conceptual…

In physics education, a number of studies have developed assessments of teachers' knowledge of student understanding (KSU) of specific physics concepts with modified versions of existing concept inventories, in which teachers were asked to predict the popular incorrect answers from students. The results provide useful but indirect information to…

We aim to graphically analyze the depth of conceptual understanding behind the Force Concept Inventory (FCI) responses of students, focusing on three questions (questions 1, 15, and 28). In our study, we created and implemented subquestions to clarify and quantify the students' reasoning steps in reaching their responses to the original FCI…

In physics education research, instructors and researchers often use research-based assessments (RBAs) to assess students' skills and knowledge. In this paper, we support the development of a mechanics cognitive diagnostic to test and implement effective and equitable pedagogies for physics instruction. Adaptive assessments using cognitive…

Procedural and conceptual e-scaffolding has been shown to be effective for assisting novice learners in understanding new concepts. Its integration with modelling instructions (E-MI) raises expectations for improving scientific reasoning (SR) in students whose level is still a concern in Indonesia. A quasi-experimental study was conducted to find…

Developing a deeper understanding of scientific concepts is one of the primary goals of science education. To improve students' conceptual understanding, it is necessary to explore the major characteristics of their learning process. Informed by previous work on conceptual understanding, this study focuses on the concept of evaporation, exploring…

At a conference on educational physics, someone described a series of multiple-choice problems to test students' ideas about various mechanical phenomena. One of the problems questioned students' conceptions about the shape of the Earth's orbit in the solar system. The question was as follows: "Which of the following schematic illustrations…

Students and educators often face time constraints, making it essential to develop interventions that are both easy to implement and have a substantial impact on learning and performance. One promising strategy is retrieval practice, particularly in the context of physics education, where many students struggle with basic knowledge. Prior research…

This study investigates the performance of GPT-4, an advanced AI model developed by OpenAI, on the force concept inventory (FCI) to evaluate its accuracy, reasoning patterns, and the occurrence of false positives and false negatives. GPT-4 was tasked with answering the FCI questions across multiple sessions. Key findings include GPT-4's…

The significance of the role of students' interpretation and creation of multiple forms of representation in science learning has long been established and advocated, but there is a paucity of research into the extent to which this emphasis in science education is reflected in high stakes final year high school science examinations. This study…