This study explores the use of artificial intelligence in grading high-stakes physics exams, emphasizing the application of psychometric methods, particularly item response theory, to evaluate the reliability of AI-assisted grading. We examine how grading rubrics can be iteratively refined and how threshold parameters can determine when…

The main objective of the present study was to construct and standardize an achievement test in science for the secondary school science students in grade 8. An achievement test having 120 test items was prepared by the facilitator based on the four main learning objectives of teaching science that are knowledge, understanding, application, and…

Previous research has suggested that changing the percentage of the course grade associated with exam grades in science, technology, engineering, and mathematics courses can change the gender gap in the course. It has also been shown that high-stakes assessments yield the lowest (relative) scores for female students. Previous research by the…

Although conceptual assessment tests are commonly administered at the beginning and end of a semester, this pre-post approach has inherent limitations. Specifically, education researchers and instructors have limited ability to observe the progression of students' conceptual understanding throughout the course. Furthermore, instructors are limited…

With the already widespread nature of multiple-choice assessments and the increasing popularity of answer-until-correct, it is important to have methods available for exploring the validity of these types of assessments as they are developed. This work analyzes a 20-question multiple choice assessment covering introductory undergraduate chemistry…

Cultivating students' enjoyment of science is one of the significant aims of science education. However, it seems challenging to achieve this goal in most countries or economies. Using the Trends in International Mathematics and Science Study (TIMSS) 2019 Hong Kong data, this study aims to identify multiple configurations of school conditions to…

This study aims to obtain and compare the opinions of exam question writers and teachers on skill-based exam questions. 24 science teachers and 11 context-based exam question writers participated in the study, which was carried out according to the convergent parallel design. Opinions of both parties on the skill-based exam questions were…

Using multiple versions of an assessment has the potential to introduce item environment effects. These types of effects result in version dependent item characteristics (i.e., difficulty and discrimination). Methods to detect such effects and resulting implications are important for all levels of assessment where multiple forms of an assessment…

This study examines the relationship between two secondary End of Course (EOC) exams, the Biology EOC and the English I EOC exams, and their impact on Emergent Bilingual (EB) students in a small district in South Texas. This study is a mixed methods study which uses both quantitative and qualitative data to answer three research questions: (a)…

Science classroom assessment often requires multilingual learners to demonstrate ideas using only English-language resources. These assessments can provide an incomplete picture of students' knowledge and limit subsequent learning opportunities. Increasingly, science teachers are incorporating translanguaging pedagogies in their instructional…

This study examines the feasibility and potential advantages of using large language models, in particular GPT-4o, to perform partial credit grading of large numbers of student written responses to introductory level physics problems. Students were instructed to write down verbal explanations of their reasoning process when solving one conceptual…

When describing motion in physics, the selection of a frame of reference is crucial. The graph of a moving object can look quite different based on the frame of reference. In recent years, various tests have been developed to assess the interpretation of kinematic graphs, but none of these tests have specifically addressed differences in reference…

Exam anxiety has been well-documented to reduce student performance in undergraduate biology courses, especially for students from marginalized groups, which can contribute to achievement gaps. Our exploratory study surveyed 61 undergraduate biology students to better understand how exams affect their anxiety levels, focusing on the impact of exam…

In order to ensure content validity by covering a broad range of content domains, the testing times of some educational large-scale assessments last up to a total of two hours or more. Performance decline over the course of taking the test has been extensively documented in the literature. It can occur due to increases in the numbers of: (a)…

In physics education, a number of studies have developed assessments of teachers' knowledge of student understanding (KSU) of specific physics concepts with modified versions of existing concept inventories, in which teachers were asked to predict the popular incorrect answers from students. The results provide useful but indirect information to…