With the already widespread nature of multiple-choice assessments and the increasing popularity of answer-until-correct, it is important to have methods available for exploring the validity of these types of assessments as they are developed. This work analyzes a 20-question multiple choice assessment covering introductory undergraduate chemistry…

Cultivating students' enjoyment of science is one of the significant aims of science education. However, it seems challenging to achieve this goal in most countries or economies. Using the Trends in International Mathematics and Science Study (TIMSS) 2019 Hong Kong data, this study aims to identify multiple configurations of school conditions to…

This study aims to obtain and compare the opinions of exam question writers and teachers on skill-based exam questions. 24 science teachers and 11 context-based exam question writers participated in the study, which was carried out according to the convergent parallel design. Opinions of both parties on the skill-based exam questions were…

Using multiple versions of an assessment has the potential to introduce item environment effects. These types of effects result in version dependent item characteristics (i.e., difficulty and discrimination). Methods to detect such effects and resulting implications are important for all levels of assessment where multiple forms of an assessment…

This study examines the relationship between two secondary End of Course (EOC) exams, the Biology EOC and the English I EOC exams, and their impact on Emergent Bilingual (EB) students in a small district in South Texas. This study is a mixed methods study which uses both quantitative and qualitative data to answer three research questions: (a)…

Science classroom assessment often requires multilingual learners to demonstrate ideas using only English-language resources. These assessments can provide an incomplete picture of students' knowledge and limit subsequent learning opportunities. Increasingly, science teachers are incorporating translanguaging pedagogies in their instructional…

This study examines the feasibility and potential advantages of using large language models, in particular GPT-4o, to perform partial credit grading of large numbers of student written responses to introductory level physics problems. Students were instructed to write down verbal explanations of their reasoning process when solving one conceptual…

In order to ensure content validity by covering a broad range of content domains, the testing times of some educational large-scale assessments last up to a total of two hours or more. Performance decline over the course of taking the test has been extensively documented in the literature. It can occur due to increases in the numbers of: (a)…

In physics education, a number of studies have developed assessments of teachers' knowledge of student understanding (KSU) of specific physics concepts with modified versions of existing concept inventories, in which teachers were asked to predict the popular incorrect answers from students. The results provide useful but indirect information to…

This research explores the effects of listening to music during exams for engineering college students. Students were given the option to listen to self-selected music while completing exams in three undergraduate engineering courses over four years. It was found that listening to music during an exam had no significant effect on the mean exam…

Collaborative testing and its benefits have been reported in diverse disciplines across different types of academic institutions. However, there has been minimal research conducted on collaborative assessments in medical schools, particularly in the gross anatomy laboratory. The objectives of this study were to explore the effect of collaborative…

Background/Context: In order to stimulate national and regional economic growth, policymakers and businesses have expressed great interest in growing the supply of workers with skills in science, technology, engineering, and math (STEM). At the same time, considerable efforts are being devoted to narrowing race and gender gaps in the STEM training…

We aim to graphically analyze the depth of conceptual understanding behind the Force Concept Inventory (FCI) responses of students, focusing on three questions (questions 1, 15, and 28). In our study, we created and implemented subquestions to clarify and quantify the students' reasoning steps in reaching their responses to the original FCI…

Predicting student performance in international large-scale assessments (ILSAs) is crucial for understanding educational outcomes on a global scale. ILSAs, such as the Program for International Student Assessment and the Trends in International Mathematics and Science Study, serve as vital tools for policymakers, educators, and researchers to…

Many educational institutions transitioned to digital distance-based learning and assessment formats in 2020 due to the severe acute respiratory syndrome--coronavirus 2 (SARS-CoV-2) pandemic. This shift has often been associated with concerns about increased student cheating and heightened stress. In this study, we compared the major course…