The Homeostasis Concept Inventory (HCI) is a validated instrument for measuring students' knowledge of homeostasis. It is comprised of 20 multiple-choice questions covering key components of the previously validated Homeostasis Conceptual Framework (HCF). In this paper, we present the first multi-institutional study of the impact of physiology…

General chemistry is often the first course taken by students interested in careers in STEM and health fields, and therefore, is considered an essential course for the success and retention of students in these fields. Prior studies have shown study habits and skills to be related to student performance in college-level courses, including STEM…

In the era defined by the fourth paradigm of science research, the burgeoning volume of science data poses a formidable challenge. The established data-related requisites within science literacy now fall short of addressing the evolving needs of researchers and STEM students. Consequently, the emergence of science data literacy becomes imperative.…

This article describes the implementation of alternative grading (AG) strategies in an upper-division kinesiology and functional human anatomy course. Traditional point-based grading systems can negatively impact student mental health, decrease intrinsic motivation, and hinder learning. To address these issues, a proficiency-based grading approach…

This study explores the use of artificial intelligence in grading high-stakes physics exams, emphasizing the application of psychometric methods, particularly item response theory, to evaluate the reliability of AI-assisted grading. We examine how grading rubrics can be iteratively refined and how threshold parameters can determine when…

With the already widespread nature of multiple-choice assessments and the increasing popularity of answer-until-correct, it is important to have methods available for exploring the validity of these types of assessments as they are developed. This work analyzes a 20-question multiple choice assessment covering introductory undergraduate chemistry…

Using multiple versions of an assessment has the potential to introduce item environment effects. These types of effects result in version dependent item characteristics (i.e., difficulty and discrimination). Methods to detect such effects and resulting implications are important for all levels of assessment where multiple forms of an assessment…

In physics education, a number of studies have developed assessments of teachers' knowledge of student understanding (KSU) of specific physics concepts with modified versions of existing concept inventories, in which teachers were asked to predict the popular incorrect answers from students. The results provide useful but indirect information to…

This research explores the effects of listening to music during exams for engineering college students. Students were given the option to listen to self-selected music while completing exams in three undergraduate engineering courses over four years. It was found that listening to music during an exam had no significant effect on the mean exam…

Collaborative testing and its benefits have been reported in diverse disciplines across different types of academic institutions. However, there has been minimal research conducted on collaborative assessments in medical schools, particularly in the gross anatomy laboratory. The objectives of this study were to explore the effect of collaborative…

Background/Context: In order to stimulate national and regional economic growth, policymakers and businesses have expressed great interest in growing the supply of workers with skills in science, technology, engineering, and math (STEM). At the same time, considerable efforts are being devoted to narrowing race and gender gaps in the STEM training…

Many educational institutions transitioned to digital distance-based learning and assessment formats in 2020 due to the severe acute respiratory syndrome--coronavirus 2 (SARS-CoV-2) pandemic. This shift has often been associated with concerns about increased student cheating and heightened stress. In this study, we compared the major course…

This study seeks to determine whether giving an explicit incentive to students in an upper-division first-semester electromagnetism course (EM1), in the form of partial credit for reworking unit exam problems, will improve their problem-solving skills as measured by performance on identical problems on the final exam. Three problems--a primarily…

The American Chemical Society advocates a shift from rule-based to risk-based safety education for chemistry graduates, emphasizing meaningful student engagement in the risk assessment process for laboratory work. To implement this paradigm shift, we introduced RAMP (Recognize Hazards, Assess Risk, Minimize Risk, and Prevent Emergencies)-based…

Students with strong metacognitive skills are positioned to learn and achieve more than peers who are still developing their metacognition. Yet, many students come to college without well-developed metacognitive skills. As part of a longitudinal study on metacognitive development, we asked when, why, and how first-year life science majors use…