The Homeostasis Concept Inventory (HCI) is a validated instrument for measuring students' knowledge of homeostasis. It is comprised of 20 multiple-choice questions covering key components of the previously validated Homeostasis Conceptual Framework (HCF). In this paper, we present the first multi-institutional study of the impact of physiology…

In this study, the performance of artificial intelligence chatbots--OpenAI's ChatGPT, Google Gemini, and Microsoft's Copilot--was evaluated and compared based on their responses to questions from the Turkish Higher Education Entrance Physics Examination over the past three years. Analysis of the chatbots' responses to TYT Physics questions showed…

Representations are an integral component of organic chemistry education and practice. Learning how to visualize and reason effectively with a variety of representations is essential for learners to succeed. However, developing the necessary representational competence skills (e.g., the ability to interpret, translate between, and use…

We investigate the multilingual and multimodal performance of a large language model-based artificial intelligence (AI) system, GPT-4o, using a diverse set of physics concept inventories spanning multiple languages and subject categories. The inventories, sourced from the PhysPort website, cover classical physics topics such as mechanics,…

General chemistry is often the first course taken by students interested in careers in STEM and health fields, and therefore, is considered an essential course for the success and retention of students in these fields. Prior studies have shown study habits and skills to be related to student performance in college-level courses, including STEM…

In the era defined by the fourth paradigm of science research, the burgeoning volume of science data poses a formidable challenge. The established data-related requisites within science literacy now fall short of addressing the evolving needs of researchers and STEM students. Consequently, the emergence of science data literacy becomes imperative.…

This article describes the implementation of alternative grading (AG) strategies in an upper-division kinesiology and functional human anatomy course. Traditional point-based grading systems can negatively impact student mental health, decrease intrinsic motivation, and hinder learning. To address these issues, a proficiency-based grading approach…

This study explores the use of artificial intelligence in grading high-stakes physics exams, emphasizing the application of psychometric methods, particularly item response theory, to evaluate the reliability of AI-assisted grading. We examine how grading rubrics can be iteratively refined and how threshold parameters can determine when…

With the already widespread nature of multiple-choice assessments and the increasing popularity of answer-until-correct, it is important to have methods available for exploring the validity of these types of assessments as they are developed. This work analyzes a 20-question multiple choice assessment covering introductory undergraduate chemistry…

In physics education, a number of studies have developed assessments of teachers' knowledge of student understanding (KSU) of specific physics concepts with modified versions of existing concept inventories, in which teachers were asked to predict the popular incorrect answers from students. The results provide useful but indirect information to…

Many educational institutions transitioned to digital distance-based learning and assessment formats in 2020 due to the severe acute respiratory syndrome--coronavirus 2 (SARS-CoV-2) pandemic. This shift has often been associated with concerns about increased student cheating and heightened stress. In this study, we compared the major course…

ChatGPT has emerged as a popular choice in education that has transformed the experience for both teachers and students. This study investigates the performance of ChatGPT in aiding learning in the biochemistry classroom in two ways. We sought to determine how effective ChatGPT 3.5 was in generating study materials for an introductory biochemistry…

The American Chemical Society advocates a shift from rule-based to risk-based safety education for chemistry graduates, emphasizing meaningful student engagement in the risk assessment process for laboratory work. To implement this paradigm shift, we introduced RAMP (Recognize Hazards, Assess Risk, Minimize Risk, and Prevent Emergencies)-based…

Students with strong metacognitive skills are positioned to learn and achieve more than peers who are still developing their metacognition. Yet, many students come to college without well-developed metacognitive skills. As part of a longitudinal study on metacognitive development, we asked when, why, and how first-year life science majors use…

Many undergraduate chemistry students hold alternate conceptions related to resonance--an important and fundamental topic of organic chemistry. To help address these alternate conceptions, an organic chemistry instructor could administer the resonance concept inventory (RCI), which is a multiple-choice assessment that was designed to identify…