The Homeostasis Concept Inventory (HCI) is a validated instrument for measuring students' knowledge of homeostasis. It is comprised of 20 multiple-choice questions covering key components of the previously validated Homeostasis Conceptual Framework (HCF). In this paper, we present the first multi-institutional study of the impact of physiology…

Natural category learning is important in science education. One strategy that has been empirically supported for enhancing category learning is testing, which facilitates not only the learning of previously studied information (backward testing effect) but also the learning of newly studied information (forward testing effect). However, in…

The artificial intelligence chatbot ChatGPT was used to answer questions from final exams administered in two general chemistry courses, including questions with closed-response format and with open-response format. For closed-response questions, ChatGPT was very capable at identifying the concept even when the question included a great deal of…

This study aimed to develop a comprehensive diagnostic tool for assessing upper-secondary school students' understanding of isomers, expanding upon existing two- and three-tier conceptual diagnostic methods. By incorporating 'Confidence Rating Factor' tiers within the answer and reason sections, a four-tier test was designed and developed. This…

The Force Concept Inventory (FCI) is one of the research-based assessments established by the physics education research community to measure students' understanding of Newtonian mechanics. Former works have often recorded the notion of gendered mean FCI scores favoring male students notably in the North American (NA) based studies. Nevertheless,…

This article provides a process to carefully evaluate the suitability of a content domain for which diagnostic classification models (DCMs) could be applicable and then optimized steps for constructing a test blueprint for applying DCMs and a real-life example illustrating this process. The content domains were carefully evaluated using a set of…

There is no need or point to testing of knowledge, attributes, traits, behaviours or abilities of an individual if information obtained from the test is inaccurate. However, by and large, it seems the estimation of psychometric properties of test items in classroomshas been completely ignored otherwise dying slowly in most testing environments. In…

Previous studies noted the scantiness of diagnostic instruments for the assessment of students' understanding of fundamental biochemistry concepts. Consequently, within this study, a four-tier test for the examination of secondary school students' conceptual understanding of amino acids, proteins, and enzymes has been developed. Items in the test…

General chemistry is often the first course taken by students interested in careers in STEM and health fields, and therefore, is considered an essential course for the success and retention of students in these fields. Prior studies have shown study habits and skills to be related to student performance in college-level courses, including STEM…

The study outlines the early-stage development of a free-response General Relativity Concept Inventory (GRCI), an educational instrument designed to test for conceptual understanding of General Relativity. Data were collected for the study by having 26 participants from General Relativity courses work through the questions on the GRCI. Interviews…

In the era defined by the fourth paradigm of science research, the burgeoning volume of science data poses a formidable challenge. The established data-related requisites within science literacy now fall short of addressing the evolving needs of researchers and STEM students. Consequently, the emergence of science data literacy becomes imperative.…

[This paper is part of the Focused Collection on Qualitative Methods in PER: A Critical Examination.] Identifying student ideas about particular physics topics is one of the earliest and longest-standing foci of physics education research. This paper presents a method for identifying common conceptual resources for understanding physics, using…

Practice examinations developed at the ACS Examinations Institute ask students to self-report mental effort when answering items. This self-reported mental effort together with performance can be represented in the form of a cognitive efficiency graph for each student giving information on the utilization of cognitive resources and content…

This article describes the implementation of alternative grading (AG) strategies in an upper-division kinesiology and functional human anatomy course. Traditional point-based grading systems can negatively impact student mental health, decrease intrinsic motivation, and hinder learning. To address these issues, a proficiency-based grading approach…

This study explores the use of artificial intelligence in grading high-stakes physics exams, emphasizing the application of psychometric methods, particularly item response theory, to evaluate the reliability of AI-assisted grading. We examine how grading rubrics can be iteratively refined and how threshold parameters can determine when…