[This paper is part of the Focused Collection in Investigating and Improving Quantum Education through Research.] One of the greatest weaknesses of physics education research is the paucity of research on graduate education. While there are a growing number of investigations of graduate student degree progress and admissions, there are very few…

[This paper is part of the Focused Collection in Artificial Intelligence Tools in Physics Teaching and Physics Education Research.] Using a high-stakes thermodynamics exam as the sample (252 students, four multipart problems), we investigate the viability of four workflows for AI-assisted grading of handwritten student solutions. We find that the…

We present an analysis of students' thinking skills as evidenced by free-response exam problems during the COVID-19 pandemic. We compare two inquiry-based, laboratory-based classical mechanics courses, one taught online and one taught in person during the pandemic, and two inquiry-based, laboratory-based electricity and magnetism courses, one…

We designed a rubric to assess free-response exam problems in order to compare thinking skills evidenced in exams in classes taught by different pedagogies. The rubric was designed based on Bloom's taxonomy and then used to code exam problems. We have analyzed historical and recent exam problems in both algebra-based and calculus-based exams. In…

The Conceptual Survey of Electricity and Magnetism (CSEM) is a widely used multiple-choice instrument measuring a student's conceptual understanding of electricity and magnetism. This study applied modified module analysis (MMA) and modified module analysis-partial (MMA-P), network analytic methods that identify groups of correlated responses, to…

Scientific abilities rubrics developed at Rutgers University are an assessment and self-assessment tool. They consist of tables, each representing a broad scientific ability (for example, "to collect and analyze data"), the listing of subabilities (for example, "independent and dependent variables are identified") and the…

Rubric-based admissions are claimed to help make the graduate admissions process more equitable, possibly helping to address the historical and ongoing inequities in the U.S. physics graduate school admissions process that have often excluded applicants from minoritized races, ethnicities, genders, and backgrounds. Yet, no studies have examined…

We studied the impact of metacognitive reflections on recently-completed work as a way to improve the retention of newly learned problem-solving techniques. Students video recorded themselves talking through problems immediately after finishing them, completed ongoing problem-solving strategy maps or problem-sorting exercises, and filled out…

A goal of introductory physics for life sciences (IPLS) curricula is to prepare students to effectively use physical models and quantitative reasoning in biological and medical settings. To assess whether this goal is being met, we conducted a longitudinal study of the impact of IPLS on student work in later biology and chemistry courses. We…

Physics inquiry can be interpreted as the construction of a cogent argument in which students apply inquiry knowledge and knowledge of physics to the systematic collection of relevant, valid, and reliable data, creating optimal scientific support for a conclusion that answers the research question. In learning how to devise, conduct and evaluate a…

Given the insufficient number of well-qualified future physics teachers in the U.S., physics programs often seek guidance for how to address this national need. Measurement tools can provide such guidance, by both defining excellence in physics teacher education (PTE) and providing a means to measure progress towards excellence. This paper…

We introduce a template to (i) scaffold the problem solving process for students in the physics 1 course, and (ii) serve as a generic rubric for measuring how expertlike students are in their problem solving. This template is based on empirical studies of the problem solving practices of expert scientists and engineers, unlike most existing…

As systematic inequities in higher education and society have been brought to the forefront, graduate programs are interested in increasing the diversity of their applicants and enrollees. Yet, structures in place to evaluate applicants may not support such aims. One potential solution to support those aims is rubricbased holistic review. Starting…

Reliable and validated assessments of introductory physics have been instrumental in driving curricular and pedagogical reforms that lead to improved student learning. As part of an effort to systematically improve our sophomore-level classical mechanics and math methods course (CM 1) at CU Boulder, we have developed a tool to assess student…

Drawing appropriate diagrams is a useful problem solving heuristic that can transform a problem into a representation that is easier to exploit for solving it. One major focus while helping introductory physics students learn effective problem solving is to help them understand that drawing diagrams can facilitate problem solution. We conducted an…