The purpose of this quantitative, non-experimental, correlational study was to determine if there was a correlation between first-time pass rates on the USMLE Step 1 and the use of active learning strategies in medical school classrooms. For the utility of this study, active learning strategies were defined as any activity in which medical…

Previous research on rapid responding tends to implicitly consider examinees as either engaging in solution behavior or purely guessing. However, particularly in a high-stakes testing context, examinees perceiving that they are running out of time may consider the remaining items for less time than necessary to provide a fully informed response,…

Test scoring models vary in their generality, some even adjust for examinees answering multiple-choice items correctly by accident (guessing), but no models, that we are aware of, automatically adjust an examinee's score when there is internal evidence of cheating. In this study, we use a combination of jackknife technology with an adaptive robust…

This article presents a new approach to the analysis of how students answer tests and how they allocate resources in terms of time on task and revisiting previously answered questions. Previous research has shown that in high-stakes assessments, most test takers do not end the testing session early, but rather spend all of the time they were…

West Virginia's three state-funded medical schools enroll more medical students per capita than any other state in the country. Due to its large number of medical student slots, the state typically can offer all qualified West Virginians the opportunity to complete their medical education in the state. In the academic year of 2023, 25 percent…

Dynamic Measurement Modeling (DMM) is a psychometric paradigm that uses longitudinal data to estimate students' capacity to learn over the course of an educational program (i.e., growth scores). Here, we provide justification for this approach in health professions education and demonstrate its proof of concept with three time-points of USMLE Step…

Test administrators are appropriately concerned about the potential for time constraints to impact the validity of score interpretations; psychometric efforts to evaluate the impact of speededness date back more than half a century. The widespread move to computerized test delivery has led to the development of new approaches to evaluating how…

Changes to the American Board of Internal Medicine's Maintenance of Certification Program: Preserving Core Assessment Values As Maintenance of Certification (MoC) for practicing physicians has evolved into more continuous programs, controversy has arisen over how physicians should self-regulate their profession and serve the public trust in doing…

The current state of technology allows physicians to look up information in everyday practice using a wealth of medical resources. This change in practice may be important enough to consider it being reflected in medical certification exams, making the exam more similar to real practice. However, there is limited research comparing open- and…

The relative impact of admissions factors and curricular measures on the first medical licensing exam (United States Medical Licensing Exam [USMLE] Step 1) scores is examined. The inclusion of first-year and second-year curricular measures nearly doubled the variance explained in Step 1 scores from the amount explained by the combination of…

This descriptive article describes the use of clinical case-based portfolios in histopathology teaching laboratories in conjunction with virtual microscopy not only to integrate histology and pathology disciplines for first and second year medical students but also to stimulate student engagement, promote self-directed and group-based learning and…

The Angoff standard setting method relies on content experts to review exam items and make judgments about the performance of the minimally proficient examinee. Unfortunately, at times content experts may have gaps in their understanding of specific exam content. These gaps are particularly likely to occur when the content domain is broad and/or…

The purpose of this study is to determine whether participation in self-study and self-assessment CME programs improves physicians' performance on a Board Maintenance of Certification (MOC) examination. Linear regression showed that participation in such CME programs within one year of taking the MOC exam predicted higher performance on the MOC…

Much of the content delivered during medical students' preclinical years is assessed nationally by such testing as the United States Medical Licensing Examination® (USMLE®) Step 1 and Comprehensive Osteopathic Medical Licensing Examination® (COMPLEX-USA®) Step 1. Improvement of student study/learning strategies skills is associated with academic…

Recent changes to the patient note (PN) format of the United States Medical Licensing Examination have challenged medical schools to improve the instruction and assessment of students taking the Step-2 clinical skills examination. The purpose of this study was to gather validity evidence regarding response process and internal structure, focusing…