Job and practice analysis is a commonly used method for determining examination content specifications. However, difficulties arise when many domains are present, as mainstream approaches do not fully adhere to the essence of the weighing process, namely a "comparison-evaluation-decision" framework for assigning percentage values to the…

The authors' institution exceeded the Texas Science of Teaching Reading (STR) exam's passing rate of 86.6% for the 2021-2022 academic year. The authors think this success was largely due to conducting an analysis of test questions and helping preservice teachers better prepare for the exam. The authors helped preservice teachers supplement the…

In a targeted double-scoring procedure for performance assessments that are used for licensure and certification purposes, a subset of responses receives an independent second rating if the first rating falls into a preidentified critical score range (CSR) where an additional rating would lead to considerably more reliable pass-fail decisions.…

Certified dietary managers (CDMs) lead their food services team by ensuring food quality, safety, and palatability while applying nutrition principles to food purchasing, storage, preparation, and service. Despite labor shortages and forecasted growth in both healthcare and food services management jobs, approximately 30% of credentialing exam…

Test scores are often used to make decisions about examinees, such as in licensure and certification testing, as well as in many educational contexts. In some cases, these decisions are based upon compensatory scores, such as those from multiple sections or components of an exam. Classification accuracy and classification consistency are two…

At a time when schools are facing the most severe staffing challenges in recent memory and with interest in becoming a teacher a fraction of what it was a generation ago, it has never been more important for state policies to support innovative approaches to teacher hiring and retention and remove unnecessary barriers into the profession.Instead…

Administrative problems such as computer malfunction and power outage occasionally lead to missing item scores, and hence to incomplete data, on credentialing tests such as the United States Medical Licensing examination. Feinberg compared four approaches for reporting pass-fail decisions to the examinees with incomplete data on credentialing…

While the CPA exam is uniform for all jurisdictions, individual jurisdictions are allowed to set the requirements to sit for the exam. These requirements vary by jurisdiction, with some being more restrictive than others. We analyze the decision process of international candidates to proxy for candidates that can choose jurisdictions with less…

With the increased restrictions on physical distancing due to the COVID-19 pandemic, remote proctoring has emerged as an alternative to traditional onsite proctoring to ensure the continuity of essential assessments, such as computer-based medical licensing exams. Recent literature has highlighted the significant impact of different proctoring…

The use of linguistic features in school assessments, as well as the impact of these factors on the outcome of assessments have received limited attention in the literature. With this study I aimed to analyse linguistic features of accounting examinations. A quantitative technique, using tests for correlation, was employed to analyse the Grade 12…

Law schools are held accountable on many fronts to achieve and maintain high bar passage rates. While the course of legal education itself, along with various interventions, is a key driver of bar exam performance, Bahadur et al. (2021) suggests that obscure institutional practices might be inflating institutional bar passage performance. Such…

In this qualitative study, I examine a provisional teacher testing policy designed and implemented in response to the COVID-19 pandemic. Survey and focus data from a public teacher education program in Massachusetts in the spring of 2021 shows that provisional teacher testing policy eased financial, logistical, and emotional pressure for teacher…

Despite extensive studies on large language models and their capability to respond to questions from various licensed exams, there has been limited focus on employing chatbots for specific subjects within the medical curriculum, specifically medical neuroscience. This research compared the performances of Claude 3.5 Sonnet (Anthropic), GPT-3.5 and…

The Uniform Bar Examination (UBE) is a multijurisdictional test that law students can use to gain admission to the bar in 37 states and territories. Despite this near-universal applicability and the potential of UBE to affect law schools' admissions, diversity, affordability, and employment outcomes, no research to date has examined the impacts of…

Linear logistic test models (LLTMs), leveraging item response theory and linear regression, offer an elegant method for learning about item characteristics in complex content areas. This study used LLTMs to model single-best-answer, multiple-choice-question response data from two medical subspecialty certification examinations in multiple years…