Successful testing programs rely on high-quality test items to produce reliable scores and defensible exams. However, determining what statistical screening criteria are most appropriate to support these goals can be daunting. This study describes and demonstrates cost-benefit analysis as an empirical approach to determining appropriate screening…

When the safety of the public is at stake, it is particularly relevant for licensing and credentialing exam agencies to use defensible standard setting methods to categorize candidates into competence categories (e.g., pass/fail). The aim of this study was to gather evidence to support change to the Comprehensive Osteopathic Medical Licensing-USA…

Decisions about progress through an academic programme are made by Boards of Examiners, on the basis of students' course assessments. For most students such pass/fail grading decisions are straightforward. However, for those students whose results are borderline (either at a pass/fail boundary or boundaries between grades) the exercise of some…

Several studies have shown that the standard error of measurement (SEM) can be used as an additional “safety net” to reduce the frequency of false-positive or false-negative student grading classifications. Practical examinations in clinical anatomy are often used as diagnostic tests to admit students to course final examinations. The aim of this…

Due to the high-stakes nature of medical exams it is prudent for test agencies to critically evaluate test data and control for potential threats to validity. For the typical multiple station performance assessments used in medicine, it may take time for examinees to become comfortable with the test format and administrative protocol. Since each…

The purpose of this research was to study the effects of violations of standard multiple-choice item writing principles on test characteristics, student scores, and pass-fail outcomes. Four basic science examinations, administered to year-one and year-two medical students, were randomly selected for study. Test items were classified as either…

A survey to review practices for reporting student performance with nontraditional grading systems, to investigate the methods used to recognize outstanding student performance, and to survey the attitudes of medical school administrators concerning the recognition of excellence is described. (MLW)

Reports a study that evaluated the efficacy of a nonranking grading system in assessing superior performance. (JT)

A first course in psychopathology for medical students uses both conventional lecture-discussion and programmed, self-instructional formats. Examination policy for the course is described that uses quizzes and a comprehensive final mandatory only for those students failing one of the quizzes. (LBH)

Discusses the use of numerical grades or a pass-fail system at the first-professional degree level in a health professions college, this paper provides the results and analysis of a student survey. Some 73 percent of student respondents felt that academic achievement was not affected by pass-fail. (LBH)

Performance in a second-year course in pedodontics/orthodontics for three classes at the State University of New York at Stony Brook School of Dental Medicine who received grades under an honors/pass/fail system was compared to that of three academically comparable classes that received letter grades. (Author/MLW)

The grading standards must be based on society's needs and the availability and ability of students to be trained to fill these needs. (IR)

A survey of 12 constituencies (totaling 2,288 respondents) concerning the National Board of Medical Examiners' (NBME) comprehensive Part I and Part II examinations revealed support for more even distribution of fail rates across examinations, support for a fixed standard, and favorable reaction to setting standards based on review of examination…