A study investigated optimal length of screening tests used to sort out medical students needing to take a full-length performance-based standardized-patient test from those not needing it. Receiver operating characteristic analysis determined a good length is one-third the full test, with cutoff just above the mean case pass level. (Author/MSE)

The Clinical Skills Assessment Examination was constructed to test the clinical skills of foreign medical graduates. A pilot test of 635 foreign graduates, including 35 United States citizens, and 123 graduates of U.S. medical schools found 28 percent of foreign graduates deficient in clinical skills, consistent with previous research. (MSE)

The University of North Carolina at Chapel Hill medical school uses an objective structured clinical examination as the final exam in physical diagnosis. Since 1987, students and evaluators have shown overwhelming acceptance and support of the test, partly because it is structured for teaching as well as assessment. (Author/MSE)

Major changes in the content and format, standard-setting procedures, and score reporting policies in the National Board of Medical Examiners' comprehensive Part I examination are described. The phase-in of the United States Medical Licensing Examination and implications for score use are also discussed. (Author/MSE)

Hypothetical costs of running a 4-hour objective structured clinical examination for 120 medical students at 1 school are detailed. Costs are reported for four phases: (1) development, (2) production, (3) administration, and (4) postexamination reporting and analysis. High- and low-end estimated costs ranged from $496 to $870 per student. The…

A study of the use of the Medical Education Evaluation Program, established by Ohio to evaluate clinical competencies of medical graduates of non-accredited schools, found the test to meet psychometric standards of certifying and licensing examinations. Potential problems with the test are discussed. (MSE)

In a pilot study, two methods of identifying problems in the evaluation of third- and fourth-year medical students' clinical skills were tested. The two types of materials, questionnaires and a problem-case analysis, were found to be complementary, both identifying some of the same problems and each identifying some different problems. (MSE)

A study investigated test-taking patterns and pass rates on the National Board of Medical Examiners test (NBME) and Foreign Medical Graduate Examination in the Medical Sciences (FMGEMS), including trends in pass rates, proportion of candidates taking each test, and proportions of repeaters for each test. (MSE)

Poor performance of medical students, residents, and faculty on a newly developed Inventory of Cognitive Biases in Medicine, suggests that cognitive biases detract from reliance on logical and statistical strategies in medical decision making. The test shows promise for use in instructional and research efforts to reduce such bias. (Author/MSE)

A study assessed the feasibility of sequential testing of medical students using standardized patients. Sequential testing passes students who score well on the first segment of the test thus eliminating additional student-standardized patient encounters. Subjects were six classes of Southern Illinois University students (n=404). Results strongly…

A study supported use of the objective structured clinical examination for screening foreign medical graduates (n=67) wishing to enter a preinternship program in at the University of Toronto. However, it also showed that appropriate training for the candidates was the internship, not preinternship, program. (MSE)

The appropriateness of using Steps 1 and 2 of the United States Medical Licensing Examination (USMLE) to make individual academic decisions and the appropriateness of determining course grades with scores from the National Board of Medical Examiners (NBME) subject tests are examined. Underlying philosophical and psychometric assumptions are…

It is proposed that, despite the fact that no large body of data from the United States Medical Licensing Examination (USMLE) is available, predictive validity of National Board of Medical Examiners test scores supports use of USMLE scores for screening potential new medical residents. (Author/MSE)

Interactive computerized tests accepting unrestricted natural-language input were used to assess knowledge of clinical biophysics at the State University of New York at Buffalo. Comparison of responses to open-ended sequential questions and multiple-choice questions on the same material found the two formats test different aspects of competence.…

Criteria are presented for determining whether licensure and/or achievement test results should be used for making various types of comparisons and judgments about medical education programs. The United States Medical Licensing Examination (USMLE) and National Board of Medical Examiners tests (NBME) are then considered as data sources. (Author/MSE)