To estimate the predictive validity of the Chinese National Medical Examination, scores of a sample (n=1,717) of participating examinees were compared with program directors' ratings on nine aspects of clinical competence. Test scores were consistent with competence measures and overall, correlated significantly with ratings, while varying for…

A study investigated the construct validity of three methods for assessing clinical performances of internal medicine clerks: a clinical evaluation form completed by faculty and residents, an objective structured clinical examination, and the National Board of Medical Examiners medicine subject test. Results suggest a significant but…

Three related Canadian studies assessed the content validity of 59 clinical problems designed as part of a test of medical decision-making skills. Focus was on the key features, i.e., the critical or essential steps in identification and management of the clinical problem. Results support content validity of the key features. (MSE)

Examined the concurrent validity of the Objective Structured Assessment of Technical Skill (OSATS), a new test of technical skills for general surgery residents. Correlations between OSATS scores and faculty rankings were generally high for six senior residents but low for six junior residents at the University of Toronto. (MDM)

Results of two certification examinations were analyzed for the cohorts of physicians who had taken in-training examinations as first, second, and third year residents. Multiple regression analysis showed that the composite score and all but one part-score were independently predictive of performance on the certification examination. (Author/MLW)

Compared four standard-setting procedures for an objective structure clinical examination (OSCE) in medical education. Applied Angoff, borderline, relative, and holistic procedures to the data used to establish a cutoff score for a pass/fail decision. The Angoff and borderline procedures gave similar results; however, the relative and holistic…

Through analysis of 2 learning-style tests given to 79 medical students at the University of Nevada School of Medicine, it was concluded that learning inventory tests are not good predictors of academic performance. Better test instructions or published standardized norms would make these tests better predictors. (GLR)

Sequential, standardized patient-based tests were given to medical students at the University of Maastricht (Netherlands); the first test was a screening test that evaluated the efficiency/validity of cutoff scores. Findings indicated that stringent pass/fail cutoff scores on the screening test produced optimal results. Fewer than 0.2 percent of…

A system of medical classification based on the dimensions of body system, etiology, and stage of disease was evaluated by classifying the content of one specialty board's examinations. This classification system may allow a board to define the content of its examinations, monitor requirements for certification, and communicate its standards.…

A 1990 study of domain-referenced scores from a multiple-station clinical examination for foreign medical graduates investigated identification of essential checklist items, setting of minimum passing scores, consistency of candidate classification, and perceived appropriateness of the number of candidates classified as competent. Results and…

The performance of foreign medical school graduates on multistation standardized patient-based tests was used to determine the validity and generalizability of global ratings of their clinical competence made by expert examiners. Results suggest that these ratings can be used as an effective form of assessment in this context. (Author/MSE)

Using a national sample of recent medical school graduates (n=12,213), a study of predictive validity of the National Board of Medical Examiners test parts I and II found strong correlations between performance on those parts and part III, supporting the test's use, at least in part, for selection of residency applicants. (MSE)

A study investigating possible sex bias, concerning both student and standardized-patient genders, in an objective structured clinical examination found that neither men nor women were afforded an advantage by patient or test location. However, women's scores on tests administered by females were higher than corresponding men's scores. (MSE)

Comparisons are made of the results of administering the same Objective Structured Clinical Examination-type clinical skills tests to two cohorts of the Ontario Pre-Internship Program. A description is provided of entry-exit comparisons between the test results of the two cohorts. (GLR)

The paper reviews a construct validation framework for research on the selection and evaluation of residents. The application of the proposed methodology to surgery residents is described. The need to measure non-cognitive and neuropsychological factors in addition to cognitive knowledge and technical ability is emphasized. (Author/MLW)