Presents a method for measuring interrater agreement on checklists. The technique computes a single agreement score from the concordance of raters' check mark configurations and derives an overall coefficient of agreement called "phi." A medical education study illustrates the phi methodology. (SLD)

A computer-assisted interaction analysis system that describes behavior in small groups and focuses on active clinical problem-solving was developed and tested. Teacher and class characteristics are incorporated into the simulation, allowing feedback for improvement of medical teaching skills. (TJH)

Three "levels" of the state of the art are discussed: the "ideal," for program evaluation; the "practical," with political limitations; and the "actual," for current practices. A review by Lloyd and Abrahamson (l979) is updated and current practices are discussed. Finally, a historical review introduces a…

Information about practice problems was solicited through a structured questionnaire completed by 59 family physicians, 101 pediatricians, and 102 orthopedic surgeons. Across all three groups, a lack of personal time was the major concern. Practice concerns vary among the specialties, a finding of interest to physician education. (SLD)

Two examples from the cluster evaluation of the W. K. Kellogg Foundation's Community Partnership for Health Professions Education illustrate why flexibility in evaluation design and activities is essential to collaborate with program directors and be responsive to program needs. (SLD)

Studied the effects of the location (community-based or hospital-based) and the structure of an ambulatory clerkship for medical students on cognitive knowledge and clinical performance. Results from 176 students suggest that something about the rotational structure of the multidisciplinary ambulatory clerkship does affect clinical ratings of…

The comprehensive model for evaluating nursing education programs is described in terms of what is evaluated; who conducts the evaluation; and why it is conducted. A structure for further action and decision making is also presented. (GDC)

Methods used in evaluating the clinical learning experiences of medical students in rural and university settings are investigated. A three-dimensional scheme for categorizing these different methods is described. (JKS)

Effects of Test-Wiseness (TW) training and level of TW on multiple-choice item type performance, on standardized and teacher-made examinations in undergraduate medical education were considered. Conditions inherent in standardized tests must be present before a susceptibility to the extraneous source of variance of TW is evidenced. (Author/GK)

Faculty committees wrote educational objectives for all 23 courses in their undergraduate medical school curriculum. The objectives were used for evaluation of curriculum, student knowledge, and attitudes. (CP)

Developed an instrument to evaluate the performance of educational administrators at a Canadian medical school. After 3 yearly evaluations, 20 administrators and 80 evaluators acknowledged broader input into evaluation, but saw little evaluation-related improved performance. (SLD)

A multiple measurement approach to validating the interpretation of student ratings of a medical school course was investigated. Results indicated that the approach allowed for greater precision than single measurement procedures. (Author/JKS)

The effects of scheduled intern rotations on the cost and quality of inpatient care at a teaching hospital were studied for 1,705 rotation patients and 3,141 no-rotation patients. Systematic discontinuity of scheduled rotations may be a source of increased health care costs at teaching hospitals. (SLD)

Assumptions implicit in the current use of licensing and certification examinations are identified, relevant evidence for these assumptions are reviewed, and implications for current methods of measurement are discussed. To ensure the protection of public health, it is critical to determine whether training and credentialing programs serve their…

Surveyed 196 medical college seniors about changes in the health-care system. Of the respondents, 79% believed that cost reduction rather than quality of care is the primary consideration behind recent changes, and 78% thought that managed-care organizations hamper physician ability in rendering optimal care. Discusses implications for curricular…