Approximately two-thirds of all United States and Canadian medical schools have provisions for the evaluation of their departments. Some of the forces leading to the popularity of departmental review, the review process and the various ways it can be managed, and its implications for medical school administration are discussed. (Author/JMD)

Sheds light on some of the possibilities and pitfalls of question design for examinations, referring to a specific academic setting as an illustrative case study. A narrative account is presented of a staff "consciousness raising" workshop in which the presenters drew on writing prompts that examiners judged to have work or not work in practice.…

Examples of innovative program evaluation techniques developed in several foreign and international settings are presented in a collection of 10 essays. Methods for understanding programs to be evaluated, focusing evaluation, gathering information, analyzing information, and communicating findings and recommendations are discussed. (TJH)

Discusses the role and consistency of judges' interpretations of teacher performance as part of an evaluative scheme for complex performance, with reference to the ideological framework of professional standards. The tension between assessment decisions and the recognition that assessment involves interpretation is explored. (SLD)

The evolution of the field of program evaluation is discussed, assuming that current major trends will continue, especially the trend toward theory-driven evaluation. Participating in planning without compromising evaluators' integrity will be an important and challenging task for the future. (SLD)

The lack of sound and practical guidelines and materials, which precludes adequate technical assistance, is one cause of the inferior quality of evaluation practices in bilingual education. Other contributing factors include incompetent program evaluators, misinformed local administrations, inappropriate state and federal policies, and complex…

Several methods for determining a passing score on an examination from individual raters' estimates of minimal pass levels were compared through simulation. The methods used differed in the weighting estimates for each item received in the aggregation process. Reasons why the simplest procedure is most preferred are discussed. (SLD)

An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)

Evaluation and strategic management are related in that each attempts to improve the quality of policy decisions and each has evolved from a product-centered focus to one in which implementation and utilization are vital. Evaluators should understand strategic management theory to evaluate its applications appropriately. (SLD)

Effects of training teacher evaluators and outcomes and quality of teacher evaluation were studied in Iowa for 619 elementary school and secondary school teachers. Findings relating to training effects are encouraging, and findings relating to teacher and evaluator attributes and the evaluation process provide direction for improving teacher…

The utilization of program evaluation is addressed and illustrated through the case study of a family reunification program at a New England child welfare agency. It is argued that evaluation is an exercise in power in an organization. Evaluators who understand power can work with the realities they find. (SLD)

A multiple-case, "tracer" study was undertaken involving 11 research projects of the "Education et Vie Active" (Education and the Active Life)--a national vocational education program in Switzerland--to assess the importance of contacts between researchers and practitioners. Iterative data from interviews, observations, and…

Seven chapters present 31 propositions challenging traditional ideas about the nature and practice of program evaluation. Methods to improve evaluation models and approaches and ways to address intermediate and advanced evaluation issues are explored. The discussion also serves as an introduction to the most analytical and comprehensive of the…

The reliability and validity of judgments of teaching quality made by independent inspectors in primary and secondary school classrooms in England were studied. Results with 173 pairs of observations by 100 inspectors show that two trained inspectors, independently observing the same lesson, are likely to identify the same strengths and weaknesses…

Describes the processes in which judges, trying out an integrative approach to portfolio evaluation for the first time, engage as they construct and document their conclusions. The research agenda in which this research is situated is described. (SLD)