The evaluator's role in planning/implementing an evaluation of a new program to train school administrators in performance appraisal skills is described. This case study of the evaluators' broadening roles uses E. Chelimsky's continuum (1987) to analyze political processes and decision making involved in the evaluation of a state-funded program.…

This final article in a series on management of instructional development projects focuses on what the project manager can do to ensure that the follow-up evaluation is as effective as possible. Highlights include the development of evaluation tools, implementing the chosen evaluation strategies, and analyzing and reporting the findings. (LRW)

The evaluation of a science education project for teachers in Durban (South Africa) illustrates some problems inherent in the application of the fourth-generation evaluation approach of Guba and Lincoln. One of the strongest concerns is that full participation by stakeholders may be an unrealistic assumption. (SLD)

Describes how Winnipeg public schools use an educational indicator system, including computer mapping graphics, to present indicator data to educational policymakers. Discusses issues and problems in the development and use of educational indicator systems, focusing on the relative importance of educational inputs, processes, and outcomes. (SV)

The Senate confirmation hearings concerning Robert Gates as director of the Central Intelligence Agency (CIA) highlight the problems evaluators share with the CIA of keeping policy imperatives out of the search for truth. The CIA at least has a structure for keeping information pure, but many evaluations do not. (SLD)

Data about outpatient treatment unit follow-up evaluations drawn from selected evaluation items in the recent National Drug Abuse Treatment Survey are reported. Directors and supervisors of 670 units completed surveys describing the follow-up studies. The majority of programs collecting follow-up data used the information for program change. (SLD)

Partial results of an evaluation of an alternative criminal-sentencing program indicate considerable disagreement among stakeholders over perceived program effectiveness. It is argued that these disagreements are not isolated events but are likely to be inherent in any program with the potential to change established systems within a complex…

Unintended effects of evaluation are discussed, with reference to the Hawthorne Effect, where unintended effects overshadow the manipulations controlled by researchers. Unintended effects are categorized as (1) affective reactions; (2) political dimensions; (3) importance of individual differences; and (4) expectations concerning evaluation.…

Ways to use standard-setting data to adjust cutoff scores on examinations are reviewed. Ten sources of information to be used in determining standards are listed. The decision to modify passing scores should be based on these types of information and consideration of adverse impact or rating process irregularities. (SLD)

Based on experiences in working with school district staff, suggestions for enhancing evaluation use through stakeholder involvement are discussed in terms of who should be involved, when involvement should occur, and how stakeholders should be involved via a dialogue-dependent process. (SLD)

Developed a needs-assessment model and validated the model with five groups of stakeholders connected with an undergraduate university nursing program in Canada. Used focus groups, questionnaires, a hermeneutic approach, and the magnitude-estimation scaling model to validate the model. Results show that respondents must define need to clarify the…

Health care professionals were surveyed concerning their use of health education methods and the ease of implementing the stages of the process of lifestyle counseling. Results are discussed for three different provider groups and for specific aspects of the health education process. Recommendations to address problems are included. (Author/EMK)

Reports a study of how decision makers in 10 different business and educational contexts valued educational technology. Considers how practitioners and scholars can use this information to improve future evaluation efforts. Two tables show interviewees' institutions and job roles and bases that interviewees used in making educational technology…

In the evaluation scenario presented, that of a mentoring program matching high school juniors and seventh graders, the external evaluator is asked for impact information before enough time has elapsed to provide really meaningful data. The commentators, T. A. Schwandt and D. G. Bonnet, take different approaches to what the evaluator should do.…

Testing and individual assessment before hiring or promoting can ensure high performance and ward off turnover. The proper job/person match can best be made by analyzing job requirements, selecting useful tests, and analyzing test results and tailoring assessment to the client. Other issues include coping with legal challenges and selecting a…