Discusses the need for systems of performance indicators (PI) to measure important aspects of university operations. Comparison of three models--production, student development, and systems--makes clear that model choice yields fundamentally different PI systems and, in turn, different contexts of relevance. Suggests a hybrid model, combining the…

Discussion of library media specialists evaluation focuses on factors that compromise the utility of evaluations by the principal: increased demands on principals as instruments of accountability; the tendency to use an evaluation designed for teachers, not media specialists; and changes that have occurred in the work of library media specialists.…

A sampling of student assessment and accountability in selected countries to help put trends in the United States in perspective. Examines national student assessments in England, France, and Hong Kong. Also looks at several international collaborative assessment projects for reading literacy, mathematics, and science. (Contains 10 references.)…

This sourcebook presents information about three types of federal decision makers who are frequent clients of evaluation: career government executives; political appointees; and congressional staff members. Differences among these decision makers are highlighted in seven articles, with emphasis on meeting client needs and process dimensions of…

The evaluator's role in planning/implementing an evaluation of a new program to train school administrators in performance appraisal skills is described. This case study of the evaluators' broadening roles uses E. Chelimsky's continuum (1987) to analyze political processes and decision making involved in the evaluation of a state-funded program.…

This final article in a series on management of instructional development projects focuses on what the project manager can do to ensure that the follow-up evaluation is as effective as possible. Highlights include the development of evaluation tools, implementing the chosen evaluation strategies, and analyzing and reporting the findings. (LRW)

The evaluation of a science education project for teachers in Durban (South Africa) illustrates some problems inherent in the application of the fourth-generation evaluation approach of Guba and Lincoln. One of the strongest concerns is that full participation by stakeholders may be an unrealistic assumption. (SLD)

Describes how Winnipeg public schools use an educational indicator system, including computer mapping graphics, to present indicator data to educational policymakers. Discusses issues and problems in the development and use of educational indicator systems, focusing on the relative importance of educational inputs, processes, and outcomes. (SV)

The Senate confirmation hearings concerning Robert Gates as director of the Central Intelligence Agency (CIA) highlight the problems evaluators share with the CIA of keeping policy imperatives out of the search for truth. The CIA at least has a structure for keeping information pure, but many evaluations do not. (SLD)

Data about outpatient treatment unit follow-up evaluations drawn from selected evaluation items in the recent National Drug Abuse Treatment Survey are reported. Directors and supervisors of 670 units completed surveys describing the follow-up studies. The majority of programs collecting follow-up data used the information for program change. (SLD)

Partial results of an evaluation of an alternative criminal-sentencing program indicate considerable disagreement among stakeholders over perceived program effectiveness. It is argued that these disagreements are not isolated events but are likely to be inherent in any program with the potential to change established systems within a complex…

Unintended effects of evaluation are discussed, with reference to the Hawthorne Effect, where unintended effects overshadow the manipulations controlled by researchers. Unintended effects are categorized as (1) affective reactions; (2) political dimensions; (3) importance of individual differences; and (4) expectations concerning evaluation.…

Ways to use standard-setting data to adjust cutoff scores on examinations are reviewed. Ten sources of information to be used in determining standards are listed. The decision to modify passing scores should be based on these types of information and consideration of adverse impact or rating process irregularities. (SLD)

Based on experiences in working with school district staff, suggestions for enhancing evaluation use through stakeholder involvement are discussed in terms of who should be involved, when involvement should occur, and how stakeholders should be involved via a dialogue-dependent process. (SLD)

Developed a needs-assessment model and validated the model with five groups of stakeholders connected with an undergraduate university nursing program in Canada. Used focus groups, questionnaires, a hermeneutic approach, and the magnitude-estimation scaling model to validate the model. Results show that respondents must define need to clarify the…