The evaluator's roles--change agent, manager, resource person, interpreter, and liaison between the project and the funding agency--are described, concerning the evaluation of innovative projects in education. Difficulties in obtaining desired commitments (i.e., a project's financial commitments and its positive attitude toward the evaluation…

Anecdotal evidence from interviews with some program managers gives evidence that unintended negative consequences of evaluations are more than a theoretical concern; they are a real problem deserving an evaluator's attention and energy. Negative consequences usually include: (1) wasted resources; (2) demotivation; and (3) program destruction and…

Based on experiences in conducting program evaluations for the Canadian Federal Government, an evaluator addresses reconciliation of the information needs of managers and accountability. External and internal accountability are covered. Using the perspectives of both line managers and senior managers, means of resolving pertinent issues are…

Evaluation utilization problems encountered and remedial strategies are discussed by a director of several government evaluation studies and evaluation manager. Political and behavioral prerequisites to evaluation utilization as well as on-going organizational requirements are emphasized. (TJH)

Unintended effects of evaluation are discussed, with reference to the Hawthorne Effect, where unintended effects overshadow the manipulations controlled by researchers. Unintended effects are categorized as (1) affective reactions; (2) political dimensions; (3) importance of individual differences; and (4) expectations concerning evaluation.…

This article describes an ongoing survey that illustrates how evaluators, working with program managers, have effectively used client-based data to monitor performance in the Social Security Administration. The value of client-based data outweighs the limitations and problems collecting it. Customer perceptions are a critical barometer of quality.…

In spite of many inherent problems, impact evaluation should remain an integral part of program evaluation, both because impact evaluation brings its budget justification with it, and because its focus on causal hypotheses is an essential part of evaluation. Methodology based on the author's body of work is reviewed. (SLD)

The evolution of the field of program evaluation is discussed, assuming that current major trends will continue, especially the trend toward theory-driven evaluation. Participating in planning without compromising evaluators' integrity will be an important and challenging task for the future. (SLD)

Events that brought independent evaluators together to address common problems and issues in the area of Acquired Immune Deficiency Syndrome (AIDS) education are described, focusing on development and accomplishments of the collaboration. The foundation stemmed from the funding agency's insistence that each program identify an evaluator. (SLD)

Three articles on evaluation in the Federal government describe a decline in budget and staff support, narrowing of the agenda to internal management issues, and the subordination of evaluation to other functions. Issues for the future of Federal government evaluation are discussed. (SLD)

This case study describes an unsuccessful research proposal submitted in response to a request for applications for projects to implement and evaluate up to 18 innovative programs for homeless persons with alcohol or other drug problems. This unsuccessful proposal reflects several tensions inherent in evaluation research. (SLD)

The history of the African people before slavery and colonization illustrates the ways in which different pictures of reality are created by which data are selected and ignored. The model of inquiry that verifies historical accuracy can help all program evaluators provide greater truth and equity for their clients. (SLD)

The future of program evaluation is bright if evaluators do not ignore their roots in quantitative research. The current interest in qualitative approaches and the call for a "fourth generation" in evaluation should not override training in quantitative research. Qualitative research should complement, rather than replace, traditional…

A case study illustrates the ways in which local reactions to a program evaluation directly threaten its validity, and shows that not all participants in a qualitative evaluation study understand or defer to the commitments of democratic evaluation. Ethical concerns in program evaluation are considered. (SLD)

Practices in needs assessment are reviewed since 1981, the year the federal government changed the role it plays in promoting needs assessment in the public sector. The review is based on reports published to 1993 and indicates that needs assessment is flourishing in a variety of settings. (SLD)