The various arts and sciences that comprise the field of program evaluation are discussed. It is argued that emphasis on rigor and expressive content has left other aspects of evaluation unexplored. Educational evaluators need to consider what programs mean and how they contribute to understanding. (SLD)

Effective practice reviews (EPRs) are described as used in evaluation studies for the Office of Evaluation and Inspections, a component of the U.S. Department of Health and Human Services. Examples are given of EPRs in addressing new problems, structuring and improving federal programs, and decreasing costs. (SLD)

The formative/summative evaluation dichotomy suggested by M. Scriven is challenged, and a conceptual typology is presented that crosses improvement and assessment evaluation functions with process and outcome program stages for four basic types of evaluation. This framework accommodates mixed types of evaluations. (SLD)

A set of criteria is proposed by which development projects can be selected for purposes of ex post assessment to determine their effects and outcomes. Arguments are advanced as to the importance of these criteria, and observations are made about their current use by international aid agencies. (SLD)

Propositions about what works in program evaluation are presented: (1) evaluators should be involved from the beginning; (2) evaluation should be based on explicit programmatic theory; (3) quasi-experimental designs must have high internal validity; and (4) evaluators must combat the deterioration of experimental control that occurs in…

This volume provides the background of the Kentucky Education Reform Act and discusses the assessment and evaluation principles on which it is based. It reviews early steps in implementation of the Act's mandates, but was written before most of the battles of implementation had begun. (SLD)

A good formative evaluator, who helps programs become as effective as possible, behaves remarkably like a good personal coach. Nine ways in which a formative evaluator can help a program manager are listed, and implications for practicing evaluators and the evaluation profession are detailed. (SLD)

Presents an approach to the evaluation of family support programs that does not violate the principles of family support. Tailoring the evaluation to the program service philosophy ensures that the evaluation process is integrated with the program to provide a more accurate picture of the program. (SLD)

Differing views about the success evaluators have had in improving programs directly are contrasted. It is suggested that evaluation, even when decisions are not based directly on evaluation outcomes, should represent continuing education for program managers, planners, and policy makers with probable impact in the future. (SLD)

Responses of 246 internal and external evaluators about reporting and communicating results show that most use traditional reporting formats, are only moderately satisfied with reporting efforts, recognize many constraints to reporting, and consider high stakeholder involvement essential to effective evaluation. (SLD)

The experiences of a group of evaluators evaluating a multisite integrated human service delivery system illustrate many design and measurement considerations in the preimplementation and implementation phases of evaluation. The reemergence of human service integration approaches will make such evaluation issues increasingly common. (SLD)

A program evaluation approach is proposed that individualizes objectives based on participants' characteristics and needs. This approach reflects tailoring of program services and assessment within the parameters of the program in order to maximize participant performance. The model appears theoretically sound and practical, but it has not been…

The assertion that evaluation has become institutionalized at state and local levels to a much greater degree than is commonly understood is supported by a discussion of trends in evaluation. Evidence is presented that evaluation plays an increasingly important informational role as the level of evaluation becomes more local. (SLD)

Assessing results of grants programs is illustrated with evaluation activities of the National Science Foundation and other federal agencies. Methods considered are ex-ante peer review of proposed work, ex-post peer review of completed work, publications-based methods, and "look-back" methods tracing contributions of past work and…

An approach to evaluation initiated by the Kellogg Foundation called cluster evaluation (not to be confused with cluster sampling) is described. Cluster evaluation provides a skilled, credible evaluator to work with a cluster of projects to assure that useful and defensible information is obtained for program evaluation. (SLD)