Weiss' and Patton's competing views concerning the influence of program evaluation on decision-making are critiqued. Patton's approach provides an essential mechanism for achieving desired ends, once they are determined. Weiss' approach supplements that contribution by including not only expert development of means, but also expert selection of…

The role of the evaluator in insuring utilization and quality of evaluation results is discussed. Topics covered include a utilization-focused vision of accountability, overcoming staff fears of evaluation, eliciting the right information from users, situational responsiveness, and advocacy. (TJH)

Steps in presenting evaluation recommendations are outlined. The steps include the following: the development of effective recommendations, the presentation of effective recommendations, and the effective following up of recommendations. (TJH)

With the advent of program theory, evaluators have begun advancing understanding of how programs function in a specific context and how generalizations of program effects are contingent upon organizational, community, and cultural settings. Program theory is described and evaluated for practicality, and a congruent theory of program evaluation is…

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

The role of the evaluator in the decision-making process is discussed. Topics covered include identification of decision makers and decision-making processes, delineation of informational needs, identification of the various media and forums for evaluation ideas, and definition of functions that evaluators serve. (TJH)

The viewpoints of contributors to the forum are reviewed. Many of the disagreements represent fundamental differences in what constitutes evaluation. All four authors agree that the formative/summative distinction is useful and will continue to be an important concept in program evaluation, although the distinction needs greater clarification.…

The Greater Avenues for Independence (GAIN) welfare-to-work program in California was evaluated by the Manpower Demonstration Research Corporation (MDRC). The evaluation relied on involvement of stakeholders, examination of program implementation, flexibility, the adaptation of evaluation questions and designs during the study, use of random…

A Chapter I evaluator reflects on developments in her role within the Title One/Chapter One Program through five phases. The phases were characterized, successively, by broad acceptance, defensiveness, indifference, negativity, and openness to criticism. (TJH)

In 1991, Michael Scriven published "Beyond Formative and Summative Evaluation," a reconsideration of the classic distinction in evaluation roles. Debate about the roles of evaluation continued in the four papers that follow this introduction, all of which were presented at a forum at the 1995 International Evaluation Conference. (SLD)

The formative-summative distinction in evaluation is defended as a reasonable way to classify evaluation activities. Context ultimately defines the formative or summative functions of evaluation. The characteristics of an evaluator are defined, and points of agreement with the other contributors to the forum are noted. (SLD)

Results of a survey of 564 Canadian and American evaluators and evaluation project descriptions provided by a subsample of 348 evaluators indicate that evaluators support a utilization-focused, stakeholder service orientation and think that maximizing evaluation use is a primary responsibility of evaluators. (SLD)

The use of focus groups by the Federal Bureau of Investigation as a tool of internal evaluation is described. Focus groups are used in an environment where credibility is key to achieving meaningful cooperation. Issues for consideration by other evaluators interested in the approach are summarized. (SLD)

The various arts and sciences that comprise the field of program evaluation are discussed. It is argued that emphasis on rigor and expressive content has left other aspects of evaluation unexplored. Educational evaluators need to consider what programs mean and how they contribute to understanding. (SLD)

The evaluator's roles--change agent, manager, resource person, interpreter, and liaison between the project and the funding agency--are described, concerning the evaluation of innovative projects in education. Difficulties in obtaining desired commitments (i.e., a project's financial commitments and its positive attitude toward the evaluation…