Areas of evaluation are identified in which the formative/summative distinction appears inadequate: (1) knowledge-generating evaluations aimed at conceptual use; (2) developmental evaluation; and (3) use of evaluation to support intervention or empower participants. An argument is also made for the effectiveness of feedback that cannot be…

Reflections on the politics of program evaluation are presented. Topics discussed include policy question development and translation into evaluation questions, translation of evaluation questions into the evaluation proper, translation of evaluation findings into policy, and generation of new policy questions. (TJH)

It is argued that reports of evaluation activities often leave much to be desired because they fail to portray the real trial-and-error processes of the research study and do not report on the logic in use at the time of the inquiry. (SLD)

Performance measurement can serve both formative and summative evaluation functions. Formative evaluation is typically more useful for government purposes whereas performance measurement is more useful than one-shot evaluations of either formative or summative nature. Evaluators should study performance measurement through case studies and…

The formative-summative distinction in evaluation is defended as a reasonable way to classify evaluation activities. Context ultimately defines the formative or summative functions of evaluation. The characteristics of an evaluator are defined, and points of agreement with the other contributors to the forum are noted. (SLD)

The construct "multicultural validity" is proposed as the vehicle for organizing concerns about pluralism and diversity in evaluation and as a way to reflect on the cultural boundness of evaluation. It should be conceptualized as a central dimension of validity and a viable focus of concern in evaluation theory. (SLD)

The author recounts how certain things have remained constant even though his work focus had changed from a concentration on human services and substance abuse to evaluating the impact of computer networks. Balancing the requirements of good methodology with the needs of decision makers remains central. (SLD)

The various arts and sciences that comprise the field of program evaluation are discussed. It is argued that emphasis on rigor and expressive content has left other aspects of evaluation unexplored. Educational evaluators need to consider what programs mean and how they contribute to understanding. (SLD)

The formative/summative evaluation dichotomy suggested by M. Scriven is challenged, and a conceptual typology is presented that crosses improvement and assessment evaluation functions with process and outcome program stages for four basic types of evaluation. This framework accommodates mixed types of evaluations. (SLD)

Definitions of and approaches to naturalistic evaluation are discussed. The qualitative aspects of the discipline are reviewed; and use of naturalistic evaluation in descriptions, illustrations, explications, hypothesis testing, and assessment of public spending are defined. A new paradigm for naturalistic evaluation is proposed. (TJH)

Assessing results of grants programs is illustrated with evaluation activities of the National Science Foundation and other federal agencies. Methods considered are ex-ante peer review of proposed work, ex-post peer review of completed work, publications-based methods, and "look-back" methods tracing contributions of past work and…

An overview is given of four evaluation studies conducted to determine the need for and possible parameters of a "postinterstate" highway policy. How these studies sought to provide cumulative information for policy makers is discussed. They investigated the scope of problems, the federal role, cost issues, and technology. (SLD)

It is time for the field of evaluation to recognize that the ability to serve policy depends as much on what is understood about how politics works as it does on the quality and appropriateness of evaluation methods. Evaluations must be defensible as the political mix changes. (SLD)

The history of the African people before slavery and colonization illustrates the ways in which different pictures of reality are created by which data are selected and ignored. The model of inquiry that verifies historical accuracy can help all program evaluators provide greater truth and equity for their clients. (SLD)

Introducing a wider perspective of evaluation into the school by developing school-based evaluation mechanisms is discussed. The approach is based on conceptual development derived from U.S. perspectives on program evaluation, actual work in schools with teachers and principals in Israel, and empirical studies in the United States. (SLD)