Areas of evaluation are identified in which the formative/summative distinction appears inadequate: (1) knowledge-generating evaluations aimed at conceptual use; (2) developmental evaluation; and (3) use of evaluation to support intervention or empower participants. An argument is also made for the effectiveness of feedback that cannot be…

The viewpoints of contributors to the forum are reviewed. Many of the disagreements represent fundamental differences in what constitutes evaluation. All four authors agree that the formative/summative distinction is useful and will continue to be an important concept in program evaluation, although the distinction needs greater clarification.…

In 1991, Michael Scriven published "Beyond Formative and Summative Evaluation," a reconsideration of the classic distinction in evaluation roles. Debate about the roles of evaluation continued in the four papers that follow this introduction, all of which were presented at a forum at the 1995 International Evaluation Conference. (SLD)

Performance measurement can serve both formative and summative evaluation functions. Formative evaluation is typically more useful for government purposes whereas performance measurement is more useful than one-shot evaluations of either formative or summative nature. Evaluators should study performance measurement through case studies and…

The formative-summative distinction in evaluation is defended as a reasonable way to classify evaluation activities. Context ultimately defines the formative or summative functions of evaluation. The characteristics of an evaluator are defined, and points of agreement with the other contributors to the forum are noted. (SLD)

The formative/summative evaluation dichotomy suggested by M. Scriven is challenged, and a conceptual typology is presented that crosses improvement and assessment evaluation functions with process and outcome program stages for four basic types of evaluation. This framework accommodates mixed types of evaluations. (SLD)

Proposals satisfy a number of functions in evaluation work. This article examines how these functions differ depending on whether the proposal concerns a preordinate study in which methods are prespecified or an emergent study in which decisions about methods are made as the study proceeds. (Author/SLD)

The use of the vignette method with a small group of respondents over a two-year teacher enhancement project sponsored by the National Science Foundation is described, and the usefulness of the method is reviewed. Vignette data provide material sufficient to answer evaluation questions. (SLD)

Unless more resources are devoted to the development of social programs, summative evaluation will increasingly become a waste of time. Formative evaluation and tactical research will become more important to the extent that they actively assist in creation of social programs, increasing challenges to the integrity and validity of their work. (SLD)

A good formative evaluator, who helps programs become as effective as possible, behaves remarkably like a good personal coach. Nine ways in which a formative evaluator can help a program manager are listed, and implications for practicing evaluators and the evaluation profession are detailed. (SLD)

Discusses the importance of modeling effective evaluation practice as teachers teach about evaluation. Using the critical incidents evaluation tool and process students in graduate evaluation courses were asked to reflect on their learning of modeling formative evaluation throughout the course as a way to teach about evaluation practice. (SLD)

Four forms of evaluation are outlined: (1) evaluation and development; (2) design evaluation; (3) process evaluation; and (4) summative evaluation. Each form is understood through five dimensions (orientation, state, focus, timing, and approach), which are illustrated through evaluation of a community services training program in Australia. (SLD)

Hypertextual ways to think about evaluation are explored, and hypertext computer programs are discussed. Hypertext is useful as a way to search out and link related material. It can help maintain, manipulate, and analyze nonnumerical evaluation data. (SLD)

Five steps for conducting a midterm evaluation of teaching rather than a standardized end-of-class evaluation are presented. Example outcomes are given, and observations about the process are discussed. Multiple values of midterm course evaluations are apparent for students, the instructor, and the designated evaluation facilitator. (SLD)