The use of the Nominal Group Technique to identify areas for formative evaluation is described. Group characteristics, pertinent group questions, and advantages of the method are outlined. The process depersonalizes results, puts individual concerns into perspective, and focuses on improving the program (not on blaming or evaluating personnel).…

A survey was sent to members of the Evaluation Use Topical Interest Group (TIG) to determine their perceptions about and experiences with evaluation use. Responses from 282 members show agreement on the major purposes of evaluation and an increased use of performance-results oriented and formative evaluations. (SLD)

Areas of evaluation are identified in which the formative/summative distinction appears inadequate: (1) knowledge-generating evaluations aimed at conceptual use; (2) developmental evaluation; and (3) use of evaluation to support intervention or empower participants. An argument is also made for the effectiveness of feedback that cannot be…

The viewpoints of contributors to the forum are reviewed. Many of the disagreements represent fundamental differences in what constitutes evaluation. All four authors agree that the formative/summative distinction is useful and will continue to be an important concept in program evaluation, although the distinction needs greater clarification.…

In 1991, Michael Scriven published "Beyond Formative and Summative Evaluation," a reconsideration of the classic distinction in evaluation roles. Debate about the roles of evaluation continued in the four papers that follow this introduction, all of which were presented at a forum at the 1995 International Evaluation Conference. (SLD)

Performance measurement can serve both formative and summative evaluation functions. Formative evaluation is typically more useful for government purposes whereas performance measurement is more useful than one-shot evaluations of either formative or summative nature. Evaluators should study performance measurement through case studies and…

The formative-summative distinction in evaluation is defended as a reasonable way to classify evaluation activities. Context ultimately defines the formative or summative functions of evaluation. The characteristics of an evaluator are defined, and points of agreement with the other contributors to the forum are noted. (SLD)

The formative/summative evaluation dichotomy suggested by M. Scriven is challenged, and a conceptual typology is presented that crosses improvement and assessment evaluation functions with process and outcome program stages for four basic types of evaluation. This framework accommodates mixed types of evaluations. (SLD)

The evaluator's roles--change agent, manager, resource person, interpreter, and liaison between the project and the funding agency--are described, concerning the evaluation of innovative projects in education. Difficulties in obtaining desired commitments (i.e., a project's financial commitments and its positive attitude toward the evaluation…

Proposals satisfy a number of functions in evaluation work. This article examines how these functions differ depending on whether the proposal concerns a preordinate study in which methods are prespecified or an emergent study in which decisions about methods are made as the study proceeds. (Author/SLD)

The use of the vignette method with a small group of respondents over a two-year teacher enhancement project sponsored by the National Science Foundation is described, and the usefulness of the method is reviewed. Vignette data provide material sufficient to answer evaluation questions. (SLD)

Unless more resources are devoted to the development of social programs, summative evaluation will increasingly become a waste of time. Formative evaluation and tactical research will become more important to the extent that they actively assist in creation of social programs, increasing challenges to the integrity and validity of their work. (SLD)

A good formative evaluator, who helps programs become as effective as possible, behaves remarkably like a good personal coach. Nine ways in which a formative evaluator can help a program manager are listed, and implications for practicing evaluators and the evaluation profession are detailed. (SLD)

Discusses the importance of modeling effective evaluation practice as teachers teach about evaluation. Using the critical incidents evaluation tool and process students in graduate evaluation courses were asked to reflect on their learning of modeling formative evaluation throughout the course as a way to teach about evaluation practice. (SLD)

Four forms of evaluation are outlined: (1) evaluation and development; (2) design evaluation; (3) process evaluation; and (4) summative evaluation. Each form is understood through five dimensions (orientation, state, focus, timing, and approach), which are illustrated through evaluation of a community services training program in Australia. (SLD)