The Greater Avenues for Independence (GAIN) welfare-to-work program in California was evaluated by the Manpower Demonstration Research Corporation (MDRC). The evaluation relied on involvement of stakeholders, examination of program implementation, flexibility, the adaptation of evaluation questions and designs during the study, use of random…

The various arts and sciences that comprise the field of program evaluation are discussed. It is argued that emphasis on rigor and expressive content has left other aspects of evaluation unexplored. Educational evaluators need to consider what programs mean and how they contribute to understanding. (SLD)

In spite of the scarcity of empirical studies of evaluation, such studies are critical to development of evaluation theory. Illustrative examples are given of studies of evaluation practice that operationalize theory. Although practitioners should continue public reflection, they must also focus on the independent and empirical study of…

Definitions of and approaches to naturalistic evaluation are discussed. The qualitative aspects of the discipline are reviewed; and use of naturalistic evaluation in descriptions, illustrations, explications, hypothesis testing, and assessment of public spending are defined. A new paradigm for naturalistic evaluation is proposed. (TJH)

Continuing the interchange of ideas about evaluation methodology, the authors argue the advisability of using the entire array of methods to produce useful and persuasive findings. There is, ultimately, a truth to be sought, but no one approach has a monopoly on finding it. (SLD)

Hypertextual ways to think about evaluation are explored, and hypertext computer programs are discussed. Hypertext is useful as a way to search out and link related material. It can help maintain, manipulate, and analyze nonnumerical evaluation data. (SLD)

The evolution of the field of program evaluation is discussed, assuming that current major trends will continue, especially the trend toward theory-driven evaluation. Participating in planning without compromising evaluators' integrity will be an important and challenging task for the future. (SLD)

The future of program evaluation is bright if evaluators do not ignore their roots in quantitative research. The current interest in qualitative approaches and the call for a "fourth generation" in evaluation should not override training in quantitative research. Qualitative research should complement, rather than replace, traditional…

A case study illustrates the ways in which local reactions to a program evaluation directly threaten its validity, and shows that not all participants in a qualitative evaluation study understand or defer to the commitments of democratic evaluation. Ethical concerns in program evaluation are considered. (SLD)