Despite bipartisan support in Washington, DC, which dates back to the mid-1990s, the "what works" approach has yet to gain broad support among policymakers and practitioners. One way to build such support is to increase the usefulness of program impact evaluations for these groups. We describe three ways to make impact evaluations more…

Papers in this collection explore alternative and nontraditional approaches to evaluation. They provide options, speculations, and propositions that affect each thinker's ideas on how to trace the impact of National Science Foundation-supported programs. Organized around a central theme of footprints as evidence of a program's impact, the papers…

This review offers a general theory of utilization of educational evaluation and considers factors affecting utilization, including evaluation context factors and evaluator-controlled factors. Special challenges in evaluating programs for gifted students and design shortcomings common in evaluation of such programs are identified. Specific…

Strengths and weaknesses of three types of semiquantitative methods used by the federal government in research impact assessment are presented, and examples of their use are reviewed. These include the classic retrospective method, another retrospective approach, and accomplishments books used by selected research-sponsoring organizations. (SLD)

A useful evaluation of an education program is one that adds to the body of timely, relevant evidence to increase the likelihood that policy decisions improve program performance. This definition focuses on performance rather than change and recognizes that studies can't guarantee the use of their findings but can only increase the likelihood of…

The history of research and development (R&D) and its evaluation within the 3M Company are traced as an example of the progression of the use of evaluation and evaluation techniques. Scoring methods, cost-benefit analysis, and risk analysis have been among the most frequently used program evaluation methods. (SLD)

This essay focuses on a key change that the author has experienced in the practice of program evaluation research over the past 20 years: the accommodation of the logic of science and the psychology of politics. This change has substantially altered the role of the evaluator, the evaluator's relationship with clients, the design of an evaluation…

Articles in this special issue deal with the assessment of the impact of research and are divided into segments concerning semiquantitative approaches; qualitative approaches; and quantitative and fiscal approaches. These articles illustrate the importance of the role of motivation and associated incentives. (SLD)