Despite bipartisan support in Washington, DC, which dates back to the mid-1990s, the "what works" approach has yet to gain broad support among policymakers and practitioners. One way to build such support is to increase the usefulness of program impact evaluations for these groups. We describe three ways to make impact evaluations more…

Evaluation of programs or projects is often perceived as a threat. This is to a great extent related to the anticipated use of evaluation for accountability, which is often prioritized at the expense of using evaluation as a learning tool. Frequently it is argued that there is a trade-off between these two evaluation functions. An alternative…

Despite a political climate demanding evidence-informed decision making in education both within individual countries and at the international level, empirically grounded European research in this field is scarce. This paper reports on a European Commission-funded study that sought to identify and analyze different initiatives across Europe aimed…

Within an RtI problem-solving context, assessment and decision making generally center around the tasks of problem identification, problem analysis, progress monitoring, and program evaluation. We use this framework to discuss the current state of the literature regarding curriculum based measurement, its technical properties, and its utility for…

Background: Research on evaluation use focuses on putting evaluation recommendations into practice. Prior theoretical research proposes varied frameworks for understanding the use (or lack) of program evaluation results. Purpose: Our purpose is to create and test a single, integrated framework for understanding evaluation use. This article relies…

Anecdotal evidence from interviews with some program managers gives evidence that unintended negative consequences of evaluations are more than a theoretical concern; they are a real problem deserving an evaluator's attention and energy. Negative consequences usually include: (1) wasted resources; (2) demotivation; and (3) program destruction and…

In spite of the scarcity of empirical studies of evaluation, such studies are critical to development of evaluation theory. Illustrative examples are given of studies of evaluation practice that operationalize theory. Although practitioners should continue public reflection, they must also focus on the independent and empirical study of…

Evaluators must use a flexible, open-minded approach oriented toward a holistic view of the implementation and operation of the program they are analyzing. The use of more than one methodology expands the potential findings and avoids the limitations of a unidimensional approach. (SLD)

The five articles of this sourcebook, organized around the five-component framework for evaluation described by W. Shadish, T. Cook, and L. Leviton (1991), present a new theory of realist evaluation that captures the sensemaking contributions of postpositivism and the sensitivity to values from the constructivist traditions. (SLD)

Twelve articles discuss the advantages of theory-driven evaluation for: (1) identifying crucial issues; (2) integrating program implementation into evaluation; (3) diagnosing problems in program studies; (4) diagnosing problems in program structures; and (5) enhancing evaluation utilization. Topics include optimizing validity in program and…

During the past 3 years, the Oral History Project Study Team, which comprises Jean King, Mel Mark, and Robin Miller, has conducted interviews with individuals who have made signal contributions to the program evaluation field. Their goal was to capture the professional evolution of those who have contributed to the way evaluation in the United…

In program evaluation and policy analyses, utility supplants rigor as the first and most important criterion in judging literature reviews. Although R. T. Ogawa and B. Malen emphasize rigor, a utilization-focused evaluation emphasizes purpose and audience, both of which affect the conduct of a multivocal literature review. (SLD)

Program design can aid problem-solving or decision-making tasks faced by evaluators. It can be used to facilitate evaluation planning through the definition of program boundaries and the generation and focusing of evaluation questions. Further, it can provide evaluation information about theoretical, historical, and political contexts of a…

Evaluation and strategic management are related in that each attempts to improve the quality of policy decisions and each has evolved from a product-centered focus to one in which implementation and utilization are vital. Evaluators should understand strategic management theory to evaluate its applications appropriately. (SLD)

One of a series of booklets on disability research, this paper is intended as an introduction to the role of evaluation in the utilization process. Its purpose is to help disability researchers grasp the importance of incorporating a focus on assessing use into plans for disseminating research outcomes. The paper begins by examining basic…