This chapter describes a concrete process that stakeholders can use to make predictions about the future performance of programs in local contexts. Within the field of evaluation, the discussion of validity as it relates to outcome evaluation seems to be focused largely on questions of internal validity (Did it work?) with less emphasis on…

Evaluation of programs or projects is often perceived as a threat. This is to a great extent related to the anticipated use of evaluation for accountability, which is often prioritized at the expense of using evaluation as a learning tool. Frequently it is argued that there is a trade-off between these two evaluation functions. An alternative…

Understanding the influence of multisite evaluation requires careful consideration of cultural context. The author illustrates dimensions of influence and culture with excerpts from four National Science Foundation evaluation case studies and summarizes what influence teaches everyone about culture and what culture teaches everyone about…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

Internal evaluators encounter risks but also significant opportunities to strengthen organizational and professional ethics. Potential contributions depend, in part, on the conjunction of ethics and evaluation in the role of the internal evaluator as the person specially commissioned to investigate value and render judgment based on evidence…

This chapter describes the author's experience and insights as the chief of evaluation for public diplomacy at the U.S. Department of State, and as a consultant assisting federal agencies in a multitude of evaluation activities relating what helps and hinders internal evaluation functions. The article discusses the challenges faced by the internal…

This chapter features a recent conversation with Dr. Arnold J. Love, a long-time proponent of internal evaluation and one of the most cited internal evaluation authors. In 1983, Love edited the first issue of "New Directions for Program Evaluation" on the topic of internal evaluation. He is the author of the book "Internal…

The chapter explores critical roles of internal evaluators in contemporary organizational settings. The need is highlighted for an expanded, reconfigured, unorthodox set of roles and styles of work to meet the needs of the emerging learning organizations effectively. A discussion of major categories of internal evaluator roles emerged from the…

From the 1980s to the present, educational accountability in the United States has grown dramatically. Such accountability in U.S. school districts, although driven primarily by external demands, has internal manifestations as well. The chapter traces the historical development of internal evaluation in American school districts, then highlights…

Setting the context for this theme issue on responsive evaluation, this article describes the core ideas of Robert Stake's responsive evaluation, presenting them as originally framed and discussing their evolution over time. Explains that the rhetoric and ethic of responsive evaluation is to be open, to find more than the initial issues. (SLD)

While legislative oversight offices, like many evaluation and policy analysis units, face substantial challenges in promoting use of their work by policymakers, they often have not taken steps to overcome these challenges by adopting the strategies suggested by the evaluation literature. Although the offices seek utilization, they have not fully…

Makes the case that responsiveness is a virtue, in evaluation as in everyday life, rather than merely a methodological tool for use in evaluation. Extends this concept using ideas from the Aristotelian tradition of practical philosophy as elaborated in recent works on hermeneutic philosophy. (SLD)

Examined the stages of evaluation practice and use at a national multisite community service program with an internal evaluation department. Reviews challenges to evaluation use and organizational supports for it and discusses the integrated theory of use of K. Kirkhart (2000) at both site and national levels. Summarizes lessons learned in this…

The seven chapters of this volume demonstrate that evaluation evidence can overturn widely held beliefs and result in changes in programs and policies. These chapters show that policymakers can welcome findings that challenge long-established ideas and use them to Improve programs and services. (SLD)

Provides a historical accounting of the work of early African American educational evaluators to show the critical place of race and culture in both historical and contemporary visions of responsive evaluation. Discusses reasons their work has so largely been ignored. (SLD)