In this chapter, we revisit and expand the context framework of Debra Rog, informed by three cases and by new aspects that we have identified. We then propose a way to move the framework into action, making context explicit. Based on the framework's components, we describe and illustrate a process we label context assessment (CA), which provides a…

This chapter describes a concrete process that stakeholders can use to make predictions about the future performance of programs in local contexts. Within the field of evaluation, the discussion of validity as it relates to outcome evaluation seems to be focused largely on questions of internal validity (Did it work?) with less emphasis on…

Evaluation of programs or projects is often perceived as a threat. This is to a great extent related to the anticipated use of evaluation for accountability, which is often prioritized at the expense of using evaluation as a learning tool. Frequently it is argued that there is a trade-off between these two evaluation functions. An alternative…

Evaluation is typically carried out with the intention of making a difference in the understandings and actions of stakeholders and decision makers. The author provides a general review of the concepts of evaluation "use," evaluation "influence," and "influence pathways," with connections to multisite evaluations. The study of evaluation influence…

Understanding the influence of multisite evaluation requires careful consideration of cultural context. The author illustrates dimensions of influence and culture with excerpts from four National Science Foundation evaluation case studies and summarizes what influence teaches everyone about culture and what culture teaches everyone about…

What do the findings of four National Science Foundation evaluation case studies suggest to an evaluation scholar who was not part of the research team that created them? This chapter carefully reviews the cases and summarizes their comparative findings. The four Beyond Use case studies add to the literature on levels of evaluation use, with the…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

Internal evaluators encounter risks but also significant opportunities to strengthen organizational and professional ethics. Potential contributions depend, in part, on the conjunction of ethics and evaluation in the role of the internal evaluator as the person specially commissioned to investigate value and render judgment based on evidence…

Knowledge utilization is a field crossing many sectors, from agriculture, since the 1920s, to health care today. Evaluators have made long-standing contributions to understanding knowledge utilization. Different models or ways to think about knowledge utilization have evolved to reflect different perspectives, contexts, and stages of the process,…

This chapter describes the author's experience and insights as the chief of evaluation for public diplomacy at the U.S. Department of State, and as a consultant assisting federal agencies in a multitude of evaluation activities relating what helps and hinders internal evaluation functions. The article discusses the challenges faced by the internal…

This chapter features a recent conversation with Dr. Arnold J. Love, a long-time proponent of internal evaluation and one of the most cited internal evaluation authors. In 1983, Love edited the first issue of "New Directions for Program Evaluation" on the topic of internal evaluation. He is the author of the book "Internal…

The chapter explores critical roles of internal evaluators in contemporary organizational settings. The need is highlighted for an expanded, reconfigured, unorthodox set of roles and styles of work to meet the needs of the emerging learning organizations effectively. A discussion of major categories of internal evaluator roles emerged from the…

From the 1980s to the present, educational accountability in the United States has grown dramatically. Such accountability in U.S. school districts, although driven primarily by external demands, has internal manifestations as well. The chapter traces the historical development of internal evaluation in American school districts, then highlights…

Offers a vision of responsiveness as the political inclusion of marginalized human service providers and end users through one evaluator's critical and sustained efforts to enact this vision in practice. Discusses difficulties in the active inclusion of the critical reference group, usually service users, in evaluation. (SLD)

Presents an integrated theory of evaluation influence that is broader than previous constructs of use and includes the dimensions of source, intention, and time. The resulting framework addresses process-based use and results-based use; intended and unintended use; and episodic and instrumental use. (SLD)