Evaluation professionals need to be nimble and innovative in their approaches in order to be relevant and provide useful evidence to decision-makers, stakeholders, and society in the crowded public policy landscape. In this article, we offer serious games as a method that can be employed by evaluators to address three persisting challenges in…

What do the findings of four National Science Foundation evaluation case studies suggest to an evaluation scholar who was not part of the research team that created them? This chapter carefully reviews the cases and summarizes their comparative findings. The four Beyond Use case studies add to the literature on levels of evaluation use, with the…

Data are only useful if people are able to access, understand and use them. Without access to the right information, stakeholders are forced to make decisions based on anecdote, experience or instinct. For information to be useful, it must be timely, readily available, and easy to understand. This brief highlights the importance of implementing…

State education data systems have often been described as data rich but information poor. Historically, these systems were created for compliance purposes and, therefore, designed and managed as information technology projects, but a culture change is under way. Educators and other stakeholders are beginning to value data as a tool to inform…

The "use of evaluation" once meant the use of evaluation results for making program decisions, but there is a new awareness of the possibility of using many aspects of evaluation. This paper highlights the importance of considering additional prospective users of evaluation, including organizers, client groups, and civil society. (Author/SLD)

Conceptualizes key differences between management and leadership as a basis for suggesting ways in which evaluators might operate to serve the decision-making needs of organizational leaders. Evaluators will provide maximum leverage if they work directly with the leadership to promote review and change. (SLD)

The user-oriented and utilization-focused evaluation design of the two-year Caribbean Agricultural Extension Project, funded by Aid to International Development, is reviewed. The evaluation scope, stakeholders, evaluation team credibility, official approval of evaluation, and confidence in the evaluation process are addressed, within a…

Discusses what it means to be a caring stakeholder and a participatory evaluator in the context of public and private domains using the example of a parent who is an evaluator of an afterschool program. Offers a perspective on the capacity of individual evaluators to deal with role strain. (SLD)

Ten functions of program theory are reviewed: contributing to social science knowledge; assisting policymakers, discriminating between theory failure and program failure, identifying the problem and target group, providing program implementation description, uncovering unintended effects, specifying intervening variables, improving formative use…

Evaluation Voices is an approach to evaluation that assumes that programs with similar goals can strengthen their evaluation strategies through cluster networking as they build evaluation expertise from within. Evaluators focus on a process that: (1) begins with program staff and stakeholders sharing their vision for the program; (2) recognizes…

This paper proposes a model to establish which criteria are considered by stakeholders as valid for evaluating a program. The model is developed with the aim of increasing the credibility and use of evaluations. Stakeholders are involved in the identification of potential evaluation criteria, and ratings of validity and priority are used as the…