Evaluation policy has been identified as an important means of shaping and influencing organizational evaluation practice, yet, to date, little empirical research has been conducted to deepen our understanding of this relationship. The purpose of this study was to illuminate evaluation policy's role in leveraging organizational capacity to do and…

This paper develops a novel approach called Outcome Trajectory Evaluation (OTE) in response to the long-causal-chain problem confronting the evaluation of research for development (R4D) projects. OTE strives to tackle four issues resulting from the common practice of evaluating R4D projects based on theory of change developed at the start. The…

This study explores the relationship between evaluation policies and evaluation practice. Through document analysis, interviews, and a multiple case study, the research examined the explicit and implicit policies overarching the evaluation work commissioned by the Robert Wood Johnson Foundation (RWJF) and explored how these policies are…

Researchers and policy makers are increasingly dissatisfied with the "average treatment effect." Not only are they interested in learning about the overall causal effects of policy interventions, but they want to know what specifically it is about the intervention that is responsible for any observed effects. In the U.S., using…

Since the early 2000s, a significant number of programs and policies have been developed and implemented to prevent and combat human trafficking. At the international, regional and national levels, government, and international, and nongovernment organizations have established plans of action, conducted training, developed policy tools, and…

Despite bipartisan support in Washington, DC, which dates back to the mid-1990s, the "what works" approach has yet to gain broad support among policymakers and practitioners. One way to build such support is to increase the usefulness of program impact evaluations for these groups. We describe three ways to make impact evaluations more…

This article presents a discourse analytic study of how the concept of impartiality is socially constructed by members of the development aid community through an examination of linguistic traits and patterns within (a) inter- and intraorganizational interactions and (b) relevant aid evaluation policy documents. A qualitative analysis of…

In evaluating local policy implementation, workaround stories--accounts of deliberate efforts to evade, subvert, or even break rules or procedures in order to get the job done--are valuable evaluative indicators. By "backward mapping" (Elmore, 1979) from frequently mentioned workarounds, we can identify flawed elements of policy- or…

Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…

In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

The international community has identified a positive link between good governance and economic development. There is an increasing appreciation of the effective role that local policy research organizations (PROs) can play in providing evidence-based policy recommendations as the basis for sound legislation and in assessing the efficacy of…

Deliberative democracy has attracted increasing attention in political science and has been suggested as a normative ideal for evaluation. This article analyzes to what extent evaluations carried out in a highly government-driven manner can nevertheless contribute to deliberative democracy. This potential is examined by taking the Organisation for…