Since 2007, two taxonomies have been proposed to identify the components of evaluation practice that may be specified in an evaluation policy. Little is known, however, about how these taxonomies align with evaluation policies developed by philanthropic foundations. Through thematic analysis, this article first compares 12 foundation evaluation…

The U.S. Department of Education (Education) plays a key role in supporting educational opportunities for K-12 students, including awarding grants and overseeing compliance with federal education laws. Over the past decade, Education's grant awards have generally increased in number and size. Using Education budget data, it was determined that in…

Selection bias pervades the evaluation of supplemental instruction (SI) in non-experimental settings. This brief note provides a formal framework to understand this issue. The objective is to contribute to the accumulation of credible evidence on the impact of SI.

Practitioners are being placed under increasing pressure to evaluate the success of their outreach activities, both by government and by their own universities. Based in a reductionist doctrine of "evidence-based practice", there is a desire to demonstrate the effectiveness and value-for-money across activities that now account for…

Tiered evidence initiatives are an important federal strategy to incentivize and accelerate the use of rigorous evidence in planning, implementing, and assessing social service investments. The Social Innovation Fund (SIF), a program of the Corporation for National and Community Service, adopted a public-private partnership approach to tiered…

Since the early 1990s, lifelong learning has become a major policy concern for the European Union, being seen as a means for enabling individuals to be more competitive in social and economic contexts that are continually changing. After a series of white papers and strategies in the field of lifelong learning, the EU launched the Lifelong…

While regression discontinuity has usually been applied retrospectively to secondary data, it is even more attractive when applied prospectively. In a prospective design, data collection can be focused on cases near the discontinuity, thereby improving internal validity and substantially increasing precision. Furthermore, such prospective…

Research on school leadership has highlighted the impact principals have on student achievement through their influence on classroom instruction, organizational conditions, community support, and setting the teaching and learning conditions in schools. However, there is limited rigorous quantitative research on the best district policies and…

The paper examines the benefits claimed for action learning at individual, organisational and inter-organisational levels. It goes on to identify both generic difficulties in evaluating development programmes and action learning specifically. The distinction between formative and summative evaluation is considered and a summative evaluation…

Background: Recent reviews suggest that many plausible programs are found to have at best small impacts not commensurate with their cost, and often have no detectable positive impacts at all. Even programs with initial rigorous impact evaluation (RIE) that show them to be effective often fail a second test with an expanded population or at…

Ronald Hughes, Judith Rycus, and their colleagues have produced a seminal review of differential response (DR) programs implemented across the nation. Their review questions nearly every aspect of the DR movement, beginning with the concept on which all DR programs are based and ending with serious concerns about the quality of evaluations…

With increased pressure on programs to evaluate outcomes, the issue of evaluation in social work has never been so topical. In response to these pressures, there has been a growing interest in evidence-based practice and strategies for the evaluation of social work programs. The American Evaluation Association (AEA) is an international…

The Safe Schools/Healthy Students (SS/HS) national evaluation seeks to assess both the implementation process and the results of the SS/HS initiative, exploring factors that have contributed to or detracted from grantee success. Each site is required to forge partnerships with representatives from education, mental health, juvenile justice, and…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

Why do we continue to see evidence that nonprofit staff feel like outcome measurement is missing important aspects of their work? Based on an analysis of over 1,000 pages of material in 10 outcome measurement guides and a focused literature review of frontline work in three types of nonprofit organizations, this article shows that existing outcome…