This document summarises key findings from the quantitative strands of a review of the Education Endowment Foundation (EEF) evaluations that had reported from the establishment of EEF in 2011 up to January 2019. The quantitative strands summarised include meta-analyses of effect sizes reported for attainment outcomes and descriptive analyses of…

The main objective of this review is to answer the following research questions: What are the effects of outreach programmes on problem/high-risk behaviour of young people between 8 and 25 years of age living in OECD countries? Are they less likely to experience an adverse outcome such as school failure or drop-out, runaway and homelessness,…

Background: Methods need to be further developed to include non-randomised studies (NRS) in systematic reviews of the effects of health care interventions. NRS are often required to answer questions about harms and interventions for which evidence from randomised controlled trials (RCTs) is not available. Methods used to review randomised…

Understanding the influence of multisite evaluation requires careful consideration of cultural context. The author illustrates dimensions of influence and culture with excerpts from four National Science Foundation evaluation case studies and summarizes what influence teaches everyone about culture and what culture teaches everyone about…

In this paper, the author considers certain aspects of the problem of obtaining unbiased information about the merits of a program or product, whether for purposes of decision making or for accountability. The evaluation of personnel, as well as the evaluation of proposals and evaluations, generally involves a different set of problems than those…

In this article, the authors consider the power and limitations of responsiveness-to-intervention (RTI) for reducing the need for ongoing and intensive services for the segment of the school population traditionally identified as having a learning disability in mathematics. To assess the robustness of RTI, the authors describe four studies with…

On the basis of a multistage exploration of evaluation texts, electronic searches, and nominations from the field and from managing social science, the author concludes there is little research literature on managing evaluation studies, evaluators and other workers, and evaluation units. The discussion explores what this limited literature tells…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

Business students are increasingly seeking international experience in short-term, study abroad programs to enhance their intercultural knowledge, intercultural communication skills, and global perspectives to be more competitive in the global arena. Intuitively, universities initiating these programs and the students sojourning abroad believe in…

This paper considers several of the key findings of the State of the Nation research. Specific reference is made to three areas--impact evaluation, strategic leadership of professional development, and barriers and constraints to effective CPD practice--which are considered with reference to findings from the other TDA-funded projects conducted at…

A large body of literature documents the central importance of fidelity of program implementation in creating an internally valid research design and considering such fidelity in judgments of research quality. The What Works Clearinghouse (WWC) provides web-based summary ratings of educational innovations and is the only rating group that is…

Syntheses of research on educational programs have taken on increasing policy importance. Procedures for performing such syntheses must therefore produce reliable, unbiased, and meaningful information on the strength of evidence behind each program. Because evaluations of any given program are few in number, syntheses of program evaluations must…

This Research Update synthesizes findings from the profiles of 15 research and evaluation reports added to the Out-of-School Time Program Research and Evaluation Database in December 2006. It highlights strategies for assessing program processes as well as key outcomes and features of programs that promote positive outcomes. The Harvard Family…

This report is the first of several to come from CASEL's major meta-analysis project. The report describes the strong positive effects after-school programs can have, and the conditions needed to realize these benefits. A meta-analysis to evaluate the magnitude of effects obtained from 73 programs was conducted. Outcomes were examined in three…

Even simple program theory evaluations could be used in meta-analysis to provide benefits. Explores several ways to combine program theory evaluation and meta-analysis, using a hypothetical model and an actual example from a federal funding program. Outlines four potential benefits to incorporating program theory evaluation into meta-analysis.…