This paper develops a novel approach called Outcome Trajectory Evaluation (OTE) in response to the long-causal-chain problem confronting the evaluation of research for development (R4D) projects. OTE strives to tackle four issues resulting from the common practice of evaluating R4D projects based on theory of change developed at the start. The…

The Cochrane COVID-19 Study Register (CCSR) is a public, continually updated database of COVID-19 study references. The aim of this study-based register is to support rapid and living evidence synthesis, including an evidence ecosystem of COVID-19 research (CEOsys). In November and December 2020, we conducted an evaluation of the CCSR for CEOsys,…

Background: Evidence syntheses provide the basis for evidence-based decision making in healthcare. To judge the certainty of findings for the specific decision context evidence syntheses should consider context suitability (ie, generalizability, external validity, applicability or transferability). Our objective was to determine the status quo and…

This document synthesizes the findings from the evaluations of four statewide programs designed to provide support for underperforming schools and districts in California as part of the state accountability system: (1) Immediate Intervention/Underperforming Schools Program (II/USP); (2) High Priority Schools Grant (HPSG) Program; (3) School…

Evaluating teachers' professional development initiatives (PDI) is one of the main challenges for the teacher professionalisation field. Although different studies have focused on the effectiveness of PDI, the obtained effects and evaluative methods have been found to be widely divergent. By means of a narrative review, this study provides an…

Special education in Saudi Arabia was formally established in 1962. The earliest cited literature on special education written in English was a 1970 government report. This article presents results from the first synthesis of internationally published Saudi special education literature over a 44-year period. This synthesis yielded information…

The Success By 6® (SB6) initiative is designed to support early care and education centers in improving and sustaining quality in Pennsylvania's Keystone STARS Quality Rating and Improvement System (QRIS). This SB6 evaluation report examines implementation and outcomes. The findings have implications for SB6 continous quality improvement process…

The Success By 6® (SB6) initiative is designed to support early care and education centers in improving and sustaining quality in Pennsylvania's Keystone STARS Quality Rating and Improvement System (QRIS). The SB6 evaluation report examines implementation and outcomes. The findings have implications for SB6 continous quality improvement process…

The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…

The number of students attending afterschool programs has skyrocketed in recent years, currently serving an estimated 8.4 million children (Afterschool Alliance, 2009). Consequently, the demand for high quality afterschool programs, and to learn from successful ones, has never been greater. This "Making Afterschool Programs Better"…

In this article we give a systematic review of the nature and design of earlier research into the impact of instructional development in higher education. Studies are clustered on the basis of the level of outcome that was measured, meaning that another synthesis technique is used than in prior reviews related to the same topic. In addition, we…

Research syntheses are appealing because they enable decision makers to determine quickly whether policies, programs, and practices will have effects on student achievement and, if so, the magnitudes of the likely effects. Such syntheses should present objective, clear, scientifically accurate, and defensible evidence in terms that educators can…

Syntheses of research on educational programs have taken on increasing policy importance. Procedures for performing such syntheses must therefore produce reliable, unbiased, and meaningful information on the strength of evidence behind each program. Because evaluations of any given program are few in number, syntheses of program evaluations must…

The Bill and Melinda Gates Foundation created the Early College High School Initiative in 2002, opening more than 200 hundred early college programs across the nation and every year a new report is created to evaluate the progress of the program (Berger, Adelman, & Cole, 2010). Staff at the Regional Educational Laboratory Southeast (REL-SE)…

Traditional methods for preparing systematic reviews and syntheses of effectiveness studies rely on a limited set of methodological criteria to include studies that measure and report effects too narrowly to forward the mission of evidence-based practice. This article discusses why and how the criteria for study selection, evidence screening, and…