Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

In recent years, there has been increased attention regarding systems-level implementation to support the sustained use of evidence-based interventions and supports in authentic early childhood settings. With this comes a need to accurately measure implementation fidelity of the critical features within a framework as well as individual practices.…

Conducting classroom-based educational research trials is important for establishing the efficacy and effectiveness of specific instructional interventions. Such endeavours, however, are challenging to implement. This was made evident during a recent independent evaluation of the efficacy of the MiniLit program, wherein various difficulties…

Purpose: This paper evaluates the implementation of a school-based physical activity intervention and discusses how the intervention outcomes can be influenced by the implementation. Design/methodology/approach: In four of the nine lower secondary schools in which the intervention was conducted, the authors examined implementation fidelity,…

Treatment fidelity assessment is critical to evaluating the extent to which interventions, such as the Good Behavior Game, are implemented as intended and impact student outcomes. The assessment methods by which treatment fidelity data are collected vary, with direct observation being the most popular and widely recommended. The current study…

We sought to identify, examine, and summarize empirical literature focused on early childhood behavior interventions examined using a single case research designs (SCD) and published between 2001 and 2018. Using systematic procedures, 28 studies that met established inclusion criteria were identified, reviewed, and compared with respect to general…

This quantitative correlational study dives into the heart of understanding the significance of model fidelity for implementing school threat assessment teams. The target population was instructional staff and threat assessment team members from schools in Dutchess, Putnam, and Westchester Counties in New York State that use the Comprehensive…

The purpose of this study was to evaluate the implementation of the "Phonics First"® program within one district to inform district level curriculum team decisions and program planning moving forward. As a level 4 Directed State Support district, the studied district was looking for ways to close the achievement gap and raise overall…

This report presents findings from exploratory, descriptive meta-analyses of effect sizes reported by the first 82 EEF evaluations that used a randomised controlled trial (RCT) or clustered RCT impact evaluation design published up to January 2019. The review used a theoretical framework derived from literature with five overarching themes to…

This document summarises key findings from the quantitative strands of a review of the Education Endowment Foundation (EEF) evaluations that had reported from the establishment of EEF in 2011 up to January 2019. The quantitative strands summarised include meta-analyses of effect sizes reported for attainment outcomes and descriptive analyses of…

This document provides supplementary statistical tables to support the review of Education Endowment Foundation (EEF) evaluations. This includes: (1) Descriptive (univariate) tables for all explanatory variables; (2) Tables for the meta-analyses of primary ITT effect sizes; (3) Tables for the meta-analyses of secondary ITT effect sizes; (4) Tables…

The purpose of the "Drivers Best Practices Assessment" ("DBPA") is to assist organizations in assessing their current supports and resources for quality use of selected programs or practices. Specifically, organizations can use it to: (1) Identify strengths and opportunities for improvement in their current supports and…

The foster youth education program strives to increase graduation rates by improving academic performance and encouraging student retention through an innovative collaboration between tutors, social workers, and schools to provide individualized support. The pilot program was funded by U.S. Department of Education Innovation Funds, which evolving…

Monitoring fidelity of implementation is a critical task when initiating evidence-based programs. This pilot study sought to identify best practices in a fidelity monitoring process and determine the feasibility of continuing a fidelity monitoring process with a multisite, multiprogram initiative. A fidelity log was created for each of 11…