Enhancing student learning, a primary purpose of assessment, can be fostered through integrating modified program theory and implementation fidelity processes into curricular, instructional, and assessment practices. Another assessment priority, reporting student learning outcome results for accreditation which may include inadequate evidence…

With increasing canonicity, particularly within higher education assessment, the demonstrable achievement of goals, or the delivery of a program, or as one scholar wryly deemed it, the "manipulation of the independent variable" (Moncher and Prinz 1991, p. 247), are commonly referred to as implementation fidelity or fidelity of…

Positive behavior support (PBS) is an evidence-based framework for improving quality of life and preventing challenging behavior that is often implemented in combination with person-centered practices in the intellectual and developmental disability (IDD) field. Recently, state agencies and organizations supporting people with IDD have adopted a…

Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

Fidelity is defined as doing what is intended. The purpose of measuring fidelity is to assist with supporting implementation. Collecting fidelity data provides an opportunity to problem-solve throughout the process versus waiting for outcome data. More often than not, purchased programs and curriculum materials are missing a research-validated…

In recent years, there has been increased attention regarding systems-level implementation to support the sustained use of evidence-based interventions and supports in authentic early childhood settings. With this comes a need to accurately measure implementation fidelity of the critical features within a framework as well as individual practices.…

Purpose: This paper evaluates the implementation of a school-based physical activity intervention and discusses how the intervention outcomes can be influenced by the implementation. Design/methodology/approach: In four of the nine lower secondary schools in which the intervention was conducted, the authors examined implementation fidelity,…

Treatment fidelity assessment is critical to evaluating the extent to which interventions, such as the Good Behavior Game, are implemented as intended and impact student outcomes. The assessment methods by which treatment fidelity data are collected vary, with direct observation being the most popular and widely recommended. The current study…

We sought to identify, examine, and summarize empirical literature focused on early childhood behavior interventions examined using a single case research designs (SCD) and published between 2001 and 2018. Using systematic procedures, 28 studies that met established inclusion criteria were identified, reviewed, and compared with respect to general…

This quantitative correlational study dives into the heart of understanding the significance of model fidelity for implementing school threat assessment teams. The target population was instructional staff and threat assessment team members from schools in Dutchess, Putnam, and Westchester Counties in New York State that use the Comprehensive…

The purpose of this study was to evaluate the implementation of the "Phonics First"® program within one district to inform district level curriculum team decisions and program planning moving forward. As a level 4 Directed State Support district, the studied district was looking for ways to close the achievement gap and raise overall…

Background/Context: Funders, researchers and developers share an interest in applying rapid cycle evaluation techniques in education (McNall & Foster-Fishman, 2007; Resch, 2016). Both rapid-cycle and other evaluation processes require monitoring the quality of implementation (Moir, 2018). By quickly monitoring and adjusting implementation,…

There are several widely used Positive Behavioral Interventions and Supports (PBIS) implementation fidelity measures, including the Schoolwide Evaluation Tool (SET), but there is limited empirical investigation substantiating the association between specific fidelity cut point scores and student outcomes. This article examined different SET cut…

This report presents findings from exploratory, descriptive meta-analyses of effect sizes reported by the first 82 EEF evaluations that used a randomised controlled trial (RCT) or clustered RCT impact evaluation design published up to January 2019. The review used a theoretical framework derived from literature with five overarching themes to…

This document summarises key findings from the quantitative strands of a review of the Education Endowment Foundation (EEF) evaluations that had reported from the establishment of EEF in 2011 up to January 2019. The quantitative strands summarised include meta-analyses of effect sizes reported for attainment outcomes and descriptive analyses of…