Assessing implementation allows for a better understanding of an intervention's effects and the mechanisms that influence its impact. Two main areas of implementation are: (1) the quality with which an intervention is delivered; and (2) instructors' adherence to the programmed intervention. The current study used data from a kindergarten…

This mixed-methods study describes a framework for conducting cost analyses of school-based programs leveraging fidelity data and applying the ingredients method. We illustrate this approach by applying it to Positive Behavioral Interventions and Supports (PBIS), drawing on multiple sources of data from a sample of U.S. 77 schools that were…

Embedded instruction facilitates individualized support and promotes meaningful participation for all children, irrespective of their abilities or disabilities, by integrating learning opportunities into the natural, everyday activities of inclusive preschool settings. This study aimed to investigate the impact of a coaching intervention on the…

This series of evaluation briefs explores the relationship between (a) school climate (as measured by the Brief School Climate Survey for elementary and secondary students), (b) student-level demographics, and (c) PBIS Fidelity (as measured by the Tiered Fidelity Inventory (TFI). All briefs in this series include the same introductory information…

For years researchers have stressed the importance of implementing a Culturally Responsive System to improve outcomes for Black students (Culturally Responsive Sustaining Education, 2018). It is important to shift towards a perspective that sees everyone from an asset-based perspective The narrative that was created throughout time was that Black…

The School Bullying Prevention and Education Grant (BPEG) program has supported Colorado schools and districts in ending bullying since it was first funded in 2016, after having been created by H.B. 11-1254. Administered by the Colorado Department of Education (CDE), as of May 2024, the BPEG program has distributed over $15 million toward this…

Fidelity of implementation (FOI) refers to the level of adherence that a project keeps to its design. The evaluation of this project, a school-based arts implementation project, used a "fidelity to structure" design to determine how well the schools in the project followed the project design in the fourth and fifth years of the project…

The present pilot study explored the feasibility, acceptability, and efficacy of a multicomponent social narrative intervention to teach behavioral expectations. We conducted a multiple probe design across three children to evaluate the effects of the intervention on student behavior. In addition, we measured the fidelity of teacher implementation…

In education, the field of implementation science is a discipline dedicated to supporting educators' use of evidence-based practices (EPBs) to improve school and student outcomes. As highlighted in previous columns in this series, school teams must thoughtfully consider how EBPs align with the school/district core values and fit the local context…

On their own, student learning and development outcomes assessment data have limited utility for improving programming. We believe outcomes data should not be collected until two fundamental questions can be answered: "Why should this programming result in the desired outcome?" (i.e., program theory) and "Was the intended…

In this study, we evaluated three lessons from a manualized social play skills intervention, Play20. Play20 is a focused intervention that is designed to improve early social skill development in children with autism spectrum disorder through naturalistic play. First, we evaluated the procedural fidelity of instructor implementation of Play20, and…

The primary goal of this study is to evaluate the efficacy of professional development (PD) and implementation fidelity on the performance of middle school students in mathematics within an online learning environment. Using a quasi-experimental design, the research compares educational outcomes between control and experimental groups…

The purpose of this study was to evaluate the feasibility and effectiveness of computer-assisted instruction (CAI) implemented by special education teachers in a school setting in China. Feasibility was evaluated by procedural fidelity of teacher implementation and a social validity questionnaire. Effectiveness was measured by the acquisition of…

There continue to be challenges of transfer from research evidence to practice in education. This paper reports on the implementation of a well-evidenced Reciprocal Reading approach in 35 schools across a high poverty region in England, working cooperatively at transition between primary and secondary. The purpose of the research reported here was…

Creating safe and supportive environments where students engage in prosocial behaviors is a priority and Positive Behavioral Interventions and Supports (PBIS) are used to achieve these goals. This study investigated relationships between PBIS fidelity, school climate, and office discipline referrals (ODRs). Participants were 204,701 students in…