Data on implementation of school-based interventions adds highly valuable information to corresponding evaluation studies. Measuring implementation outcomes, such as fidelity or acceptability, provides information on how to improve current and future implementation processes. Moreover, analyzing intervention outcomes in combination with…

Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

In an effort to best support student learning, school districts are seeking the most effective means of improving instruction while effectively addressing student inequities. As the focus on accountability intensifies, the use of data is paramount. Access to data alone, does not ensure quality, data-driven instruction. The lack of teacher…

Background: Implementation quality is a significant factor in determining whether a program has its intended impact (Durlak and DuPre, 2008; List et al., 2021). Therefore, when studying a program's efficacy, researchers must ensure that the program is implemented as intended to estimate its impact. To evaluate whether a program is being…

BoSTEM, implemented by United Way of Massachusetts Bay and Merrimack Valley and Boston Afterschool and Beyond, is a network of STEM-focused after school programs in the Boston area that provide high-quality science, technology, engineering, and math (STEM) opportunities to Boston middle school students. Through an innovative citywide coalition of…

In recent years, there has been increased attention regarding systems-level implementation to support the sustained use of evidence-based interventions and supports in authentic early childhood settings. With this comes a need to accurately measure implementation fidelity of the critical features within a framework as well as individual practices.…

The Massachusetts Early Childhood Support Organization (ECSO) initiative seeks to improve the quality of early education programs (EEPs) by supporting leaders to strengthen their organizational climate, provide job-embedded professional learning opportunities for educators, support the use of instructional curriculum and child assessments in their…

This study examined the efficacy of a novel manualized educator training as part of the Guggenheim Museum's Guggenheim for All (GFA) program to increase access to high-quality arts programming for neurodiverse individuals. Ten arts educators and 37 parents of autistic children aged 2-17 were recruited to participate in this study. Results…

Although teachers are key figures of a program's effectiveness, most intervention studies to date have not explored how anti-bullying programs are associated with changes at teacher level. Moreover, teacher data also informs about aspects of program implementation, which are essential in program evaluations. Therefore, the aim of this study was to…

This study evaluated the use of the Prevent-Teach-Reinforce (PTR) model as an intensive individualized behavior intervention. Three educators and three high school students with autism spectrum disorder participated in the study. A concurrent multiple baseline design across participants was used to demonstrate the outcomes. The results indicated…

Assessing implementation allows for a better understanding of an intervention's effects and the mechanisms that influence its impact. Two main areas of implementation are (a) the quality with which an intervention is delivered and (b) instructors' adherence to the programmed intervention. The current study used data from a kindergarten mathematics…

Assessing implementation allows for a better understanding of an intervention's effects and the mechanisms that influence its impact. Two main areas of implementation are: (1) the quality with which an intervention is delivered; and (2) instructors' adherence to the programmed intervention. The current study used data from a kindergarten…

The Learning While Leading (LWL) professional development program motivates and further prepares administratively certified educators to become principals or assistant principals and offers continuous support to new principals during induction. The LWL program addresses a clear need for transitional support to motivate, fully prepare, and support…

Young children with intensive behavioral needs are often served by paraprofessionals, who are typically among the least trained and least supported staff in the school. While professional development opportunities to address challenging behavior are generally limited for special education teachers, such professional growth opportunities are often…

As evidence-based interventions are scaled, fidelity of implementation, and thus effectiveness, often wanes. Validated fidelity measures can improve researchers' ability to attribute outcomes to the intervention and help practitioners feel more confident in implementing the intervention as intended. We aim to provide a model for the validation of…