Data on implementation of school-based interventions adds highly valuable information to corresponding evaluation studies. Measuring implementation outcomes, such as fidelity or acceptability, provides information on how to improve current and future implementation processes. Moreover, analyzing intervention outcomes in combination with…

Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

We aimed to identify empirically valid cut scores on the positive behavioral interventions and supports (PBIS) Tiered Fidelity Inventory (TFI) through an expert panel process known as bookmarking. The TFI is a measurement tool to evaluate the fidelity of implementation of PBIS. In the bookmark method, experts reviewed all TFI items and item scores…

Individual Placement and Support (IPS), an evidence-based supported employment model for working-age adults with serious mental illness, also serves transition age adults (TAY; ages 16-24). The IPS-Y is a new IPS fidelity scale tailored to this younger population. Although adopted worldwide, it lacks research on the psychometric properties of its…

Children with intellectual and developmental disabilities (IDDs) require intensive multicomponent interventions to learn to read. Parent-implemented interventions have been shown to be effective for children with disabilities and are one potential method for providing intervention. This study used a multiple probe single case design to evaluate…

Interventions for youth are often studied in school settings, yet there are barriers that hinder schools from actively participating in the research studies. To ensure interventions are studied in the context they are intended for, adopted in a timely manner, and regularly used in practice as designed, researchers can conduct studies in a manner…

In an effort to best support student learning, school districts are seeking the most effective means of improving instruction while effectively addressing student inequities. As the focus on accountability intensifies, the use of data is paramount. Access to data alone, does not ensure quality, data-driven instruction. The lack of teacher…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

Background: Implementation quality is a significant factor in determining whether a program has its intended impact (Durlak and DuPre, 2008; List et al., 2021). Therefore, when studying a program's efficacy, researchers must ensure that the program is implemented as intended to estimate its impact. To evaluate whether a program is being…

BoSTEM, implemented by United Way of Massachusetts Bay and Merrimack Valley and Boston Afterschool and Beyond, is a network of STEM-focused after school programs in the Boston area that provide high-quality science, technology, engineering, and math (STEM) opportunities to Boston middle school students. Through an innovative citywide coalition of…

In recent years, there has been increased attention regarding systems-level implementation to support the sustained use of evidence-based interventions and supports in authentic early childhood settings. With this comes a need to accurately measure implementation fidelity of the critical features within a framework as well as individual practices.…

The Massachusetts Early Childhood Support Organization (ECSO) initiative seeks to improve the quality of early education programs (EEPs) by supporting leaders to strengthen their organizational climate, provide job-embedded professional learning opportunities for educators, support the use of instructional curriculum and child assessments in their…

This study examined the efficacy of a novel manualized educator training as part of the Guggenheim Museum's Guggenheim for All (GFA) program to increase access to high-quality arts programming for neurodiverse individuals. Ten arts educators and 37 parents of autistic children aged 2-17 were recruited to participate in this study. Results…

Although teachers are key figures of a program's effectiveness, most intervention studies to date have not explored how anti-bullying programs are associated with changes at teacher level. Moreover, teacher data also informs about aspects of program implementation, which are essential in program evaluations. Therefore, the aim of this study was to…

This study evaluated the use of the Prevent-Teach-Reinforce (PTR) model as an intensive individualized behavior intervention. Three educators and three high school students with autism spectrum disorder participated in the study. A concurrent multiple baseline design across participants was used to demonstrate the outcomes. The results indicated…