Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

The PBIS Framework has demonstrated effectiveness in supporting schools in improving various prosocial outcomes including improved social, emotional, and behavioral skills; increased academic outcomes and attendance; decreased exclusionary discipline (e.g., office referrals, suspensions); and reduced reports of bullying and substance abuse. In…

This quantitative correlational study dives into the heart of understanding the significance of model fidelity for implementing school threat assessment teams. The target population was instructional staff and threat assessment team members from schools in Dutchess, Putnam, and Westchester Counties in New York State that use the Comprehensive…

Background: Designed in 2012 with a first implementation in 2013, NE STEM 4U is a professional development program for post-secondary students/undergraduates, and serves as a source of outreach, content knowledge generation, and STEM literacy for youth in grades kindergarten through 8th grade (ages 5-14). The model empowers post-secondary students…

Juvenile Rehabilitation (JR) became part of Washington State's Department of Children, Youth, and Families (DCYF) on July 1, 2019. JR serves the state's highest-risk youth who have been charged with a qualifying offense and either adjudicated in a county's juvenile court or convicted in an adult criminal court. In 2000, JR needed to further define…

Project/problem-based learning (PBL) can provide an effective model for school reform when implemented with fidelity. In the report, "Rising Above the Gathering Storm," it was recommended that if the U.S. is to remain competitive in the 21st-century economy, there must be a serious effort to "enlarge the pipeline of students who are…

The Intercultural Development Research Association (IDRA) was awarded an Education Innovation and Research (EIR) Early Phase grant from the U.S. Department of Education in 2017 to develop, implement, and test a promising program to improve student achievement and educational progress for high-need students: Reenergizing Leadership to Achieve…

Purpose: In far too many cases the initiatives to change schools by introducing new programs, processes and reforms has not resulted in obtainment of the desired outcomes. A major reason for limited outcomes suggested in this paper is that there has been a failure to learn from and apply constructs and measures related to understanding,…

The Soccer Coaching Club program used the Teaching Personal and Social Responsibility (TPSR) model in an after-school soccer program for sixth grade boys between 11 and 12 years old in a local middle school. Soccer, as the featured physical activity, provided the "hook" for regular attendance. Desired outcomes included improved…

Research Findings: We evaluated the fidelity of implementation and the sustainability of effects of a research-based model for scaling up educational interventions. The model was implemented by 64 teachers in 26 schools in 2 distal city districts serving low-resource communities, with schools randomly assigned to condition. Practice or Policy:…

Background: Recent reviews suggest that many plausible programs are found to have at best small impacts not commensurate with their cost, and often have no detectable positive impacts at all. Even programs with initial rigorous impact evaluation (RIE) that show them to be effective often fail a second test with an expanded population or at…

Assessing fidelity of implementation is becoming increasingly important in education research, in particular as a tool for understanding variations in treatment effectiveness. Fidelity of implementation is defined as "the determination of how well an intervention is implemented in comparison with the original program design during an efficacy…

Given that there is no universal way to measure implementation fidelity, instructional designers developing instructional innovations may find themselves faced with the challenge of determining the extent to which teachers' implementation of an instructional model is faithful. This article contends that a faithful implementation is one in…

This five-year evaluation examined the effectiveness of a promising middle-school mathematics intervention funded through an Investing in Innovation (i3) development grant. Evaluation objectives were to: (1) study the impact of an intervention aimed at increasing the academic achievement of students in Algebra I--a gate-keeping course--as measured…