Background: To understand and apply the results of multisite impact studies, it is necessary to know the extent to which the components of an intervention were implemented as they were designed in each context (e.g., Carroll et al., 2007; Hill, Corey, & Jacob, 2018). Rigorous and cost-effective measures of implementation fidelity can help…

Estimates of fidelity of implementation are essential to interpret the effects of educational interventions in randomized controlled trials (RCTs). While random assignment protects against many threats to validity, and therefore provides the best approximation to a true counterfactual condition, it does not ensure that the treatment condition…

Assessing fidelity of implementation is becoming increasingly important in education research, in particular as a tool for understanding variations in treatment effectiveness. Fidelity of implementation is defined as "the determination of how well an intervention is implemented in comparison with the original program design during an efficacy…

The practical need for multidimensional measures of fidelity of implementation (FOI) of reform-based science, technology, engineering, and mathematics (STEM) instructional materials, combined with a theoretical need in the field for a shared conceptual framework that could support accumulating knowledge on specific enacted program elements across…

The main confirmatory research question guiding the design of the impact evaluation is: "What is the impact of Success for All (SFA) on elementary school students' reading achievement, compared to students in non-SFA schools?" An answer to this question will determine the assessment of whether SFA is successful at turning around low-performing…

Previous research has linked inquiry-based science instruction (i.e., science instruction that engages students in doing science rather than just learning about science) with greater gains in student learning than text-book based methods (Vanosdall, Klentschy, Hedges & Weisbaum, 2007; Banilower, 2007; Ferguson 2009; Bredderman, 1983;…

A variety of research has pointed to the interdependent linkage among vocabulary knowledge, reading comprehension, and level of literacy. With this point in mind, the present study addressed the question of whether student vocabulary acquisition could be accelerated by using a multi-part, semantic word-family-oriented learning strategy to…

In this paper, the authors describe a case of measuring implementation fidelity within an evaluation of Math Recovery (MR), a pullout tutoring program for low-achieving first-graders. They use this case to address two aspects of implementation fidelity studies: (1) their feasibility with respect to unscripted interventions, and (2) their…

The ESEA Blueprint for Reform states that teachers need "effective, ongoing, job-embedded, professional development that is targeted to student and school needs… [and] aligned with evidence of improvements in student learning." Unfortunately, the professional development approaches advocated, though sensible and compelling in theory,…

To address concerns about low graduation rates and a lack of workforce readiness, states and districts have been experimenting with different models of high school reform. One of the most popular models has been the Early College High School (ECHS) model, small schools that blur the line between high school and college. Since 2002, over 200 ECHSs…

"Success for All" (SFA) is one of the best known and thoroughly evaluated school reform models. Further evaluation of the initiative is especially important for two reasons. First, the program model has continued to evolve over time, with a greater emphasis placed on the use of engaging technology in the classroom and on the deployment…

The BioBridge Professional Development model was created to bring current and relevant science into the high school classroom. The purpose of this intervention was to connect teachers with relevant science and to create innovative, hands-on activities that engage students, with the goal of increasing student interest in STEM careers. To this end,…

The purpose of this study is to rigorously examine the implementation and impact of the Early College High School (ECHS) model in North Carolina. The primary goal of the ECHS model is to increase the number of students who graduate from high school and who continue on and succeed in college. Therefore, the anticipated long-term outcomes for the…