Background: Implementation quality is a significant factor in determining whether a program has its intended impact (Durlak and DuPre, 2008; List et al., 2021). Therefore, when studying a program's efficacy, researchers must ensure that the program is implemented as intended to estimate its impact. To evaluate whether a program is being…

Background: The closures resulting from the COVID-19 pandemic significantly impacted teacher licensure pathways. During that time, prospective teachers had less access to student teaching experiences, fewer program and course completion opportunities, and a reduced ability to prepare for and pass state licensing examinations. In response, a State…

Expanded Learning Time (ELT) is seen as one promising approach for improving academic achievement, particularly in the nation's chronically low-performing schools. Since 1995, Citizen Schools (CS) has developed and supported the implementation of its own ELT model. The CS ELT model uses an additional shift of educators and community volunteers to…

The Fidelity of Implementation (FOI) study that is the focus of this report was conducted as a component of a scale-up effectiveness trial of the SRA/McGraw-Hill Open Court Reading program. The overall purpose of the FOI study was to support and provide context for findings from the larger experimental impact study of Open Court Reading (OCR). To…

Assessing fidelity of implementation is becoming increasingly important in education research, in particular as a tool for understanding variations in treatment effectiveness. Fidelity of implementation is defined as "the determination of how well an intervention is implemented in comparison with the original program design during an efficacy…

Writing is an essential skill for participating in modern American society. Although it is crucial to careers and civic engagement, student writing falls far short of national expectations (College Board, 2004; NCES, 2012; Persky, Daane, & Jin, 2003). The Common Core State Standards (CCSS) seek to increase the rigor of writing instruction…

In experimental studies, researchers are often interested in secondary research questions that explore important aspects of main findings, such as whether or not program effects vary according to the level of fidelity in which the program has been implemented; or according to the dosage received by individuals participated in the program. In this…

The purpose of this study is to extend the work of Spybrook and Raudenbush (2009) and examine how the research designs and sample sizes changed from the planning phase to the implementation phase in the first wave of studies funded by IES. The authors examine the impact of the changes in terms of the changes in the precision of the study from the…

The concept of "implementation fidelity" is broadly used to capture the extent to which an intervention is executed as intended by the designers of the intervention (Century, Rudnick, & Freeman, 2010; Huntley, 2005, McNaught, Tarr, & Sears, 2010, Munter, 2010). Though implementation fidelity instruments are often used to assess…

This paper examines measures used by studies associated with Preschool Curriculum Evaluation Research Initiative (PCER) funded by the Institute of Education Sciences. Analysis of 17 measures of fidelity used by 13 curriculum interventions highlights how research in preschools is and is not measuring fidelity of implementation. The following…

One approach some U.S. schools now use to combat high rates of adolescent substance use is school-based mandatory-random student drug testing (MRSDT). Under MRSDT, students and their parents sign consent forms agreeing to the students' participation in random drug testing as a condition of participating in athletics and other school-sponsored…

To address concerns about low graduation rates and a lack of workforce readiness, states and districts have been experimenting with different models of high school reform. One of the most popular models has been the Early College High School (ECHS) model, small schools that blur the line between high school and college. Since 2002, over 200 ECHSs…

"Success for All" (SFA) is one of the best known and thoroughly evaluated school reform models. Further evaluation of the initiative is especially important for two reasons. First, the program model has continued to evolve over time, with a greater emphasis placed on the use of engaging technology in the classroom and on the deployment…

The purpose of this study was twofold: (1) to determine the efficacy of the Leveled Literacy Intervention program (LLI) in increasing reading achievement for K-2 students and (2) to examine LLI program implementation fidelity. This study evaluated LLI in two U.S. school districts and used a mixed-method design to address the following key research…

This paper addresses methodological issues arising from an experimental study of North Carolina's Early College High School Initiative, a four-year longitudinal experimental study funded by Institute for Education Sciences. North Carolina implemented the Early College High School (ECHS) Initiative in response to low high school graduation rates.…