We present an aggregation scheme that increases power in randomized controlled trials and quasi-experiments when the intervention possesses a robust and well-articulated theory of change. Intervention studies using longitudinal data often include multiple observations on individuals, some of which may be more likely to manifest a treatment effect…

This five-year study focused on school processes that promoted the scaling-up of a high school academic literacy framework, Reading Apprenticeship, developed by WestEd's Strategic Literacy Initiative (SLI). Implementing an innovative strategy for scaling-up involving school-based cross-disciplinary teacher teams, SLI brought the framework to 274…

This article illustrates the value of large-scale impact evaluations with counterfactual components. It begins by exploring the limitations of small-scale impact studies, which do not allow reliable inference to a wider population or which do not use valid comparison groups. The paper then describes the design features of a recent large-scale…

In a common approach for scaling up effective educational practice, schools adopt evidence-based programs to be implemented with fidelity. An alternative approach assumes that programs should be adapted to local contexts. In this randomized trial of a reading intervention, we study a scaffolded sequence of implementation in which schools first…

This multiyear scale-up effectiveness study of Open Court Reading (OCR) involved approximately 4,500 students and more than 1,000 teachers per year in Grades K-5 from 49 elementary schools in seven districts across the country. Using a school-level cluster randomized trial design, we assessed the implementation and effectiveness of Open Court…

Background: Many school-based interventions are being delivered in the absence of evidence of effectiveness (Snowling & Hulme, 2011, "Br. J. Educ. Psychol., 81," 1). Aims: This study sought to address this oversight by evaluating the effectiveness of the commonly used the Lexia Reading Core5 intervention, with 4- to 6-year-old pupils…

The purpose of this report is to present the results of a two-year randomized control trial evaluation of the SPARK literacy program. SPARK is an early grade literacy program developed by Boys & Girls Clubs of Greater Milwaukee. In 2010, SPARK was awarded an Investing in Innovation (i3) Department of Education grant to further develop the…

To improve the reading comprehension outcomes of children in high-poverty schools, policymakers need to identify reading interventions that show promise of effectiveness at scale. This study evaluated the effectiveness of a low-cost and large-scale summer reading intervention that provided comprehension lessons at the end of the school year and…

In 2013-14, the Wake County Public School System (WCPSS) launched Achieve3000 as a randomized controlled trial in 16 elementary schools. Achieve3000 is an early literacy program that differentiates non-fiction reading passages based on individual students' Lexile scores. Twoyear results show that Achieve3000 did not have a significant impact on…

This National Foundation for Educational Research (NFER) report has been produced for the Education Endowment Foundation and its evaluation of the Chatterbooks reading scheme. Chatterbooks is an extracurricular reading initiative, developed by the Reading Agency, that aims to increase a child's motivation to read by providing tools and resources…

REACH is a targeted reading support programme designed to improve reading accuracy and comprehension in pupils with reading difficulties in Years 7 and 8. It is based on research by the Centre for Reading and Language at York and is delivered by specially trained teaching assistants (TAs). This evaluation tested two REACH interventions, one based…

Rhythm for Reading is a programme which aims to improve children's reading ability by taking part in rhythm-based exercises such as stamping, clapping and chanting, while reading musical notation. The intervention builds on the evidence of a link between the natural rhythm and phrasing of prose and intuitive reading comprehension. Rhythm for…

Switch-on Reading is an intensive 10-week literacy intervention. It is delivered on a one to one basis by staff, most commonly teaching assistants, who have been trained in the approach. The purpose of Switch-on is to achieve functional literacy for as many pupils as possible, and so to close the reading achievement gap for vulnerable children…

We report on the scaling up of a high school content literacy framework, Reading Apprenticeship, over a period of four years as part of the independent evaluation of an Investing in Innovation grant from the U.S. Department of Education to WestEd's Strategic Literacy Institute (SLI). Our goal was to understand the school processes that support…

As evidence-based reform becomes increasingly important in educational policy, it is becoming essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. The purpose of this study was to examine how methodological features such as types of publication, sample sizes, and…