Analyzing heterogeneous treatment effects (HTEs) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and preintervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

This paper describes a 12-week cluster randomized controlled trial that examined the efficacy of BookNook, a virtual tutoring platform focused on reading. Cohorts of first- through fourth-grade students attending six Rocketship public charter schools in Northern California were randomly assigned within grades to receive BookNook. Intent-to-Treat…

An emerging body of research suggests that incorporating randomization schemes in single-case research designs strengthens study internal validity and data evaluation. The purpose of this study was to test the utility and feasibility of a randomized alternating-treatment design in an investigation that compared the combined effects of vocabulary…

Analyzing heterogeneous treatment effects (HTE) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and pre-intervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

Background: The language of the science curriculum is complex, even in the early grades. To communicate their scientific observations, children must produce complex syntax, particularly complement clauses (e.g., "I think it will float;" "We noticed that it vibrates"). Complex syntax is often challenging for children with…

We present an aggregation scheme that increases power in randomized controlled trials and quasi-experiments when the intervention possesses a robust and well-articulated theory of change. Intervention studies using longitudinal data often include multiple observations on individuals, some of which may be more likely to manifest a treatment effect…

Background: Efficacy trials in education often possess a motivating theory of change: how and why should the desired improvement in outcomes occur as a consequence of the intervention? In scenarios with repeated measurements, certain subgroups may be more or less likely to manifest a treatment effect; the theory of change (TOC) provides guidance…

This paper describes the context, processes and issues experienced over 5 years in which a RCT was carried out to evaluate a programme for children aged 7-8 who were struggling with their reading. Its specific aim is to illuminate questions about the design of complex teaching approaches and their evaluation using an RCT. This covers the early…

Randomized controlled trials in education are necessary to keep pace with the evidence-based practices demanded by schools and the nation. In this study, kindergarten students in a school district in Indiana were randomized on the class level: The experimental condition consisted of students utilizing a computer-adaptive reading program for 15…

This paper presents evidence confirming the validity of the RD design in the Reading Recovery study by examining the ability of the RD design to replicate the 1st grade results observed in the original i3 RCT focused on short-term impacts. Over 1,800 schools participated in the RD study over all four cohort years. The RD design used cutoff-based…

The significance of a process evaluation for understanding randomised controlled trials (RCTs) of complex teaching interventions in a classroom setting is discussed in relation to the evaluation of the Integrated Group Reading (IGR) programme trial. This process evaluation is based on realist principles and draws on different data sources. The…

This paper presents findings from a systematic literature review that explored the delivery arrangements of school-based reading interventions for struggling readers aged 5-8 years. Databases were searched for published and unpublished studies from 1970 to 2017, which employed a randomised controlled trial or quasi-experimental design. Sixty-four…

RAND Europe evaluated the implementation of a technology-based intervention that made use of the Microsoft Immersive Reader (IR) in UK classrooms for eight- and nine-year-old pupils. This is the first evaluation of this intervention that uses a randomised control trial (RCT) design, following promising findings related to the use of IR from a…

The Grade 2 learner results of the Early Grade Reading Study (EGRS) randomised control trial (RCT) in the North West province showed that the structured pedagogic intervention model that included instructional coaching, lesson plans, and quality learning materials was more cost-effective than a similar intervention model that excluded coaching.…

Almost 20% of English pupils still experience difficulties with reading despite the use of a predominantly phonics-based approach that works well for most children, but not for all; therefore, other approaches need to be explored. The Integrated Group Reading (IGR) programme involves an inclusive approach to targeted teaching led by class teachers…