Using an RD design provides statistically robust estimates while allowing researchers a different causal estimation tool to be used in educational environments where an RCT may not be feasible. Results from External Evaluation of the i3 Scale-Up of Reading Recovery show that impact estimates were remarkably similar between a randomized control…

Educational stakeholders are keen to know the magnitude and importance of different interventions. However, the way evidence is communicated to support understanding of the effectiveness of an intervention is controversial. Typically studies in education have used the standardised mean difference as a measure of the impact of interventions. This…

The report of the national response to intervention (RTI) evaluation study, conducted during 2011-2012, was released in November 2015. Anyone who has read the lengthy report can attest to its complexity and the design used in the study. Both these factors can influence the interpretation of the results from this evaluation. In this commentary, we…

The "Examining Implementation and Outcomes of the Project On-Track High-Dosage Literacy Tutoring Program" study describes the characteristics of students who participated in a full year of Project On-Track, a high-dosage, small-group literacy tutoring program for students in grade 1-3. Its online adaptive program, Amplify Reading, groups…

There is growing pressure to make efficacy experiments more useful. This requires attending to the twin goals of generalizing experimental results to those schools that will use the results and testing the intervention's theory of action. We show how electronic records, created naturally during the daily operation of technology-based…

Recently researchers have begun exploring the efficacy of interventions designed to improve text comprehension skills for students with developmental disabilities (DD). Text comprehension is essential for understanding academic content as students with disabilities make progress in the general education curriculum. This article focuses on single…

Given the importance of education and the growing public demand for improving education quality under tight budget constraints, there has been an emerging movement to call for research-informed decisions in educational resource allocation. Despite the abundance of rigorous studies on the effectiveness, cost, and implementation of educational…

The history of research on interventions for struggling readers in Grades 4 through 12 dates back to 19th-century case studies of seemingly intelligent children who were unable to learn to read. Physicians, psychologists, educators, and others were determined to help them. In the process, they launched a century of research on a wide variety of…

This paper presents a reflective narrative of the process of designing a PhD project. Using the analogy of the play "One Man, Two Guvnors," this paper discusses the tensions a beginning researcher faces in reconciling her own vision for a project with the academic demands of doctoral-level study. Focusing on an ethnographic study of a reading…

This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

We contribute to debate about causal inferences in educational research in two ways. First, we quantify how much bias there must be in an estimate to invalidate an inference. Second, we utilize Rubin's causal model to interpret the bias necessary to invalidate an inference in terms of sample replacement. We apply our analysis to an inference…

An important recent development in evidence-based policy is the federal government's use of a "tiered evidence" approach to allocating funding in grant programs such as the U.S. Department of Education's Investing in Innovation Fund (i3). A central feature of this approach is that the largest grants are awarded to fund large-scale…

In a randomized controlled trial (RCT), treatments are assigned randomly and treatments are withheld from participants. Is it ethically permissible to conduct an RCT in a social setting? This paper addresses two conditions for justifying RCTs: that there should be a state of equipoise and that the trial should be scientifically promising.…

The recently reported i3 Scale-Up of Reading Recovery (May et al., 2015) found an effect size of +0.69 in favor of Reading Recovery compared to the control group. We discuss four issues: (a) many of the lowest achieving students were excluded from participation in Reading Recovery; (b) the control group received a range of different experiences;…

The main purpose of the current study is to explain the effect of an enrichment reading program on the cognitive processes and neural structures of children experiencing reading difficulties. The current study was carried out in line with a single-subject research method and the between-subjects multiple probe design belonging to this method. This…