Background: The need for evidence-based, effective interventions is especially great in literacy -- particularly for young students, mastering early literacy skills is predictive of later school success (Slavin et al., 2011). Understanding the relationship between letters and sounds, also known as the alphabetic principle, is essential for…

The purpose of this report is to present the results of a two-year randomized control trial evaluation of the SPARK literacy program. SPARK is an early grade literacy program developed by Boys & Girls Clubs of Greater Milwaukee. In 2010, SPARK was awarded an Investing in Innovation (i3) Department of Education grant to further develop the…

The Fidelity of Implementation (FOI) study that is the focus of this report was conducted as a component of a scale-up effectiveness trial of the SRA/McGraw-Hill Open Court Reading program. The overall purpose of the FOI study was to support and provide context for findings from the larger experimental impact study of Open Court Reading (OCR). To…

As part of the 2010 economic stimulus, a $55 million "Investing in Innovation" (i3) grant from the US Department of Education was awarded to scale up Reading Recovery across the nation. This paper presents the final round of results from the large-scale, mixed methods randomized evaluation of the implementation and impacts of Reading…

In this paper the authors present a new method for sample selection for scale-up experiments. This method uses propensity score matching methods to create a sample that is similar in composition to a well-defined generalization population. The method they present is flexible and practical in the sense that it identifies units to be targeted for…

The problem of summer reading loss among low-income children has been amply documented by researchers. Over time, income-based disparities in reading achievement appear to grow more rapidly during the summer months than the academic school year. This paper describes two experiments in which teachers scaffold summer book reading with two different…

As evidence-based reform becomes increasingly important in educational policy, it is becoming essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. The purpose of this study was to examine how methodological features such as types of publication, sample sizes, and…

In this paper the authors extend recent work on mediation in a multilevel setting and on causal inference under interference among units to develop a template for the mediation analysis of group randomized educational interventions. The present work will contribute to the literature on interference, in particular on interference in the context of…

"Success for All" (SFA) is one of the best known and thoroughly evaluated school reform models. Further evaluation of the initiative is especially important for two reasons. First, the program model has continued to evolve over time, with a greater emphasis placed on the use of engaging technology in the classroom and on the deployment…

The current study will examine possible contextual effects relative to differences in reading comprehension performance in the state of Florida. While the Reading First (RF) Impact study examined such difference using a regression discontinuity design, the authors are primarily interested in other analytic methods that might answer different…

The goal of the RF program, Part B of the No Child Left Behind Act of 2001 (NCLB), is to have all children reading at grade level by the end of third grade. There is no legislative precedent for this program, focused as it is on preventing reading failure in the early elementary years (US Department of Education, April 2002). Because the design of…

The research reported in this paper is focused directly on assessing the validity of the "Teaching Knowledge about Reading and Reading Practices" (TKRRP) assessment. Following the recommendations of the Standards for Educational and Psychological Testing (APA/AERA, 1999), the authors see validation as a process of constructing an…

Rigorous research provides information that will allow other schools and districts to select interventions that have a scientifically based track record of effectiveness. All Striving Reader grants include the mandate to evaluate literacy intervention(s) targeted to adolescents who are reading significantly below grade level. Although all studies…