Educational researchers conduct studies to gather critical empirical evidence in the determination of what are "evidence-based" curricular programs, which in turn, directly inform adoption efforts. The predominate method of validating these programs is through the use of group experimental designs, although single-case designs have also…

This paper uses recent evidence from international early grade reading programs to provide guidance about how best to create appropriate targets and more effectively identify improved program outcomes. Recent results show that World Bank and US Agency for International Development-funded large-scale international education interventions in low-…

The report of the national response to intervention (RTI) evaluation study, conducted during 2011-2012, was released in November 2015. Anyone who has read the lengthy report can attest to its complexity and the design used in the study. Both these factors can influence the interpretation of the results from this evaluation. In this commentary, we…

Reading Recovery is one of the most researched literacy programs worldwide. Although there have been at least 4 quantitative reviews of its effectiveness, none have considered all rigorous group-comparison studies from all implementing nations from the late 1970s to 2015. Using a hierarchical linear modeling (HLM) v-known analysis, we examined if…

In this paper, we examine the validity and precision of two nonexperimental study designs (NXDs) that can be used in educational evaluation: the comparative interrupted time series (CITS) design and the difference-in-difference (DD) design. In a CITS design, program impacts are evaluated by looking at whether the treatment group deviates from its…

In this paper the authors extend recent work on mediation in a multilevel setting and on causal inference under interference among units to develop a template for the mediation analysis of group randomized educational interventions. The present work will contribute to the literature on interference, in particular on interference in the context of…

The purpose of this paper is to provide a basis for judging the adequacy of evaluation plans or, as they are commonly called, evaluation designs. The authors assume that using the procedures suggested in this paper to determine the adequacy of evaluation designs in advance of actually conducting evaluations will lead to better evaluation designs,…

This review examines the effectiveness of educational technology applications in improving the reading achievement of struggling readers in elementary schools. The review applies consistent inclusion standards to focus on studies that met high methodological standards. A total of 20 studies based on about 7,000 students in grades K-6 were included…

The primary purpose of this study was to explore if there could be a more beneficial method in organizing the individual instructional reading components (phonological decoding, spelling, fluency, and reading comprehension) within a remedial reading program to increase sensitivity to instruction for middle school students with reading disabilities…

The purpose of this review is to learn from rigorous evaluations of alternative technology applications how features of using technology programs and characteristics of their evaluations affect reading outcomes for students in grades K-12. The review applies consistent inclusion standards to focus on studies that met high methodological standards.…

Low-achieving readers in Grade 5 often lack comprehension strategies, domain knowledge, word recognition skills, fluency, and motivation to read. Students with such multiple reading needs seem likely to benefit from instruction that supports each of these reading processes. The authors tested this expectation experimentally by comparing the…

This paper is about the interaction between policy and practice, and about how competing policies contributed to a paradoxical tension within that interaction in one school. Within a paradigm of educational renewal, the Singapore Ministry of Education (MOE) has initiated a number of policies designed to give schools autonomy in designing and…

The current study will examine possible contextual effects relative to differences in reading comprehension performance in the state of Florida. While the Reading First (RF) Impact study examined such difference using a regression discontinuity design, the authors are primarily interested in other analytic methods that might answer different…

Most K-12 evaluations are designed to make inferences about how a program implemented at the classroom or school level affects student learning outcomes and such inferences inherently involve hierarchical data structure. One methodological challenge for evaluators is linking program implementation factors typically measured at the classroom or…

This article systematically reviews research on the achievement outcomes of four types of approaches to improving the reading success of children in the elementary grades: reading curricula, instructional technology, instructional process programs, and combinations of curricula and instructional process. Study inclusion criteria included use of…