A substantial number of randomized trials of educational interventions that have been conducted over the past two decades have produced null results, with either no impact or an unreliable estimate of impact on student achievement or other outcomes of interest. The investment of time and money spent implementing such trials warrants more useful…

Why, when so many educational interventions demonstrate positive impact in tightly controlled efficacy trials, are null results common in follow-up effectiveness trials? Using case studies from literacy, this article suggests that replication failure can surface hidden moderators--contextual differences between an efficacy and an effectiveness…

Poor program implementation constitutes one explanation for null results in trials of educational interventions. For this reason, researchers often collect data about implementation fidelity when conducting such trials. In this article, we document whether and how researchers report and measure program fidelity in recent cluster-randomized trials.…

An analysis was conducted of the What Works Clearinghouse (WWC) research evidence base on the effectiveness of replicable education interventions. Most interventions were found to have little or no support from technically adequate research studies, and intervention effect sizes were of questionable magnitude to meet education policy goals. These…

Experimental and quasi-experimental designs are used in educational research to establish causality and develop effective practices. These research designs rely on a counterfactual model that, in simple form, calls for a comparison between a treatment group and a control group. Developers of educational practices often assume that the population…

Impact evaluation plays a critical role in determining whether federally funded research programs in science, technology, engineering, and mathematics are wise investments. This paper develops quantitative methods for program evaluation and applies this approach to a flagship National Science Foundation-funded education research program, Research…

Commentaries regarding appropriate methods for researching professional development have been a frequent topic in recent issues of "Educational Researcher" as well as other venues. In this article, the authors extend this discussion by observing that randomized trials of specific professional development programs have not enhanced our…

A strong base of research is needed to guide investments in teacher professional development (PD). This article considers the status of research on PD and articulates a particular direction for future work. Little is known about whether PD can have a positive impact on achievement when a program is delivered across a range of typical settings and…

Education researchers, practitioners, and policymakers alike are committed to identifying interventions that teach students more effectively. Increased emphasis on evaluation and accountability has increased desire for sound evaluations of these interventions; and at the same time, school-level data have become increasingly available. This article…

This article discusses the potential positive and problematic influences of the National Early Literacy Panel (NELP; 2008) report on prekindergarten and kindergarten classroom instructional practice. The authors support the instructional importance of the majority of the foundational skills identified in the NELP report as having "clear and…

Traditional methods for preparing systematic reviews and syntheses of effectiveness studies rely on a limited set of methodological criteria to include studies that measure and report effects too narrowly to forward the mission of evidence-based practice. This article discusses why and how the criteria for study selection, evidence screening, and…

Teacher professional development is essential to efforts to improve our schools. This article maps the terrain of research on this important topic. It first provides an overview of what we have learned as a field, about effective professional development programs and their impact on teacher learning. It then suggests some important directions and…

Asserts that both the Feuer, Towne, and Shavelson article on scientific culture and educational research and the recent National Research Council (NRC) report must be understood in the context of current federal discourse focused on experimentally derived causal explanations of educational program effectiveness. Notes that the NRC report risks…

Explores issues in evaluating exemplary programs, including the measurement of the degree to which the program is exemplary or promising. Suggests that comparison (control) group analysis can mislead researchers about the effectiveness of a program and suggests the use of gain scores to identify exemplary programs. (SLD)

Notes that even with the problems identified in this paper, consistent, positive results are appearing in preliminary reports. Equally important, the data seem to support a number of reasonable notions about the impact of distinctive curricula on students. (Author/AM)