A substantial number of randomized trials of educational interventions that have been conducted over the past two decades have produced null results, with either no impact or an unreliable estimate of impact on student achievement or other outcomes of interest. The investment of time and money spent implementing such trials warrants more useful…

Why, when so many educational interventions demonstrate positive impact in tightly controlled efficacy trials, are null results common in follow-up effectiveness trials? Using case studies from literacy, this article suggests that replication failure can surface hidden moderators--contextual differences between an efficacy and an effectiveness…

Poor program implementation constitutes one explanation for null results in trials of educational interventions. For this reason, researchers often collect data about implementation fidelity when conducting such trials. In this article, we document whether and how researchers report and measure program fidelity in recent cluster-randomized trials.…

An analysis was conducted of the What Works Clearinghouse (WWC) research evidence base on the effectiveness of replicable education interventions. Most interventions were found to have little or no support from technically adequate research studies, and intervention effect sizes were of questionable magnitude to meet education policy goals. These…

Experimental and quasi-experimental designs are used in educational research to establish causality and develop effective practices. These research designs rely on a counterfactual model that, in simple form, calls for a comparison between a treatment group and a control group. Developers of educational practices often assume that the population…

Commentaries regarding appropriate methods for researching professional development have been a frequent topic in recent issues of "Educational Researcher" as well as other venues. In this article, the authors extend this discussion by observing that randomized trials of specific professional development programs have not enhanced our…

Impact evaluation plays a critical role in determining whether federally funded research programs in science, technology, engineering, and mathematics are wise investments. This paper develops quantitative methods for program evaluation and applies this approach to a flagship National Science Foundation-funded education research program, Research…

A strong base of research is needed to guide investments in teacher professional development (PD). This article considers the status of research on PD and articulates a particular direction for future work. Little is known about whether PD can have a positive impact on achievement when a program is delivered across a range of typical settings and…

Teacher professional development is essential to efforts to improve our schools. This article maps the terrain of research on this important topic. It first provides an overview of what we have learned as a field, about effective professional development programs and their impact on teacher learning. It then suggests some important directions and…

Asserts that both the Feuer, Towne, and Shavelson article on scientific culture and educational research and the recent National Research Council (NRC) report must be understood in the context of current federal discourse focused on experimentally derived causal explanations of educational program effectiveness. Notes that the NRC report risks…

Education researchers, practitioners, and policymakers alike are committed to identifying interventions that teach students more effectively. Increased emphasis on evaluation and accountability has increased desire for sound evaluations of these interventions; and at the same time, school-level data have become increasingly available. This article…

Discusses the use of transaction-cost economics in measuring the impact of educational reforms and whether these reforms are likely to succeed in the "real life" of schools. Several current educational reforms are judged on the basis of their transaction costs and consequent prospects for success. (GR)

The author responds to Pinnell et al's (1996) call for caution in using cost-benefit analysis in measuring educational reform success. It is argued that reform already is being sold to state legislators and educators in cost-benefit terms and that research has been inappropriately used in the selling process. (GR)

Responds to Hiebert's 1994 article in Educational Researcher in which she criticized Reading Recovery (RR) advocates for failing to base RR's success on an adequate cost-benefit analysis. The authors suggest reliance on the informal judgements of local administrators rather than using administratively difficult, large-scale, cost-benefit analyses…