Randomized experiments are a strong design for establishing impact evidence because the random assignment mechanism theoretically allows confidence in attributing group differences to the intervention. Growth of randomized experiments within educational studies has been widely documented. However, randomized experiments within education have…

Evidence-based education aims to support policy makers choosing between potential interventions. This rarely involves considering each in isolation; instead, sets of evidence regarding many potential policy interventions are considered. Filtering a set on any quantity measured with error risks the "winner's curse": conditional on…

Evidence-based policy at the local level requires predicting the impact of an intervention to inform whether it should be adopted. Increasingly, local policymakers have access to published research evaluating the effectiveness of policy interventions from national research clearinghouses that review and disseminate evidence from program…

This article addresses the gap between what works in research and what works in practice. Currently, research in evidence-based education policy and practice focuses on randomized controlled trials. These can support causal ascriptions ("It worked") but provide little basis for local effectiveness predictions ("It will work…

School-based evaluations of interventions are increasingly common in education research. Ideally, the results of these evaluations are used to make evidence-based policy decisions for students. However, it is difficult to make generalizations from these evaluations because the types of schools included in the studies are typically not selected…

The United States considers educating all students to a threshold of adequate outcomes to be a central goal of educational justice. The No Child Left Behind Act introduced evidence-based policy and accountability protocols to ensure that all students receive an education that enables them to meet adequacy standards. Unfortunately, evidence-based…

National governments use evidence selectively to argue that a successful policy intervention in one local area should be emulated in others ("evidence-based best practice"). However, the value of such evidence is always limited because there is: disagreement on the best way to gather evidence of policy success, uncertainty regarding the…

Given increasing interest in evidence-based policy, there is growing attention to how well the results from rigorous program evaluations may inform policy decisions. However, little attention has been paid to documenting the characteristics of schools or districts that participate in rigorous educational evaluations, and how they compare to…

This report describes in detail how researchers, policymakers, and program administrators can recognize opportunities for experiments and carry them out. Specifically, the report focuses on opportunistic experiments, defined as randomized controlled trials (RCTs) that study the effects of initiatives, program changes, or policy actions that…

One purpose of education research is to develop and rigorously evaluate the effectiveness of programs for supporting students' learning and achievement. The Institute of Education Sciences has amplified that purpose (Shadish & Cook, 2009) and attempted to improve the methodological standards for conducting such work--primarily through the What…

Kenya is investing in information and communication technology (ICT) to improve children's learning outcomes. However, the literature on ICT is pessimistic about the ability of ICT alone to improve outcomes, and few ICT programs have created the instructional change necessary to increase learning. The Primary Math and Reading (PRIMR) Initiative…

To do research that really makes a difference--the authors of this book argue--social scientists need questions and methods that reflect the complexity of the world. Bringing together a consortium of voices across a variety of fields, "Methods that Matter" offers compelling and successful examples of mixed methods research that do just…

Research methods are tools that can be variously applied - depending on the stage of knowledge in a particular area, the type of research question being asked, and the context of the research. The field of program evaluation, critical for social policy development, often has not adequately embraced the full range of methodological tools needed to…