Meta-analyses are systematic summaries of research that use quantitative methods to find the mean effect size (standardized mean difference) for interventions. Critics of meta-analysis point out that such analyses can conflate the results of low- and high-quality studies, make improper comparisons and result in statistical noise. All these…

More aggregate data on school performance is available than ever before, opening up new possibilities for applied researchers interested in assessing the effectiveness of school-level interventions quickly and at a relatively low cost by implementing comparative interrupted times series (CITS) designs. We examine the extent to which effect…

Short comparative interrupted times series (CITS) designs are increasingly being used in education research to assess the effectiveness of school-level interventions. These designs can be implemented relatively inexpensively, often drawing on publicly available data on aggregate school performance. However, the validity of this approach hinges on…

When randomized control trials (RCT) are not feasible, researchers seek other methods to make causal inference, e.g., propensity score methods. One of the underlined assumptions for the propensity score methods to obtain unbiased treatment effect estimates is the ignorability assumption, that is, conditional on the propensity score, treatment…

The landscape of medical education is continuously evolving, as are the needs of the learner. The appropriate use of research and evaluation is key when assessing the need for change and instituting one's innovative endeavours. This paper demonstrates how research seeks to generate new knowledge, whereas evaluation uses information acquired from…

This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

Researchers may be interested in examining the impact of programs that prepare youth and adults for successful careers but unable to implement experimental designs with true randomization of participants. As a result, these studies can be compromised by underlying factors that impact group selection and thus lead to potentially biased results.…

Impact evaluation plays a critical role in determining whether federally funded research programs in science, technology, engineering, and mathematics are wise investments. This paper develops quantitative methods for program evaluation and applies this approach to a flagship National Science Foundation-funded education research program, Research…

Extension agents and specialists have experienced increased pressure for greater program effectiveness and accountability and especially for evidence-based programs. This article builds on previously published evidence-based programming articles. It provides ideas that address three problems that Extension staff face with EBPs and that Extension…

This document provides guidance about how to describe studies and report their findings in a way that is clear, complete, and transparent. This document does not include information about how studies are judged against What Works Clearinghouse evidence standards. For information about What Works Clearinghouse evidence standards, please refer to…

The evidence that teacher preparation programs have an impact on teacher quality is often limited. Progress in research on this topic will remain rather limited in its influence on practice until more proximal measures of teacher education outcomes can be established. The dearth of variables to measure the impact of teacher preparation programs on…

The undergraduate psychology curriculum often does not address guidelines for acceptable participant behavior. This two-part study tested the efficacy of a recently developed online learning module on ethical perceptions, knowledge, and behavior. In the preliminary quasi-experiment, students who viewed the module did not have higher…

With research indicating substantial differences among teachers in terms of their effectiveness (Nye, Konstantopoulous, & Hedges, 2004), a major focus of recent research in education has been on improving teacher quality through professional development (Desimone, 2009; Institute of Educations Sciences [IES], 2012; Measures of Effective…

This sequential mixed methods study analyzed how program evaluation was used to assess educational administration and examined thematic trends in educational evaluation published over 10 years (2001-2010). First, qualitative content analysis examined the articles in eight peer-reviewed evaluation journals. This analysis revealed that numerous…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…