Introduction: The What Works Clearinghouse (WWC) reviews rigorous research on educational interventions with a goal of identifying "what works" and making that information accessible to educators and policymakers. In rating the quality of causal research, the WWC has historically prioritized internal validity over external validity. One…

Multiple imputation (MI) is a popular method for handling missing data. In education research, it can be challenging to use MI because the data often have a clustered structure that need to be accommodated during MI. Although much research has considered applications of MI in hierarchical data, little is known about its use in cross-classified…

A substantial number of randomized trials of educational interventions that have been conducted over the past two decades have produced null results, with either no impact or an unreliable estimate of impact on student achievement or other outcomes of interest. The investment of time and money spent implementing such trials warrants more useful…

Over the past 15 years, we have seen an increase in the use of cluster randomized trials (CRTs) to test the efficacy of educational interventions. These studies are often designed with the goal of determining whether a program works, or answering the what works question. Recently, the goals of these studies expanded to include for whom and under…

Since the first descriptions of design research (DR), there have been calls to better define it to increase its rigour. Yet five uncertainties remain: (1) the processes for conducting DR, (2) how DR differs from other forms of research, (3) how DR differs from design, (4) the products of DR, and (5) why DR can answer certain research questions…

"Promoting the Emergence of Advanced Knowledge-Direct Training Module" (PEAK-DTM) is a commercially available assessment and curriculum for individuals whose language skills are not developmentally adequate. In their review of PEAK-DTM, Reed and Luiselli (2016) analyzed the extant literature on PEAK-DTM and concluded that it has a sound…

This article addresses the gap between what works in research and what works in practice. Currently, research in evidence-based education policy and practice focuses on randomized controlled trials. These can support causal ascriptions ("It worked") but provide little basis for local effectiveness predictions ("It will work…

In the past few decades, we have seen a rapid proliferation in the use of quasi-experimental research designs in education research. This trend, stemming in part from the "credibility revolution" in the social sciences, particularly economics, is notable along with the increasing use of randomized controlled trials in the strive toward…

Background: The use of randomised controlled trials (RCTs) in education has increased significantly over the last 15 years. However, their use has also been subject to sustained and rather trenchant criticism from significant sections of the education research community. Key criticisms have included the claims that: it is not possible to undertake…

Card and Giuliano conducted a regression discontinuity study in a large Florida school district to investigate the magnitude of academic benefits of the district's gifted program. They found that for children identified as gifted through an intelligence test, the program provided few or no benefits. But children who were admitted to the gifted…

One of the major successes of advanced quantitative methods has been its seeming ability to provide unbiased determinations of which education practices are effective for education in general and for improving the educational achievement and opportunity of the neediest students. The power of this methodology as applied in the top education…

Bui, Craig, and Imberman assessed the impact of gifted and talented programs on student achievement using regression discontinuity and random assignment to gifted magnet schools. In both analyses, they found minimal impact of the gifted and talented programs on student achievement. This commentary addresses two concerns associated with the study.…

Upward Bound (UB) was one of the original federal "Great Society" programs of the 1960s and remains, fifty years later, the single largest college access program in the country. Recently, Congress has reduced funding and considered eliminating the program because of federal budget pressures and because the first analysis of the only…

This chapter will examine characteristics of first-year experience programs in community colleges, with specific attention to the extant research about their effectiveness, the ways in which research and program delivery can be integrated, and the unique challenges of delivering FYE programs and conducting research about them in community colleges.

The science-to-service problem continues to taunt the field of education (Fixsen, Blasé, Naoom, & Wallace, 2009). As an academic discipline, the field requires knowledge generation that adds to or deepens theoretical understandings. As a profession, knowledge generation that solves local problems and supports continuous improvement is…