Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next…

This article reviews important statistical methods for estimating the impact of interventions on outcomes in education settings, particularly programs that are implemented in field, rather than laboratory, settings. We begin by describing the causal inference challenge for evaluating program effects. Then four research designs are discussed that…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

This report from the Career and Technical Education (CTE) Research Network Lead team provides final results from an evaluability assessment of CTE programs that feasibly could be evaluated using a rigorous experimental design. Evaluability assessments (also called feasibility studies) are used in education and other fields, such as international…

Given the widespread use of non-experimental (NE) methods for assessing program impacts, there is a strong need to know whether NE approaches yield causally valid results in field settings. In within-study comparison (WSC) designs, the researcher compares treatment effects from an NE with those obtained from a randomized experiment that shares the…

Background and purpose: Studies of education and learning that were described as experiments have been carried out in the USA by educational psychologists since about 1900. In this paper, we discuss the history of randomised trials in education in the USA in terms of five historical periods. In each period, the use of randomised trials was…

"ACCESS", A Culture Creating Effective Systems for Success, was a three-year Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. The "ACCESS" grant led the way for a district-wide redesign of educational practices based on the novel approach of…

Educators have embraced the promotion of social emotional development, student well-being, and mental health as essential educational objectives to promote academic readiness and growth. To address known research-to-practice gaps and limited availability of evidence-based, universal high school programs, we took a community-based participatory…

The Design Implementation Framework, or DIF, is a design approach that evaluates learner and user experience at multiple points in the development of intelligent tutoring systems. In this chapter, we explore how DIF was used to make system modifications to iSTART, a game-based intelligent tutoring system for reading comprehension. Using DIF as a…

Many states have scaled up School-Wide Positive Behavioral Interventions and Supports (SW-PBIS) with the goal of improving student behavior and academic outcomes. Although the effects of SW-PBIS on behavioral and discipline outcomes have been promising, the findings for academic achievement have been inconclusive and are often limited to…

"12 for Life" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "12 for Life" provides a rigorous STEM curriculum, combined with on-the-job-training, work/life skills development, mentoring, and employment opportunities to high school students…

The conventional approach to school implementation involves different sets of schools in designing, developing, and testing an innovation and yet another set of schools involved in implementation at scale. Decades of research suggest that this approach has yielded inconsistent and often disappointing improvements for schools most in need. More…

The goal of the Rural Math Excel Partnership (RMEP) project, a development project funded by the U.S. Department of Education Investing in Innovation (i3) grant program, was to develop a model of shared responsibility among families, teachers, and communities in rural areas as collective support for student success in and preparation for advanced…

"INSPIRE" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "INSPIRE" provides an innovative integrated K-12 STEM pipeline approach focused on STEM course content and instructional redesign. The INSPIRE model was implemented in Cabarrus County…

The Schools to Watch: School Transformation Network Project is a whole school reform model designed to improve the educational practices, experiences, and outcomes of low-performing middle-grades schools. Developed by the National Forum to Accelerate Middle-Grades Reform, the four-year project was funded in 2010 by a U.S. Department of Education…