Background/Context: The reckoning with racial injustice and growing inequality that have become hallmarks of the early 2020s in the United States has implications for impact analysis and the evidence it produced for public policy decision-making. Various researchers have highlighted the shortcomings that impact analyses have when estimating the…

Random encouragement designs are randomized controlled trials (RCTs) that test interventions aimed at increasing participation in a program or activity whose take up is not universal. In these RCTs, instead of randomizing individuals or clusters directly into treatment and control groups to participate in a program or activity, the randomization…

This article introduces an alternative impact parameter for group-based RCTs with student mobility--the survivor average causal effect ("SACE")--that pertains to the subpopulation of original cohort students who would remain in their baseline study schools in either the treatment or control condition. The "SACE" parameter has a clear…

In this paper, the authors examine some of the ways that different types of non-equivalent comparison groups can be used to strengthen causal inferences based on regression discontinuity design (RDD). First, they consider a design that incorporates pre-test data on assignment scores and outcomes that were collected either before the treatment…

In recent years, the regression discontinuity design (RDD) has gained widespread recognition as a quasi-experimental method that when used correctly, can produce internally valid estimates of causal effects of a treatment, a program or an intervention (hereafter referred to as treatment effects). In an RDD study, subjects or groups of subjects…

The purpose of this paper is to clarify the assumptions that must be met if this--multiple site, multiple mediator--strategy, hereafter referred to as "MSMM," is to identify the average causal effects (ATE) in the populations of interest. The authors' investigation of the assumptions of the multiple-mediator, multiple-site IV model demonstrates…

Response to Intervention (RTI) is a tiered instructional delivery framework developed to meet the needs of all students and has the potential to improve reading achievement, prevent reading problems, and improve identification accuracy for learning disabilities. Tier 1 typically occurs in the context of the general education classroom and is…

The What Works Clearinghouse (WWC) seeks to provide educators, policymakers, researchers, and the public with a central and trusted source of scientific evidence for what works in education. The WWC was established in 2002 by the U.S. Department of Education's Institute of Education Sciences (IES). It serves as a decision-making resource by…

One of the most widely used commercially available systems incorporating benchmark assessment and training in differentiated instruction is the Northwest Evaluation Association's (NWEA) Measures of Academic Progress (MAP) program. The MAP program involves two components: (1) computer-adaptive assessments administered to students three to four…

In this paper the authors extend recent work on mediation in a multilevel setting and on causal inference under interference among units to develop a template for the mediation analysis of group randomized educational interventions. The present work will contribute to the literature on interference, in particular on interference in the context of…

The authors' primary aim was to investigate a potential causal relationship between spatial ability and math ability. To do so, they used a pretest-training-posttest experimental design in which children received short-term spatial training and were tested on problem solving in math. They focused on first and second graders because earlier studies…

Randomized trials of educational interventions often face logistical hurdles (Cook, 2002). For example, sometimes they are prevented from reaching their full-term. This would happen if, as a condition of participation, subjects insist on receiving the treatment program within a certain timeframe. This timeframe may be shorter than the full-term…

This paper illustrates how information collected through interviews can develop a richer understanding of the assignment mechanism, which can result in more plausible causal effect estimates from observational studies and provides a roadmap for sensitivity analysis. Focusing on the issue of assignment to algebra in 8th grade, the author shows how…

The objective of this paper is to provide some practical insight into the process of implementing large-scale randomized controlled trials (RCT) in educational settings and to provide general recommendations for researchers conducting education-based RCTs in the future. The authors draw their recommendations from their recent experiences…