In 2018 the Center for Universal Education (CUE) at Brookings launched a series of Real-time Scaling Labs (RTSL) to generate more evidence and provide practical recommendations on how to expand, deepen, and sustain the impact of education initiatives leading to transformative change in education systems, especially for the most disadvantaged…

Suppose an education researcher wants to test the impact of a high school drop-out prevention intervention in which at-risk students attend classes to receive intensive summer school instruction. The district will allow the researcher to randomly assign students to the treatment classes or to the control group. Half of the students (the treatment…

Mediation is usually assessed by a regression-based or structural equation modeling (SEM) approach that we refer to as the classical approach. This approach relies on the assumption that there are no confounders that influence both the mediator, "M", and the outcome, "Y". This assumption holds if individuals are randomly…

Programs that address the needs of low-income parents and children at the same time may hold promise for reducing the transmission of poverty across generations. Contemporary programs of this type address some key weaknesses that may have limited the effectiveness of earlier such approaches, including too little attention paid to the quality,…

Treatment integrity, in its broadest sense, is the extent to which an intervention is implemented as intended. Over the past 3 decades, understanding of treatment integrity has greatly evolved. This book summarizes the current state of our knowledge of treatment integrity on such topics as: (1) how it fits into the larger contexts of…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

This volume focuses on how family-school partnerships are conceptualized, defined, and operationalized as well as the research that is needed to advance these foundational issues. Each chapter integrates prevailing approaches into a research-based framework for supporting learning from pre-K through high school. The book incorporates structural…

This paper provides practical guidance for researchers who are designing and analyzing studies that randomize schools--which comprise three levels of clustering (students in classrooms in schools)--to measure intervention effects on student academic outcomes when information on the middle level (classrooms) is missing. This situation arises…

Selection bias is problematic when evaluating the effects of postsecondary interventions on college students, and can lead to biased estimates of program effects. While instrumental variables can be used to account for endogeneity due to self-selection, current practice requires that all five assumptions of instrumental variables be met in order…

The purpose of this article is to describe mediating variables and moderating variables and provide reasons for integrating them in outcome studies. Separate sections describe examples of moderating and mediating variables and the simplest statistical model for investigating each variable. The strengths and limitations of incorporating mediating…

One can distinguish statistical models used in causal modeling from the causal interpretations that align them with substantive hypotheses. Causal modeling typically assumes an efficient causal interpretation of the statistical model. Causal modeling can also make use of mereological causal interpretations in which the state of the parts…

As the education reform movement increasingly focuses on teachers and teaching, educators, policy-makers, and researchers need valid and reliable measures that can be used to evaluate individual teachers, provide guidance for improving teaching performance, and support research in ways that advance instruction and classroom dialog and practice. A…

Paradigms serve as metaphysical frameworks that guide researchers in the identification and clarification of their beliefs with regard to ethics, reality, knowledge, and methodology. The transformative paradigm is explained and illustrated as a framework for researchers who place a priority on social justice and the furtherance of human rights.…

Video modeling interventions involve a child watching videotapes of positive examples of adults, peers, or him- or herself engaging in a behavior that is being taught. The purpose of this review was to examine empirical studies in which video modeling interventions were applied to individuals with autism. Nineteen studies published between 1985…

There has been considerable discussion in recent years about the role in educational research of randomized controlled trials (RCTs) and systematic reviews (SR). Advocacy of these methods arose partly as a result of the spread of the notion of evidence-based practice from medicine into other fields, and of the rise of the "new public…