Randomized controlled trials (RCTs) in education are common as the design allows for an unbiased estimate of the overall impact of a program. As more RCTs are completed, researchers are also noting that an overall average impact may mask substantial variation across sites or groups of individuals. Mixed methods can provide insight and help in…

Learner-centered coaching and feedback are relevant to various educational contexts. Spaced retrieval enhances long-term knowledge retention. We examined the efficacy of Blank Slate, a novel spaced retrieval software application, to promote learning and prevent forgetting, while gathering and analyzing data in the background about learners'…

This article assesses the likely generalizability of educational treatment-effect estimates from regression discontinuity designs (RDDs) when treatment assignment is based on academic pretest scores. Our assessment uses data on outcome and pretest measures from six educational experiments, ranging from preschool through high school, to estimate…

This article assesses the likely generalizability of educational treatment-effect estimates from regression discontinuity designs (RDDs) when treatment assignment is based on academic pretest scores. Our assessment uses data on outcome and pretest measures from six educational experiments, ranging from preschool through high school, to estimate…

Randomized trials are often conducted with separate randomizations across multiple sites such as schools, voting districts, or hospitals. These sites can differ in important ways, including the site's implementation, local conditions, and the composition of individuals. An important question in practice is whether--and under what…

Good research in education is defined as randomized experiments. For a study to be eligible to earn the highest possible rating from the What Works Clearinghouse (Meets WWC Standards without Reservations), the arbiter of what constitutes rigorous research within the U.S. Department of Education, it must use random assignment to determine group…

Estimating treatment effects for subgroups defined by posttreatment behavior (i.e., estimating causal effects in a principal stratification framework) can be technically challenging and heavily reliant on strong assumptions. We investigate an alternative path: using bounds to identify ranges of possible effects that are consistent with the data.…

Qualitative researchers often have to decide whether to collect data using focus groups or individual interviews. We systematically compare these two methods on their ability to generate two types of information: unique items in a brainstorming task and personally sensitive disclosures. Our study sample consisted of 350 African-American men living…

We report here the type of problems and solutions that 38 school teams reported during a randomized wait-list controlled trial of one problem-solving approach (Team Initiated Problem Solving [TIPS]). The experimental results from that analysis are reported elsewhere. The purpose of this article is to summarize companion descriptive data from this…

The primary purpose of the 2017-2018 NC Pre-Kindergarten (NC Pre-K) Evaluation was to examine the effectiveness of the NC Pre-K Program using a randomized controlled trial (RCT) design. The major issue addressed by this type of study is around the benefits of offering children access to enrollment in NC Pre-K. An RCT is considered the…

The primary purpose of the 2017-2018 NC Pre-Kindergarten (NC Pre-K) Evaluation was to examine the effectiveness of the NC Pre-K Program using a randomized controlled trial (RCT) design. Because children are randomly assigned to either receive NC Pre-K (treatment) or not (control) in an RCT, differences in outcomes can be causally attributed to…

School districts are increasingly adopting technology-based resources in an attempt to improve student achievement. This paper reports the two-year results from randomized control trial of Achieve3000 in the Wake County Public School System (WCPSS) in Raleigh, North Carolina. Achieve3000 is an early literacy program that differentiates non-fiction…

Cluster randomized experiments are now widely used to examine intervention effects in prevention science. It is meaningful to use empirical benchmarks for interpreting effect size in prevention science. The effect size (i.e., the standardized mean difference, calculated by the difference of the means between the treatment and control groups,…

The purpose of this paper is to showcase new research that seeks to provide guidance on the heterogeneity of treatment effects by utilizing the variance of demographic differences in state assessments. This study is focused on a simple randomized block design where students are nested within schools, and within each school students are randomized…

Randomized controlled trials (RCTs) are rarely used to evaluate social and behavioral interventions designed for releasing prisoners. Objective: We use a pilot RCT of a social support intervention (Support Matters) as a case example to discuss obstacles and strategies for conducting RCT intervention evaluations that span prison and community…