Binary outcomes are often analyzed in cluster randomized trials (CRTs) using logistic regression and cluster robust standard errors (CRSEs) are routinely used to account for the dependent nature of nested data in such models. However, CRSEs can be problematic when the number of clusters is low (e.g., < 50) and, with CRTs, a low number of…

Multi-site randomized controlled trials (RCTs) provide unbiased estimates of the average impact in the study sample. However, their ability to accurately predict the impact for individual sites outside the study sample, to inform local policy decisions, is largely unknown. To extend prior research on this question, we analyzed six multi-site RCTs…

Researchers face many choices when conducting large-scale multisite individually randomized control trials. One of the most common quantities of interest in multisite RCTs is the overall average effect. Even this quantity is non-trivial to define and estimate. The researcher can target the average effect across individuals or sites. Furthermore,…

Evaluators of education interventions are increasingly designing studies to detect impacts much smaller than the 0.20 standard deviations that Cohen characterized as "small." While the need to detect smaller impacts is based on compelling arguments that such impacts are substantively meaningful, the drive to detect smaller impacts may…

This article assesses the likely generalizability of educational treatment-effect estimates from regression discontinuity designs (RDDs) when treatment assignment is based on academic pretest scores. Our assessment uses data on outcome and pretest measures from six educational experiments, ranging from preschool through high school, to estimate…

Maternal education is one of the strongest predictors of children's academic outcomes. One possible explanation for this is that more highly educated mothers more frequently engage in parenting practices that may promote children's later cognitive development; however, most of this evidence is correlational. This study uses Head Start Impact Study…

Despite consensus that school absenteeism has negative consequences for children's life outcomes, until recently, little was known about the prevalence of absenteeism or its potential to moderate the impacts of school-based interventions. This study provides evidence from a randomized experiment of a preschool intervention involving 1,876 children…

Research shows that participation in school-based arts education has declined over the past decade. A problem for the arts' role in education has been a lack of rigorous scholarship that demonstrates educational benefits. A component of this problem has been a lack of available data. In this study, we use original data collected through a…