Background: When RCTs are not feasible and time series data are available, panel data methods can be used to estimate treatment effects on outcomes, by exploiting variation in policies and conditions over time and across locations. A complication with these methods, however, is that treatment timing often varies across the sample, for example, due…

Researchers face many choices when conducting large-scale multisite individually randomized control trials. One of the most common quantities of interest in multisite RCTs is the overall average effect. Even this quantity is non-trivial to define and estimate. The researcher can target the average effect across individuals or sites. Furthermore,…

Conventionally, regression discontinuity analysis contrasts a univariate regression's limits as its independent variable, "R," approaches a cut point, "c," from either side. Alternative methods target the average treatment effect in a small region around "c," at the cost of an assumption that treatment assignment,…

In basic regression discontinuity (RD) designs, causal inference is limited to the local area near a single cutoff. To strengthen the generality of the RD treatment estimate, a design with multiple cutoffs along the assignment variable continuum can be applied. The availability of multiple cutoffs allows estimation of a pooled average treatment…

In basic regression discontinuity (RD) designs, causal inference is limited to the local area near a single cutoff. To strengthen the generality of the RD treatment estimate, a design with multiple cutoffs along the assignment variable continuum can be applied. The availability of multiple cutoffs allows estimation of a pooled average treatment…

Information provided at the moment a person makes a decision can influence behavior in predictable ways. The United Kingdom's Behavioural Insights Team have used this idea to help improve the insulation of lofts, collect taxes, and even reduce litter. The authors of this article developed software that appends a personalized message to each…

Background: High parental self-efficacy (PSE) has been associated with healthy diets and higher levels of physical activity (PA) in children; however, data on PSE in relation to body weight and body composition are scarce. The objective of this study was to investigate associations of PSE with measures of diet, PA, body composition, and physical…

Evidence-based treatments (e.g. quitlines) are greatly underutilized by smokers limiting their public health impact. A three-session phone intervention for nonsmoking family members and friends (i.e. support persons) was successful for increasing smoker quitline enrollment. To enhance the intervention's potential translatability, in this study, we…

A meta-analysis of randomized controlled trials (RCTs) has recently showed that theory-based interventions designed to promote physical activity (PA) significantly increased PA behavior. The objective of the present study was to investigate the moderators of the efficacy of these theory-based interventions. Seventy-seven RCTs evaluating…

The What Works Clearinghouse (WWC) maintains design standards to identify rigorous, internally valid education research. As education researchers advance new methodologies, the WWC must revise its standards to include an assessment of the new designs. Recently, the WWC has revised standards for two emerging study designs: regression discontinuity…

With superintendents being overwhelmingly White, male, career educators, investigations into what factors contribute to the homogeneous composition of the position are warranted. This study examined whether superintendent candidates' and school board chairpersons' gender and candidates' professional background impact resume screening decisions.…

Despite recent interest in flipped classrooms, rigorous research evaluating their effectiveness is sparse. In this study, the authors implement a randomized controlled trial to evaluate the effect of a flipped classroom technique relative to a traditional lecture in an introductory undergraduate econometrics course. Random assignment enables the…

In recent years, schools have started implementing preventive practices such as universal screening. Yet, researchers have not evaluated the extent to which universal screening contributes to academic and behavioral outcomes. The purpose of this study was to evaluate the treatment utility of universal screening for behavioral risk. Student…

Students involved in bullying experience mental health issues and negative psychosocial outcomes. Few studies have investigated how teacher-student relationships (TSRs) may buffer the negative outcomes experienced by students involved in bullying. To investigate the moderating role of TSRs with bullying involvement status and psychosocial…

This article illustrates the value of large-scale impact evaluations with counterfactual components. It begins by exploring the limitations of small-scale impact studies, which do not allow reliable inference to a wider population or which do not use valid comparison groups. The paper then describes the design features of a recent large-scale…