Multi-site randomized controlled trials (RCTs) provide unbiased estimates of the average impact in the study sample. However, their ability to accurately predict the impact for individual sites outside the study sample, to inform local policy decisions, is largely unknown. To extend prior research on this question, we analyzed six multi-site RCTs…

Education decisionmakers need access to the best evidence about the effectiveness of education interventions, including practices, products, programs, and policies. It can be difficult, time consuming, and costly to access and draw conclusions from relevant studies about the effectiveness of interventions. The What Works Clearinghouse (WWC)…

Using an RD design provides statistically robust estimates while allowing researchers a different causal estimation tool to be used in educational environments where an RCT may not be feasible. Results from External Evaluation of the i3 Scale-Up of Reading Recovery show that impact estimates were remarkably similar between a randomized control…

In basic regression discontinuity (RD) designs, causal inference is limited to the local area near a single cutoff. To strengthen the generality of the RD treatment estimate, a design with multiple cutoffs along the assignment variable continuum can be applied. The availability of multiple cutoffs allows estimation of a pooled average treatment…

In basic regression discontinuity (RD) designs, causal inference is limited to the local area near a single cutoff. To strengthen the generality of the RD treatment estimate, a design with multiple cutoffs along the assignment variable continuum can be applied. The availability of multiple cutoffs allows estimation of a pooled average treatment…

A meta-analysis of randomized controlled trials (RCTs) has recently showed that theory-based interventions designed to promote physical activity (PA) significantly increased PA behavior. The objective of the present study was to investigate the moderators of the efficacy of these theory-based interventions. Seventy-seven RCTs evaluating…

Outdoor orientation programs have a growing literature demonstrating positive impacts with students transitioning to college (Bell, Gass, Nafizer, & Starbuck, 2014). One of the most valued outcomes for colleges and universities is retention of students until successful graduation. This is an outcome few outdoor orientation researchers have…

Background: The purpose is to determine if altering school breakfast policies and the school breakfast environment will positively impact adolescent beliefs of the barriers and benefits of eating breakfast. Methods: There were 904 adolescents from 16 rural high schools, Minnesota, in the BreakFAST Study who reported eating breakfast fewer than 4…

More than 100 million people globally are estimated to be exposed to arsenic in drinking water that exceeds the World Health Organization guideline of 10 µg/L. In an effort to develop and test a low-cost sustainable approach for water arsenic testing in Bangladesh, we conducted a randomized controlled trial which found arsenic educational…

Increasing teacher efficacy poses challenges to educational leaders, highlighting the need for a study of the awareness and development of strengths related to teacher efficacy. The purpose of the current study was to examine the effect of the awareness and development of strengths on teachers' perceived self-efficacy, as well as to determine if…

This study examined differences in students' classroom motivational climate perceptions and motivational beliefs between those enrolled in undergraduate Biology courses that implemented an innovative, active learning intervention and those enrolled in traditional Biology courses (control group). This study also sought to determine whether…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies. The impact estimators are derived using the building blocks of experimental designs with minimal assumptions, and have good statistical properties. The methods apply to randomized controlled trials (RCTs) and…

A new design-based theory has recently been developed to estimate impacts for randomized controlled trials (RCTs) and basic quasi-experimental designs (QEDs) for a wide range of designs used in social policy research (Imbens & Rubin, 2015; Schochet, 2016). These methods use the potential outcomes framework and known features of study designs…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Imbens and Rubin, 2015; Schochet, 2015, 2016). The estimators are derived using the building blocks of experimental designs with minimal assumptions, and are unbiased and normally distributed in large samples…

Background: Community health worker (CHW) interventions are known to be an effective strategy to improve health behaviors and outcomes in relation to diabetes, particularly for racial/ethnic communities. Although understanding the function of identity with same race/ethnicity among clients of CHW interventions could contribute to more effective…