Recently, there has been an increase in the number of cluster randomized trials (CRTs) to evaluate the impact of educational programs and interventions. These studies are often powered for the main effect of treatment to address the "what works" question. However, program effects may vary by individual characteristics or by context,…

In the coming years, public programs will capture even more and richer data than they do now, including data from web-based tools used by participants in employment services, from tablet-based educational curricula, and from electronic health records for Medicaid beneficiaries. Program evaluators seeking to take full advantage of these data…

The Good Participatory Practice (GPP) guidelines provide a framework for stakeholder engagement within clinical trials, to ensure a study's acceptability, feasibility, and improving the overall research quality; however, they have rarely been applied beyond this setting, and no literature exists on its application in adolescent research. A review…

Randomized trials play an important role in estimating the effect of a policy or social work program in a given population. While most trial designs benefit from strong internal validity, they often lack external validity, or generalizability, to the target population of interest. In other words, one can obtain an unbiased estimate of the study…

This article summarizes findings from a two-year randomized control trial, focusing on a subset of 194 fourth graders with reading comprehension scores at or below the 15th percentile. Students in the treatment condition received an average of 94 daily 30-min sessions of small group intervention implemented with fidelity by well-trained research…

Researchers are often interested in whether the effects of an intervention differ conditional on individual- or group-moderator variables such as children's characteristics (e.g., gender), teacher's background (e.g., years of teaching), and school's characteristics (e.g., urbanity); that is, the researchers seek to examine for whom and under what…

The aim of this study was to evaluate a rapid systematic review method in which randomised controlled trial (RCT) data was extracted from existing reviews and subsequent RCTs. The method enabled: identification of RCTs not included by existing reviews; cross-checking RCT data for consistency where there was more than one review; double data…

Background: Assessment of implementation is essential for the evaluation of school-based preventive activities. Interventions are more easily implemented in schools if detailed instructional manuals, lesson plans, and materials are provided; however, implementation may also be affected by other factors than the intervention itself--for example,…

This secondary analysis of data from a randomized control trial of an early mathematics intervention, ROOTS, explored whether patterns of intervention response were best categorized by the typical response/non-response binary or a more complex framework with additional response profiles. Participants included kindergarten students at risk for…

The paradigm of evidence-based education continues to inform the development of policy in a number of countries. At its simplest level, evidence-based education incorporates evidence, often that provided by randomised controlled trials, into classroom practice. England's Education Endowment Foundation is in the process of exporting evidence-based…

We performed an empirical study of the perceived quality of scientific graphics produced by beginning R users in two plotting systems: the base graphics package ("base R") and the ggplot2 add-on package. In our experiment, students taking a data science course on the Coursera platform were randomized to complete identical plotting…

A prior cluster randomized controlled trial (RCT) compared outcomes for a comprehensive school intervention (schoolMAX) to typical educational programming (services-as-usual [SAU]) for 103 children with autism spectrum disorder (ASD) without intellectual disability. The schoolMAX intervention was superior to SAU in improving social-cognitive…

Many public and private initiatives have focused on improving prekindergarten (PK) through Grade 12 mathematics education, given that the mathematics content learned before college is foundational for later learning and college success across STEM subjects. Although decades of educational research have studied PK-12 mathematics interventions, the…

We consider situations in which public charter school lotteries are neither universally conducted nor consistently documented. Such lotteries produce "broken" Randomized Control Trials, but provide opportunities to assess the internal validity of quasi-experimental research designs. Here, we present the results of a statewide charter…

In response to the increasing emphasis on 'evidence-based teaching', this article examines the privileging of randomised controlled trials and their statistical synthesis (meta-analysis). It also pays particular attention to two third-level statistical syntheses: John Hattie's "Visible learning" project and the EEF's "Teaching and…