It is a healthy exercise to debate the merits of using effect-size benchmarks to interpret research findings. However, these debates obscure a more central insight that emerges from empirical distributions of effect-size estimates in the literature: Efforts to improve education often fail to move the needle. I find that 36% of effect sizes from…

It is not uncommon for randomised trials in education to have the performance of sample members in national examinations as their primary outcome. In many cases, examination results are available as summary measures only. Taking the example of GCSE examination results in England, this paper shows that using summary measures of an underlying score…

The National Board of Certification and Recertification for Nurse Anesthetists (NBCRNA) conducted a one-year research study comparing performance on the traditional continued professional certification assessment, administered at a test center or online with remote proctoring, to a longitudinal assessment that required answering quarterly…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

Relevance interventions have shown a great potential to foster motivation and achievement (Lazowski & Hulleman, 2016). Yet, further research is warranted to test how such interventions can be successfully implemented in practice. We conducted a cluster-randomized trial in ninth-grade math classrooms to test the effectiveness of a relevance…

Recent methods have sought to improve precision in randomized controlled trials (RCTs) by utilizing data from large observational datasets for covariate adjustment. For example, consider an RCT aimed at evaluating a new algebra curriculum, in which a few dozen schools are randomly assigned to treatment (new curriculum) or control (standard…

The provision of high-quality early mathematics instruction and intervention is critical to ensure that all students are on track for academic success. Given this, identifying and utilizing assessments that can enable the detection of nonresponse to mathematics instruction is a critical aspect of early intervention. To this end, the current study…

In the United States, school-based mentoring programs are a large and widely funded form of mentoring. Despite widespread support, meta-analyses indicate that the effects of school-based mentoring programs are small. One hypothesis for these results is that school-based mentors are not able to develop a sufficiently high-quality relationship with…

Taking a college entrance exam such as the ACT™ or SAT™ can be an important step in the college-going process. Although overall, 1 out of 10 students who register for the ACT on a national test date are absent on their registered test day, the absentee rate (at 21%) for students who registered with a fee waiver is substantially higher than the…

More than 20 percent of all school-aged children in the United States have vision problems, and low-income and minority children are disproportionately likely to have unmet vision care needs. Vision screening is common in U.S. schools, but it remains an open question whether screening alone is sufficient to improve student outcomes. We implemented…

The Teacher Observation intervention aimed to improve teacher effectiveness through structured peer observation. Teachers observe and are observed by their peers a number of times over the course of two years. It was delivered by the Centre for Market and Public Organisation (CMPO) at the University of Bristol. CMPO researchers trained lead…

In recent years, schools have started implementing preventive practices such as universal screening. Yet, researchers have not evaluated the extent to which universal screening contributes to academic and behavioral outcomes. The purpose of this study was to evaluate the treatment utility of universal screening for behavioral risk. Student…

Background: A cost-effective method to address reading delays is to use computer-assisted learning, but these techniques are not always effective. Methods: We evaluated a commercially available computer system that uses visual mnemonics, in a randomised controlled trial with 78 English-speaking children (mean age 7 years) who their schools…

We conducted a randomized controlled potential efficacy trial to examine effects of two variants of the Tools for Teachers (TfT) professional development (PD) intervention on preschool teachers' implementation of embedded instruction practices and children's developmental and learning outcomes. Thirty-six preschool teachers recruited from three…

The purpose of this closely aligned conceptual replication study was to investigate the efficacy of a Tier 2 kindergarten mathematics intervention. The replication study differed from the initial randomized controlled trial on three important elements: geographical region, timing of the intervention, and instructional context of the…