As reporting of effect sizes in evaluation studies has proliferated, researchers and consumers of research need tools for interpreting or benchmarking the magnitude of those effect sizes that are relevant to the intervention, target population, and outcome measure being considered. Similarly, researchers planning education studies with social and…

When studies use different scales to measure continuous outcomes, standardised mean differences (SMD) are required to meta-analyse the data. However, outcomes are often reported as endpoint or change from baseline scores. Combining corresponding SMDs can be problematic and available guidance advises against this practice. We aimed to examine the…

We conducted a systematic review to identify randomized controlled trials (RCTs) and single case research design (SCRD) studies of children with autism spectrum disorder that evaluate the effectiveness of responsivity intervention techniques for improving prelinguistic and/or language outcomes. Mean effect sizes were moderate and large for RCTs…

Over the past 15 years, we have seen an increase in the use of cluster randomized trials (CRTs) to test the efficacy of educational interventions. These studies are often designed with the goal of determining whether a program works, or answering the what works question. Recently, the goals of these studies expanded to include for whom and under…

Early intervention efforts have been effective in reducing disruptive behaviors and the probability of poor developmental outcomes. Early interventions include common practice elements to improve social functioning and decrease problem behaviors that disrupt the teaching-learning process. The First Step Next intervention has been well validated…

This report presents findings from exploratory, descriptive meta-analyses of effect sizes reported by the first 82 EEF evaluations that used a randomised controlled trial (RCT) or clustered RCT impact evaluation design published up to January 2019. The review used a theoretical framework derived from literature with five overarching themes to…

Group social skills interventions (GSSIs) are a commonly offered treatment for children with high functioning ASD. We critically evaluated GSSI randomised controlled trials for those aged 6-25 years. Our meta-analysis of outcomes emphasised internal validity, thus was restricted to trials that used the parent-report social responsiveness scale…

This article discusses the nonuse, misuse, and proper use of pilot studies in experimental evaluation research. The authors first show that there is little theoretical, practical, or empirical guidance available to researchers who seek to incorporate pilot studies into experimental evaluation research designs. The authors then discuss how pilot…

Most evaluators have embraced the goal of evidence-based practice (EBP). Yet, many have criticized EBP review systems that prioritize randomized control trials and use various criteria to limit the studies examined. They suggest this could produce policy recommendations based on small, unrepresentative segments of the literature and recommend a…

The objective was to qualitatively examine the treatment effects of depression interventions on young, Black males (YBM) across treatment providers and settings via a review. Randomized controlled trials (RCTs) seeking to ameliorate depressive symptomology in Black males ages 12-29 were eligible for inclusion. After review of 627 abstracts and 212…

The aim of the present study is to determine the influence of student-centered methods employed in Turkish language instruction on the academic success of students through meta-analysis. To this end, a literature review was conducted on the relevant studies conducted between 2000 and 2016 in order to determine the studies were suitable for the…

As evidence becomes increasingly important in educational policy, it is essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. A total of 645 studies from 12 recent reviews of evaluations of preschool, reading, mathematics, and science programs were studied. Effect…

We describe our experience of using a modified version of the Cochrane risk of bias (RoB) tool for randomised and non-randomised comparative studies. Objectives: (1) To assess time to complete RoB assessment; (2) To assess inter-rater agreement; and (3) To explore the association between RoB and treatment effect size. Methods: Cochrane risk of…

Background: For a majority of the world's children, despite substantial increases in primary school enrollment, academic learning is neither occurring at expected rates nor supplying the basic foundational skills necessary to succeed in the 21st century. The significant lag in academic achievement tells us that simply making formal education…

This meta-analysis summarizes research on the effects of a comprehensive, interactive web-based software (AXXX) on the development of reading competencies among kindergarteners and elementary students. Findings from seven randomized control trials and quasi-experimental studies undertaken in a variety of contexts across Canada, Australia and Kenya…