This study introduces an innovative meta-analytic approach, two-stage multilevel meta-analysis that considers the hierarchical structure of single-case experimental design (SCED) data. This approach is unique as it is suitable to include moderators at the intervention level, participant level, and study level, and is therefore especially…

Rigorous evidence of program effectiveness has become increasingly important with the 2015 passage of the Every Student Succeeds Act (ESSA). One question that has not yet been fully explored is whether program evaluations carried out or commissioned by developers produce larger effect sizes than evaluations conducted by independent third parties.…

Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes--overlap measures (percentage non-overlapping data, improvement rate…

This review describes a meta-analysis of findings from 50 controlled evaluations of intelligent computer tutoring systems. The median effect of intelligent tutoring in the 50 evaluations was to raise test scores 0.66 standard deviations over conventional levels, or from the 50th to the 75th percentile. However, the amount of improvement found in…

Attention-Deficit/Hyperactivity Disorder (ADHD) is a neurodevelopmental disability characterized by symptoms of inattention, hyperactivity and impulsiveness, which may cause impairment in a variety of cognitive, social, behavioral, and emotional domains. Extensive research has been conducted to determine the best course of treatment for…

Recent meta-analyses of the effectiveness of token economies (TEs) report insufficient quality in the research or mixed effects in the results. This study examines the contemporary (post-Public Law 94-142) peer-reviewed published single-case research evaluating the effectiveness of TEs. The results are stratified across quality of demonstrated…

The purpose of this review was to identify naturalistic language interventions for increasing spontaneous expressive language (defined in this review as absence of verbal prompt or other verbalization from adults or peers) in young children with autism spectrum disorder. Also, the methodological rigor and effectiveness of each study were evaluated…

This meta-analysis synthesized the findings from 23 published and five unpublished experimental or quasi-experimental group design studies on word problem-solving instruction for K-12 students with learning disabilities (LD) and mathematics difficulties (MD). A secondary purpose of this meta-analysis was to analyze the relation between treatment…

This meta-analysis provides an extensive and organized summary of intervention studies in education that are grounded in motivation theory. We identified 74 published and unpublished papers that experimentally manipulated an independent variable and measured an authentic educational outcome within an ecologically valid educational context. Our…

Background: Confounding caused by selection bias is often a key difference between non-randomized studies (NRS) and randomized controlled trials (RCTs) of interventions. Key methodological issues: In this third paper of the series, we consider issues relating to the inclusion of NRS in systematic reviews on the effects of interventions. We discuss…

This paper focuses on commonalities and differences of three approaches to large-scale professional development (PD) in mathematics education, based on two studies from Germany and one from the United States of America. All three initiatives break new ground in improving PD targeted at educating "multipliers", and in all three cases…

We review the effectiveness of first-year seminars based on the widely used criteria of first-year grades and the 1-year retention rate. Meta-analytic results indicate that first-year seminars have a small average effect on both first-year grades (k = 89, N = 52,406, d = 0.02) and the 1-year retention rate (k = 195, N = 169,666, d = 0.11). We…

Optimal levels of treatment fidelity, a critical moderator of intervention effectiveness, are often difficult to sustain in applied settings. It is unknown whether performance feedback, a widely researched method for increasing educators' treatment fidelity, is an evidence-based practice. The purpose of this review was to evaluate the current…

Much is known about how to improve students' comprehension when reading printed text; less is known about outcomes when reading digital text. The purpose of this meta-analysis was to analyze research on the impact of digital text interventions. A comprehensive literature search resulted in 27 group intervention studies with 16,513 participants.…

This study explores the extent to which differences in research design explain variation in Head Start program impacts. We employ meta-analytic techniques to predict effect sizes for cognitive and achievement outcomes as a function of the type and rigor of research design, quality and type of outcome measure, activity level of control group, and…