Background/Context: In meta-analysis examining educational intervention, characterizing heterogeneity and exploring the sources of variation in synthesized effects have become increasingly prominent areas of interest. When combining results from a collection of studies, statistical dependency among their effects size estimates will arise when a…

School climate is one of the variables that affect academic achievement, but the level of correlation between school climate and academic achievement differs. On the basis of these inconsistent results between school climate and academic achievement, researchers can use meta-analyses to shed light on relevant literature. The present study ran a…

This study introduces an innovative meta-analytic approach, two-stage multilevel meta-analysis that considers the hierarchical structure of single-case experimental design (SCED) data. This approach is unique as it is suitable to include moderators at the intervention level, participant level, and study level, and is therefore especially…

Colleges and universities play a critical role in shaping intergroup dynamics in an era of increasing racial tensions in the United States. Diversity courses may serve as one important approach for preparing college students for participation in an equitable and just society, since this coursework holds a unique position at many institutions to…

The focus of the current study is on handling the dependence among multiple regression coefficients representing the treatment effects when meta-analyzing data from single-case experimental studies. We compare the results when applying three different multilevel meta-analytic models (i.e., a univariate multilevel model avoiding the dependence, a…

Multilevel meta-analysis is an innovative synthesis technique used for the quantitative integration of effect size estimates across participants and across studies. The quantitative summary allows for objective, evidence-based, and informed decisions in research, practice, and policy. Based on previous methodological work, the technique results in…

This study investigates three methods to handle dependency among effect size estimates in meta-analysis arising from studies reporting multiple outcome measures taken on the same sample. The three-level approach is compared with the method of robust variance estimation, and with averaging effects within studies. A simulation study is performed,…

Multiple-baseline studies provide meta-analysts the opportunity to compute effect sizes based on either within-series comparisons of treatment phase to baseline phase observations, or time specific between-series comparisons of observations from those that have started treatment to observations of those that are still in baseline. The advantage of…

This study uses data from a comprehensive database of U.S. early childhood education program evaluations published between 1960 and 2007 to evaluate the relationship between class size, child-teacher ratio, and program effect sizes for cognitive, achievement, and socioemotional outcomes. Both class size and child-teacher ratio showed nonlinear…

When cluster randomized experiments are analyzed as if units were independent, test statistics for treatment effects can be anticonservative. Hedges proposed a correction for such tests by scaling them to control their Type I error rate. This article generalizes the Hedges correction from a posttest-only experimental design to more common designs…

In contrast to Early Intensive Behavioral Intervention (EIBI), there are far fewer meta-analyses evaluating Naturalistic Developmental Behavioral Interventions (NDBIs) (Schreibman et al., 2015). Indeed, Pivotal Response Treatment (PRT)--a prominent NDBI--lacks meta-analytic studies. In the context of developing a line of research on the…

Multilevel modeling techniques are becoming more popular in handling data with multilevel structure in educational and behavioral research. Recently, researchers have paid more attention to cross-classified data structure that naturally arises in educational settings. However, unlike traditional single-level research, methodological studies about…

The daily report card (DRC) is a commonly employed behavioral intervention for treating attention deficit hyperactivity disorder (ADHD) in schools. Much of the support for the DRC comes from single-case studies, which have traditionally received less attention than group studies. This lack of attention to single-case studies results in an…

The Daily Report Card (DRC) is a commonly employed behavioral intervention for treating Attention Deficit Hyperactivity Disorder (ADHD) in schools. Much of the support for the DRC comes from single-case studies, which have traditionally received less attention than group studies. This lack of attention to single-case studies results in an…

Randomized experiments are commonly used to evaluate the effectiveness of educational interventions. The goal of the present investigation is to develop small-sample corrections for multiple contrast hypothesis tests (i.e., F-tests) such as the omnibus test of meta-regression fit or a test for equality of three or more levels of a categorical…