Field experiments in education frequently assign entire groups such as schools to treatment or control conditions. These experiments incorporate sometimes a longitudinal component where for example students are followed over time to assess differences in the average rate of linear change, or rate of acceleration. In this study, we provide methods…

The statistical method "meta-analysis" is perhaps unique as a contribution to empirical inquiry of many types because it arose entirely within the practice of education research. In spite of its origins, meta-analysis has found its widest application and most important contributions in the field of medicine. Contrasting the success of…

The recently reported i3 Scale-Up of Reading Recovery (May et al., 2015) found an effect size of +0.69 in favor of Reading Recovery compared to the control group. We discuss four issues: (a) many of the lowest achieving students were excluded from participation in Reading Recovery; (b) the control group received a range of different experiences;…

Experimental evaluations that involve the educational system usually involve a hierarchical structure (students are nested within classrooms that are nested within schools, etc.). Concerns about contamination, where research subjects receive certain features of an intervention intended for subjects in a different experimental group, have often led…

This study explores the extent to which differences in research design explain variation in Head Start program impacts. We employ meta-analytic techniques to predict effect sizes for cognitive and achievement outcomes as a function of the type and rigor of research design, quality and type of outcome measure, activity level of control group, and…

This meta-analysis summarizes results from k = 24 studies comparing either Brief Strategic Family Therapy, Functional Family Therapy, Multidimensional Family Therapy, or Multisystemic Therapy to either treatment-as-usual, an alternative therapy, or a control group in the treatment of adolescent substance abuse and delinquency. Additionally, the…

For the 2014 study, "The Iterative Development and Initial Evaluation of We Have Skills!, an Innovative Approach to Teaching Social Skills to Elementary Students", researchers examined the effects of We Have Skills! (WHS), a supplemental, video-based social skills program for early elementary students. WHS consists of three components:…

The study, "The Impact of Indiana's System of Interim Assessments on Mathematics and Reading," examined the effects of using Diagnostic Assessment Tools (DAT) on mathematics and reading outcomes for students in 59 Indiana schools during the 2009-10 academic year. DAT consists of interim assessment tools--Wireless Generation's mCLASS for…

This study contextualizes an effect-size-like index of educational treatment effects or any group mean differences in academic achievement by referencing time. The new effect size metric can enrich effect size interpretations while serving as a supplement (but not substitute) for conventional standardized effect size measures. Specifically, the…

"Spelling Mastery" is designed to explicitly teach spelling skills to students in grades 1 through 6. One of several Direct Instruction curricula from McGraw-Hill that precisely specify how to teach incremental content, "Spelling Mastery" includes phonemic, morphemic, and whole-word strategies. The What Works Clearinghouse…

Most people would agree that helping students learn new information is important; however, there are numerous methods for achieving this goal, and not all of them have been proven to be effective. One method with intuitive appeal and some empirical backing is prompting students to self-explain. A self-explanation can be defined as generating…

Benchmarking is a program evaluation approach that can be used to study whether the outcomes of parents/children who participate in an evidence-based program in the community approximate the outcomes found in randomized trials. This paper presents a case illustration using benchmarking methodology to examine a community implementation of…

Field experiments that involve nested structures frequently assign treatment conditions to entire groups (such as schools). A key aspect of the design of such experiments includes knowledge of the clustering effects that are often expressed via intraclass correlation. This study provides methods for constructing a more powerful test for the…

The 2013 study, "Interactive Learning Online at Public Universities: Evidence From a Six-Campus Randomized Trial," examined the impact of interactive learning online (ILO) on the pass rates of 605 students enrolled in introductory statistics courses at six public universities. ILO is a form of online course instruction in which…

The study reviewed here examined the effect of charter schools on annual student achievement growth in reading and math in 25 states, the District of Columbia, and New York City. The study primarily used data on students in grades 3-8, but additional elementary and high school grades were included for several states. The authors reported that…