This article illustrates the value of large-scale impact evaluations with counterfactual components. It begins by exploring the limitations of small-scale impact studies, which do not allow reliable inference to a wider population or which do not use valid comparison groups. The paper then describes the design features of a recent large-scale…

The purpose of this paper is to showcase new research that seeks to provide guidance on the heterogeneity of treatment effects by utilizing the variance of demographic differences in state assessments. This study is focused on a simple randomized block design where students are nested within schools, and within each school students are randomized…

An appropriate estimate of statistical power is critical for the design of intervention studies. Although the inclusion of a pretest covariate in the test of the primary outcome can increase statistical power, samples selected on the basis of pretest performance may demonstrate range restriction on the selection measure and other correlated…

A quasi-experimental study was conducted to examine the impact of Strategic and Interactive Writing Instruction on 3rd-5th grade deaf and hard of hearing students' writing and written language compared to a business-as-usual condition (treatment group N = 41, comparison group N = 22). A total of 18 hours of instruction was provided for each of two…

Data-based decision making (DBDM) is an important element of educational policy in many countries, as it is assumed that student achievement will improve if teachers worked in a data-based way. However, studies that evaluate rigorously the effects of DBDM on student achievement are scarce. In this study, the effects of an intensive…

This study investigated the influence of strategy training instruction and an extrinsic incentive on American fourth- and fifth-grade students' (N = 35) performance, confidence in performance, and calibration accuracy. Using an experimental design, children were randomized to either an experimental group (strategy training and an extrinsic…

This experimental study examined the effectiveness of a text-based reading and vocabulary intervention with self-regulatory supports for 4th graders with low reading comprehension. Students with standard scores on the Gates MacGinitie Reading Test between 1.0 standard deviation (SD) and 0.5 SD below the normative sample were included (N=44) and…

This article describes the effects of an analysis-of-practice professional development (PD) program on elementary school students' (Grades 4-6) science outcomes. The study design was a cluster-randomized trial with an analysis sample of 77 schools, 144 teachers and 2,823 students. Forty-two schools were randomly assigned to treatment, (88.5 hours)…

We present results of an experimental study of an urban, museum-based science teacher PD programme. A total of 125 teachers and 1676 of their students in grades 4-8 were tested at the beginning and end of the school year in which the PD programme took place. Teachers and students were assessed on subject content knowledge and attitudes towards…

Reading and comprehending content area texts require learners to effectively select and encode with hierarchically strategic memory structures in order to combine new information with prior knowledge. Unfortunately, evidence from state and national tests shows that children fail to successfully navigate the reading comprehension challenges they…

The present study used a randomized control trial to examine the effects of a widely used multicomponent Tier 2-type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students…

The present study used a randomized control trial to examine the effects of a widely-used multi-component Tier 2 type intervention, Passport to Literacy, on the reading ability of 221 fourth graders who initially scored at or below the 30th percentile in reading comprehension. Intervention was provided by research staff to groups of 4-7 students…

Given the dearth of high-quality curriculum materials aligned with the new standards (NGSS and CCSS) and low student persistence in STEM fields, we sought to develop and test a STEM curriculum that would improve student knowledge, interest, and emotions. A cluster randomized control trial was conducted to assess the impact of Speedometry, a…

This article examines the effects of one year of exposure to "Learning to Read in a Healing Classroom" (LRHC) on the reading and math skills of second- to fourth-grade children in the low-income and conflict-affected Democratic Republic of the Congo. LRHC consists of two primary components: teacher resource materials that infuse…

The purpose of the present study was to examine the effects of a program that offered sustained strategic reading instruction on reading abilities of third and fourth graders. The study was conducted among 1,469 children from 40 schools in the Netherlands. Schools were randomly assigned to either the experimental or control group. Multilevel…