Background/Context: Observational studies often employ regression discontinuity (RD) designs and multiple control-group designs to explore the causal quantities of interest. RD designs assess policy and program effectiveness by assigning subjects to treatment based on whether they exceed a pre-defined cutoff. RD designs are classified into two…

Background/Context: Some observational studies involve multiple layers of treatment selection, specifically in the context of the extended time accommodation (ETA) for English language learners (ELLs). In ETA settings, the first selection occurs due to the eligibility rule, where students whose ELL English proficiency is below a certain threshold…

Background/Context: Sometimes students with the academic credentials to attend more selective colleges enroll in a less selective institution or do not enroll at all, a phenomenon known as undermatching (Bowen et al., 2009; Roderick et al., 2011; Smith et al., 2013; Rodriguez, 2015). Undermatching is associated with lower graduation rates and…

Context: Assessments of baseline equivalency of intervention and control groups, "balance," play a critical role in evaluating educational interventions. The highest What Works Clearinghouse (WWC) of the Institute of Educational Studies (IES) standard for educational studies, "Meets WWC Design Standards Without Reservations,"…

This paper examines the "ecological validity" of a randomized controlled trial (RCT) conducted in 42 high schools to measure the impact of a content literacy program. This study of comparable schools implementing the same program in different contexts highlights characteristics that are often not attended to in rigorous effectiveness…

The Comparative Short Interrupted Time Series (C-SITS) design is a frequently employed quasi-experimental method, in which the pre- and post-intervention changes observed in the outcome levels of a treatment group is compared with those of a comparison group where the difference between the former and the latter is attributed to the treatment. The…

A consistent finding across early childhood interventions targeting mathematics and other achievement-related skills that is that initial treatment effects fade over time, with children not receiving the intervention catching up to children who did (Clements et al., 2013; Leak et al., 2010; Puma et al., 2010). One popular explanation for this is…

The purpose of this study is to study the performance of different methods (inverse probability weighting and estimation of informative bounds) to control for differential attrition by comparing the results of different methods using two datasets: an original dataset from Portland Public Schools (PPS) subject to high rates of differential…

When randomized experiments cannot be conducted in practice, propensity score (PS) techniques for matching treated and control units are frequently used for estimating causal treatment effects from observational data. Despite the popularity of PS techniques, they are not yet well studied for matching multilevel data where selection into treatment…

The Knowledge Is Power Program (KIPP) is a national network of public charter schools whose stated mission is to help underserved students enroll in and graduate from college. As of 2014-2015 the network included 162 elementary, middle, and high schools serving 59,495 students. Questions remain, however, about the ability of charter school…

The Fidelity of Implementation (FOI) study that is the focus of this report was conducted as a component of a scale-up effectiveness trial of the SRA/McGraw-Hill Open Court Reading program. The overall purpose of the FOI study was to support and provide context for findings from the larger experimental impact study of Open Court Reading (OCR). To…

Meta-analyses are syntheses of effect-size estimates obtained from a collection of studies to summarize a particular field or topic (Hedges, 1992; Lipsey & Wilson, 2001). These reviews are used to integrate knowledge that can inform both scientific inquiry and public policy, therefore it is important to ensure that the estimates of the effect…

Out-of-school factors can significantly impact students' readiness to learn and thrive in school. Research confirms that larger social structures and contexts beyond the school are critical, accounting for up to two-thirds of the variance in student achievement (Coleman et al., 1966; Rothstein, 2010; Phillips, Brooks-Gunn, Duncan, Klebanov, &…

Motivated by the passage of the No Child Left Behind (NCLB) Act, all states operate accountability systems that measure and report school and student performance annually. The purpose of this study is to examine the effects of interim assessments on the achievement gap. The authors examine the impact of interim assessments throughout the…

Student achievement in literacy has been a focal concern in the United States for many years. Improving teachers' knowledge and skill that leads to improved student achievement, particularly in the early grades, can place children on an improved trajectory that can have long-term impacts on life outcomes. Over the past decade, a large body of…