Rigorous evidence of program effectiveness has become increasingly important with the 2015 passage of the Every Student Succeeds Act (ESSA). One question that has not yet been fully explored is whether program evaluations carried out or commissioned by developers produce larger effect sizes than evaluations conducted by independent third parties.…

The Institute of Education Sciences has funded more than 100 experiments to evaluate educational interventions in an effort to generate scientific evidence of program effectiveness on which to base education policy and practice. In general, these studies are designed with the goal of having adequate statistical power to detect the average…

Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…

With research indicating substantial differences among teachers in terms of their effectiveness (Nye, Konstantopoulous, & Hedges, 2004), a major focus of recent research in education has been on improving teacher quality through professional development (Desimone, 2009; Institute of Educations Sciences [IES], 2012; Measures of Effective…

The purpose of this article is to synthesize the available studies regarding responsive interaction intervention (RII) for children with or at risk for developmental delays with a focus on six dimensions: (a) the characteristics of participants, (b) the features of RII, (c) the measurement of treatment fidelity, (d) the overall effectiveness of…

This review examines the effectiveness of educational technology applications in improving the reading achievement of struggling readers in elementary schools. The review applies consistent inclusion standards to focus on studies that met high methodological standards. A total of 20 studies based on about 7,000 students in grades K-6 were included…

The purpose of this review is to learn from rigorous evaluations of alternative technology applications how features of using technology programs and characteristics of their evaluations affect reading outcomes for students in grades K-12. The review applies consistent inclusion standards to focus on studies that met high methodological standards.…

PCI Education conducted a three-year longitudinal study to determine the comparative effectiveness of the "PCI Reading Program" ("PCI") for students with severe disabilities as implemented in Florida's Brevard Public Schools and Miami-Dade County Public Schools. The primary question addressed by the study is whether students…

This article examines theoretical and empirical issues related to the statistical power of impact estimates for experimental evaluations of education programs. The author considers designs where random assignment is conducted at the school, classroom, or student level, and employs a unified analytic framework using statistical methods from the…

PCI Education sought scientifically based evidence on the effectiveness of the "PCI Reading Program--Level One" for students with severe disabilities. During the 2007-2008 academic year. Empirical Education conducted a randomized control trial (RCT) in two Florida districts, Brevard and Miami-Dade County Public Schools. For this…

Strength and integrity issues are central to planning and interpreting evaluation studies. In the absence of actual data from previous studies, estimates of strength and integrity can often be derived in other ways. These issues of strength and integrity are described in the context of resource allocation in evaluation research. (Author/BS)

An outreach and linkage program for the homeless mentally ill documented successful outcomes in terms of housing but not in terms of functioning for the 163 participants. Recruitment source, client functioning cluster type, and hours of service received were predictors of the four-month residential setting. (SLD)

This report summarizes the National Job Training Partnership Act (JTPA) Study, which examined the impact of Title IIA of JTPA on participants' employment, earnings, and welfare receipt. Between 1987 and 1989, more than 20,000 adults and out-of-school youths who applied for JTPA services in 16 areas across the country were randomly assigned to a…

In August 1996 Jay P. Greene, Paul E. Peterson, and Jiangtao Du, with Leesa Boeger and Curtis L. Frazier, issued a report called "The Effectiveness of School Choice in Milwaukee." The report, referred to as GPDBF, presented data that indicated that low-income minority students in their third and fourth years of participation in the…

The No Child Left Behind Act (P.L. 107-110) called for the U.S. Department of Education to carry out a national study of the effectiveness of educational technology. With computers becoming ubiquitous in American schools, and purchases of hardware and software now substantial expenses for school districts, whether funding is supporting effective…