This paper drills deeper into the documented effects of the Cognitive Tutor Algebra I and ASSISTments intelligent tutoring systems by estimating their effects on specific problems. We start by describing a multilevel Rasch-type model that facilitates testing for differences in the effects between problems and precise problem-specific effect…

This article presents the results of a study examining the highest implementers of the Schools to Watch (STW): School Transformation Network Project, and the impact the project had on their teaching/learning practices and outcomes. The project was funded by the U.S. Department of Education's Investing in Innovation (i3) grant program and was…

Data from a large-scale math intervention program were used to evaluate the degree to which implementation fidelity (IF) and interventionist content knowledge were associated with student outcomes. Data were available for 33 interventionists serving 658 students in Grades 4-6 across one school year. A series of multilevel models were fit to the…

These appendices accompany the report "Final Report of the i3 Impact Study of Making Sense of SCIENCE, 2016-17 through 2017-18." Science education has experienced a significant transition over the last decade, catalyzed by a re-envisioning of what students should know and be able to do in science. That re-envisioning culminated in the…

Many preschool language-focused interventions attempt to boost language and literacy skills in young children at risk in these areas of development, though the long-term effects of such interventions are not well-established. This study investigated kindergarten language and reading skills, specifically the subcomponents of vocabulary, decoding,…

The capacity of the field to conduct power analyses for group randomized trials (GRTs) of educational interventions has improved over the past decade (Authors, 2009). However, a power analysis depends on estimates of design parameters. Hence it is critical to build the empirical base of design parameters for GRTs across a variety of outcomes and…

The use and scope of after-school programs (ASPs) have always varied with the local context. Historically, affluent families used ASPs to provide enrichment for their children. During the Civil Rights and Black Nationalist movements, African Americans used ASPs for cultural and educational activities. In recent times, ASPs have been used for…