We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

More than 20 percent of all school-aged children in the United States have vision problems, and low-income and minority children are disproportionately likely to have unmet vision care needs. Vision screening is common in U.S. schools, but it remains an open question whether screening alone is sufficient to improve student outcomes. We implemented…

This randomized controlled trial in 55 low-performing schools across Florida compared 2 early literacy interventions--1 using stand-alone materials and 1 using materials embedded in the existing core reading/language arts program. A total of 3,447 students who were below the 30th percentile in vocabulary and reading-related skills participated in…

This randomized controlled trial in 55 low-performing schools across Florida compared 2 early literacy interventions--1 using stand-alone materials and 1 using materials embedded in the existing core reading/language arts program. A total of 3,447 students who were below the 30th percentile in vocabulary and reading-related skills participated in…

Randomized experiments have long been established as the gold standard for addressing causal questions. However, experiments are not always feasible or desired, so observational methods are also needed. When multiple observations on the same variable are available, a repeated measures design may be used to assess whether a treatment administered…

Despite schools increasingly adopting multitiered systems of support (MTSS) for prevention and intervention of mental health concerns, many are slow to adopt universal mental health screening (UMHS), a core MTSS feature, due to concerns about their limited capacity to meet the needs of all identified. In this study, we examined differences in the…

The objective of the present study was to evaluate the extent to which students who took a computer adaptive test of reading comprehension accounting for testlet effects were administered fewer passages and had a more precise estimate of their reading comprehension ability compared to students in the control condition. A randomized controlled…

Researchers are increasingly using comparative interrupted time series (CITS) designs to estimate the effects of programs and policies when randomized controlled trials are not feasible. In a simple interrupted time series design, researchers compare the pre-treatment values of a treatment group time series to post-treatment values in order to…

The goal of this pilot study was to evaluate the effectiveness of a multi-component consultation package in improving teachers' classroom management skills, particularly among teachers with lower baseline levels of knowledge, skills, and intervention-supportive beliefs. Participants were 58 elementary school teachers (93% female; 50% Non-Hispanic…

The goal of this paper is to provide guidance for applied education researchers in using multi-level data to study the effects of interventions implemented at the school level. Two primary approaches are currently employed in observational studies of the effect of school-level interventions. One approach employs intact school matching: matching…

Maladaptive adolescent behavior patterns often create escalating conflict with adults and peers, leading to poor long-term social trajectories. To address this, school-based behavior management often consists of contingent reinforcement for appropriate behavior, behavior reduction procedures, and placement in self-contained or alternative…

Sixth graders participating in the "Too Good for Drugs" (TGFD) prevention program in comparison to 6th graders not participating show different results by student risk level. Sixth graders from 20 middle schools were randomly assigned to receive the intervention and those from 20 paired middle schools assigned to serve as controls (N =…