In a clustered observational study, a treatment is assigned to groups and all units within the group are exposed to the treatment. We develop a new method for statistical adjustment in clustered observational studies using approximate balancing weights, a generalization of inverse propensity score weights that solve a convex optimization problem…

The visual analysis of data presented in time-series graphs are common in single-case design (SCD) research and applied practice in school psychology. A growing body of research suggests that visual analysts' ratings are often influenced by construct-irrelevant features including Y-axis truncation and compression of the number of data points per…

Single-case experimental designs (SCEDs) have been used with increasing frequency to identify evidence-based interventions in education. The purpose of this study was to explore how several procedural characteristics, including within-phase variability (i.e., measurement error), number of baseline observations, and number of intervention…

It is difficult for consumers to access the evidence base for prevention programs to determine which models or practices have the strongest empirical support for improving youth social, emotional, and behavioral (SEB) outcomes within their specific service contexts. Researchers can address this evidence-to-practice gap through innovations in…

The clustered observational study (COS) design is the observational study counterpart to the clustered randomized trial. In a COS, a treatment is assigned to intact groups, and all units within the group are exposed to the treatment. However, the treatment is non-randomly assigned. COSs are common in both education and health services research. In…

Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. The authors' collaborative network of five research teams applying this design in early education settings and methods experts has identified six challenges that need to be carefully considered in this next…

Research and theory indicate that the type and quality of instruction, not the delivery mechanism, are what impact learning. Previous reviews have not systematically explored variations in the instructional strategies, approaches, and designs of educational technology programs and also suffered from lax inclusion criteria, which has been known to…

In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

Within the field of school psychology, we often put a premium on evidence-based practices, but what is often missing from these conversations is a consideration of replication and open science principles in the evaluation of evidence. Amid growing concerns regarding the replicability of psychological science, calls for greater research…