Background/Context: In meta-analyses examining educational interventions, researchers seek to understand the distribution of intervention impacts, in order to draw generalizations about what works, for whom, and under what conditions. One common way to examine equity implications in such reviews is through moderator analysis, which involves…

Background/Context: In meta-analysis examining educational intervention, characterizing heterogeneity and exploring the sources of variation in synthesized effects have become increasingly prominent areas of interest. When combining results from a collection of studies, statistical dependency among their effects size estimates will arise when a…

Background: Rooted in problems of social justice, intersectionality addresses intragroup differences in impacts and outcomes and the compound discrimination at specific intersections of classification (Crenshaw,1991). It stresses that deficits/debts in outcomes often occur non-additively; for example, discriminatory hiring practices can be…

Background/Context: Predictive analytics has emerged as an indispensable tool in the education sector, offering insights that can improve student outcomes and inform more equitable policies (Friedler et al., 2019; Kleinberg et al., 2018). However, the widespread adoption of predictive models is hindered by several challenges, including the lack of…

Teachers need instructionally useful data to make timely and appropriate decisions to meet their students with intensive needs (Filderman et al., 2019). Teachers have still experienced difficulty in instructional decision making in response to students' CBM data (Gesel et al., 2021). This is because data itself that was used for simply determining…

Background: Education researchers typically estimate average program effects with regression; if they are interested in heterogeneous effects, they include an interaction in the model. Such models quantify and infer the influences of each covariate on the effect via interaction coefficients and their associated p-values or confidence intervals.…

Background: Regression Discontinuous Design (RDD) is widely used in educational studies. Through RDD, researchers can obtain unbiased results when Randomized Experimental Design (RED) is inaccessible. Compared to RED, the RDD only requires a cut score variable (continuous) and a cutoff value to assign students to the treatment or control groups.…

Doubly robust (DR) estimators that combine regression adjustments and inverse probability weighting (IPW) are widely used in causal inference with observational data because they are claimed to be consistent when either the outcome or the treatment selection model is correctly specified (Scharfstein et al., 1999). This property of "double…

Background/Context: Methodological background: Meta-analysis typically depends on the assumption that true effects follow the normal distribution. While assuming normality of effect "estimates" is often supported by a central limit theorem, normality for the distribution of interventions' "true" effects is a computational…

The administration of college financial aid is a key venue through which colleges can affect the likelihood that students will make it to graduation. We investigate the effects of an understudied yet consequential federal student aid policy: Return of Title IV Funds (R2T4). Under R2T4, students "earn" Federal Student Aid over a term or…

The What Works Clearinghouse (WWC) seeks to provide practitioners information about "what works in education." One challenge in understanding "what works" to practitioners is that effect sizes--the degree to which an intervention produces positive (or negative) outcomes--are not comparable across different interventions, in…

Background/Context: Observational studies often employ regression discontinuity (RD) designs and multiple control-group designs to explore the causal quantities of interest. RD designs assess policy and program effectiveness by assigning subjects to treatment based on whether they exceed a pre-defined cutoff. RD designs are classified into two…

Background: When RCTs are not feasible and time series data are available, panel data methods can be used to estimate treatment effects on outcomes, by exploiting variation in policies and conditions over time and across locations. A complication with these methods, however, is that treatment timing often varies across the sample, for example, due…

Background/Context: Some observational studies involve multiple layers of treatment selection, specifically in the context of the extended time accommodation (ETA) for English language learners (ELLs). In ETA settings, the first selection occurs due to the eligibility rule, where students whose ELL English proficiency is below a certain threshold…

Purpose and Background: Despite the flexibility of multilevel structural equation modeling (MLSEM), a practical limitation many researchers encounter is how to effectively estimate model parameters with typical sample sizes when there are many levels of (potentially disparate) nesting. We develop a method-of-moment corrected maximum likelihood…