With the growing attention on large-scale educational testing and assessment, the ability to process substantial volumes of response data becomes crucial. Current estimation methods within item response theory (IRT), despite their high precision, often pose considerable computational burdens with large-scale data, leading to reduced computational…

Researchers in the education sciences, like those in other disciplines, are increasingly encountering requirements and incentives to make the data supporting empirical research available to others. However, the process of preparing and sharing research data can be daunting. The present article aims to support researchers who are beginning to think…

Being able to understand, interpret, and critically evaluate data is necessary for all individuals in our society. Using the PreK-12 Guidelines for Assessment and Instruction in Statistics Education-II (GAISE-II; Bargagliotti et al., 2020) curriculum framework, the current paper outlines five evidence-based recommendations that teachers can use to…

In a clustered observational study, a treatment is assigned to groups and all units within the group are exposed to the treatment. We develop a new method for statistical adjustment in clustered observational studies using approximate balancing weights, a generalization of inverse propensity score weights that solve a convex optimization problem…

We consider Bayesian estimation of a hierarchical linear model (HLM) from partially observed data, assumed to be missing at random, and small sample sizes. A vector of continuous covariates C includes cluster-level partially observed covariates with interaction effects. Due to small sample sizes from 37 patient-physician encounters repeatedly…

The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit with panel data. Two challenges arise with higher frequency data (e.g., monthly versus yearly): (1) achieving excellent pre-treatment fit is typically more challenging; and (2) overfitting to noise is more likely. Aggregating data…

This article presents methods for using extant data to improve the properties of estimators of the standardized mean difference (SMD) effect size. Because samples recruited into education research studies are often more homogeneous than the populations of policy interest, the variation in educational outcomes can be smaller in these samples than…

The What Works Clearinghouse (WWC) at the Institute of Education Sciences reviews rigorous research on educational practices, policies, programs, and products with a goal of identifying 'what works' and making that information accessible to the public. One critique of the WWC is the need to more closely examine 'what works' for whom, in which…

Automated detection of facial emotions has been an interesting topic for multiple decades in social and behavioral research but is only possible very recently. In this tutorial, we review three popular artificial intelligence based emotion detection programs that are accessible to R programmers: Google Cloud Vision, Amazon Rekognition, and…

We provide a novel characterization of augmented balancing weights, also known as automatic debiased machine learning (AutoDML). These popular "doubly robust" or "de-biased machine learning estimators" combine outcome modeling with balancing weights -- weights that achieve covariate balance directly in lieu of estimating and…

Given the increased focus of educational research on what works for whom and under what circumstances over the last decade, educational researchers are increasingly turning toward mixture models to identify heterogeneous subgroups among students. Such data are inherently nested, as students are nested within classrooms and schools. Yet there has…

The visual analysis of data presented in time-series graphs are common in single-case design (SCD) research and applied practice in school psychology. A growing body of research suggests that visual analysts' ratings are often influenced by construct-irrelevant features including Y-axis truncation and compression of the number of data points per…

Data-Based Instruction (DBI) has a strong empirical base for supporting the intensive academic needs of students who do not respond to standard treatment protocols. However, teachers use DBI infrequently in practice. In a previous study (Poch et al., 2020), teachers reported supports such as coaching facilitated DBI implementation, whereas access…

The education sector has been quick to recognize the power of predictive analytics to enhance student success rates. However, there are challenges to widespread adoption, including the lack of accessibility and the potential perpetuation of inequalities. These challenges present in different stages of modeling, including data preparation, model…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…