Sensitivity analysis, a statistical method crucial for validating inferences across disciplines, quantifies the conditions that could alter conclusions (Razavi et al., 2021). One line of work is rooted in linear models and foregrounds the sensitivity of inferences to the strength of omitted variables (Cinelli & Hazlett, 2019; Frank, 2000). A…

Meta-analysis of proportions is conceptually simple: Faced with a binary outcome in multiple studies, we seek inference on some overall proportion of successes/failures. Under common effect models, exact inference has long been available, but is not when we more realistically allow for heterogeneity of the proportions. Instead a wide range of…

Inferential reasoning is an integral part of science and civic society, but research shows that it is a problematic domain for many people. One possibility for a more accessible approach to inferential reasoning is to use randomization tests via computer simulations. A case study was conducted with primary preservice teachers after they had passed…

This short article continues the exploration of the Common Online Data Analysis Platform (CODAP) and statistics begun in the previous article "Statistical Investigations and CODAP, Part 1: EDA." In Part 2, the author discusses the teaching of statistical inference focusing on activities for the senior secondary years. In particular, the…

Using software to teach statistical inference in introductory courses opens the door for methods and practices that are more conceptually appealing to students. With an increasing number of fields requiring competency in statistics including data science, natural and social sciences, public health and more, it is crucial that we as instructors…

Growing scholarship on the pedagogical applications of statistical modeling is currently taking place to create adaptations of this practice to introduce novices to statistics. These are intended to promote novices' reasoning, and are typically void of formal mathematical procedures and calculations. In this article, we define the potential…

Randomized A/B tests within online learning platforms enable us to draw unbiased causal estimators. However, precise estimates of treatment effects can be challenging due to minimal participation, resulting in underpowered A/B tests. Recent advancements indicate that leveraging auxiliary information from detailed logs and employing design-based…

The year 2022 is the 20th anniversary of Joseph Schafer and John Graham's paper titled "Missing data: Our view of the state of the art," currently the most highly cited paper in the history of "Psychological Methods." Much has changed since 2002, as missing data methodologies have continually evolved and improved; the range of…

Teacher shortages and attrition are problems of international concern. One of the most frequent reasons for teachers leaving the profession is a lack of job satisfaction. Accordingly, in this study we have adopted a causal inference machine learning approach to identify practical interventions for improving overall levels of job satisfaction. We…

Using simulation approaches when conducting randomization tests for comparing two groups in the context of experimental studies has been promoted as a beneficial approach for supporting student learning of statistical inference. Many researchers have suggested that the data production process in simulations for the randomization test intuitively…

Research questions regarding how, for whom, and where a treatment achieves its effect on an outcome have become increasingly valued in substantive research. Such questions can be answered by causal moderated mediation analysis, which assesses the heterogeneity of the mediation mechanism underlying the treatment effect across individual and…

Machine learning is a popular topic in data analysis and modeling. Many different machine learning algorithms have been developed and implemented in a variety of programming languages over the past 20 years. In this article, we first provide an overview of machine learning and clarify its difference from statistical inference. Then, we review…

Multilevel modeling (MLM) is a statistical technique for analyzing clustered data. Despite its long history, the technique and accompanying computer programs are rapidly evolving. Given the complexity of multilevel models, it is crucial for researchers to provide complete and transparent descriptions of the data, statistical analyses, and results.…

Accompanied by increasing demands on school administrator preparation and rapid development of computer technology, educational statistics courses are exposed to unprecedented pressures for changing both curriculum content and computing platforms. In this article, the intended curriculum is reviewed according to data analysis expectations from…

In this digital ITEMS module, Dr. Roy Levy describes Bayesian approaches to psychometric modeling. He discusses how Bayesian inference is a mechanism for reasoning in a probability-modeling framework and is well-suited to core problems in educational measurement: reasoning from student performances on an assessment to make inferences about their…