Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

This report characterizes forms of dialogic support that a sixth-grade teacher generated during whole-class and small-group conversations to help students develop a practice of statistical modeling. During four weeks of instruction, students constructed and revised models to account for variability and uncertainty across a variety of random…

Although parallel analysis has been found to be an accurate method for determining the number of factors in many conditions with complete data, its application under missing data is limited. The existing literature recommends that, after using an appropriate multiple imputation method, researchers either apply parallel analysis to every imputed…

Purpose: This article provides a tutorial introduction to ordinal pattern analysis, a statistical analysis method designed to quantify the extent to which hypotheses of relative change across experimental conditions match observed data at the level of individuals. This method may be a useful addition to familiar parametric statistical methods…

Takers of educational tests often receive proficiency levels instead of or in addition to scaled scores. For example, proficiency levels are reported for the Advanced Placement (AP®) and U.S. Medical Licensing examinations. Technical difficulties and other unforeseen events occasionally lead to missing item scores and hence to incomplete data on…

A wide range of machine-learning-based approaches have been developed in the past decade, increasing our ability to accurately model nonlinear and nonadditive response surfaces. This has improved performance for inferential tasks such as estimating average treatment effects in situations where standard parametric models may not fit the data well.…

Data preparation (also called "wrangling" or "cleaning") -- the evaluation and manipulation of data prior to formal analysis -- is often dismissed as a precursor to meaningful engagement with a dataset. Here, we re-envision data preparation in light of calls to prepare students for a data-rich world. Traditionally, curricular…

Data Analytics has grown dramatically in importance and in the level of business deployments in recent years. It is used across most functional areas and applications, some of the latter including market campaigns, detecting fraud, determining credit, identifying assembly line defects, health services and many others. Indeed, the realm of…

Emergent technologies present platforms for educational researchers to conduct randomized controlled trials (RCTs) and collect rich data to study students' performance, behavior, learning processes, and outcomes in authentic learning environments. As educational research increasingly uses methods and data collection from such platforms, it is…

The purpose of this article is to illustrate the dynamic process involved in developing and utilizing a theoretical model in a mixed methods study. Specifically, I illustrate how the theoretical model can serve as the starting point in framing the study, as a lens for guiding the data collection and analysis, and as the end point in explaining the…

Building on previous work on the civic returns of adult learning, this article examines the association between adult education, personality traits, and demands for civic participation or volunteering. Based on National Education Panel Study data, the study finds openness to be a crucial personality trait for participating in further training, as…

Machine learning is a popular topic in data analysis and modeling. Many different machine learning algorithms have been developed and implemented in a variety of programming languages over the past 20 years. In this article, we first provide an overview of machine learning and clarify its difference from statistical inference. Then, we review…

Probabilistic reasoning underpins much of middle school students' future work in data analysis and inferential statistics. Unfortunately for many middle school students, probabilistic reasoning is not intuitive. One specific area in which students seem to struggle is determining the probability of compound events (Moritz and Watson 2000). Research…

We examine the challenges of teaching probability through the use of modelling. We argue how an integrated modelling approach might facilitate a coordinated understanding of distribution by marrying theoretical and data-oriented perspectives and present probability as more connected to the social lives of modern-day students. Research is, however,…

Statistical inference simply means to draw a conclusion based on information that comes from data. Error bars are the most commonly used tool for data analysis and inference in chemical engineering data studies. This work demonstrates, using common types of data collection studies, the importance of specifying the statistical model for sound…