Common sense is a dynamic concept and it is natural that our (statistical) common sense lags behind the development of statistical science. What is not so easy to understand is why common sense lags behind as much as it does. We conduct a survey among Japanese students and provide examples and tentative explanations of a number of statistical…

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed- or random effects meta-analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and…

For ease of instruction in the classroom, the one-way analysis of variance F statistic is rewritten in terms of pairwise differences in individual sample means instead of differences of individual sample means from the overall sample mean. Likewise, the Kruskal-Wallis statistic may be rewritten in terms of pairwise differences in individual…

This short article continues the exploration of the Common Online Data Analysis Platform (CODAP) and statistics begun in the previous article "Statistical Investigations and CODAP, Part 1: EDA." In Part 2, the author discusses the teaching of statistical inference focusing on activities for the senior secondary years. In particular, the…

It is well known that Newton's work on mechanics depended in a crucial way on the previous observations of Galileo. The key insight of Galileo was that one can analyze the motion of bodies using experiments and mathematical equations. One experimental observation that roughly emerges from this work in modern terms is that two objects of different…

Jokes, cartoons, songs, and games can help engage students in discussion and learning key concepts about hypothesis testing.

In mixed methods approaches, statistical models are used to identify "nested" cases for intensive, small-n investigation for a range of purposes, including notably the examination of causal mechanisms. This article shows that under a commonsense interpretation of causal effects, large-n models allow no reliable conclusions about effect…

For students with severe or complex challenging behavior, incorporating hypothesis testing as a component of functional behavior assessment (FBA) is often warranted. Several hypothesis testing strategies (i.e., functional analysis, antecedent analysis, concurrent operant analysis) can confirm whether and how features of a student's environment…

In the classroom, we traditionally visualize inferential concepts using static graphics or interactive apps. For example, there is a long history of using apps to visualize sampling distributions. The lineup protocol for visual inference is a recent development in statistical graphics that has created an opportunity to build student understanding.…

Data reasoning is an essential component of scientific reasoning, as a component of evidence evaluation. In this paper, we outline a model of scientific data reasoning that describes how data sensemaking underlies data reasoning. Data sensemaking, a relatively automatic process rooted in perceptual mechanisms that summarize large quantities of…

Introduction: Undergraduate research experiences prepare students for graduate training or employment. Statement of problem: At many teaching-intensive universities, there is a greater demand for research experiences than there are independent study opportunities. Students from typically underrepresented backgrounds may also be unaware of a…

Given the growing prevalence of computational methods in chemistry, it is essential that undergraduate curricula introduce students to these approaches. One such area is the application of machine learning (ML) techniques to chemistry. Here we describe a new activity that applies ML regression analysis to the common physical chemistry laboratory…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Students often believe that statistical significance is the only determinant of whether a quantitative result is "important." In this paper, I review traditional null hypothesis statistical testing to identify what questions inferential statistics can and cannot answer, including statistical significance, effect size and direction,…