This article introduces a collection of four datasets, similar to Anscombe's quartet, that aim to highlight the challenges involved when estimating causal effects. Each of the four datasets is generated based on a distinct causal mechanism: the first involves a collider, the second involves a confounder, the third involves a mediator, and the…

Researchers tasked with understanding the effects of educational technology innovations face the challenge of providing evidence of causality. Given the complexities of studying learning in authentic contexts interwoven with technological affordances, conducting tightly-controlled randomized experiments is not always feasible nor desirable. Today,…

Most current statistics courses include some instruction relevant to causal inference. Whether this instruction is incorporated as material on randomized experiments or as an interpretation of associations measured by correlation or regression coefficients, the way in which this material is presented may have important implications for…

Over the last two decades, statistics educators have made important changes to introductory courses. Current guidelines emphasize developing statistical thinking in students and exposing them to the entire investigative process in the context of interesting research questions and real data. As a result, many concepts (confounding, multivariable…

Student evaluation is a key consideration for educational program administrators because program success depends on students' ability to demonstrate successful development of core competencies. Student evaluations must therefore be aligned with learning objectives and overall program goals. Graduate level educational programs typically incorporate…

The President's Committee on the Arts and Humanities report heartily supported arts integration. However, the President's Committee called for a better understanding of the dimensions of quality and best practices. One promising arts integration method is drama-based pedagogy (DBP). A comprehensive search of the literature revealed 47…

Organizational and applied sciences have long struggled with improving causal inference in quasi-experiments. We introduce organizational researchers to propensity scoring, a statistical technique that has become popular in other applied sciences as a means for improving internal validity. Propensity scoring statistically models how individuals in…

Selection bias is a problem for mathematics education researchers interested in using observational rather than experimental data to make causal inferences about the effects of different instructional methods in mathematics on student outcomes. Propensity score methods represent 1 approach to dealing with such selection bias. This article…

Causal reasoning represents one of the most basic and important cognitive processes that underpin all higher-order activities, such as conceptual understanding and problem solving. Hume called causality the "cement of the universe" [Hume (1739/2000). Causal reasoning is required for making predictions, drawing implications and…

Inference for causal effects is a critical activity in many branches of science and public policy. The field of statistics is the one field most suited to address such problems, whether from designed experiments or observational studies. Consequently, it is arguably essential that departments of statistics teach courses in causal inference to both…

The authors propose a strategy for studying the effects of time-varying instructional treatments on repeatedly observed student achievement. This approach responds to three challenges: (a) The yearly reallocation of students to classrooms and teachers creates a complex structure of dependence among responses; (b) a child's learning outcome under a…

Describes a teaching activity that improves students' scientific reasoning by focusing attention on the causal, explanatory nature of psychological theories. Students learn and use an argument form called Inference to the Best Explanation (IBE). Includes examples of this technique and student responses to the course. (MJP)

Rectifies the unsatisfactory textbook treatment of the finite-sample proprieties of estimators of regression models with a lagged dependent variable and autocorrelated disturbances. Maintains that the bias of the ordinary least squares estimator is determined by the dynamic and correlation effects. (MJP)