In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

This paper discusses, compares, and contrasts 4 different models for bringing evidence from randomised controlled trials (RCTs) into practice and into practical reasoning. I look at what questions the models can and cannot answer, what role they accord to RCT evidence, and what their possible attraction for practitioners might be. The models are…

Researchers often include covariates when they analyze the results of randomized controlled trials (RCTs), valuing the increased precision of the estimates over the potential of inducing small-sample bias when doing so. In this paper, we develop a sufficient condition which ensures that the inclusion of covariates does not induce small-sample bias…

This essay expands Perelman and Olbrechts-Tyteca's concept of argumentation by model to bring more attention to the persuasive effects of using the self as a model. To illuminate this technique, I analyze the personal narratives of popular health coaches, who are championing a holistic health movement toward what I refer to as "do-it-yourself…

This article describes the analysis of regression-discontinuity designs (RDDs) using the R packages rdd, rdrobust, and rddtools. We discuss similarities and differences between these packages and provide directions on how to use them effectively. We use real data from the Carolina Abecedarian Project to show how an analysis of an RDD can be…

Field experiments in education frequently assign entire groups such as schools to treatment or control conditions. These experiments incorporate sometimes a longitudinal component where for example students are followed over time to assess differences in the average rate of linear change, or rate of acceleration. In this study, we provide methods…

To succeed in today's economy, students need both proficiency in the "three Rs" (reading, writing and arithmetic) and strong applied skills. Communication skills, team work, and critical thinking have long been at the top of employers' lists of applied skills they seek in employees. States are responding to employers' needs by putting in…

Use of multivariate analysis (e.g., multivariate analysis of variance) is common when normally distributed outcomes are collected in intervention research. However, when mixed responses--a set of normal and binary outcomes--are collected, standard multivariate analyses are no longer suitable. While mixed responses are often obtained in…