Quasi-experimental methods are a cornerstone of applied social science, providing critical answers to causal questions that inform policy and practice. Although open science principles have influenced experimental research norms across the social sciences, these practices are rarely implemented in quasi-experimental research. In this paper, we…

In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

Conventional advice discourages controlling for postoutcome variables in regression analysis. By contrast, we show that controlling for commonly available postoutcome (i.e., future) values of the treatment variable can help detect, reduce, and even remove omitted variable bias (unobserved confounding). The premise is that the same unobserved…

Single case studies can provide vital contributions to theory-testing in social science studies. Particularly, by applying the process-tracing method, case studies can test theoretical frameworks through a rigorous research design that ensures substantial empirical leverage. While most scholarly contributions on process-tracing focus on either…

This article highlights the problem of omitted variable bias in research on the causal effect of financial aid on college-going. I first describe the problem of self-selection and the resulting bias from omitted variables. I then assess and explore the strengths and weaknesses of random assignment, multivariate regression, proxy variables, fixed…

Written by a social worker for social work students, this is a nuts and bolts guide to statistics that presents complex calculations and concepts in clear, easy-to-understand language. It includes numerous examples, data sets, and issues that students will encounter in social work practice. The first section introduces basic concepts and terms to…

The focus of this paper is causal inference in social and educational research. A concern with causality has had a profound impact on the kinds of questions that may be addressed in research, on how they must be formulated, and on the methodology that must be applied. In the social sciences the prevailing experimental paradigm is used to address…

Explains causal path modeling, addressing common misconceptions. Emphasizes the real-world validity of causal relationships depicted in models. Uses examples from research on the antecedents of career success. (Contains 37 references.) (SK)

In most cases, questions of cause and effect cannot be answered by social science methods. However, it is argued that evaluation should not be freed from dealing with missing causal links. It is possible to predict whether a causal question is likely to be measured or assessed. (SLD)

This paper contains a consideration of the nature and role of warrants for research conclusions in educational research. The paper argues the need for an explicit warrant in the form of a logical and persuasive link between the evidence produced and the conclusions drawn (with appropriate qualifications and caveats). It describes social scientific…

Provides a brief overview of single-subject research designs. This method exercises its power by examining changes in single subjects' responses over time across experimental conditions. Describes a classroom project in which students collect repeated measures of their own behavior and graph the data. (MJP)

Provides an exercise for introducing research methods to undergraduates. The students view a graph revealing that left-handed people are underrepresented in older age groups. Small group discussions attempt to explain this phenomenon. A follow-up class discussion focuses on the different approaches and methods available for interpreting the data.…