As part of a growing emphasis on "STEM," engineering has gained prominence in precollege education. In response to that trend, an emerging area of educational research focuses on the "Nature of Engineering" (NOE), a collection of ideas about what engineering is, what engineers do, and how engineering is related to science and…

In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

While there has been a lot of debate over the impact of online and remote learning on mental health and well-being, there has been no systematic syntheses or reviews of the research on this particular issue. In this paper, we review the research on the relationship between mental health/well-being and online or remote learning. Our review shows…

This article addresses the gap between what works in research and what works in practice. Currently, research in evidence-based education policy and practice focuses on randomized controlled trials. These can support causal ascriptions ("It worked") but provide little basis for local effectiveness predictions ("It will work…

There is unexamined potential for developing and testing rival causal explanations in the type of data that participant observation is best suited to create: descriptions of in situ social interaction crafted from the participants' perspectives. By intensively examining a single ethnography, we can see how multiple predictions can be derived from…

It is common in regression discontinuity analysis to control for high order (third, fourth, or higher) polynomials of the forcing variable. We argue that estimators for causal effects based on such methods can be misleading, and we recommend researchers do not use them, and instead use estimators based on local linear or quadratic polynomials or…

Organizational and applied sciences have long struggled with improving causal inference in quasi-experiments. We introduce organizational researchers to propensity scoring, a statistical technique that has become popular in other applied sciences as a means for improving internal validity. Propensity scoring statistically models how individuals in…

Counterfactuals are routinely used in physical and biological sciences to develop and evaluate sophisticated, non-linear models. They have been used with telling effect in the study of economic history and American politics. For some historians, counterfactual arguments have no scholarly standing. They consider them flights of fancy, fun over a…

Discusses Lawrence A. Hirschfeld's (1995) experiments, which Hirschfeld claims demonstrate that preschoolers use a biologically grounded theory in reasoning about race. Argues that the methods used cannot address the issue and therefore, the results do not support Hirschfeld's claims. Maintains that the experiments fail to demonstrate that 4- and…

The authors' review of scientific studies on sexual coercion leads to their conclusions that many such studies lack rigor, reflect experimenter bias, and provide almost no insight into causal mechanisms of coercive behaviors. In the politicized area of women's studies, social expression is valued beyond scientific progress. (SLD)

Abuses and misuses of statistics are frequent. This digest attempts to warn against these in three broad classes of pitfalls: sources of bias, errors of methodology, and misinterpretation of results. Sources of bias are conditions or circumstances that affect the external validity of statistical results. In order for a researcher to make…

Remedial or developmental courses are the most common policy instruments used to assist underprepared postsecondary students who are not ready for college-level coursework. However, despite its important role in higher education and its substantial costs, there is little rigorous evidence on the effectiveness of college remediation on the outcomes…

This special issue summarizes parallel studies in five countries (Japan, Greece, Thailand, Republic of China, United States) investigating the causal linkages among socioeconomic status variables, family processes, and school variables on the mathematics achievement of urban elementary school children. Methodological problems in cross-cultural and…

Illustrates problems facing researchers trying to demonstrate causal relationships between types of nonparental care and differences between groups of Swedish children. Argues that efforts must be made to validate and interpret differences that are found. Indicates ways to avoid misinterpretation of differences that are attributable to…

Provides an exercise for introducing research methods to undergraduates. The students view a graph revealing that left-handed people are underrepresented in older age groups. Small group discussions attempt to explain this phenomenon. A follow-up class discussion focuses on the different approaches and methods available for interpreting the data.…