This guide offers a comprehensive handbook to scientific research methodology and experimental design, specifically for novice MA and PhD researchers in Education and Language Learning (TESOL/TEFL). It establishes scientific research as a systematic, objective inquiry focused on identifying cause-and-effect relationships through empirical data.…

Donald Campbell's approach to causal inference (D. T. Campbell, 1957; W. R. Shadish, T. D. Cook, & D. T. Campbell, 2002) is widely used in psychology and education, whereas Donald Rubin's causal model (P. W. Holland, 1986; D. B. Rubin, 1974, 2005) is widely used in economics, statistics, medicine, and public health. Campbell's approach focuses on…

In Shadish (2010) and West and Thoemmes (2010), the authors contrasted 2 approaches to causality. The first originated in the psychology literature and is associated with work by Campbell (e.g., Shadish, Cook, & Campbell, 2002), and the second has its roots in the statistics literature and is associated with work by Rubin (e.g., Rubin, 2006). In…

Matching methods such as nearest neighbor propensity score matching are increasingly popular techniques for controlling confounding in nonexperimental studies. However, simple k:1 matching methods, which select k well-matched comparison individuals for each treated individual, are sometimes criticized for being overly restrictive and discarding…

This paper contains a consideration of the nature and role of warrants for research conclusions in educational research. The paper argues the need for an explicit warrant in the form of a logical and persuasive link between the evidence produced and the conclusions drawn (with appropriate qualifications and caveats). It describes social scientific…

This overview of nonexperimental causal research methods focuses on latent variable structural equation modeling using the LISREL computer program. An extended example in special education is used to present LISREL as an extension of structural equations analysis (path analysis) and as a method of reducing the effects of error in research.…

Provides a brief overview of single-subject research designs. This method exercises its power by examining changes in single subjects' responses over time across experimental conditions. Describes a classroom project in which students collect repeated measures of their own behavior and graph the data. (MJP)

Provides an exercise for introducing research methods to undergraduates. The students view a graph revealing that left-handed people are underrepresented in older age groups. Small group discussions attempt to explain this phenomenon. A follow-up class discussion focuses on the different approaches and methods available for interpreting the data.…

This study examined the process of college choice focusing on the earlier stages of the college choice process among 4,923 high school students (3,110 students participated by returning completed surveys) involving 21 high schools in Indiana. The study attempted to: (1) construct a mid-range model representing the search phase of the college…