Mediation analyses are crucial for understanding the mechanisms through which interventions or theoretical constructs influence outcomes within nested structures, commonly found in education, psychology, and sociology. Recognizing the importance of these effects, designing and analyzing robust studies to detect them is essential. This dissertation…

For researchers seeking to improve education, a common goal is to identify teaching practices that have causal benefits in classroom settings. To test whether an instructional practice exerts a causal influence on an outcome measure, the most straightforward and compelling method is to conduct an experiment. While experimentation is common in…

Based on the increasing interest in systematic reviews and meta-analyses of Single-Subject Experimental Designs (SSEDs), the aim of the present review is to determine the general characteristics of these meta-analyses, including design characteristics of the primary studies and the meta-analyses, the kind of data, and the kind of analysis. After a…

In the field of special education there is a dearth of group experimental studies that establish evidence-based practice. The effort to establish evidence-based practice has been associated with emphasizing experiments by using randomized controlled trial with large numbers of participants who are randomly assigned to a treatment. However,…

Many practitioner researchers strive to understand which assessment practices have the best impact on learning, but in authentic educational settings, it can be difficult to determine whether one intervention, for example the introduction of an online quiz to a course studied by diverse students, is responsible for the observed effect. This paper…

Single-subject experimental research (SSER), one of the most commonly used research methods in special education and applied behaviour analysis, is a scientific, rigorous and valid method to evaluate the effectiveness of behavioural, educational and psychological treatments. However, studies using single-subject experimental research designs are…

This chapter is a call for consequential education research that has transformative potential: intellectually, educationally, and socially. It is about learning to see differently. It is an argument about seeing our work with youth and communities in ways that can help education researchers see ingenuity instead of ineptness and inability, to see…

In this article, the authors examine the interconnections among education researchers' misconceptions about the quality of the education research literature. Specifically, the authors catalog the sequence of events that, when taken together with a series of contradictory graphs presented by influential scholars in prominent settings, may have…

Randomized trials are a common way to provide rigorous evidence on the impacts of education programs. This article discusses the trade-offs associated with study designs that involve random assignment of students within schools and describes the experience from one such study of Teach for America (TFA). The TFA experiment faced challenges with…

Given scarce resources for evaluation, we recommend that education researchers more frequently conduct comprehensive randomized trials that generate evidence on how, why, and under what conditions interventions succeed or fail in producing effects. Recent experience evaluating a randomized need-based financial aid intervention highlights some of…

Purpose: This article provides a comprehensive narrative review of intervention studies for children with speech sound disorders (SSD). Its companion paper (Baker & McLeod, 2011) provides a tutorial and clinical example of how speech-language pathologists (SLPs) can engage in evidence-based practice (EBP) for this clinical population. Method:…

A common mistake in analysis of cluster randomized experiments is to ignore the effect of clustering and analyze the data as if each treatment group were a simple random sample. This typically leads to an overstatement of the precision of results and anticonservative conclusions about precision and statistical significance of treatment effects.…

Mathematics education researchers conducting instruction experiments using a design research methodology are challenged with the analysis of often complex and large amounts of qualitative data. In this paper, we present two case studies that show how multimedia analysis software can greatly support video data analysis and theory development in…

Throughout history human subject research has been plagued by researchers whose studies were riddled with danger and/or risk to their subjects. Indeed, one may cite numerous situations where human subjects were injured and/or killed in experiments that were designed with no thought or anticipation of risk to the subjects. As a result, the federal…

This article examines theoretical and empirical issues related to the statistical power of impact estimates for experimental evaluations of education programs. The author considers designs where random assignment is conducted at the school, classroom, or student level, and employs a unified analytic framework using statistical methods from the…