Until now, the conventional approach using two distinct groups, experimental and control, continues to dominate research, especially education research. Researchers, particularly those who are active in this domain, readily recognise this pattern when surveying literature. This article explores the use of the Solomon four-group design as a…

The randomized control trial (RCT) is the primary experimental design in education research due to its strong internal validity for causal inference. However, in situations where RCTs are not feasible or ethical, quasi-experiments are alternatives to establish causal inference. This paper serves as an introduction to several quasi-experimental…

This study examined bias reduction in the eight nonequivalent comparison group designs (NECGDs) that result from combining (a) choice of a local versus non-local comparison group, and analytic use or not of (b) a pretest measure of the study outcome and (c) a rich set of other covariates. Bias was estimated as the difference in causal estimate…

Group design research studies can provide evidence to draw conclusions about "what works," "for whom," and "under what conditions" in special education. The quality indicators introduced by Gersten and colleagues (2005) have contributed to increased rigor in group design research, which has provided substantial…

Randomized control trials are considered the gold standard for conducting research and estimating causal effects; however, educational research rarely lends itself to experimental design and true randomization. In recent years, there has been a growing interest in finding new approaches to estimate causal effects in nonrandomized studies in…

Over many decades, educators have developed countless interventions and theories about how to create lasting change. Implementation research is the study of these efforts with a set of basic questions: What are we doing? Is it working? For whom? Where? When? How? And, Why? In other words, implementation research is an endeavor to understand if and…

In experimental research, internal validity refers to what extent researchers can conclude that changes in dependent variable (i.e. outcome) are caused by manipulations in independent variable. The causal inference permits researchers to meaningfully interpret research results. This article discusses (a) internal validity threats in social and…

E-learning research is plenty of difficulties, as also research in education is. Usually, the high number of features involved in e-learning processes complicates and masks the identification and isolation of the factors which cause the expected benefits, when they exist. At the same time, a bunch of threats are ready to weaken the validity of the…

Experimental and quasi-experimental designs are used in educational research to establish causality and develop effective practices. These research designs rely on a counterfactual model that, in simple form, calls for a comparison between a treatment group and a control group. Developers of educational practices often assume that the population…

Experimental evaluations that involve the educational system usually involve a hierarchical structure (students are nested within classrooms that are nested within schools, etc.). Concerns about contamination, where research subjects receive certain features of an intervention intended for subjects in a different experimental group, have often led…

In an effort to bring rigorous research into the education and social sciences field, the past decade had seen an increase in the advocacy of randomized controlled trials. The argument in favor of using randomized controlled trial is that one can evaluate the impact of an intervention in comparison to a control group with confidence during a…

In this paper, the authors examine some of the ways that different types of non-equivalent comparison groups can be used to strengthen causal inferences based on regression discontinuity design (RDD). First, they consider a design that incorporates pre-test data on assignment scores and outcomes that were collected either before the treatment…

The purpose of this study was to examine the effects of Play Practice (PP) instruction on the performance of table tennis skills. Fifty-six college students in four intact classes were taught by two instructors using PP and Skill-focused Instruction (SI). A nonequivalent control/comparison group experimental design with pre and post measures was…

Experimental designs that randomly assign entire clusters of individuals (e.g., schools and classrooms) to treatments are frequently advocated as a way of guarding against contamination of the estimated average causal effect of treatment. However, in the absence of contamination, experimental designs that randomly assign intact clusters to…

The motivation for this paper is the authors' recent work on several randomized control trials in which they found the primary result, which averaged across subgroups or sites, to be moderated by demographic or site characteristics. They are led to examine a distinction that the Institute of Education Sciences (IES) makes between "confirmatory"…