Until now, the conventional approach using two distinct groups, experimental and control, continues to dominate research, especially education research. Researchers, particularly those who are active in this domain, readily recognise this pattern when surveying literature. This article explores the use of the Solomon four-group design as a…

Context: Assessments of baseline equivalency of intervention and control groups, "balance," play a critical role in evaluating educational interventions. The highest What Works Clearinghouse (WWC) of the Institute of Educational Studies (IES) standard for educational studies, "Meets WWC Design Standards Without Reservations,"…

Randomized control trials are considered the gold standard for conducting research and estimating causal effects; however, educational research rarely lends itself to experimental design and true randomization. In recent years, there has been a growing interest in finding new approaches to estimate causal effects in nonrandomized studies in…

To help researchers understand potential issues one can encounter when conducting propensity matching studies in complex settings, this paper describes methodological complications faced when studying schools using deeper learning practices to improve college and career readiness. The study uses data from high schools located in six districts…

This study investigated the effects of the use of Augmented Reality (AR) on the academic performance of students, as well as perceptions that were following the use of this new technology resource. The participants were students of primary education in Spain, which were assigned to an experimental group and a control group. Contents related to the…

E-learning research is plenty of difficulties, as also research in education is. Usually, the high number of features involved in e-learning processes complicates and masks the identification and isolation of the factors which cause the expected benefits, when they exist. At the same time, a bunch of threats are ready to weaken the validity of the…

This article provides two illustrations of some of the factors that can influence findings from pre- and post-test research designs in evaluation studies, including regression to the mean (RTM), maturation, history and test effects. The first illustration involves a re-analysis of data from a study by Marsden (2004), in which pre-test scores are…

Experimental evaluations that involve the educational system usually involve a hierarchical structure (students are nested within classrooms that are nested within schools, etc.). Concerns about contamination, where research subjects receive certain features of an intervention intended for subjects in a different experimental group, have often led…

The goal of this research is to make sensitivity analysis accessible not only to empirical researchers but also to the various stakeholders for whom educational evaluations are conducted. To do this it derives anchors for the omitted variable (OV)-program participation association intrinsically, using the Love plot to present a wide range of…

The studies in this special section of the "Journal of Educational Psychology" present a variety of social-psychological interventions across large numbers of classrooms and populations. They show notable benefits for many students at risk for low performance. This is the glass half-full interpretation, and we consider the strengths of…

This paper describes an alternative to unrestricted randomization in experimental design, termed minimization, which can be used to achieve better balance of critical factors in small to medium-sized experimental studies. Several critical factors are controlled which are known to influence outcomes but which are not the foci of the study. Based on…

In an effort to bring rigorous research into the education and social sciences field, the past decade had seen an increase in the advocacy of randomized controlled trials. The argument in favor of using randomized controlled trial is that one can evaluate the impact of an intervention in comparison to a control group with confidence during a…

Research based on randomized experiments (along with high-quality quasi-experiments) has gained traction in education circles in recent years. There is little doubt this has been driven in large part by the shift in research funding strategy by the Department of Education's Institute of Education Sciences under Grover Whitehurst's lead, described…

Experimental designs that randomly assign entire clusters of individuals (e.g., schools and classrooms) to treatments are frequently advocated as a way of guarding against contamination of the estimated average causal effect of treatment. However, in the absence of contamination, experimental designs that randomly assign intact clusters to…

The motivation for this paper is the authors' recent work on several randomized control trials in which they found the primary result, which averaged across subgroups or sites, to be moderated by demographic or site characteristics. They are led to examine a distinction that the Institute of Education Sciences (IES) makes between "confirmatory"…