Until now, the conventional approach using two distinct groups, experimental and control, continues to dominate research, especially education research. Researchers, particularly those who are active in this domain, readily recognise this pattern when surveying literature. This article explores the use of the Solomon four-group design as a…

Improving academic, behavioural, and social outcomes of students through empirical research has been a firm commitment among researchers, policy-makers, and other professionals in education across Europe and the United States (U.S.). To assist in building scientific evidences, executive bodies such as the European Commission and the Institute for…

To answer "what works?" questions about policy interventions based on an experimental design, Peck (2003) proposes to use baseline characteristics to symmetrically divide treatment and control group members into subgroups defined by endogenously determined postrandom assignment events. Symmetric prediction of these subgroups in both…

Experimental evaluations that involve the educational system usually involve a hierarchical structure (students are nested within classrooms that are nested within schools, etc.). Concerns about contamination, where research subjects receive certain features of an intervention intended for subjects in a different experimental group, have often led…

This article introduces an alternative impact parameter for group-based RCTs with student mobility--the survivor average causal effect ("SACE")--that pertains to the subpopulation of original cohort students who would remain in their baseline study schools in either the treatment or control condition. The "SACE" parameter has a clear…

Early detection methods for autism spectrum disorder (ASD) in infancy are rapidly advancing, yet the development of interventions for infants under two years with or at-risk for ASD remains limited. In order to guide research and practice, this paper systematically reviewed studies investigating interventions for infants under 24 months with or…

In an effort to bring rigorous research into the education and social sciences field, the past decade had seen an increase in the advocacy of randomized controlled trials. The argument in favor of using randomized controlled trial is that one can evaluate the impact of an intervention in comparison to a control group with confidence during a…

Use of multivariate analysis (e.g., multivariate analysis of variance) is common when normally distributed outcomes are collected in intervention research. However, when mixed responses--a set of normal and binary outcomes--are collected, standard multivariate analyses are no longer suitable. While mixed responses are often obtained in…

The motivation for this paper is the authors' recent work on several randomized control trials in which they found the primary result, which averaged across subgroups or sites, to be moderated by demographic or site characteristics. They are led to examine a distinction that the Institute of Education Sciences (IES) makes between "confirmatory"…

Objective: To evaluate the effectiveness of a web-based protocol, ModerateDrinking.com (MD; "www.moderatedrinking.com") combined with use of the online resources of Moderation Management (MM; "www.moderation.org") as opposed to the use of the online resources of MM alone. Method: We randomly assigned 80 problem drinkers to…

Bootstrapping methods and random distribution methods are increasingly recommended as better approaches for teaching students about statistical inference in introductory-level statistics courses. The authors examined the effect of teaching undergraduate business statistics students using random distribution and bootstrapping simulations. It is the…

Defining self assessment as the involvement of students in identifying standards and/or criteria to apply to their work and making judgements about the extent to which they have met these criteria and standards, this paper seeks to highlight the gestalt effect of self assessment. The total effect of self assessment on the learner is greater than…

Randomized trials have experienced a marked surge in endorsement and popularity in education research in the past decade. This surge reignited paradigm debates and spurred qualitative critics to accuse these experimental designs of eclipsing qualitative research. This article reviews a current iteration of this debate and examines two randomized…

Despite advances in the science of teaching reading, there still exists a small percentage of students who fail to make the expected progress in reading-related skills, notwithstanding attempts at intervention. Even if these struggling readers learn to decode adequately, fluency remains a problem for many, and little is known about the…

Program providers work extremely hard to offer services that they believe will enhance the lives and future prospects of children and youth. But how can they be sure that their program is having the intended impacts? How can funders and policy makers be sure that their investments in programs are paying off in substantially better outcomes for…