Suppose an education researcher wants to test the impact of a high school drop-out prevention intervention in which at-risk students attend classes to receive intensive summer school instruction. The district will allow the researcher to randomly assign students to the treatment classes or to the control group. Half of the students (the treatment…

An opportunistic experiment is a type of randomized controlled trial that studies the effects of a planned intervention or policy change with minimal added disruption and cost. This guide defines opportunistic experiments and provides examples, discusses issues to consider when identifying potential opportunistic experiments, and outlines the…

The goal of this paper is to provide guidance for applied education researchers in using multi-level data to study the effects of interventions implemented at the school level. Two primary approaches are currently employed in observational studies of the effect of school-level interventions. One approach employs intact school matching: matching…

This brief is part of a series that explores key implementation considerations. It focuses on the importance of identifying, operationalizing, and implementing the "core components" of evidence-based and evidence-informed interventions that likely are critical to producing positive outcomes. The brief offers a definition of "core components",…

This paper includes a nontechnical description of methods for calculating effect sizes in intellectual and developmental disability studies. Different hypothetical studies are used to illustrate how null hypothesis significance testing (NHST) and effect size findings can result in quite different outcomes and therefore conflicting results. Whereas…

One can distinguish statistical models used in causal modeling from the causal interpretations that align them with substantive hypotheses. Causal modeling typically assumes an efficient causal interpretation of the statistical model. Causal modeling can also make use of mereological causal interpretations in which the state of the parts…

To explore whether different balances of fiction/non-fiction reading and challenge might help explain differences in reading achievement between genders, data on 45,670 pupils who independently read over 3 million books were analysed. Moderate (rather than high or low) levels of challenge were positively associated with achievement gain, but…

This document contains three papers concerned with prevention intervention research, a new area of depression research which has shown great promise for contributing new knowledge to the understanding of depression. The first paper, "Clinical Trials vs. Prevention Trials: Methodological Issues in Depression Research" (Ricardo F. Munoz), emphasizes…

This article examines the relationship between an adolescent with behavior disorders, his family, and the system of care, through a single case analysis. The methodology used to collect the case record and interview data and to analyze and graphically illustrate the data are presented to demonstrate use of qualitative data in program evaluation.…

This is a checklist of key items to get right when conducting a randomized controlled trial to evaluate an educational program or practice ("intervention"). It is intended as a practical resource for researchers and sponsors of research, describing items that are often critical to the success of a randomized controlled trial. A significant…

This study compared three spelling interventions to increase the spelling accuracy of elementary students with learning disabilities. Thirty-six randomly selected third, fourth, and fifth grade students with learning disabilities were assigned to three interventions: (1) the traditional spelling procedure; (2) a multisensory procedure without…

This paper presents principles that should be considered in planning and interpreting studies of outcomes of interventions with children receiving mental health services. Principles to consider when planning outcome studies include recognizing that "outcome" refers to multiple rather than single domains and choosing outcome domains that…