The What Works Clearinghouse (WWC) Standards Briefs explain the rules the WWC uses to evaluate the quality of studies for practitioners, researchers, and policymakers. This brief explains what baseline equivalence is and why it matters. As part of the WWC review process for certain types of studies, reviewers assess whether the intervention group…

Our study used a case-control matching design to assess the influence of a voluntary tutoring program in improving first-year students' Grade Point Averages (GPA). To evaluate program effectiveness, we applied case-control matching to obtain 215 pairs of students with or without participation in tutoring, but matched on high school GPA and…

Misconceptions of psychological phenomena are widespread and often not easily eliminated--even among students completing college-level psychology courses. As part of a research methods psychology course, students developed public-service-announcement-style posters as part of a psychology myth-debunking campaign and presented these to students…

Teacher and principal surveys are among the most common data collection techniques employed in education research. Yet there is remarkably little research on survey methods in education, or about the most cost-effective way to raise response rates among teachers and principals. In an effort to explore various methods for increasing survey response…

Educational researchers frequently study the impact of treatments or interventions on educational outcomes. However, when observational or quasiexperimental data are used for such investigations, selection bias can adversely impact researchers' abilities to make causal inferences about treatment effects. One way to deal with selection bias is to…

Education research rarely lends itself to large scale experimental research and true randomization, leaving the researcher to quasi-experimental designs. The problem with quasi-experimental research is that underlying factors may impact group selection and lead to potentially biased results. One way to minimize the impact of non-randomization is…

Background: Recruiting schools into a matched-pair randomized control trial (MP-RCT) to evaluate the efficacy of a school-level prevention program presents challenges for researchers. We considered which of 2 procedures would be most effective for recruiting schools into the study and assigning them to conditions. In 1 procedure (recruit and…

In this set of four supplemental tables, the authors compare the baseline test scores of the treatment and matched control group samples observed in each year after KIPP entry (outcome years 1 to 4). As discussed in Chapter III, the authors used an iterative propensity score estimation procedure to calculate each student's probability of entering…

This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…

Purpose: This study tests the hypothesis that toddlers with autism spectrum disorders (ASD) will show differences from contrast groups in preferences for attending to speech. Method: This study examined auditory preferences in toddlers with ASD and matched groups of (a) typical age-mates, (b) age-mates with nonautistic developmental disabilities,…

In a nonrandomized or observational study, propensity scores may be used to balance observed covariates and trajectory groups may be used to control baseline or pretreatment measures of outcome. The trajectory groups also aid in characterizing classes of subjects for whom no good matches are available and to define substantively interesting groups…

This paper reviews limitations in the interpretations of group differences in studies that use younger, language-matched controls in addition to age-matched controls to examine the role of "language level" on performance. Problems arise because of the multidimensional nature of language, extraneous age effects associated with language matching,…

Employed a developmental context to discuss the problem of assessing both quantitative and qualitative deficits in the behavioral profiles of various diagnostic subcategories of developmentally disabled children. Methods of appropriate matching of control groups are suggested to help delineate specific and general deficits in subgroups of…

This article discusses research design problems peculiar to work with intellectually disabled subjects, such as discrepancies in uses of control groups and mental age matching, definitions of subject groups and variability within and between subject groups. Suggestions for minimizing these problems are made and alternative methodologies offered.…

Several research laboratories have found that instructed behavior can be less sensitive to changes in contingencies than shaped behavior. The current experiment examined whether these differences in sensitivity could be related to resistance to change. Two groups of subjects, who were matched on the basis of an initial disruption assessment, were…