Background: Recruiting schools into a matched-pair randomized control trial (MP-RCT) to evaluate the efficacy of a school-level prevention program presents challenges for researchers. We considered which of 2 procedures would be most effective for recruiting schools into the study and assigning them to conditions. In 1 procedure (recruit and…

This pilot study proposes a set of analytical steps for comparing schools that participate in the National Science Foundation's Math and Science Partnership (MSP) Program and their nonparticipating peers in the same state. This pilot is part of a larger effort to evaluate the MSP Program's role in student achievement, with two companion analyses.…

This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…

Describes seven myths concerning reading-level-match designs, in which individual differences in reading acquisition are compared for groups of different ages matched on some aspect of reading performance. Gives examples from the reading literature to illustrate these myths and to suggest more realistic alternatives. Summarizes relevant…

This review and critique of the use of comparison groups in 57 studies of mental retardation family research addresses such issues as: matching on age versus competency of the mentally retarded family member, demographic equivalence of groups, research involving siblings, research involving mentally retarded parents, and appropriateness of…

This article discusses research design problems peculiar to work with intellectually disabled subjects, such as discrepancies in uses of control groups and mental age matching, definitions of subject groups and variability within and between subject groups. Suggestions for minimizing these problems are made and alternative methodologies offered.…

Argues that only positive results in a reading-level (RL) match and negative results in a chronological-age (CA) match are interpretable; negative results in a CA match and positive results in a RL match are not. Argues that using the RL control is only a first step in research into reading disability. (RS)

Matching, randomization, random sampling, and other methods of controlling extraneous variation are discussed. The purpose was to specify the benefits of randomization in estimating causal effects of treatments. It is concluded that randomization should be employed whenever possible, but the use of carefully controlled nonrandomized data to…

Expresses the importance of scientifically based research in education reform and explains how to judge the validity of educational research. Describes control groups, randomized and matched experiments, statistical educational significance, sample size, and the difference between scientifically based and rigorously evaluated research. (Contains…

The Evaluation of the Emergency School Assistance Program (ESAP) for the 1971-72 school year is the first application of full-blown experimental design with randomized experimental and control cases in a federal evaluation of a large scale program. It is also one of the very few evaluations which has shown that federal programs can raise tested…

Evidence is presented that strengthens the argument against comparison group research strategies. Results from a study of youth attitudes related to the California Conservation Corps involving 528 participants and 668 comparisons indicate that the comparison group may not adequately represent the nontreatment state. (SLD)

Problems with conducting randomized field experiments in education are explored. Focus is on problems encountered while evaluating a group of dropout prevention projects. Project planners were asked to manipulate the subject eligibility criteria until they identified as eligible three to four times as many students as they could serve. They were…

A broad range of strategies in sampling, measurement, design, execution, implementation, and analysis are examined. Specific strategies are suggested that tend to be successful in the real world of psychiatric clinical research. (Author)

Discusses how clinicians and researchers can critically evaluate information from efficacy studies of language intervention programs. It argues for combining both experimental and nonexperimental approaches and suggests that the use of matching in nonrandomized studies allows for comparison of groups of children participating in an intervention…

SURVEY AND TESTING TECHNIQUES USED BY THE BRITISH BROADCASTING CORPORATION IN THE YEARS 1952-63 TO ANSWER QUESTIONS OF INTEREST TO TELEVISION PLANNERS INDICATE METHODOLOGY FOR FUTURE PLANNING RESEARCH. TO ANSWER THE BASIC QUESTION--WHAT PEOPLE ARE AVAILABLE FOR WATCHING AND LISTENING--BBC USED THE METHOD OF HAVING 2981 MEMBERS OF A NATIONAL SAMPLE…