A meta-analysis was conducted on 44 educational studies that used either a (labelled) Hawthorne control group, a manipulation of Hawthorne effects, or a group designed to control for the Hawthorne effect. The sample included published journal articles, ERIC documents or unpublished papers, and dissertations. The studies were coded on 20 variables,…

This article assimilates and critically reviews 10 reports between 1960 and 1980 in which hypnosis was used with non-retarded children, aged 6 to 17, who had learning problems. Studies are reviewed in terms of the major deficit focused on by the researchers, i.e., reading deficits, self-concept and academic achievement, academic behavior problems,…

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

The failure of educational research to fully allow for limitations in methodology when drawing conclusions is faulted. In addition to this, a failure on the part of the media--educational and other--to fully publicize these limitations is also criticized. Methodological shortcomings of the 1977-78 American Institutes of Research (AIR) study of…

The experience of a research group in studying Neighborhood Youth Corps (NYC) programs provides the framework for a discussion of the methodological difficulties of conducting research on disadvantaged groups. However, the report does not deal with the programs and operations of NYC itself. Four problem areas are described: (1) criterion, program,…

Evidence is presented that strengthens the argument against comparison group research strategies. Results from a study of youth attitudes related to the California Conservation Corps involving 528 participants and 668 comparisons indicate that the comparison group may not adequately represent the nontreatment state. (SLD)

This commentary on EC 605 442, which indicated long-term gains for children with autism who experienced intensive behavioral intervention as preschoolers, questions the magnitude of the student changes and their significance, because of concerns about the representativeness and comparability of the sample group and the failure to measure skills…

Problems with conducting randomized field experiments in education are explored. Focus is on problems encountered while evaluating a group of dropout prevention projects. Project planners were asked to manipulate the subject eligibility criteria until they identified as eligible three to four times as many students as they could serve. They were…

Four types of control groups are commonly used in cognitive manipulation studies: (1) no-treatment; (2) practice with own methods; (3) practice and training with competing treatments; and (4) practice and training with irrelevant treatments. There are problems associated with the use of each group as a baseline for identifying the "true"…

This commentary on EC 605 442, which indicated long-term gains for children with autism who experienced intensive behavioral intervention as preschoolers, emphasizes the need for replication. The replication study should use random assignment to experimental and control groups, a larger sample of cases, standard diagnostic instruments to delineate…

Recruiting schools and kids to participate in drug prevention evaluations is no longer, if it ever was, a "done deal." Since the mid-1980s, schools have been inundated with requirements for drug programs and requests to cooperate with program evaluations. As a consequence, both treatment and control schools are harder to find. In addition, many…

Research efforts have established that the Mantel-Haenszel procedure (MHP) is an effective method for detecting the presence of test items exhibiting differential item functioning (DIF). While the MHP has been advocated for situations where item response theory based methods may not be usable, recent findings have suggested that the performance of…

The three RMC models endorsed by the U.S. Office of Education for the evaluation of Elementary and Secondary Education Act Title I programs are based on narrowly conceived approaches to evaluation--the measurement of cognitive achievement gains. Each model requires the comparison of observed student performance with an estimate of what level of…

The New York State Experimental Prekindergarten Program (PreK) evaluation studied successive waves of children while they were in PreK, and as they progressed through the third grade. For each wave, two control groups were obtained: (1) A waiting-list control group, children in districts offering PreK programs who were identified as eligible for…