Evidence is presented that strengthens the argument against comparison group research strategies. Results from a study of youth attitudes related to the California Conservation Corps involving 528 participants and 668 comparisons indicate that the comparison group may not adequately represent the nontreatment state. (SLD)

After a brief introduction indicating the value of the first Follow Through evaluation, this document offers ideas about how a new wave of Follow Through approaches should be evaluated. The discussion is based on the premise that the form of an evaluation must be derived from the questions for which answers are sought, the audience(s) to whom the…

These three newsletters focus on advances and challenges in disability research. The first issue focuses on the results of a survey that investigated how many consumers with disabilities had a computer available in their home and their Internet use. The study involved administrators of Independent Living Centers (ILC) and ILC consumers. Findings…

This commentary on EC 605 442, which indicated long-term gains for children with autism who experienced intensive behavioral intervention as preschoolers, questions the magnitude of the student changes and their significance, because of concerns about the representativeness and comparability of the sample group and the failure to measure skills…

In August 1996 Jay P. Greene, Paul E. Peterson, and Jiangtao Du, with Leesa Boeger and Curtis L. Frazier, issued a report called "The Effectiveness of School Choice in Milwaukee." The report, referred to as GPDBF, presented data that indicated that low-income minority students in their third and fourth years of participation in the…

Some students are excluded from the National Education Longitudinal Study of 1988 (NELS:88) because of an inability, whether due to physical, mental, or linguistic barriers, to participate in studies requiring questionnaire or cognitive test completion. The implications of this exclusion for sample representativeness, national estimation, and…

Problems with conducting randomized field experiments in education are explored. Focus is on problems encountered while evaluating a group of dropout prevention projects. Project planners were asked to manipulate the subject eligibility criteria until they identified as eligible three to four times as many students as they could serve. They were…

The implementation of research design in studies on substance abuse education is discussed in this meta-analysis. Findings indicate that the quality of research design is constrained by negative feedback from evaluation stakeholders. This finding is applied to an evaluation of the Here's Looking at You, 2000 drug education program currently…

Two studies are reviewed to determine their relevance to proposed legislation (H.R. 2620) concerning athletic scholarships. The review was conducted at the request of U.S. Representative James J. Howard who proposed the bill. H.R. 2620 would require colleges to graduate at least 75% of their scholarship athletes within 5 years in order for…

Four types of control groups are commonly used in cognitive manipulation studies: (1) no-treatment; (2) practice with own methods; (3) practice and training with competing treatments; and (4) practice and training with irrelevant treatments. There are problems associated with the use of each group as a baseline for identifying the "true"…

Alternative ways of analyzing data from Aptitude Treatment Interactions were examined over a two-year period. In light of past arguments the author maintains that the questions surrounding aggregation have been badly posed and that the customary methods of analysis were either incorrect or subject to misinterpretation. Therefore, the majority of…

A beverage-server intervention project at two West Coast Navy bases that attempted to reduce levels of alcoholic intoxication via policy changes and server training is described. Data obtained via interviews and structured observations of 1,511 club customers indicate methodological bias and self-selection effects. Bias adjustments were performed…

Issues that arose in attempting to survey people with Acquired Immune Deficiency Syndrome (AIDS) are described. Questions of confidentiality, nonimplementation, and slow accrual of information are considered for an initial sample of 2,731 cases. Comparison with a database concerning 1,313 clinic clients indicates overrepresentation of compliant…

This commentary on EC 605 442, which indicated long-term gains for children with autism who experienced intensive behavioral intervention as preschoolers, emphasizes the need for replication. The replication study should use random assignment to experimental and control groups, a larger sample of cases, standard diagnostic instruments to delineate…

The National Household Education Survey (NHES) was conducted for the first time in 1991 to collect data on the early childhood education (ECE) experiences of young children and participation in adult education. Because the NHES methodology is relatively new, field tests were necessary. A large field test of approximately 15,000 households was…