The purpose of this study was to examine the impact of the i3-funded SPARK program on the literacy development of students in kindergarten through third grade. The SPARK program represents a collaboration between Boys & Girls Clubs of Greater Milwaukee and the Milwaukee Public Schools. In the study, two cohorts of students were randomly…

"Let's Count" is an early mathematics program that has been designed by The Smith Family and the authors to assist educators in early childhood contexts in socially disadvantaged areas of Australia to work in partnership with parents and other family members to promote positive mathematical experiences for young children (3-5 years). A…

Our current capacity to understand or provide a context for interpreting the size of an effect in education program evaluation is limited. To address the problem, this study proposes a time-indexed effect size metric (d') to estimate how long it would take for an "untreated" control group to reach the treatment group outcome in terms…

Findings from the first round of evaluation of an afterschool youth development program are presented. This program, the 4H Afterschool Activity Program, incorporated a specific curriculum of aggression reduction, the BrainPower program, into its ongoing activities, which cover a wide range from homework assistance to arts and crafts. The…

Describes a method that uses program participants' compliance with program instructions as a means of classifying participants and in that way obtains a randomized control group for a subset of participants. Illustrates two variations of the method through a large smoking-intervention project. (SLD)

The one group posttest only evaluation model has been identified as a relatively inexpensive and useful model that can identify program components that are not being successful. The use of the model is discussed and illustrated through a hypothetical evaluation of a compensatory (Chapter 1) program. The one group posttest only evaluation model…

A persistent problem in the evaluation of field-based projects is the lack of no-treatment comparison groups. Frequently, potential comparison groups are confounded by socioeconomic, racial, or other factors. Among the possible methods for dealing with this problem are various matching procedures, but they are cumbersome to use with multiple…

Summative evaluations have often been undertaken to determine the impact of educational programs on student academic achievement employing a quasi-experimental design. The summative finding is expected to be less misleading if a statistical model is performed on a dataset including a sound matched sample as a control group. This is because an…

Since 1988 five evaluations of Federal demonstration programs in education have been implemented that had random-assignment designs to measure program impacts. The implementation of two of these evaluations, the evaluation of the School Dropout Demonstration Assistance Program and that of the Alternative Schools Random Assignment Program, are…

Although informal assessments of caregiver training and support groups have been positive, empirical evidence of their beneficial impact is needed. To evaluate a group program for families of elderly parents, a pre/postmeasure, experimental/control group design was implemented. Adults participating in two workshops on "Your Aging…

This paper presents findings of a study that examined the effectiveness of the guidance program used by change agents in the Dutch School Improvement Project (NSIP) on program implementation. Sixteen schools composed the experimental group and 13 made up the control group. The experimental variable was the guidance strategy of the NSIP. The two…

A context in which existing items may provide a convenient source of questions for questionnaires was explored through a case study making use of existing comparison groups. Two programs at Oak Ridge Associated Universities (ORAU), the Science and Engineering Research Semester (SERS) and the Laboratory Graduate Research Participation (Lab Grad)…

The suggestions offered in this paper are based on the experiences of two scientific researchers of how evaluations undertaken in a competitive arena, in which true experimental designs are not viable, can be designed in such a way that meaningful comparative data can be examined. Case studies of the Science and Engineering Research Semester and…

Suggestions, based on the experience of researchers at Oak Ridge (Tennessee) Associated Universities (ORAU), are offered on how evaluations in which true experimental designs are not possible can be designed for meaningful comparison. The ORAU conducts evaluation and assessment studies of educational programs intended to explore some aspect of the…

Problems with conducting randomized field experiments in education are explored. Focus is on problems encountered while evaluating a group of dropout prevention projects. Project planners were asked to manipulate the subject eligibility criteria until they identified as eligible three to four times as many students as they could serve. They were…