A problem for program evaluators involves a search for ways to maximize internal validity and inferential power of research designs while being able to assess long-term effects of social programs. A multimethodological research strategy combining a delayed control group true experiment with a multiple time series and switching replications design…

Explores the possibility of randomly assigning groups (or clusters) of individuals to a program or control group to estimate the impact of programs designed to affect whole groups. Applies the cluster-assignment approach to the evaluation of education programs targeting whole schools. Discusses statistical implications of the method. (SLD)

This article discusses the use of propensity scoring in experimental program evaluations to estimate impacts for subgroups defined by program features and participants' program experiences. The authors discuss estimation issues and provide specification tests. They also discuss the use of an overlooked data collection design--obtaining predictions…

This article examines the effect of the Massachusetts workforce development system on the earnings of disadvantaged adults using nonexperimental data from the late 1990s. The authors construct a comparison sample for program participants using individuals who apply for and are offered services yet do not participate in a training program. They…

Describes a method that uses program participants' compliance with program instructions as a means of classifying participants and in that way obtains a randomized control group for a subset of participants. Illustrates two variations of the method through a large smoking-intervention project. (SLD)

Using data from a sales campaign for the Arizona State lottery, a multiplist strategy of program evaluation is analyzed. Several complementary designs are used within the strategy to help remove threats to internal validity associated with the nonequivalent control group design. (SLD)

The conventional way to measure program impacts is to compute the average treatment effect; that is, the difference between a treatment group that received some intervention and a control group that did not. Recently, scholars have recognized that looking only at the average treatment effect may obscure impacts that accrue to subgroups. In an…

Aim: To evaluate the effectiveness of a multiservice intervention designed to move substance-abusing women on welfare to sobriety and self-sufficiency by addressing their substance abuse, domestic violence, employment, and basic needs. Design: A field evaluation with repeated measures at 6 and 12 months on an intent-to-treat sample of 529 women…

A pretest-posttest control group design was used to assess the leadership and problem-solving skills of 281 participants and 110 controls in a statewide community leadership development program. Quantitative and qualitative data demonstrate that the program has been a catalyst to influence leadership and problem-solving skills for community…

A solution to the problem of specification error due to excluded variables in statistical models of treatment effects in nonrandomized (nonequivalent) control group designs is presented. It involves longitudinal observation with at least two pretests. A maximum likelihood estimation program such as LISREL may provide reasonable estimates of…

Difficulties experienced in implementing a randomized design in a school-based adolescent health promotion program are explained, and a solution using a randomized control group design nested within two treatment options is proposed. The Health for Life project involved 21 middle schools in Wisconsin. (SLD)