Evaluating school-based mental health services for children and youth with emotional disturbance (ED) has been a challenge for researchers. One particular challenge is the study design of using the student as the statistical unit of analysis, which in certain cases may lead to a violation of the "independence of error" assumption.…

Provides the conceptual framework for the Treatment Improvement Protocols (TIPs) evaluation project, using the diffusion of innovations theory as the theoretical foundation to understand and assess the development of TIPs. Summarizes principles of diffusion theory, and discusses how the model was used to structure the TIPs studies. (SLD)

The concept of evaluation readiness complements other evaluation planning approaches. Its basic products are the formal program definition and the data inventory framework. Ways to improve timeliness, appropriateness, and use of evaluation are also discussed. (Author/GDC)

The self-selection problem in program evaluation is explored, and two ways of addressing it, covariate control approaches and two-stage sample selection models, are described. A longitudinal study of the effects of participation in Alcoholics Anonymous illustrates both approaches and shows the advantages of the two-step procedure. (SLD)

A consumer-oriented program evaluation of a master's level clinical psychology training program is reported. A goal attainment model of evaluation was employed, requiring specification of program goals, development of goal-related objectives and hypotheses, and formulation of recommendations for program modification based on results achieved.…

This article provides a case study of the use of emergent design, which asks evaluators to adapt their inquiry processes as understanding develops, in the evaluation of a family support program, tracing the emergence of evaluation procedures through three phases. Two phases produced data that policymakers found very helpful. (SLD)

Some specific opportunities and techniques are described for combining and integrating qualitative and quantitative methods from the design stage of a substance abuse program evaluation through implementation and reporting. The multiple problems and requirements of such an evaluation make integrated methods essential. (SLD)

An outreach and linkage program for the homeless mentally ill documented successful outcomes in terms of housing but not in terms of functioning for the 163 participants. Recruitment source, client functioning cluster type, and hours of service received were predictors of the four-month residential setting. (SLD)

Articles in this special issue suggest improvements in longitudinal program evaluation to meet the challenges of evaluation of human services programs. Contributions describe innovations in design, methods, data analysis, utilization, and interpretation of the findings of longitudinal studies. (SLD)

Considers the workings and effects of The Innovation and New Technology Programme in Norway, describing the design of the evaluation and the use of a centrally established control group to assess programs results. Uses results from innovation theory to appraise the aims and working methods of the program and a combination of quantitative and…

Factors involved in pre-planned and post-planned evaluation of program effectiveness are compared: (1) reliability and cost of data; (2) internal and external validity; (3) obtrusiveness and threat; (4) goal displacement and program direction. A model to help program administrators decide which approach is more appropriate is presented. (Author/MH)

Strasser and Deniston's own analysis (TM 504 254) shows that post-planned evaluations are unsuitable substitutes for pre-planned evaluations. When viewed as post-experimental interviews, however, post-planned evaluations can produce valuable information which complements traditional experimental and quasi-experimental evaluations. (MH)

Why conclusions of many outcome evaluations do not stand up to scrutiny is discussed, drawing on examples from evaluations of drug abuse prevention programs. Factors that undermine these studies are largely the result of social-structural problems that influence the design and implementation of the research. (SLD)

The traditional experimental-control group method for evaluating delinquency prevention programs is questioned. It is contended that the method harms the intervention and exacerbates the deliquency problem. (JKS)

Seven qualitative issues associated with randomization that have the potential to weaken or destroy otherwise sound experimental designs are reviewed and illustrated via actual field experiments. Issue areas include ethics and legality, liability risks, manipulation of randomized outcomes, hidden bias, design intrusiveness, case flow, and…