Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its…

There exist an increasing number of studies that demonstrate the necessity to evaluate the processes which characterize a program and guarantee its implementation and evaluation. This paper deals with the implementation of a program designed to improve the acculturation of immigrant families in Spain (EU). Implementation followed a process that…

In 2005, state fish and wildlife agency wanted to examine how one of its conservation education programs was providing science-based understanding and outdoor experiences by evaluating students' knowledge, skills, attitudes and intended behavioral outcomes related to fish, fishing and aquatic habitats in Montana. A key factor in this study was the…

The distinction between experimental evaluation (which employs generalizable analyses of discrete causes and effects) and contextual evaluation (which examines particular program operations holistically) is articulated. Program characteristics are examined and linked to experimental and contextual models of program evaluation. (Author/MH)

Evaluating school-based mental health services for children and youth with emotional disturbance (ED) has been a challenge for researchers. One particular challenge is the study design of using the student as the statistical unit of analysis, which in certain cases may lead to a violation of the "independence of error" assumption.…

Provides the conceptual framework for the Treatment Improvement Protocols (TIPs) evaluation project, using the diffusion of innovations theory as the theoretical foundation to understand and assess the development of TIPs. Summarizes principles of diffusion theory, and discusses how the model was used to structure the TIPs studies. (SLD)

The concept of evaluation readiness complements other evaluation planning approaches. Its basic products are the formal program definition and the data inventory framework. Ways to improve timeliness, appropriateness, and use of evaluation are also discussed. (Author/GDC)

The self-selection problem in program evaluation is explored, and two ways of addressing it, covariate control approaches and two-stage sample selection models, are described. A longitudinal study of the effects of participation in Alcoholics Anonymous illustrates both approaches and shows the advantages of the two-step procedure. (SLD)

A consumer-oriented program evaluation of a master's level clinical psychology training program is reported. A goal attainment model of evaluation was employed, requiring specification of program goals, development of goal-related objectives and hypotheses, and formulation of recommendations for program modification based on results achieved.…

This article provides a case study of the use of emergent design, which asks evaluators to adapt their inquiry processes as understanding develops, in the evaluation of a family support program, tracing the emergence of evaluation procedures through three phases. Two phases produced data that policymakers found very helpful. (SLD)

This article describes the on-going evaluation of a pilot program characterized by: (1) cooperation between program managers and evaluators; (2) first-hand knowledge about the implementation of the pilot; and (3) a focus on summative and formative evaluations. Evaluators participated actively in the design of the pilot. (Author/SLD)

Some specific opportunities and techniques are described for combining and integrating qualitative and quantitative methods from the design stage of a substance abuse program evaluation through implementation and reporting. The multiple problems and requirements of such an evaluation make integrated methods essential. (SLD)

An outreach and linkage program for the homeless mentally ill documented successful outcomes in terms of housing but not in terms of functioning for the 163 participants. Recruitment source, client functioning cluster type, and hours of service received were predictors of the four-month residential setting. (SLD)

Articles in this special issue suggest improvements in longitudinal program evaluation to meet the challenges of evaluation of human services programs. Contributions describe innovations in design, methods, data analysis, utilization, and interpretation of the findings of longitudinal studies. (SLD)

Considers the workings and effects of The Innovation and New Technology Programme in Norway, describing the design of the evaluation and the use of a centrally established control group to assess programs results. Uses results from innovation theory to appraise the aims and working methods of the program and a combination of quantitative and…