The distinction between experimental evaluation (which employs generalizable analyses of discrete causes and effects) and contextual evaluation (which examines particular program operations holistically) is articulated. Program characteristics are examined and linked to experimental and contextual models of program evaluation. (Author/MH)

Evaluating school-based mental health services for children and youth with emotional disturbance (ED) has been a challenge for researchers. One particular challenge is the study design of using the student as the statistical unit of analysis, which in certain cases may lead to a violation of the "independence of error" assumption.…

The Combined Modified Design is presented to overcome problems of internal and external validity in the conduct of true experiments in longitudinal studies. It combines a modified version of the Randomized Invitation Design with the lottery longitudinal experimental field trial situation. (SLD)

Reports on the use of the tailored design method (TDM) to achieve high survey response in two separate studies of the dissemination of Treatment Improvement Protocols (TIPs). Findings from these two studies identify six factors may have influenced nonresponse, and show that use of TDM does not, in itself, guarantee a high response rate. (SLD)

Little is known about effective eHealth recruitment methods. This paper presents recruitment challenges associated with enrolling African-American girls aged 8-10 years in an eHealth obesity prevention program, their effect on the recruitment plan, and potential implications for eHealth research. Although the initial recruitment strategy was…

Provides the conceptual framework for the Treatment Improvement Protocols (TIPs) evaluation project, using the diffusion of innovations theory as the theoretical foundation to understand and assess the development of TIPs. Summarizes principles of diffusion theory, and discusses how the model was used to structure the TIPs studies. (SLD)

Presents a framework to describe typical constraints that program evaluators face. The framework encompasses the usual evaluation costs and other factors that impede data collection or the implementation of strong evaluation designs. These are characterized as internal/substantive or external/political. (SLD)

Several recent studies are identified that used expert ratings of the job performance of certified professionals as a validation criterion. These studies showed a strong relationship between expert ratings and certification, but were susceptible to alternative interpretations due to design constraints. Inclusion of control constructs is presented…

The concept of evaluation readiness complements other evaluation planning approaches. Its basic products are the formal program definition and the data inventory framework. Ways to improve timeliness, appropriateness, and use of evaluation are also discussed. (Author/GDC)

The self-selection problem in program evaluation is explored, and two ways of addressing it, covariate control approaches and two-stage sample selection models, are described. A longitudinal study of the effects of participation in Alcoholics Anonymous illustrates both approaches and shows the advantages of the two-step procedure. (SLD)

In the studies described, focus groups were conducted with recreation administrators, special-interest groups, and the general public to determine needs and opinions about recreation and leisure activities. The ways in which the groups elicited information about the needs, language, and history of the community are discussed. (SLD)

A consumer-oriented program evaluation of a master's level clinical psychology training program is reported. A goal attainment model of evaluation was employed, requiring specification of program goals, development of goal-related objectives and hypotheses, and formulation of recommendations for program modification based on results achieved.…

Many evaluation researchers are now attempting to synthesize quantitative and qualitative approaches. Although such efforts appear to carry great promise, some subtleties and incompatibilities of these approaches are perhaps being overlooked. Implications for social inquiry are discussed. (Author/GDC)

This article provides a case study of the use of emergent design, which asks evaluators to adapt their inquiry processes as understanding develops, in the evaluation of a family support program, tracing the emergence of evaluation procedures through three phases. Two phases produced data that policymakers found very helpful. (SLD)

Some specific opportunities and techniques are described for combining and integrating qualitative and quantitative methods from the design stage of a substance abuse program evaluation through implementation and reporting. The multiple problems and requirements of such an evaluation make integrated methods essential. (SLD)