Discusses the challenges facing evaluators of welfare reform and the ways that multiple methods can be combined to meet these challenges. Describes the studies reported in this issue. (Author/SLD)

This paper reviews the state-of-the-art in program evaluation for substance abuse prevention efforts. Included in this review is a discussion of approaches to process, outcome, and impact evaluation. Evaluation designs are reviewed with attention given to topics such as recruitment and retention of sites and participants, defining interventions,…

Application of evaluability assessment by the Cooperative Extension Service of the Department of Agriculture is reviewed. The effort involved five states with six major programs since 1984. Underlying philosophy and methodological considerations are discussed, and background information is provided on the assessment processes and studies…

Describes a training-evaluation method that assesses whether participants remember what they were supposed to have learned and know how to apply it on the job. (Author)

A technique to estimate variances of weighted estimates in program evaluation is discussed. BRR estimates of variance are constructed from orthogonally weighted subsamples and can provide better estimates from complex samples than can other methods. Use of BRR is illustrated in a government evaluation of a food service program. (SLD)

Changes made in 1981 to the Aid to Families with Dependent Children (AFDC) program under the Omnibus Budget Reconciliation Act were evaluated. Multiple quasi-experimental designs (interrupted time series, non-equivalent comparison groups, and simple pre-post designs) used to address evaluation questions illustrate the issues faced by evaluators in…

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

This evaluation matrix considers three aspects: (1) evaluation focus (purpose/rationale, context, audience); (2) evaluation design (questions, methods, data sources, analysis, reporting); and (3) management (personnel, timeline, costs). Application to six elements (participant, instructor, course, curriculum, program, project) is illustrated. (SK)

Presents a selected bibliography of scholarship in the assessment of writing. Offers 125 items that have appeared in major scholarly publications from 1979-91, organized in 7 categories: large-scale assessment; classroom writing assessment; theory; politics and issues; methods and procedures; program assessment; and networking resources. (SR)

The appropriate delivery of service to people with intellectual disabilities in Victoria (Australia) can be facilitated by General Service Plans (GSPs). This paper provides suggested content for such plans, a protocol for their evaluation, and an assessment of GSPs in Victoria constructed between 1987 and 1990. A large number of GSPs were found to…

A series of surveys in the last 30 years shows little application of Kirkpatrick's 4-level model for training evaluation (reaction, learning, application, benefit) beyond level 1, a finding confirmed in recent responses from 72 of 620 companies surveyed. A mirror of the model, working from level four to one and back, might be more widely adopted.…

Previous research on program implementation is integrated and extended to form a participatory approach to evaluating program implementation. This method focuses on the continuous active involvement of program developers, managers, and staff in the evaluation process. The methodology is applied to an actual program to highlight the steps involved.…

The relationship between alternative evaluation approaches and the concerns of policy communities is examined. It is assumed that there are certain criteria and methods that are more relevant to particular types of policy discussions. Evaluation methodology should be based on the interests of the policy actors involved. (TJH)

Comments on S. Pogrow's suggestion that educational programs should be judged by the degree to which schools using them achieve "surprising scores." Emphasizes the importance of the use of control groups in program evaluation. (SLD)

The Situated Evaluation Framework for continuing professional education programs situates the learner and knowledge assessment at the junction of three contexts: educational, practice, and evaluation. The framework incorporates the following components of evaluation theory: programming, valuing, knowledge, and utilization. (SK)