Describes a training-evaluation method that assesses whether participants remember what they were supposed to have learned and know how to apply it on the job. (Author)

A technique to estimate variances of weighted estimates in program evaluation is discussed. BRR estimates of variance are constructed from orthogonally weighted subsamples and can provide better estimates from complex samples than can other methods. Use of BRR is illustrated in a government evaluation of a food service program. (SLD)

Changes made in 1981 to the Aid to Families with Dependent Children (AFDC) program under the Omnibus Budget Reconciliation Act were evaluated. Multiple quasi-experimental designs (interrupted time series, non-equivalent comparison groups, and simple pre-post designs) used to address evaluation questions illustrate the issues faced by evaluators in…

When the four administrators at a Wisconsin high school indicated they would appreciate staff feedback about their performance, union representatives undertook the task of formalizing an evaluation agreement, developing an evaluation instrument, implementing the evaluation process, and reviewing assessment procedures. The instrument and written…

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

This evaluation matrix considers three aspects: (1) evaluation focus (purpose/rationale, context, audience); (2) evaluation design (questions, methods, data sources, analysis, reporting); and (3) management (personnel, timeline, costs). Application to six elements (participant, instructor, course, curriculum, program, project) is illustrated. (SK)

Presents a selected bibliography of scholarship in the assessment of writing. Offers 125 items that have appeared in major scholarly publications from 1979-91, organized in 7 categories: large-scale assessment; classroom writing assessment; theory; politics and issues; methods and procedures; program assessment; and networking resources. (SR)

Argues for a change from the artificial and irrelevant evaluation activities found in so many special education programs. Provides examples of school districts in the United States that are developing new ways of assessing, ways that are less artificial and more appropriate to children's modes of thinking and learning. (RS)

A series of surveys in the last 30 years shows little application of Kirkpatrick's 4-level model for training evaluation (reaction, learning, application, benefit) beyond level 1, a finding confirmed in recent responses from 72 of 620 companies surveyed. A mirror of the model, working from level four to one and back, might be more widely adopted.…

Notes that, although consultation researchers and practitioners have called attention to need for more psychometrically sound instruments, little advancement has occurred in this area. Outlines key quantitative and qualitative psychometric standards for organizational consultation assessment and evaluation instruments. Presents framework and…

The relationship between alternative evaluation approaches and the concerns of policy communities is examined. It is assumed that there are certain criteria and methods that are more relevant to particular types of policy discussions. Evaluation methodology should be based on the interests of the policy actors involved. (TJH)

Comments on S. Pogrow's suggestion that educational programs should be judged by the degree to which schools using them achieve "surprising scores." Emphasizes the importance of the use of control groups in program evaluation. (SLD)

The Situated Evaluation Framework for continuing professional education programs situates the learner and knowledge assessment at the junction of three contexts: educational, practice, and evaluation. The framework incorporates the following components of evaluation theory: programming, valuing, knowledge, and utilization. (SK)

The most important result of training is the satisfaction of customers who deal with trainees when they return to their jobs. Customer reaction sheets are easy and inexpensive to create, administer, tabulate, and interpret. (JOW)

In the last 10 years, there has been increased use of case study methodology, with accompanying refinement and improvement of the methods. Case studies have become legitimate research methods in evaluation, but it is too soon to say whether improvements in methodology are really resulting in improvements in the case studies conducted. (SLD)