This article provides a critical review of the quality of 12 recent large federal program evaluations. The review focused on elements of the evaluation design, inclusion of evaluation expertise among those who have oversight of the evaluation, and evaluation dissemination. Overall, the process analyses from these evaluations provide good models…

Discusses the role that causal models play in program theory evaluation. Considers several types of causal relationships and discusses three causal models derived from systems theory, the theories of virtuous or vicious cycles, symptomatic solutions, and feedback delays. (SLD)

This article addresses the construction of "critical friendships" within the practice of one particular program evaluation. It focuses on the evolution of relationships developed during one 2-year program evaluation study that examined a collaborative educational project. Findings show that a caring interest and mentoring rapport developed between…

Areas of evaluation are identified in which the formative/summative distinction appears inadequate: (1) knowledge-generating evaluations aimed at conceptual use; (2) developmental evaluation; and (3) use of evaluation to support intervention or empower participants. An argument is also made for the effectiveness of feedback that cannot be…

Major drawback of traditional evaluation is its emphasis on outcome" or terminal performance; what is needed are more process-oriented methods of assessment. Author describes Program Analysis" as a possible model. (Author/MB)

The evaluation of educational programs in higher education needs a better theoretical base than it has had. Proposals as to what that base should encompass are discussed and an approach that involves a more adequate conceptual and procedural model is explored. Focus is on a systems viewpoint. (JMD)

This interview focuses on usability testing, one method for evaluating whether library Web sites are useful for users. Discussion includes: benefits and drawbacks of usability testing; why it is important; lessons learned from testing; advice for someone interested in doing a study; and recommendations. (AEF)

This paper presents a framework for monitoring implementation which defines a process for implementing new programs into organizations. The process requires a team of monitors who examine the adequacy of implementation plans and look at the effect of plan execution upon the organization, individual, and new program. Immediate feedback is provided…

Describes a program evaluation model that was developed over three semesters of teaching an introductory graduate-level course in program evaluation. The framework uses a systems approach that emphasizes its sequenced methodology and the significant of monitoring work through feedback loops in an ongoing revision process. (Author/SLD)

A number of different methods have been used by instructional television (ITV) projects to obtain audience feedback, and some of these are now being used in the ITV system in El Salvador. We know that pretesting programs on a representative sample can bring considerable gains in learning. Another feedback source can be a classroom of pupils in the…

This paper describes the use of both quantitative and qualitative methods to evaluate a project designed to define a state system of care for meeting the needs of people with concurrent disorders of mental illness and substance abuse. The evaluation was intended to develop a feedback system to provide program implementers with information about…

The client-oriented cost outcome system provides feedback of the data generated by or for consumers for a program's service planning, delivery, quality control, and evaluation methods. The system's conceptual framework, necessary components, and applications for program evaluation are described. Available from: Pergamon Press, Maxwell House,…

Procedures for setting and monitoring program goals are discussed, using a drug treatment project as an example. Implementation steps include goal setting, checking for consistency, monitoring, and providing feedback. The advantages and limitations of this goal-oriented approach are described. Available from: Pergamon Press, Maxwell House,…

A case is made for, and three examples are given of the use of, "participation evaluation" in classroom, college, and state education program evaluation. This approach is based on feedback from program participants. (MDR)

The author describes his experience with an educational audit at Laredo Junior College in Texas and says that the audit is a fast, inexpensive way of evaluating vocational programs that provides immediate feedback. (MF)