Many evaluation students are still being taught the use of tests of statistical significance without being warned about their limitations. This paper discusses other estimates of treatment effects necessary to interpret between-group differences correctly. Sources to improve evaluation practice are also suggested. (SLD)

Asserts that pursuing use as the defining goal of evaluation can distort the allocation of evaluation resources and reduce the contributions of evaluation to broader social goals, such as social betterment. Pursuing use can result in an overemphasis on evaluations oriented toward program improvement at the expense of assessment of worth and other…

Introduces the 21 papers in this special issue on the future of evaluation. These articles suggest a field that is more eclectic in methods, approaches, and practitioners than was the field described in a similar issue in 1994. (SLD)

Presents a vision for the future of evaluation in which it will play an expanded and more productive role within organizations. This future will emphasize a learning approach to evaluation that is contextually sensitive, ongoing, and supportive of dialogue, reflection, and decision making at all administrative levels. Traces the development of…

Examined use of the viva in British doctoral examinations, specifically: (1) its roles as delineated within university policy; and (2) its purposes from the perspectives of examiners, supervisors, and doctoral candidates. Found no consensus regarding the viva's role in the Ph.D. examination process; moreover, found inconsistencies and…

The seven chapters of this volume demonstrate that evaluation evidence can overturn widely held beliefs and result in changes in programs and policies. These chapters show that policymakers can welcome findings that challenge long-established ideas and use them to Improve programs and services. (SLD)

"Evaluation Theory, Models, and Applications" is designed for evaluators and students who need to develop a commanding knowledge of the evaluation field: its history, theory and standards, models and approaches, procedures, and inclusion of personnel as well as program evaluation. This important book shows how to choose from a growing…

The study of the consequences of evaluation, or more specifically of evaluation use or utilization, represents a significant portion of the body of research on evaluation. Much has been written on the evolution of the multidimensional concept of evaluation use, most recently the examination of consequences of evaluation that are not a function of…

This article presents an interview with Michael Patton whose professional evolution has contributed to the way evaluation in the United States is understood and practiced today. Patton is an evaluation and organizational development consultant who spent 18 years at the University of Minnesota (1973-1991), including 5 years as the director of the…

Like other universities, RMIT recognises the significance of graduates' ratings of their experience and has had a long-term commitment to improving student learning. As at other universities, RMIT's standard subject-level survey (the Course Experience Survey [CES]) incorporates items from the national Course Experience Questionnaire, with the aim…

For more than 50 years, the International Association for the Evaluation of Educational Achievement (IEA) has been instrumental in developing an analytical model for understanding the relationships between educational policy (the intended curriculum), classroom and instructional practices (the implemented curriculum), and educational learning…

Questionnaires covering evaluation strategies and practices were sent to directors of 200 camps accredited by the American Camping Association. Half received questionnaires designed to collect quantitative data in the form of yes/no responses and Likert scales; the other half received qualitative questionnaires covering the same information in an…

Various strategies for optimizing the use of program evaluation information are recommended, based on a thorough evaluation of the literature. The recently revised "Program Evaluation Standards" (Joint Committee, 1994) are then reviewed point by point as regards sensitivity to these recommendations. It appears that the new standards…

One rationale for implementing a particular evaluation approach is the empowerment of stakeholders. Evaluation as empowerment and possible links between empowerment and increased utilization of evaluation results are explored. Evaluation as empowerment assumes that individuals need to be personally productive and responsible in coping with their…

This paper presents a plan of action for managing evaluation implementation and ensuring the ongoing utilization of evaluation results. It addresses strategies that are required to manage the problems encountered in a 10-step management plan. Focus is on introducing an evaluation monitoring system within organizations. Steps in the plan include:…