COVID-19 is disrupting assessment practices and accelerating changes. With special focus on K-12 and credentialing exams, this article describes the series of changes observed during the pandemic, the solutions assessment providers have implemented, and the long-term impact on future practices. Additionally, this article highlights the importance…

This paper attempts to define evaluation use and manipulable variables related to it. Approaches to defining evaluation use have included typologies inventorying kinds of evaluation use, threshold criteria defining accepted levels of evidence, construct or operational definitions, and dependence on the perspective of the decision maker. None of…

Research has suggested that evaluators vary in the extent to which they interpret the challenges they face in ethical terms. The question of what accounts for these differences was explored through a survey completed by 391 individuals listed in the database of the American Evaluation Association. The first section of the questionnaire presented…

Whether there can be professional reasons for turning down an evaluation contract is explored. Considering how evaluations can promote either guild maintenance interests or societal improvement interests illuminates several dilemmas in the proper conduct of evaluation and suggests the need for greater explicit attention to what it means for the…

This paper considers the setting of evaluation from the perspective of the situations and stages of problem solving in which institutional leaders might call for the assistance of evaluators. This discussion should provide evaluators with a framework to understand and adjust their interactions with the environmental context of the evaluation. R.…

This paper reviews what has been learned about evaluation ultilization during the past 20 years. Evaluation utilization is discussed in terms of what is used, who uses evaluation, when evaluation is used, how evaluation is used, where evaluation is used, and why evaluation is used. It is suggested that the personal factor - the interests and…

Questionnaires covering evaluation strategies and practices were sent to directors of 200 camps accredited by the American Camping Association. Half received questionnaires designed to collect quantitative data in the form of yes/no responses and Likert scales; the other half received qualitative questionnaires covering the same information in an…

Various strategies for optimizing the use of program evaluation information are recommended, based on a thorough evaluation of the literature. The recently revised "Program Evaluation Standards" (Joint Committee, 1994) are then reviewed point by point as regards sensitivity to these recommendations. It appears that the new standards…

This paper presents a plan of action for managing evaluation implementation and ensuring the ongoing utilization of evaluation results. It addresses strategies that are required to manage the problems encountered in a 10-step management plan. Focus is on introducing an evaluation monitoring system within organizations. Steps in the plan include:…

Procedures for generating evaluation questions in the Discrepancy Evaluation Model (DEM) are problematic as they are described in the literature. These procedures would lead to unmanageably or ineffectively long lists of questions. Any process of narrowing down the list must be drawn from other sources. One such source, developed for a specific…

The "U.S. News & World Report" (USNWR) rankings have become the "gold standard" of the college ranking business. College and university presidents proclaim that these rankings are not a measure of the quality of their institutions and that they do not pay attention to the rankings, but, in fact, institutions are very…

This paper describes the methods engaged in by an internal evaluation unit within a large school district to transition program staff from participating in a formal program evaluation to continuing the responsibility of program monitoring once an evaluation ends. Formal multiyear program evaluations can provide program managers and staff with…

This paper presents an evaluation of the National Network of Eisenhower Regional Consortia and Clearinghouse. A symposium presentation was chosen to report the consortia's contribution to the improvement of mathematics and science education. The presentation is divided into four sections, each of which was presented separately by one of the panel…

While there is a recognized need for new and better ways to train soldiers to fight, many training programs developed in response to this need are used poorly or not at all. In part, the failure to use these training programs stems from the lack of established procedures for monitoring implementation and evaluating use. Effective monitoring can…

Areas of evaluation are identified in which the formative/summative distinction appears inadequate: (1) knowledge-generating evaluations aimed at conceptual use; (2) developmental evaluation; and (3) use of evaluation to support intervention or empower participants. An argument is also made for the effectiveness of feedback that cannot be…