As part of a multiyear research study on the preparation of educators to use assessment data for instructional improvement, the present study is a pilot test of a research-based professional development intervention for career-technical teachers. Forty-eight educators at nine sites in five states participated in a 1-day workshop followed by…

This article identifies concrete steps used at Argosy University/Orange County (Argosy or AUOC) to integrate assessment in daily institutional operations and utilize assessment data for educational and organizational improvements. Additionally, the article addresses the role of an institutional effectiveness committee in facilitating the…

More and more, data from standardized assessments are being used to make instructional decisions for struggling middle school readers. Administrators must stop spending money on "silver-bullet" curriculum programs and start spending money on training opportunities that will lead to autonomy and creativity in the classroom. In this article, the…

Despite assessment being viewed as integral to practice, there are questions about schools' preparedness to engage in this process. Data from three studies conducted in New Zealand primary schools explore whether use of student achievement data is part of the professional canon or skill set. (1) When implementing new literacy materials, evidence…

Keeping faculty one step ahead of emerging technologies--and providing them with the support to manage what often feels like a rising tide of new tools and learning research--can indeed be difficult. Managing the widening gulf between early adopters and less technologically savvy faculty can be downright frustrating. And then there's the delicate…

Evaluation practices used by state legislatures to monitor educational reform are analyzed in this paper, which focuses on the link between politics and choice of oversight strategies and evaluation methods. Two oversight strategies are compared--"police-patrol" and "fire-alarm.""Fire-alarm" oversight involves…

Surveyed 42 community mental health centers (CMHCs) to examine how evaluations of these centers affect programmatic decisions. Results showed that availability of funds was the most important factor influencing decision making when evaluation of CMHCs pointed to a need for change. (BH)

This paper discusses two models that hold promise for helping evaluators understand and cope with different decision contexts: (1) the conflict Model (Janis and Mann, 1977) and the Social Process Model (Vroom and Yago, 1974). Implications and guidelines for using decisionmaking models in evaluation settings are presented. (BS)

In this collection, evaluation theorists and practitioners consider evaluator role and identity in evaluation theory, practice, and society. The chapters are: (1) "Three Frameworks for Considering Evaluator Role" (Jean A. King and Laurie Stevahn); (2) "Toward Better Understanding of Alternative Evaluator Roles" (Melvin M. Mark); (3) "Making (More)…

Research has suggested that evaluators vary in the extent to which they interpret the challenges they face in ethical terms. The question of what accounts for these differences was explored through a survey completed by 391 individuals listed in the database of the American Evaluation Association. The first section of the questionnaire presented…

This introduction to a special section on evaluation utilization decribes the charge presented to the commissioned authors: to clarify what is meant by evaluation utilization. The resulting papers are described as presenting a clear rejection of the term utilization and as providing substantial assistance in distinguishing between utilization and…

Highlights the important contributions of responsive evaluation's orientation to local issues and qualitative methods, but rejects responsive evaluation's relativity in favor of deliberation as a vehicle for adjudicating among competing evaluative claims. The great strength of responsive evaluation is that it helped break the intellectual…

An experiment examined combinations of evaluation report type (anecdotal, critical outcomes, utility analysis) and impact level (low, average, high) on 233 managers' interpretation of human resources scenarios. Anecdotal reports were significantly less useful. Impact level had no effect. There was no interaction between report type and impact…

Discusses four reasons why progress in evaluation in private foundations has been so slow and intermittent. These include: (1) inflated claims for the power of evaluation as a guide; (2) foundations' distance from the consequences of their actions; (3) sensitivity to hostile criticism and the difficulties of learning from legitimate criticism; and…

Linkages between utilization and stakeholder participation in the evaluation process are discussed, with emphasis on the communication of results. Data from two small-scale participatory evaluations are used to support the argument that key elements of the participatory process can be linked to meaningful and multiple forms of research…