The role of the evaluator in insuring utilization and quality of evaluation results is discussed. Topics covered include a utilization-focused vision of accountability, overcoming staff fears of evaluation, eliciting the right information from users, situational responsiveness, and advocacy. (TJH)

On behalf of the Joint Committee on Standards for Educational Evaluation, the author reviews the Committee's recent efforts and discusses the needs for further work related to the "Standards for Evaluations of Educational Programs, Projects, and Materials." The Committee has developed a program to guide its work. The program addresses…

Recommendations to increase the relevance of information, improve the communication of information, and increase user responsiveness to information are presented. Recommendations include the following: (1) the Department of Education (ED) should institute a flexible planning system for evaluations of federal education programs; (2) congressional…

Some of the methodological problems in analyzing and reporting qualitative data are addressed, and some solutions based on recent experiences in conducting several qualitative studies are proposed. The following are some guidelines for implementing an intuitive approach to analyzing and reporting qualitative data: (1) use a team of evaluators; (2)…

The program evaluation standards approved by the American National Standards Institute (ANSI) in 1994 that deal with reliability and validity accurately represent contemporary views of the psychometric community with regard to reliability and validity. As such, these standards move the field forward. The ANSI standards recognize that reliability…

Some of the most important evaluation questions cannot be answered through experimental research. The "assessment" of the St. Louis Leadership Program (SLLP), sponsored by the Danforth Foundations, is used as an illustration of a "connoisseur-based study" approach to evaluation. The project team, given limited time and funds, decided that it could…

Discusses the need to develop an appropriate pedagogy for cooperative education to integrate the educational outcomes from the work and classroom experience. Suggests that the model should structure, guide, and provide for the systematic evaluation of the learning resulting from the cooperative education assignment. (JOW)

Taking the position that science is not value-free has certain consequences. There are both risks and rewards inherent when evaluators relinquish an objective, non-involved role for a more subjective, partisan role in an evaluation where issues of class, gender, and race are intertwined. It is important for evaluators to consider how their…

The stages of the policy process are examined and explained in terms of the decision making framework. The policy process is comprised of four stages; policy analysis, policy formation, policy decision, and political analysis. Political analysis is the performance of the market analysis needed for a decision. The political weight, rather than the…

Where mental health administrators used to rely on subjective judgments of senior clinicians to evaluate the effectiveness of mental health services, they now rely more on a quality assurance (QA) plan. The primary motive for undertaking a QA program should be better service. QA may start out being very expensive in terms of personnel and…

This paper reviews what has been learned about evaluation ultilization during the past 20 years. Evaluation utilization is discussed in terms of what is used, who uses evaluation, when evaluation is used, how evaluation is used, where evaluation is used, and why evaluation is used. It is suggested that the personal factor - the interests and…

The author believes her ideas on evaluation reporting are old ideas in various fields including communication theory, advertising, social science, and learning theory. The human factor in reporting evaluation must be considered. Those being evaluated often feel threatened by the evaluation. Evaluators need to accept the behaviors of evaluation…

The evaluation literature suggests that evaluation studies may be underutilized by policy makers. This possibility has stimulated a good deal of evaluation use research. However, most of the research has not been theoretically grounded. This paper reviews the key propositions of communications theory and related previous research, as they are…

Aspects of monitoring and evaluating programs for visually handicapped students are examined. The certification/accreditation program evaluation design is considered in terms of advantages and disadvantages. Roles of governmental (state and federal) and voluntary agencies are discussed. The functions of the National Accreditation Council of…

Individual program evaluation studies have the potential to accumulate of very valuable knowledge and practical wisdom. Drawing on "The Case for Pragmatic Psychology" (D. Fishman, 1999), this paper contends that much of this wisdom is being thrown away because of the positivist paradigm used in determining which knowledge should be…