Evaluated the success of a palliative health care team in a Dutch health region. Results show that it is more appropriate to acknowledge ambiguity and facilitate its handling as part of dynamic learning processes. Discusses the usefulness of a responsive approach to evaluation, evaluation methodology, and learning experiences. (SLD)

Using his experience with rankings of Master's degree programs in public affairs, one public administration professor provides lessons for those in other disciplines who are about to be ranked, explaining what he learned from being ranked and how to improve the process. A sidebar presents U.S. News & World Report rankings in Master's Degree…

Asserting that college union and student activities administrators can become more effective in reaching their desired outcomes by conducting environmental assessment, this article provides a comprehensive plan to conduct such an assessment. Discusses defining the purpose; getting to know the audience, its satisfaction level, and its needs;…

Discusses methods for evaluating the return on investment of training. Compares the effectiveness of electronic learning and traditional methods and suggests that measuring hard numbers might not be a true indicator. (JOW)

Describes methods used to adapt a health care program so that it would better meet the needs of a group of well, older Mandarin-speaking Chinese residents of Los Angeles. Outcomes from a pilot experiment are presented that are consistent with the notion that the adapted program was effective in reducing health-related declines among participants.…

Offers a critical commentary on theory-based evaluation, stressing its utility as a method of program planning and as an adjunct to experiments but rejecting it as an alternative to experiments. Cites seven reasons for doubting that theory-based evaluations can provide the valid conclusions about a program's causal effects that proponents have…

Makes the case that faith in randomized controlled trials (RCTs) to determine "what works" in education may be misplaced. Identifies eight possible problems with relying on RCTs and notes that the rigor required for RCTs may not be practicable. (SLD)

Introduces the 21 papers in this special issue on the future of evaluation. These articles suggest a field that is more eclectic in methods, approaches, and practitioners than was the field described in a similar issue in 1994. (SLD)

Evaluation of the International Faculty Development Seminars (IFDS) was conducted through a review of files of the Council on International Educational Exchange. Since 1990, the IFDS has run 93 programs in 25 countries, enrolling 1,560 people from 613 colleges and universities. Most participants returned to their institutions to create new…

Describes didactic material linking assessment, case conceptualization, and analysis of intervention effects. Analyses were conducted with data provided by 131 students who completed a counseling process course where this material was taught. Results indicate that students increased their self-efficacy for conceptualization and assessment tasks…

Presents a case study of the development and implementation of the "results framework," an innovative planning and evaluation tool that is becoming a standard for U.S. Agency for International Development projects. Explains the advantages of this evaluation and monitoring approach. (SLD)

The Listening Post is an informal, structured technique whereby extension program participants collect feedback from other participants. Benefits include high-quality feedback, high participation, and a sense of ownership. It could, however, exclude persons reluctant to talk, and respondents tend to comment on what is most salient to them. (SK)

Describes the use of multilevel models (MLMs) for studies in which individuals are randomized by groups to treatment condition. Uses data from the Safer Choices study, an evaluation of a theory-based multi-component program to prevent sexually transmitted diseases and pregnancy, to illustrate the application of MLMs for both continuous and…

The Citizens Changing Communities program trained advisory boards in time and meeting management, conflict management, problem solving, goal setting, action planning, and decision making. Although evaluations revealed high interest in program content and delivery methods, actual participation did not match responses. A holistic approach focused on…

Describes and critiques medical school rankings by "U.S. News & World Report" on methodologic and conceptual grounds, arguing that the annual evaluation falls short in both areas. Presents three alternative categories of program quality indicators. Concludes that the rankings have no practical value and fail to meet standards of…