A method called multi-attribute utility analysis (MAUA) provides a decision-making framework that facilitates comparative analysis of multiple real-world decision alternatives with unique complex attributes. Utility analysis as a measure of effectiveness has been minimally used by educational researchers to date, despite clear relevance in complex…

What kinds of ethical dilemmas do people who are new to the profession of evaluation face? Are they different from the challenges faced by more experienced evaluators? What strategies do they use to resolve them? These questions were the starting point for the essays included in this issue of the Ethical Challenges section. The essays were written…

Ethical challenges occur even in the relatively protected context of an evaluation project conducted by students under the guidance of their instructor. Successfully building an evaluation project into a semester-long course is not easy. Practical challenges include identifying an appropriate evaluand, completing the evaluation within the…

Evaluation practice has grown in leaps and bounds in recent years. In contrast, the most recent survey data suggest that there has been a sharp decline in the number and strength of preservice evaluation training programs in the United States. In an effort to further understand this curious trend, an alternative methodology was used to examine the…

Suggests an approach to providing practical evaluation training through university-supported, long-term funded evaluation projects. Such projects are managed through a university center that provides assistance to clients in student assessment and program evaluation. Discusses the benefits and challenges of these experiences for students. (SLD)

Describes the conceptual scheme for a 1-year evaluation course designed to each the competencies required to conduct evaluations that provide the sense-making for informed decision making. Draws on the authors' experience in developing such a course over 4 years. (SLD)

Describes the Northwestern training program in methodology and evaluation research, discussing its faculty, curriculum, research opportunities, and emotional climate. (SLD)

The Delphi technique permits the collection of rich evaluation data. Benefits of using the Delphi include the collection of data that is generated by participants with minimal leading by researchers, an iterative process that demonstrates to participants how their ideas and opinions are being utilized in the research process, and a planned…

This article describes the Self-Assessment of Program Evaluation Expertise instrument and procedure developed to help participants assess their learning gains in a 3-week evaluation institute. Participants completed the instrument in a pre- and posttest format. To reduce both the threat of embarrassment from individual results and the temptation…