Program reviews are standard practice in higher education. Yet, due to the infancy of the leadership discipline, little is known about the process of conducting reviews of leadership programs. Through interviewing 13 experienced leadership program reviewers in both curricular and co-curricular contexts, the authors of this study aim to address…

This article explores issues that had to be confronted over a three-year period in terms of two New York State funded grants for which I was the evaluator. Major, critical challenges are presented, described, and discussed. Specifically, the paper addresses issues related to lack of planning at the grant design stage that resulted in challenges…

Evaluations are practiced in political contexts, posing ethical dilemmas to evaluators. It is important, therefore, to prepare evaluation students for ethical decision-making in their future evaluative work. This study explores the use of scenario-based moral reasoning and ethical argumentation as an instructional strategy for teaching evaluation…

The importance of engaging in high quality program evaluation is a generally accepted principle underscored by external pressure from funders. High quality evaluation necessarily begins with good evaluation planning. This paper outlines Evolutionary Evaluation and specifically the Systems Evaluation Protocol, an approach that emphasizes…

While evaluators have explored the implementation of culturally responsive evaluation (CRE), the failures of applying CRE are less often told. In this article, we use a reflective case narrative to explore our successes and failures in implementing our CRE approach, including an educative stance. We draw on a formative evaluation of a…

Research on evaluation theories, methods, and practices has increased considerably in the past decade. Even so, little is known about whether published findings from research on evaluation are read by evaluators and whether such findings influence evaluators' thinking about evaluation or their evaluation practice. To address these questions, and…

Drawing on a qualitative study of an educational reform and its external evaluation, I describe how a well-intentioned but poorly conceptualized evaluation helped perpetuate asymmetries in the generation and use of evaluation findings. This article explores this project's failure to clarify evaluator roles, identify intended users and expected…

This article provides an introduction to geographic information systems (GIS) and how the technology can be used to enhance evaluation practice. As a tool, GIS enables evaluators to incorporate contextual features (such as accessibility of program sites or community health needs) into evaluation designs and highlights the interactions between…

The use of technology in the evaluation of higher education programs is a mainstay. Physical evidence rooms, face-to-face interviews, and reviewing of documentation on site have become obsolete. Relying on the heavy use of technology in the evaluation process has allowed what some believe to be a more cohesive, streamlined approach to the…

In this paper we share our reflections, as evaluators, on an evaluation where we encountered Excessive Evaluation Anxiety (XEA). The signs of XEA which we discerned were particularly evident amongst the program head and staff who were part of a new training program. We present our insights on the evaluation process and its difficulties, as well as…

In 1999, the National Science Foundation (NSF) awarded funds to the Evaluation Center at Western Michigan University to conduct an external evaluation of the Advanced Technological Education (ATE) program. ATE, a federally mandated program designed to increase the number and quality of skilled technicians in the U.S. workforce, has funded over 346…

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

As Americans shift their work and leisure activities online, Extension seeks to remain viable by delivering programs through a website known as eXtension. eXtension is predicated on the voluntary labor of Extension specialists and educators who form Communities of Practice to create and deliver content through the website. Evaluation of eXtension…

In the past few years researchers have published lists of evidence-based practices that research indicates "should" be in place in programs and supports for students with emotional or behavioral disorders (EBD) (e.g., Farley, Torres, Wailehua, & Cook, 2012; Ryan, Pierce, & Mooney, 2008; Simpson, Peterson, & Smith, 2011). Some…

Background: A music education program with a goal of enhancing cognitive development of preschool-aged children enrolled in local preschools is evaluated by The Evaluation Center at Western Michigan University. The budget for the evaluation was small, and therefore presented several challenges to the evaluation team. Purpose: Through a case study…