This article describes three challenges encountered during a developmental evaluation and explains how these were addressed from the evaluators' perspective. The evaluation was conducted to support the implementation of a three-year educational technology leadership project funded by the Alberta provincial government. The developmental evaluation…

Making the program theory explicit is an essential first step in Theory Driven Evaluation (TDE). Once explicit, the program logic can be established making necessary links between the program theory, activities, and outcomes. Despite its importance evaluators often encounter situations where the program theory is not explicitly stated. Under such…

Evaluators know they are supposed to identify and engage with stakeholders. What happens when the client has a very narrow concept of the meaning of evaluation? What happens when the primary stakeholders, including the client, disappear just as the evaluation gets started? First, it is important to acknowledge the challenge, then develop a…

This article describes an evaluation that was judged to be unsuccessful from the point of view of key program stakeholders. This was due to the fact that the evaluation did not support program advocates who had much to gain from positive evaluation findings. We argue that, although the knowledge needs of stakeholders must be taken into account,…

The clash between Western and Indigenous ways of knowing has been epitomized by the "parachuting model" of the Western researcher who drops onto the reservation, collects data, and leaves, never to be heard from again. The strengths of indigenous science, for example, observation and contextual factors, are either ignored or…

Professional identity is a precondition for the establishment of a profession. This examines the professional identity of program evaluators in Israel. The field of evaluation in Israel has developed differently than in most Western countries--from the ground and with minimal governmental interference--and thus it is an interesting case study. In…

While we may all agree in principle that both implementers and evaluators should be culturally sensitive and ethical as well as instrumentally effective in their work practices, we often ignore the extent to which these practice goals may conflict with one another in achieving bureaucratic competence, particularly in a multicultural society.…

Despite increasing interest in the integration of evaluative inquiry into organizational functions and culture, the availability of empirical research addressing organizational capacity building to do and use evaluation is limited. This exploratory descriptive survey of internal evaluators in Canada asked about evaluation capacity building in the…

Presented are the results of a study using latent profile analysis to describe the self-reported practices of 138 evaluators. Four classes emerged and were labeled (a) indistinct pattern of practice, (b) method-focused, (c) user-focused, and (d) robust pattern of practice. Evaluators in the "indistinct pattern of practice" class had mean item…

Studied the convergence of evaluator and non-evaluator perspectives about collaborative evaluation. Results based on work of 67 pairs of evaluators and program practitioners show that, generally, program practitioners were more conservative in their opinions. Many differences in the two perspectives are noted. (SLD)

In participatory evaluations of K-12 programs, evaluators develop school faculty's and administrators' evaluation capacity by training them to conduct evaluation tasks and providing consultation while the tasks are conducted. A strong case can be made that the capacity building in these evaluations can be examined using a Vygotskian approach. We…

How can indigenous evaluators implement culturally competent models in First Nations communities while ensuring that government grant evaluation requirements are met? Through describing the challenges in one tribal community in the United States, this article will discuss how American Indian/Alaska Native substance abuse prevention programs are…

The American Indian Higher Education Consortium (AIHEC), comprising 34 American Indian tribally controlled colleges and universities, has undertaken a comprehensive effort to develop an "Indigenous Framework for Evaluation" that synthesizes Indigenous ways of knowing and Western evaluation practice. To ground the framework, AIHEC engaged…