Despite the present economic difficulties facing all levels of the nation's educational enterprise, a significant portion of education's resources continue to be used for evaluative activities. As a result, presumably competent evaluation personnel are sought after to evaluate activities in nearly every area of education and its cognate fields.…

Background: Evaluation is sometimes viewed as a professional practice rather than a discipline corresponding to a well defined set of theories. However, Shadish, Cook and Leviton (1991) were able to demonstrate that evaluators' work does have theoretical foundations. In particular, the authors identified five main elements for evaluation theory…

Evaluators use their eyes to see what is there, whether it is intended or not. But they use their test instruments to measure what is intended, whether it is there or not. Evaluators have been broadening their repertoire of instruments for years: curriculum-embedded tests, observer checklists, audiotape recorders, videotape recorders, unobtrusive…

Background: Professional standards for validity of achievement tests have long reflected a consensus that validity is the degree to which evidence and theory support interpretations of test scores entailed by the intended uses of tests. Yet there are convincing lines of evidence that the standards are not adequately followed in practice, that…

It is a special characteristic of all modern societies that people consciously decide on and plan projects designed to improve their social systems. It is their universal predicament that their projects do not always have their intended effects. It seems inevitable that in most countries this common set of problems, combined with the obvious…

This paper addresses an important problem that may really be a pseudoproblem perpetuated by a current artificial or even political need to isolate researchers, evaluators, and theorists and put them in conceptual-methodological boxes. In this paper, we argue that scholars of all kinds should focus on the nouns (i.e., research, evaluation, theory)…

Background: Turkey is a fast-developing country facing a lot of different problems. One of the problems is inadequate education. A large project was started to improve Turkish elementary education. The project includes many different purposes from physical refurbishment of school buildings, to increasing technology use in education. The author of…

Background: A music education program with a goal of enhancing cognitive development of preschool-aged children enrolled in local preschools is evaluated by The Evaluation Center at Western Michigan University. The budget for the evaluation was small, and therefore presented several challenges to the evaluation team. Purpose: Through a case study…

This paper provides a reflective account of a consultation process on professional designations for evaluators initiated and coordinated by the Canadian Evaluation Society (CES). Described are: (1) the forces leading CES to generate discussion and debate about professional designations for Canadian evaluators, (2) the process of developing and…

Background: Since the late 1970s participatory approaches have been widely promoted to evaluate international development programs. However, there is no universal agreement of what is meant by participatory evaluation. For some evaluators, participatory evaluations involve the extensive participation of all stakeholder groups (from donor to…

This paper presents a retrospective explanation as to how evaluation culture has been slowly incorporated into politics and public institutions in Spain during the last three decades. Evaluation, quality, and excellence are relevant concepts embedded in the design of current political programs. At this moment in history, it is important to ask,…

Background: Cultural competency is an important but under-adopted skill among professional evaluators. Yet in the transactions around job seeking and hiring in evaluation, cultural competency is a practical and common concept. How cultural competency gets communicated in those transactions may provide insights for the field. Purpose: The purpose…

Background: Readability tests are indicators that measure how easy a document can be read and understood. Simple, but very often ignored, readability statistics cannot only provide information about the level of difficulty of the readability of particular documents but also can increase an evaluator's credibility. Purpose: The purpose of this…

This article focuses on ethical issues faced in evaluation practice from the viewpoint of third generation of activity theory, which gives a constructive perspective on how contradictions can be a driving force behind interorganizational learning and development in multiactor networks. The problem field is firstly addressed through an illustration…

In a 2004 interview with the late Everett Rogers, author of the book "Diffusion of Innovation", Rogers lamented that in 1963, he and other members of a prominent research group expected to solve the remaining international development problems and end poverty within ten to fifteen years. Now, forty-five years hence, it is time for a "reality…