Psychological theory suggests that evaluators' individual values and traits play a fundamental role in evaluation practice, though few empirical studies have explored those constructs in evaluators. This paper describes an empirical study on evaluators' individual, work, and political values, as well as their personality traits to predict…

This article compares the purposes and content of the four foundational documents of the American Evaluation Association (AEA): the Program Evaluation Standards, the AEA Public Statement on Cultural Competence in Evaluation, the AEA Evaluator Competencies, and the AEA Guiding Principles. This reflection on alignment is an early effort in the third…

This study challenges persistent misrepresentations of evaluation as a value-neutral inquiry process by presenting an empirical study that deepens understanding of evaluators' values and how they "show up" in evaluation practice. Through semistructured interviews and inductive analysis, we examined the values advanced by a sample of…

In this article, I report on examiners' views and experiences of using Pairwise Comparative Judgement (PCJ) and Rank Ordering (RO) as alternatives to traditional analytical marking for GCSE English Language essays. Fifteen GCSE English Language examiners took part in the study. After each had judged 100 pairs of essays using PCJ and eight packs of…

This article is the fifth in a series on the relationship of evaluation theory and practice. It was commissioned by the Eastern Evaluation Research Society and the American Evaluation Association as part of The Chelimsky Forum, launched in 2013 to honor Eleanor Chelimsky, one of the most influential and respected program evaluators of our era, and…

Evaluators have opportunities to advance equity within evaluations, yet little research has examined whether and how evaluators center equity in evaluation practice. This paper explores whether and how evaluators in New England address inequities and advance equity throughout evaluation phases. The study uses a complementarity, sequential mixed…

As global discussions of evaluation standards become more contextually nuanced, culturally responsive conceptions of ethics have not been sufficiently discussed. In academic social research, ethical clearance processes have been designed to protect vulnerable people from harm related to participation in a research project. This article expands the…

Academic reviews take on new directions in an ever-increasing fast-paced development. Unit reviewers should be provided different samples, with varied cultural contents also providing nuances, as related to the 'object' of the evaluation, as well as a final overall product, i.e. more of a synthesis, through which one will check the degree of…

Evaluations are practiced in political contexts, posing ethical dilemmas to evaluators. It is important, therefore, to prepare evaluation students for ethical decision-making in their future evaluative work. This study explores the use of scenario-based moral reasoning and ethical argumentation as an instructional strategy for teaching evaluation…

Efforts to promote professionalism in evaluation, whether through certification, credentialing, or other path, are not new, but there is a new push to adopt sets of essential evaluator competencies, both in the United States and globally, that are intended to advance professionalism of the field. This emphasis on professionalism is relevant to the…

This essay explores the implications of the zeitgeist that emerged in the United States during the 1960s for the conceptualization of ethical issues in evaluation and community psychology, and how perspectives from the latter field might enhance ethical practice in the former. Special attention is paid to articulations of social justice,…

This contribution to the Ethics section is intended to foster discussion about the relationship between multicultural competence and ethics; a timely discussion especially in view of the release in 2011 of the American Evaluation Association's Public Statement on Cultural Competence (http://www.eval.org/ccstatement.asp). Over the course of 2011,…

Where do evaluators find resources on ethics and ethical practice? This article highlights a relatively new online resource, a centerpiece project of the National Center for Professional and Research Ethics (NCPRE), which brings together information on best practices in ethics in research, academia, and business in an online portal and center. It…

In this paper we share our reflections, as evaluators, on an evaluation where we encountered Excessive Evaluation Anxiety (XEA). The signs of XEA which we discerned were particularly evident amongst the program head and staff who were part of a new training program. We present our insights on the evaluation process and its difficulties, as well as…

When conducting research on sensitive topics, it is challenging to use new methods of data collection given the apprehensions of Institutional Review Boards (IRBs). This is especially worrying because sensitive topics of research often require novel approaches. In this article a brief personal history of navigating the IRB process for conducting…