All students at Norwegian universities and colleges have the right to complain about ordinary grading decisions. When an appeal is made, two new examiners are appointed, at least one of whom should be external. The handling of appeals in the current system is to be blind, meaning that the examiners handling the complaint should not be aware of the…

An Angoff standard setting study generally yields judgments on a number of items by a number of judges (who may or may not be nested in panels). Variability associated with judges (and possibly panels) contributes error to the resulting cut score. The variability associated with items plays a more complicated role. To the extent that the mean item…

Medical education relies heavily on assessment formats that require raters to assess the competence and skills of learners. Unfortunately, there are often inconsistencies and variability in the scores raters assign. To ensure the scores from these assessment tools have validity, it is important to understand the underlying cognitive processes that…

"The Belmont Report" was written in 1979 to address the abuse of human participants in biomedical research. In the report, three ethical principles were described: (1) "beneficence," which describes an act of charity or kindness that maximizes possible benefits while minimizing possible harms; (2) "justice," described…

In the absence of photographic or DNA evidence, a credible eyewitness, or perpetrator confession, forensic evaluators in cases of alleged child sexual abuse must rely on psychosocial or "soft" evidence, often requiring substantial professional judgment for case determination. This article offers a three-part rebuttal to Herman's (2009) argument…

How do evaluators make decisions about how to approach an evaluation in their everyday practice? What are the bases for evaluators' approach choices? In what ways do evaluators think about evaluation models? The evaluation literature remains unclear about what specific information evaluators consider when making decisions in response to everyday…

In an effort to gain better understanding of the assessment of prior informal and non-formal learning, this article explores assessors' approaches to portfolio assessment. Through this portfolio assessment, candidates had requested exemptions from specific courses within an educational programme or admission to the programme based on their prior…

The increasing demand of constituents to conduct analyses in order to help inform the decision-making process has led to the need for Institutional Research (IR) guidelines for community college educators. One method of maintaining the quality of research conducted by IR staff is to include professional development about ethics. This article…

The chapter explores critical roles of internal evaluators in contemporary organizational settings. The need is highlighted for an expanded, reconfigured, unorthodox set of roles and styles of work to meet the needs of the emerging learning organizations effectively. A discussion of major categories of internal evaluator roles emerged from the…

How do evaluation practitioners make choices when they evaluate a program? What function do evaluation theories play in practice? In this article, I report on an exploratory study that examined evaluation practices in France. The research began with observations of practitioners' activities, with a particular focus on the phases of evaluation…

Race to the Top represented a new paradigm in federal education. Instead of spreading relatively modest dollars evenly across all jurisdictions through funding formulas--as virtually all federal education funding has been and continues to be spent--a small number of successful states received all of the available funding, and in turn made it…

This chapter explores how the structure of large complex organizations such as Cooperative Extension affects their ability to support internal evaluation of their programs and activities. Following a literature review of organizational structure and its relation to internal evaluation capacity, the chapter presents the results of interviews with…

In this article, the authors discuss the technologies of normalization and self in relation to ethics and the problematization of extrinsic research ethics. They argue that institutional review boards (IRBs) and other similar institutional mechanisms promote extrinsic forms of ethics that are exemplified through institutionalized structures such…

This scenario discusses a situation in which a proposal has been published by a consortium of foundations for an "external" evaluator to evaluate a replication at two new sites of a program they have been funding for many years. A proposal is received from Dr. Porto-Novo, who has been the external evaluator of the initial program for about 10…

Is it appropriate and useful for evaluators to use findings to make recommendations? If so, under what circumstances? How specific should they be? This article presents a decision-making framework for the appropriateness of recommendations in varying contexts. On the basis of reviews of evaluation theory, selected evaluation reports, and feedback…