The current evaluation literature tends to conceptualize evaluator roles as a single, overarching orientation toward an evaluation, an orientation largely driven by evaluation methods, models, or stakeholder orientations. Roles identified range from a social transformer or a neutral social scientist to that of an educator or even a power merchant.…

This study adopted a multilevel modeling (MLM) approach to examine the contribution of rater and essay factors to variability in ESL essay holistic scores. Previous research aiming to explain variability in essay holistic scores has focused on either rater or essay factors. The few studies that have examined the contribution of more than one…

The aim of the present study is to examine the relation between stakeholders as internal evaluators and their systemic positions in light of construal level theory. The study examines the two samples of county representatives, teachers and principals who answered the questionnaire regarding evaluation of the Norwegian assessment program. In…

Written as four scenes that span a five-year period, this article examines the summative evaluation of an organized school reform programme in the United States from the teacher perspective. The study provides fine-grained details of how the evaluation of the particular reform effort went "awry" in the view of some teachers who directly…

In an effort to gain better understanding of the assessment of prior informal and non-formal learning, this article explores assessors' approaches to portfolio assessment. Through this portfolio assessment, candidates had requested exemptions from specific courses within an educational programme or admission to the programme based on their prior…

Over a period spanning 8 years, the Oral History Project Team has conducted interviews with individuals who have made significant contributions to the scholarship, practice, and profession of evaluation. In 2006, Robin Miller, Chris Coryn, and Daniela Schroeter conducted an oral history interview with James R. Sanders at the Evaluation Center that…

The effects of four different identity revelation modes (three fixed modes: real-name, anonymity, nickname and one dynamic user self-choice mode) on participants' perceptions toward their assessors, classroom climate, and past experience with the learning activity in which they were engaged were examined. A pretest-posttest quasi-experimental…

The increasing demand of constituents to conduct analyses in order to help inform the decision-making process has led to the need for Institutional Research (IR) guidelines for community college educators. One method of maintaining the quality of research conducted by IR staff is to include professional development about ethics. This article…

There is an abundance of research that examines the social-psychological phenomenon called stereotype threat. There is not, however, a conclusive understanding of the processes and mechanisms that operate within stereotype threat that produce reduced performance in a negative stereotype relevant area. This dissertation proposes that there are…

Teacher evaluation has the ability to greatly support increased student achievement. However, existing literature on the topic finds evaluations are not meeting the intended purpose. Since principals are responsible for the implementation of the process at their school site, their perceptions of current processes is of value if evaluations are to…

Nearly 2,500 districts, schools, and nonprofits representing every state have indicated they plan to compete for an Investing in Innovation grant, setting up a furious fight over $650 million in federal economic-stimulus money that is designed to scale up creative solutions to education's most vexing problems. The large group of prospective…

In education, data-driven decision making is a buzz word that has come to mean collecting absolutely as much data as possible on everything from attendance to zero tolerance, and then having absolutely no idea what to do with it. Most educational organizations with a plethora of data usually call in a data miner, or evaluator, to make some sense…

The marketplace continues to move working adults toward completing their college degrees at an expeditious rate. Prior learning assessment has been shown to aid retention efforts. As with any assessment tool, reliability and validity are key to quality assurance. Given the student-centered nature of prior learning assessment, evaluators have…

The author is increasingly sensitive to the Venn diagram of overlapping expertise in which program evaluation intersects a content area such as public health, urban education, or--in the case of Katherine Hay--international development. Many evaluators practice in these areas of overlap, experts in the evaluation of a specific domain. Given her…

Knowledge utilization is a field crossing many sectors, from agriculture, since the 1920s, to health care today. Evaluators have made long-standing contributions to understanding knowledge utilization. Different models or ways to think about knowledge utilization have evolved to reflect different perspectives, contexts, and stages of the process,…