This article compares the purposes and content of the four foundational documents of the American Evaluation Association (AEA): the Program Evaluation Standards, the AEA Public Statement on Cultural Competence in Evaluation, the AEA Evaluator Competencies, and the AEA Guiding Principles. This reflection on alignment is an early effort in the third…

In this article, I report on examiners' views and experiences of using Pairwise Comparative Judgement (PCJ) and Rank Ordering (RO) as alternatives to traditional analytical marking for GCSE English Language essays. Fifteen GCSE English Language examiners took part in the study. After each had judged 100 pairs of essays using PCJ and eight packs of…

Recurring forms of abuse like domestic violence are unfortunately common. When an individual makes an allegation about their experience, however, there is rarely additional evidence to corroborate their claim. The veracity of the allegation is thus likely to be a central concern in subsequent proceedings. This experiment explored evaluator's…

Instant feedback plays a vital role in promoting academic achievement and student success. In practice, however, delivering timely feedback to students can be challenging for instructors for a variety of reasons (e.g., limited teaching resources). In many cases, feedback arrives too late for learners to act on the advice and reinforce their…

Providing timely feedback is crucial in promoting academic achievement and student success. However, for multifarious reasons (e.g., limited teaching resources), feedback often arrives too late for learners to act on the feedback and improve learning. Thus, automated feedback systems have emerged to tackle educational tasks in various domains,…

Academic reviews take on new directions in an ever-increasing fast-paced development. Unit reviewers should be provided different samples, with varied cultural contents also providing nuances, as related to the 'object' of the evaluation, as well as a final overall product, i.e. more of a synthesis, through which one will check the degree of…

This research gathered data from a sample of university students with disabilities (and a control group without disabilities) from two university campuses (one urban and the other suburban). The project examined the current work and school experiences, plans upon graduation, and understanding of major legislation designed to protect against…

It is currently unknown how many Institutional Review Boards (IRBs) exist at community colleges. This study investigates the percentage of public and Tribal community colleges that have active IRBs. It also examines the potential relationships between states that allow community colleges to confer baccalaureate degrees, or that have articulation…

This research describes, classifies, and comparatively evaluates national models and mechanisms used to evaluate research and allocate research funding in 16 countries. Although these models and mechanisms vary widely in terms of how research is evaluated and financed, nearly all share the common characteristic of relating funding to some measure…

Highlights differences related to the ethics of the evaluation situation for internal and external evaluators and differences related to the attention evaluators pay to the ethics of the evaluand. Internal and external evaluations occupy different "communities," and it is the nature of those communities that is critical for the…

A broad set of ethical principles is examined to determine their relevance for evaluation. The five principles of K. S. Kitchener (autonomy, nonmaleficience, beneficence, justice, and fidelity) are relevant to evaluation and are fully represented in the evaluation standards of the Joint Committee on Standards for Educational Evaluation. (SLD)

Survey items representing 30 standards of the Joint Committee on Standards for Educational Evaluation were used to examine violations in program evaluations. Twenty-nine novice graduate students, 57 graduate students with moderate knowledge about evaluation, and 61 expert evaluators viewed propriety and accuracy standards as suffering the most…

The purpose of the study reported in this chapter was to determine if senior evaluation consultants experienced stages of growth in their practice similar to the small business development stages described by Bruce and Scott, to identify the stimuli that led to those changes, to determine what the consultants learned from these incidents, and to…