Assessments used for both clinical practice and research should show evidence of validity and reliability for the target group of people. It is easy to agree with this statement, but it is not always easy to choose the right assessment for the right purpose. Recently there have been increasing numbers of studies which investigate further the…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

This "Instructor's Corner" describes a step forward on the journey to write, review, and publish high-quality qualitative research manuscripts. This article examines two existing perspectives on generating high-quality qualitative manuscripts and then compares and contrasts the different elements of each. First, an overview of Rocco's (2010) eight…

Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

The test review process used by the Buros Center for Testing is described as a series of 11 steps: (1) identifying tests to be reviewed, (2) obtaining tests and preparing test descriptions, (3) determining whether tests meet review criteria, (4) identifying appropriate reviewers, (5) selecting reviewers, (6) sending instructions and materials to…

The assessment of vocational workplace-based qualifications in England relies on human assessors (raters). These assessors observe naturally occurring, non-standardised evidence, unique to each learner and evaluate the learner as competent/not yet competent against content standards. Whilst these are considered difficult to measure, this study…

Universities in Europe have been playing an increasingly important role in the institutional evaluation of political and social systems for the last thirty years. Their major contribution to those processes of accountability has been to add methods and safeguards of evaluative research. In this paper we report an illustration of how evaluative…

This article investigates whether the characteristics of feedback identified by the literature can be found within written assessment records for work and competence-based qualifications. It uses a brief literature review and analysis of the formative feedback within 257 learner portfolios. The characteristics identified by the literature are…

The author of an indicator that tests evaluation system compliance with good governance principles addresses the UNDP's response to his article by offering an empirical test of the UNDP's commitment to reform. While the UNDP Evaluations Office claims to be working on reforms, the test exposes the unwillingness of the UNDP Evaluations Office to…

This monograph has grown out of a series of discussions and a six-month period of reading and reflecting on the literature which were initiated by Fritz Mosher's suggestions to the National Assessment of Educational Progress (NAEP) to examine the "standards" question. Conversations with Mosher himself and the staff of NAEP have been most…

Supercharged. High-performers. Leaders of the pack. This article presents "Training" magazine's 2012 Top Young Trainers--those high-potential training professionals who are on the fast track to success. For the fifth year, "Training" magazine is pleased to recognize the outstanding talents, accomplishments, and leadership exhibited by 40 learning…

Education aiming at students' competence development asks for new assessment methods. The quality of these methods needs to be assured using adapted quality criteria and accompanying standards. As such standards are not widely available, this study sets out to examine what level of compliance with quality criteria stakeholders consider…

In this article, the characteristics of five test review models are described. The five models are the US review system at the Buros Center for Testing, the German Test Review System of the Committee on Tests, the Brazilian System for the Evaluation of Psychological Tests, the European EFPA Review Model, and the Dutch COTAN Evaluation System for…

Innovation inducement prizes have been used for centuries. In the United States, a recent federal policy change--the America COMPETES Reauthorization Act of 2010--clarified and simplified a path by which all federal agencies can offer innovation inducement prizes, thus intensifying interest in how government agencies can most effectively design…

Each year a great many evaluations are conducted of international development efforts around the world. These development evaluations study projects, programs, country-wide portfolios, policy reform efforts, and other topics of interest to funders, governments, program managers, and other involved stakeholders. Although some of these evaluations…