Due to the diversity of steps to be followed in program evaluation and knowledge, skills, qualification and competency requirements, the evaluation should be a field of expertise similar to other disciplines. Thus, it is important to consider program evaluation as a field of expertise and to determine the required competencies. This study aimed to…

The Research Excellence Framework (REF) is a new system for assessing the quality of research in UK higher education institutions (HEIs). For the first time, part of the assessment included the wider impact of research. RAND Europe was commissioned to evaluate the assessment process of the impact element of REF submissions, and to explore the…

Making the program theory explicit is an essential first step in Theory Driven Evaluation (TDE). Once explicit, the program logic can be established making necessary links between the program theory, activities, and outcomes. Despite its importance evaluators often encounter situations where the program theory is not explicitly stated. Under such…

This study was conducted in order to examine how and to what extent the implementation of the performance-based bonus program in South Korean schools has motivated teachers to improve their behavior, as well as to identify any other positive or negative effects of the program. Interviews with teachers indicated that a large percentage of teachers…

This paper provides a reflective account of a consultation process on professional designations for evaluators initiated and coordinated by the Canadian Evaluation Society (CES). Described are: (1) the forces leading CES to generate discussion and debate about professional designations for Canadian evaluators, (2) the process of developing and…

Purpose: The purpose of this study is to examine how students with workplace learning experience the process of the assessment of prior experiential learning (APEL) in higher education. Design/methodology/approach: This is an inductive and exploratory study drawing on methodology from the field of academic literacies. It addresses two questions:…

This article critically analyses the mechanisms and procedures that facilitate the effectiveness of the current teacher appraisal system in Botswana secondary schools. Teachers in schools, in this case in Botswana secondary schools have to undergo appraisal every year for both accountability and developmental purposes. In this article, the author…

The Centre for Social Action was commissioned by the Leicester City Council to evaluate its Teenage Pregnancy Prevention Strategy. This was a multi-stage project with a central element of consulting with young people. This article outlines the process that was followed in order to recruit, train and support young people through the process of…

In this study, the purpose was to determine whether there was concordance among raters in the assessment of the writing performance using analytic rubric; furthermore, factors affecting the assessment process were examined. The analytic rubric used in the study consists of three sections and ten properties: External structure (format, spelling and…

This paper is a reflection on practice. It begins by briefly describing an evaluation of an externally-funded education programme in Kosovo (a new country in south-east Europe). The programme was managed by Save the Children in Kosovo and aimed to develop and promote models of inclusive education through three strands of activity. The first of…

This article explores the interaction of formal and informal attributes of competence-based assessment. Specifically, it presents evidence from a small qualitative case study of summative assessment practices for competence-based qualifications within apprenticeships in the motor industry in England. The data are analysed through applying an…

This paper reports on the findings of a research project that elicits the main factors impacting on the performance of workplace assessors in the oil and gas industry. The purpose of the paper is to reveal the significance of the role of workplace assessors and the subsequent impact upon workforce engagement. One model of employee competency…

The ECERS-R and ITERS-R are among two of the most widely used observational measures for describing the characteristics of early childhood education and care. This paper describes a professional development programme currently taking place in seven regions across England, designed to train local government staff in the application of the scales as…

This article describes Local Education Authority (LEA) practices in England and Wales, with regard to institutional evaluation during the mid to late 1980s. It considers the various approaches and systems used and particularly looks at issues of information handling, reporting, follow-up, and adviser (inspector) training. (IAH)

The paper discusses two common scenarios in which evaluators must conduct impact evaluations when working under budget, time, or data constraints. Under the first scenario the evaluator is not called in until the project is already well advanced, and there is a tight deadline for completing the evaluation, frequently combined with a limited budget…