Data Envelopment Analysis (DEA) is a widely adopted non-parametric technique for evaluating R&D performance. However, traditional DEA models often struggle to provide reliable solutions in the presence of data uncertainty. To address this limitation, this study develops a novel robust super-efficiency DEA approach to evaluate R&D…

While social programs are often assessed using short-term impact studies, longitudinal designs allow evaluators to capture change over time, identify longer-term outcomes, adapt instruments, and better understand participants in transition. A mixed methods design can be critical in understanding these dynamics; yet there is a lack of literature…

This paper describes the context, processes and issues experienced over 5 years in which a RCT was carried out to evaluate a programme for children aged 7-8 who were struggling with their reading. Its specific aim is to illuminate questions about the design of complex teaching approaches and their evaluation using an RCT. This covers the early…

Background: The Education Endowment Foundation (EEF) is an independent charity that was established in 2011 with the explicit aim of breaking the link between family income and educational achievement in England. Over the seven years since its inception, EEF has contributed to the existing evidence base by funding over one hundred randomised…

This paper reviews literature on the rationale, challenges, and recommendations for choosing a nonequivalent comparison (NEC) group design when evaluating intervention effects. After reviewing frequently addressed threats to validity, the paper describes recommendations for strengthening the research design and how the recommendations were…

HIV/AIDS is one of the most important public health challenges facing Nigeria today. Recent evidence has revealed that the adolescent population make up a large proportion of the 3.7% reported prevalence rate among Nigerians aged 15-49 years. School-based sexual health education has therefore become an important tool towards fighting this problem.…

Current economic conditions and the increasing competition for government funding are leading to an increased focus on the impact of research. Measuring the impact of research is difficult because not all impacts are direct and some can be negative or result from the identification of problems that require a non-research response. The time between…

Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific…

This article provides a brief summary of the seven articles in this special issue through the lens of the concept of "caring reflexivity". In joining "caring" and "reflexivity", we deepen the conversation about what constitutes reflexivity, encouraging an explicit focus on the relational. Revisiting the first article,…

Rapidly declining response rates and the associated threat of nonresponse bias call into question the validity of data obtained through telephone surveys, a tool often used in evaluation. This article explores changes in nonresponse bias over time by examining three data points (1991, 1996, and 2002) from an annual household telephone survey…

The present review examines research on the effects of technology use on reading achievement in K-12 classrooms. Unlike previous reviews, this review applies consistent inclusion standards to focus on studies that met high methodological standards. In addition, methodological and substantive features of the studies are investigated to examine the…

This article reviews the processes, issues and dilemmas involved in evaluation research undertaken in the context of changing and evolving government policy in education. The article is grounded in an evaluation of the National Partnership Project (NPP), the team conducted on behalf of England's Teacher Training Agency (TTA) in 2004-2005. It will…

This paper provides a critical analysis of New Zealand's Performance Based Research Fund (PBRF). The first section sketches the development and implementation of the PBRF. The second section evaluates the scheme, concentrating on three themes: the relationship between privatization, competition and research performance; the standardization of…

The net result of the social-scientific developments in the 19th and 20th centuries is that educational research has inherited a science that is assumed to constitute a disinterested technology of social engineering and a benevolent source of positive social advance. Unfortunately, the social experiment conducted on traditional lines depends upon…

This paper is devoted to an analysis of the "Standards for Evaluation of Educational Programs, Projects, and Materials" as they apply to qualitative data. The most difficult ethical problem arises from the conflict between the right to privacy of research subjects and the right to know of audiences. There are two technical points in the…