With the push for evidence-informed policy and practice, schools and policy makers are now increasingly encouraged and supported to use and enagage with research evidence. This means that consumers of research will now need to be discerning in judging the quality of research evidence that will inform their decisions. This paper evaluates the…

This paper focuses on our experience of researching the influence of ResourceSmart Schools, a sustainable schools programme in Victoria, Australia. Drawing on ideas from programme theory and realist synthesis, we illustrate and reflect upon our approach to conceptualising, investigating and generating evidence about the programme's…

"FRIENDS for Life" is a cognitive behavioural therapy (CBT) programme which aims to reduce anxiety and promote resilience among children. This study evaluated the "FRIENDS for Life" (FRIENDS) programme used as an intervention for seven children between the ages of 10 and 11 presenting with high functioning autism spectrum…

The primary objective of this article is to evaluate the design variables of a newly developed teaching intervention, "The Amazing Tax Race". It comprises a race against time in which accounting students participate within teams in multiple tax-related activities so that they are exposed to pervasive skills. The findings provide…

In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

This paper reviews literature on the rationale, challenges, and recommendations for choosing a nonequivalent comparison (NEC) group design when evaluating intervention effects. After reviewing frequently addressed threats to validity, the paper describes recommendations for strengthening the research design and how the recommendations were…

This article proposes an innovative approach to estimating the counterfactual without the necessity of generating information from either a control group or a before-measure. Building on the idea that program participants are capable of estimating the hypothetical state they would be in had they not participated, the basics of the Roy-Rubin model…

Participatory research is a broad term covering a range of approaches that are characterised by a focus on "action-oriented" research involving researchers and participants working in collaboration to bring about positive change. These approaches emphasise engagement with co-researchers and the development and implementation of…

Evaluation designs for social programs are developed assuming minimal or no disruption from external shocks, such as natural disasters. This is because extremely rare shocks may not make it worthwhile to account for them in the design. Among extreme shocks is the 2010 Chile earthquake. Un Buen Comienzo (UBC), an ongoing early childhood program in…

Background: In program evaluation interventions are usually examined for global effects but not always for differential effects. The reasoning behind the focus on global effects is that most of the concepts applied in data analyses, and most of the hypotheses being assessed, are variable-oriented. Consequently, existing differential effects will…

In the context of intensifying accountability for academic work internationally, there are increasing pressures on individual supervisors, departments and universities to evaluate the quality of doctoral supervision. Existing evaluation tools are focused at departmental rather than individual level and are mostly quantitative. Evaluation for…

The internationalization of distance learning in special education is at a pivotal point in expansion. Even with concerted efforts through traditional means to increase the supply of special educators, shortages persist; therefore, teacher preparation programs are turning to online education. This dissertation study was a formative program…

This paper presents a retrospective explanation as to how evaluation culture has been slowly incorporated into politics and public institutions in Spain during the last three decades. Evaluation, quality, and excellence are relevant concepts embedded in the design of current political programs. At this moment in history, it is important to ask,…

A study was conducted to design valid and reliable self-evaluation instruments for periodic evaluation of academic programmes of Bolgatanga Polytechnic in Ghana, using evaluation experts and relevant stakeholders of the polytechnic. This paper presents some of the challenges, including those of institutional support, the technical demands of…

How do evaluation practitioners make choices when they evaluate a program? What function do evaluation theories play in practice? In this article, I report on an exploratory study that examined evaluation practices in France. The research began with observations of practitioners' activities, with a particular focus on the phases of evaluation…