Implementation refers to the process by which an intervention is put into practice. Research studies across multiple disciplines, including education, have consistently demonstrated that interventions are rarely implemented as designed and, crucially, that variability in implementation is related to variability in the achievement of expected…

Purpose: The article explores the significance of "evaluation" in the delivery of multifunctional extension advisory programmes and argues the necessity of integrating evaluation into programme planning, to ensure that programme guidelines are adhered to and extension advisory programmes generate their desired impact. The article focuses…

This paper reviews the literature about peer and self-assessment in university courses from the point of view of their use, and the suitability of their use, in the first year of university study. The paper is divided into three parts. The first part argues that although first-year students are involved in many of the studies that report on the…

I define a treatment effect in terms of a comparison of outcomes and provide a typology of all possible comparisons that can be used to estimate treatment effects, including comparisons that are relatively unknown in both the literature and practice. I then assess the relative merit, worth, and value of all possible comparisons based on the…

A large body of literature documents the central importance of fidelity of program implementation in creating an internally valid research design and considering such fidelity in judgments of research quality. The What Works Clearinghouse (WWC) provides web-based summary ratings of educational innovations and is the only rating group that is…

Environment and sustainable development show how policies are becoming ever more complex and ambiguous. This trend calls for new evaluation approaches. They need to be more clearly focused on specific, explicit concerns. They must be driven by a strategic concept of use to overcome the vulnerability to manipulation of many integrative, essentially…

In order to assess how completely a Small Learning Community (SLC) and/or Career Academy is implemented in any given site, and to connect the degree of implementation with the amount of improvement in student performance, two kinds of information are needed. The first is information on the quality of implementation, which can be collected by…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

This article describes the planning of a multi-agency and multi-stakeholder evaluation of the implementation of supportive housing. The Ottawa Housing"Plus" Collaborative Communities project is a collaboration between university-based evaluators and members of a local network of supportive housing providers. The objectives of the…

In consultation with experts in the fields of education research and whole school improvement, researchers at the Comprehensive School Reform Quality (CSRQ) Center created a framework for evaluating the scientific rigor of research studies that report on the efficacy of whole school improvement models. In this paper, the authors begin with a brief…

This article seeks to explore the "fit" of "the network" as an organizational form being implemented in schools in England. It considers current trends within education policy, pedagogy and educational technology in the context of these new service delivery models and relates these to the current interest in learning networks.…

This document contains 16 issues of the first 5 years of a newsletter encouraging collaborative research and informed policy on welfare reform and focusing on the use of an on-line database of child welfare research projects, as well as research and policy issues related to implementation studies, indicators of well-being, and administrative data.…