The aim of the article is to describe the assessment model adopted by the SCINTILLA Project, a project in Italy aimed at the online vocational training of young, seriously-disabled subjects and their subsequent work inclusion in smart-work mode. It will thus describe the model worked out for evaluation of the training program conceived for the…

From a utilization-focused evaluation perspective, the success of an evaluation is rooted in the extent to which the evaluation was used by stakeholders. This paper details the "Expectations to Change" (E2C) process, an interactive, workshop-based method designed to engage primary users with their evaluation findings as a means of…

Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

After months of waiting, the grant reviews came back: "excellent," "excellent," and "fair." What?! How can this be? Why is the third review so out of line with the first two? On more than one occasion a principal investigator (PI) has been frustrated not only by a negative funding decision but more so by the accompanying reviewer evaluation forms…

This article addresses the leadership preparation line of inquiry developed in the past decade by the University Council for Educational Administration/Learning and Teaching in Educational Leadership Special Interest Group Taskforce on Evaluating Leadership Preparation Programs, and it particularly addresses the series of survey instruments…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

Presented are the results of a study using latent profile analysis to describe the self-reported practices of 138 evaluators. Four classes emerged and were labeled (a) indistinct pattern of practice, (b) method-focused, (c) user-focused, and (d) robust pattern of practice. Evaluators in the "indistinct pattern of practice" class had mean item…

The authors discuss how to use economic techniques to evaluate educational programs and show how to apply basic cost analysis to implementation of school-wide positive behavior support (SWPBS). A description of cost analysis concepts used for economic program evaluation is provided, emphasizing the suitability of these concepts for evaluating…

This study describes the Math and Science Partnership Program Evaluation (MSP-PE) during the project's first two years and provides the evaluation framework being used to assess the National Science Foundation's MSP Program. The study conveys the MSP-PE's ongoing design and implementation. To show how they reflect the nature of the MSP Program,…

The efforts of the Austin (Texas) Public School District to improve the readability and usefulness of technical reports are reviewed. Coincident with, or consequent to, a 1977 letter by W. E. Jones to the editor of an Austin paper (the "Austin American Statesman") complaining about excessively lengthy (500-page) evaluation reports, the…

Objective: Organizational learning, underpinned by evidence-based health care, and greater user involvement in planning and delivery were key objectives of the NHS Plan. Evaluation, and specifically participatory evaluation, offers the potential to address these elements of the NHS modernization agenda. We discuss the strengths and limitations of…

The Even Start program, designed to demonstrate ways of implementing and delivering family literacy services, has had strong evaluation requirements since its inception. An analysis was conducted to determine the types of evaluations programs had conducted and their findings concerning Even Start outcomes. A convenience sample of 4 state…

This article explores how the evidence base for aspects of early childhood has been explored using systematic research synthesis methods developed at the Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI-Centre). Three early childhood systematic reviews have been carried out using EPPI-Centre procedures and tools. The…

This document is comprised of the single 2000 issue of a newsletter of the Harvard Family Research Project, designed to share new ideas and experiences in evaluating systems reform and comprehensive child and family services. The issue focuses on after-school programs and includes the following articles: (1) "Building the After School…

Building the evaluation capacity of K-12 schools is clearly an important goal for the field of evaluation, especially in the current educational environment, which is dominated by issues of accountability and high-stakes testing. The focus on student achievement has forced schools to become more data-driven as they attempt to analyze test scores…