Over the last decade, the idea of societal impact resulting from publicly funded research has changed from being a relatively fringe concern related to high-technology entrepreneurship and spin-off companies to becoming an increasingly important public policy concern. This has stimulated academic science policy research to investigate the impact…

Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal inferences about the effects of an intervention but others have designs that do not permit these types of conclusions. To help policymakers, practitioners, and others make sense of study results, the…

The What Works Clearinghouse (WWC) evaluates research studies that look at the effectiveness of education programs, products, practices, and policies, which the WWC calls "interventions." Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal…

The term "outcome evaluation" has become one of the most popular terms among human service providers and those whose job it is to evaluate the impact of human service programs. In the public sector alone, there are over a hundred instruments in use to evaluate the impact of state human service programs. Most states, many providers, and…

Professionals in various fields have the opportunity to train in real-life situations before they take on a job by themselves. In program evaluation, however, preservice training usually focuses on coursework oriented to research design and methods. After completing these studies, evaluators go off to conduct evaluations guided primarily by their…

Over the last decade, teacher evaluation has moved onto center stage in efforts to strengthen schooling. In this article, we address the question of whether focusing on this administrative process is likely to accomplish what reformers hope. We answer that question by examining the available evidence, both direct and indirect. We deepen the…

States and districts can use this tool to create their own plans for continual improvement of an observation system, no matter where they are in their implementation. Included are action steps to improve observation rubrics, observer training, observer assessment, and monitoring. A planning process is described to assess current status, determine…

Nearly all private, government and non-governmental organizations that receive government funding to run social or health promotion programs in the United States are required to conduct program evaluations and to report findings to the funding agency. Reports are usually due at the end of a funding cycle and they may or may not have an influence…

Although the importance of addressing and evaluating treatment and program fidelity is clearly emphasized in the literature on psychology, education, and health, little attention has been given to fidelity in adventure literature or research. Program fidelity refers to whether or not, and how well, a specific intervention or program was…

This paper provides a reflective account of a consultation process on professional designations for evaluators initiated and coordinated by the Canadian Evaluation Society (CES). Described are: (1) the forces leading CES to generate discussion and debate about professional designations for Canadian evaluators, (2) the process of developing and…

Evaluators in the HPI field can improve their performance program results with effective evaluation through appreciative inquiry. Appreciative inquiry and evaluation have many similarities, and when combined they add value and effectiveness to the measurement of intervention results. Appreciative inquiry is beneficial in many evaluation contexts:…

For the internal evaluator, the issue of trust can be one of the more difficult ethical matters to manage. An organization might choose to conduct an internal program evaluation for a variety of reasons, including capitalizing on the abilities of invested stakeholders to assess aspects of a program, building an institutional culture oriented…

Evaluators face challenges when programs consistently fail to meet expectations for performance or improvement and consequently, evaluators may recommend that closing a program is the most prudent course of action. However, the evaluation literature provides little guidance regarding when an evaluator might recommend program closure. Given…

The Centre for Social Action was commissioned by the Leicester City Council to evaluate its Teenage Pregnancy Prevention Strategy. This was a multi-stage project with a central element of consulting with young people. This article outlines the process that was followed in order to recruit, train and support young people through the process of…

This brief describes different types of evaluations and sets forth five steps for selecting an evaluator that can benefit a program in the long run. It also provides some tips on the cost of evaluations. Evaluation refers to "the process of acquiring and assessing information to provide useful feedback about a program or program activity."…