Implementation fidelity data indicate to what extent the delivered educational intervention (e.g., pedagogies, curricula) differs from the designed intervention (Gerstner & Finney, 2013; O'Donnell, 2008). Fidelity data help practitioners make more accurate inferences regarding program effectiveness (Dumas, Lynch, Laughlin, Smith, & Prinz,…

The term "outcome evaluation" has become one of the most popular terms among human service providers and those whose job it is to evaluate the impact of human service programs. In the public sector alone, there are over a hundred instruments in use to evaluate the impact of state human service programs. Most states, many providers, and…

Professional school counselors have been advocating for their role as counselors in the schools for decades (Galassi & Akos, 2007; Gysbers, 2002; Slaten & Baskin, 2013). Although researchers have addressed this concern through advocacy in service and writing, school counselors continue to perform a significant amount of non-counseling…

Schools, districts, and state-level educational organizations are experiencing a great shift in the way they do the business of education. This shift focuses on accountability, specifically through the expectation of the effective utilization of evaluative-focused efforts to guide and support decisions about educational program implementation. In…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

Although the importance of addressing and evaluating treatment and program fidelity is clearly emphasized in the literature on psychology, education, and health, little attention has been given to fidelity in adventure literature or research. Program fidelity refers to whether or not, and how well, a specific intervention or program was…

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…

There is a growing recognition of the value of measuring fidelity of implementation (FOI) as a necessary part of evaluating interventions. However, evaluators do not have a shared conceptual understanding of what FOI is and how to measure it. Thus, the creation of FOI measures is typically a secondary focus and based on specific contexts and…

This paper provides a reflective account of a consultation process on professional designations for evaluators initiated and coordinated by the Canadian Evaluation Society (CES). Described are: (1) the forces leading CES to generate discussion and debate about professional designations for Canadian evaluators, (2) the process of developing and…

Evaluators know they are supposed to identify and engage with stakeholders. What happens when the client has a very narrow concept of the meaning of evaluation? What happens when the primary stakeholders, including the client, disappear just as the evaluation gets started? First, it is important to acknowledge the challenge, then develop a…

Across the country, states and districts are designing principal evaluation systems as a means of improving leadership, learning, and school performance. Principal evaluation systems hold potential for supporting leaders' learning and sense of accountability for instructional excellence and student performance. Principal evaluation is also an…

Evaluators face challenges when programs consistently fail to meet expectations for performance or improvement and consequently, evaluators may recommend that closing a program is the most prudent course of action. However, the evaluation literature provides little guidance regarding when an evaluator might recommend program closure. Given…

Evaluators are often faced with many challenges in the design and implementation of a program's evaluation. Because programs are entangled in complex networks of structures and stakeholders, they can be challenging to understand, and they often pose issues of competing and conflicting goals. However, by using a systems mapping approach to…

This brief describes different types of evaluations and sets forth five steps for selecting an evaluator that can benefit a program in the long run. It also provides some tips on the cost of evaluations. Evaluation refers to "the process of acquiring and assessing information to provide useful feedback about a program or program activity."…

In this essay, we describe our experiences working with a rebellious primary stakeholder, Sylvia, as evaluators of a district-wide safe schools program. Given the breadth of the program and its multiple target constituencies, we were confronted with the challenges of managing a large number of stakeholders, or those individuals and groups that…