Collaborative evaluation is an approach that offers, among others, many advantages in terms of access to information, quality of information gathered, opportunities for creative problem-solving, and receptivity to findings. In the last decade, collaborative evaluation has grown in popularity along with similar participatory, empowerment, and…

Schools, districts, and state-level educational organizations are experiencing a great shift in the way they do the business of education. This shift focuses on accountability, specifically through the expectation of the effective utilization of evaluative-focused efforts to guide and support decisions about educational program implementation. In…

Program theory evaluation, which has grown in use over the past 10 years, assesses whether a program is designed in such a way that it can achieve its intended outcomes. This article describes a particular type of program theory evaluation--logic analysis--that allows us to test the plausibility of a program's theory using scientific knowledge.…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

This paper addresses the issue of the knowledge gap between evaluators and the entity being evaluated: the dilemma of the knowledge of professional evaluators vs. the in-depth knowledge of the evaluated subjects. In order to optimize evaluative outcomes, the author suggests an approach based on ideas borrowed from the science of cybernetics as a…

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…

This paper details a semi-structured interview protocol that evaluators can use to develop a logic model of a program's services and outcomes. The protocol presents a series of questions, which evaluators can ask of specific program informants, that are designed to: (1) identify key informants basic background and contextual information, (2)…

Describes efforts to build a worldwide evaluation community, noting events that resulted in an almost 200% growth in the number of regional and national evaluation organizations in slightly more than 1 year. Profiles some national and regional evaluation organizations that participated in a recent evaluation meeting and suggests some alternative…

Outlines a training strategy that has been used to encourage evaluators to make sense of codes of behavior and to incorporate such codes into their work. By grouping standards into broad categories, evaluators, and those who commission evaluations, can concentrate on the relevant aspects of the evaluation stage. (SLD)

The Evaluation Voices approach collaboratively united perspectives of program stakeholders, evaluators, and network partners to strengthen individual program evaluation strategies. This approach is described, with emphasis on the shared experience of evaluators and network partners. (SLD)

Describes lessons evaluators can learn from the Honda Motor Company and how an evaluation office within the Department of Health and Human Services has applied these lessons. The lessons include (1) sound market research; (2) creating top-notch production capabilities; (3) building a better mousetrap; and (4) aggressive product selling. (SLD)

Illustrates the use of latent growth modeling (LGM) as an analytical tool in program evaluation using the hypothetical example of a high school drug prevention program. Demonstrates the use of LGM in assessing longitudinal impact and in incorporating predictors of status and growth into a model. Highlights advantages and limitations of LGM. (SLD)

In the evaluation of a major university's effort to extend its resources in support of volunteer development, the program decisionmakers' involvement went beyond the usual limits. The program advisory council participated in the design of data collection instruments and the interviewing of clients. The advantages and disadvantages are described.…

This paper describes the development process of an evaluation framework for describing and comparing web survey tools. We believe that this approach will help shape the design, development, deployment, and evaluation of population-based health interventions. A conceptual framework for describing and evaluating web survey systems will enable the…

This article describes the on-going evaluation of a pilot program characterized by: (1) cooperation between program managers and evaluators; (2) first-hand knowledge about the implementation of the pilot; and (3) a focus on summative and formative evaluations. Evaluators participated actively in the design of the pilot. (Author/SLD)