Site visits are used extensively in a variety of settings within the evaluation community. They are especially common in making summative value decisions about the quality and worth of research programs/centers. However, there has been little empirical research and guidance about how to appropriately conduct evaluative site visits of research…

Evaluation research has been in progress to clarify the concept of participatory evaluation and to assess its impact. Recently, two theoretical frameworks have been offered--Daigneault and Jacob's participatory evaluation measurement index and Champagne and Smits' model of practical participatory evaluation. In this case report, we apply these…

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1)…

Environmental education organizations can do more to either institute evaluation or improve the quality of their evaluation. In an effort to help evaluators bridge the gap between the potential for high quality evaluation systems to improve environmental education, and the low level of evaluation in actual practice, we reviewed recent…

Schools are held more responsible for evaluating, quality assuring and improving their student assessments. Teachers' lack of understanding of new, competence-based assessments as well as the lack of key stakeholders' involvement, hamper effective and efficient self-evaluations by teachers of innovative, competence-based assessments (CBAs). While…

The process of liberalization and globalization of Indian economy has brought new opportunities and challenges in all areas of human endeavor including education. Educational institutions have to adopt new strategies to make best use of the opportunities and counter the challenges. One of these challenges is how to assess the performance of…

As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site…

This paper presents information on re-developing an outcome evaluation for a state-funded program providing service coordination utilizing wraparound to youth with severe emotional disturbance (SED) and their families. Originally funded by the Robert Wood Johnson Foundation, the Kentucky IMPACT program has existed statewide since 1990. Changing…

As evaluations are more often implemented by internal staff, internal evaluators must begin to assume decision-making and advocacy tasks. This advocacy evaluation concept is described using the Federal Bureau of Investigation evaluation staff as a model. (TJH)

This paper identifies and discusses conceptual and methodological issues related to five attributes of emergent programs that frequently apply across the spectrum of human services: undefined client populations, inadequate causal evidence relating inputs to outcomes, shifting objectives, identification of criteria for standarizing treatments, and…

Studied the reliability of the Addiction Severity Index (1980) by using eight trained professional actors as client surrogates to examine the reliability of the instrument when administered in the field. With careful surrogate selection and training, the method proves to be an effective means of assessment. (SLD)

The importance of addressing the political dynamics inherent in any evaluation research process is discussed. The theoretical orientation contributing to the denial and avoidance of politics is articulated and contrasted with one which posits politics as normative and useful. (Author/LMO)

This study examines demands placed on evaluators by the Joint Committee on Educational Evaluation's standards. Twenty-two experts in evaluation rated the compatibility of implementing pairs of standards or rated individual standards on a series of scales. Multidimensional scaling revealed five demands of ethical practice. (JAZ)

Compared two methods for evaluating youth empowerment programs. One program used a traditional, open-ended style of service planning and program tracking, and the other used precoded measurement procedures that invited the direct participation of youth in goal setting and evaluation. Discusses the relatively greater usefulness of the precoded…

Draws on interviews with 61 officials in 13 federal agencies to illustrate a framework showing many of the potential uses of evaluation in support of performance management. Suggests 10 actions as opportunities for agency administrators and evaluators to bridge the current gaps between potential and actual uses of evaluation. (Author/SLD)