Schools, districts, and state-level educational organizations are experiencing a great shift in the way they do the business of education. This shift focuses on accountability, specifically through the expectation of the effective utilization of evaluative-focused efforts to guide and support decisions about educational program implementation. In…

In the broad field of evaluation, the importance of stakeholders is often acknowledged and different categories of stakeholders are identified. Far less frequent is careful attention to analysis of stakeholders' interests, needs, concerns, power, priorities, and perspectives and subsequent application of that knowledge to the design of…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

Developed a comprehensive methodology for a series of process evaluations of seven therapeutic communities for drug-involved offenders. The methodology used stakeholder interviews, official measures of program implementation, and a new structured observation technique. Discusses the type and quality of information provided by each technique. (SLD)

There is increasing recognition of the need for evaluations that identify program processes or mediators and assess degree of program implementation rather than focusing solely on outcome evaluation. This paper describes the application of complementary qualitative and quantitative evaluation procedures to assess the degree of implementation of…

Summarizes ongoing economic impact assessment activities at the National Institute of Standards and Technology (NIST) for its Measurement and Standards Laboratory Program. Explores designing economic impact studies for integration into assessments of broader programmatic objectives. (SLD)

Concept mapping was used to assess the fidelity of an experimental program model for psychiatrically disabled street dwellers. Concept maps portrayed the program as conceptualized by its Boston University developers and program staff. Quantitative and descriptive analyses of the maps indicated good fidelity of model transfer. (SLD)

Four key entities participating in foreign assistance projects are (1) donors; (2) technical advisors; (3) host country counterparts; and (4) beneficiaries. Resistance to collaborative evaluation that each may exhibit is discussed, along with ways evaluators can overcome resistance and enhance evaluation outcomes, credibility, and utilization.…

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Contrasts different methods of evaluating aid programs to small and medium enterprises. Methods focus on the relationship between beneficiaries and program implementers to explore the role intangible relational means play in specific cultural contexts. (SLD)

Explores implications for evaluation practice of using five different perspectives on organizations, drawing on the four models of social program implementation developed by R. F. Elmore (1978). It is argued that evaluation will only really be effective when its focus, methods, and management reflect realistic assumptions about how organizations…

The implementation of a collaborative approach to evaluating family literacy programs was studied using a conceptual framework and applied to 36 family literacy programs from a midwestern state. Evaluation participants learned how results could be used to develop curriculum in addition to reporting to funding agencies. (SLD)

Partial results of an evaluation of an alternative criminal-sentencing program indicate considerable disagreement among stakeholders over perceived program effectiveness. It is argued that these disagreements are not isolated events but are likely to be inherent in any program with the potential to change established systems within a complex…

An evaluation of case management services to families on public assistance suggests that a "logic model" and an "open systems" evaluation approach might be useful in program evaluation. A second study describes how the logic model and open systems evaluation were used to develop an evaluation plan for services to homeless…

Traditional evaluation approaches assume that consensus can be reached among policymakers, managers, and staff about goals that should guide a program. Evaluations of juvenile detention facilities and a home arrest program illustrate that consensus is not always possible. A constructionist evaluation approach is recommended for such situations.…