Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

This study reports efforts to locate and survey participants in Project Northland Chicago (PNC), a longitudinal, group-randomized trial of an alcohol preventive intervention for racial/ethnic minority, urban, early-adolescents, 3-4 years following the end of the intervention. Data were collected annually among students from 6th-8th grade and then…

Focus groups have an established history in applied research and evaluation. The fundamental methods of the focus group technique have been well discussed, as have their potential advantages. Less guidance tends to be provided regarding the analysis of data resulting from focus groups or how to organize and defend conclusions drawn from the…

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…

This manuscript describes the development and testing of an Internet-based cost survey that was designed by the authors for the National Assembly on School-Based Health Care (NASBHC) to capture the costs of school-based health programs. The intent of the survey was twofold. First, the survey was designed to collect comprehensive data on costs in a…

This paper presents information on re-developing an outcome evaluation for a state-funded program providing service coordination utilizing wraparound to youth with severe emotional disturbance (SED) and their families. Originally funded by the Robert Wood Johnson Foundation, the Kentucky IMPACT program has existed statewide since 1990. Changing…

Needs assessment (NA) is generally based on the discrepancy between two conditions--the desired and present states. To date, there has not been an extensive research regarding a number of subtle problems in discrepancy analysis. One such example is missing data for one or both the two states. This leads to highly varied item "n's" for calculating…

A between method triangulation strategy was used to evaluate a process for long-range program planning. One study team conducted interviews and the other used a mail questionnaire. The resulting problems in coordination between teams are discussed. (Author/GDC)

Conditions influencing conduct and impact of state-level program evaluation are explored. A model is offered as a guide for assessing conduct and impact, and its use is demonstrated by a case study contrasting the approaches of two states examining an issue raised by the Federal Health Care Financing Agency. (SLD)

Describes the development of a pilot uniform data set (UDS) intended to serve as the primary data collection mechanism for all grants and standard cooperative agreements funded by the U.S. Office of Minority Health. The UDS is the product of a formative research project with implications for other program evaluations. (SLD)

Identified methods that six federal agencies reported using to verify and validate performance data used in complying with the requirements of the Government Performance and Results Act. Developed a framework containing four major approaches to assessing and improving data quality. (SLD)

Describes the use of the program logic model as an integrative framework in the multimethod evaluation of a middle school curriculum delivery program. Shows how the logic model was used to focus data collection, organize data, and interpret the data in an integrative framework. Focuses on the area of computer skills to illustrate the usefulness of…

A meta-analysis combining expert evaluation with naturalistic case study methods indicates that such investigations must use special methods to render evaluative judgments of worth. It is demonstrated that descriptive, interpretive, and evaluative aspects of such a study must be combined to yield justifiable conclusions. (TJH)

Using a needs assessment conducted for the Girl Scouts of Greater Philadelphia as a test case, this article analyzes the conditions facilitating the collection of information needed for strategic planning in a voluntary organization and the related conditions influencing whether or not the information would in fact be used. (TJH)

Presents a framework to describe typical constraints that program evaluators face. The framework encompasses the usual evaluation costs and other factors that impede data collection or the implementation of strong evaluation designs. These are characterized as internal/substantive or external/political. (SLD)