As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site…

The purpose of this study was to assess staff and client perspectives on the Internet-based Journey Mapping program evaluation tool. A drug court program was chosen for a case study research design. Six staff and 10 clients participated in interviews and observations, and also responded to a questionnaire. A staff survey provided additional data.…

This paper presents information on re-developing an outcome evaluation for a state-funded program providing service coordination utilizing wraparound to youth with severe emotional disturbance (SED) and their families. Originally funded by the Robert Wood Johnson Foundation, the Kentucky IMPACT program has existed statewide since 1990. Changing…

Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific…

A two-step procedure is proposed for detecting behavioral patterns in observational data in evaluation research. Latent class analysis is used to derive a classification of single observations at the variable level. The second step uses the probabilities that each observation falls into latent classes to derive behavioral preference scores. (SLD)

Empowerment evaluation is defined as a process that encourages self-determination among the recipients of a program evaluation. This article contains a theoretical framework of empowerment evaluation, a discussion of methodological issues, and suggestions for operational considerations for evaluators who wish to implement empowerment evaluation.…

Studied the reliability of the Addiction Severity Index (1980) by using eight trained professional actors as client surrogates to examine the reliability of the instrument when administered in the field. With careful surrogate selection and training, the method proves to be an effective means of assessment. (SLD)

The five articles of this special section focus on the quantitative-qualitative debate in program evaluation. This section focuses on philosophical aspects of program evaluation, making it clear that the issues are far more complex than the simple quantitative-qualitative dichotomy described by T. S. Kuhn (1970) implies. (SLD)

Compared two methods for evaluating youth empowerment programs. One program used a traditional, open-ended style of service planning and program tracking, and the other used precoded measurement procedures that invited the direct participation of youth in goal setting and evaluation. Discusses the relatively greater usefulness of the precoded…

Applied an alternative strategy for assessing the extent of change clients undergo as a result of receiving human services. Used the approach in a survey of parents of 61 young children in an art program. Findings show the feasibility of the service productivity approach. Psychometric properties of the approach were promising. (SLD)

Discusses how a time-series approach was used in the evaluation of the impact of California Senate Bill 2669 on child maltreatment reports. Describes the factors that influenced decisions about evaluation methods and the selection of outcome and exogenous measures. Recommends actions that would facilitate the implementation of evaluations of this…

Outcomes evaluation of community partnerships to prevent substance abuse poses many methodological challenges. The nine articles of this special section illustrate the variety of approaches evaluators have taken to studies that are often complicated because of small sample size. (SLD)

In many evaluations, presenting probability distributions of cost-effectiveness results offers a convenient way to show the likelihood of various conclusions given the uncertainties in the inputs. The techniques presented in this paper should be useful for many programs characterized by controversy over perspectives, assumptions, and dollar…

Summarizes ongoing economic impact assessment activities at the National Institute of Standards and Technology (NIST) for its Measurement and Standards Laboratory Program. Explores designing economic impact studies for integration into assessments of broader programmatic objectives. (SLD)

Illustrates the use of latent growth modeling (LGM) as an analytical tool in program evaluation using the hypothetical example of a high school drug prevention program. Demonstrates the use of LGM in assessing longitudinal impact and in incorporating predictors of status and growth into a model. Highlights advantages and limitations of LGM. (SLD)