Discusses the strategies used to integrate evaluation research into the management of an organization. Also discusses the methodologies and managerial problems encountered in using evaluation research to change the policymaking procedures of public agencies. (RB)

When procedures for developing recommendations are integrated into evaluation methods, it is easier to produce useful recommendations for program improvement. (RB)

Two program goals were: (1) providing a community-based alternative for arrested juveniles who otherwise would have been referred to the juvenile justice system; and (2) reducing juvenile delinquency. Results from various measures indicated the program had little success in decreasing referrals but produced positive delinquency reduction effects.…

The underlying logic and usefulness of true performance monitoring and its potential contribution to program evaluation are examined. It provides an accumulating data base to serve many research designs and generally supports the evaluation process. Increased emphasis on performance monitoring will lead to more cost-effective, policy-relevant…

Introduces an new approach for measuring the impact of whole school reforms. The approach, based on "short" interrupted time-series analysis, is explained, its statistical procedures are outlined, and how it was used in the evaluation of a major whole-school reform, Accelerated Schools is described (H. Bloom and others, 2001). (SLD)

Examined the use of cellular digital packet data (CDPD) systems by a state police agency to support a problem-oriented policing project (POP), focusing on 20 officers. The CDPD data system should have improved the agency's POP operations, but in practice, the benefits were not clear. Few differences were seen between officers who did and did not…

A technique to estimate variances of weighted estimates in program evaluation is discussed. BRR estimates of variance are constructed from orthogonally weighted subsamples and can provide better estimates from complex samples than can other methods. Use of BRR is illustrated in a government evaluation of a food service program. (SLD)

Two competing approaches to policy analysis are distinguished: a credibility approach, and a truth approach. According to the credibility approach, the policy analyst's role is to search for plausible argument rather than truth. Each approach has pragmatic tradeoffs in fulfilling the goal of providing usable knowledge to decision makers. (TJH)

Changes made in 1981 to the Aid to Families with Dependent Children (AFDC) program under the Omnibus Budget Reconciliation Act were evaluated. Multiple quasi-experimental designs (interrupted time series, non-equivalent comparison groups, and simple pre-post designs) used to address evaluation questions illustrate the issues faced by evaluators in…

Previous research on program implementation is integrated and extended to form a participatory approach to evaluating program implementation. This method focuses on the continuous active involvement of program developers, managers, and staff in the evaluation process. The methodology is applied to an actual program to highlight the steps involved.…

Articles in this special issue are reviews that focus on issues related to the evaluation of addiction treatment outcomes over longer term followup periods (2 years or more). The primary conclusion that can be drawn is that research evaluations of substance abuse treatment should reflect, to a greater degree, the chronic nature of addiction. (SLD)

This article reviews the agricultural research evaluation literature in an effort to assess the extent of coverage in this area. Coverage breakdowns with respect to evaluation approaches, types of research, and products and production processes are presented. Results suggest that there has been limited coverage of research undertaken in…

This article presents procedures for improving professional group cooperation in responding to mailed survey questionnaires which differ from those used with general populations. The procedures deal with: (1) improving the cost-benefit ratio of cooperation; (2) being sensitive to confidentiality concerns; and (3) allowing respondents a full range…

This article explores the relationships between kinds of evaluations, analytic methods, and interpersonal processes and the acceptance of recommendations by decision makers. Detailed typologies based on a review of the literature provide the basis for quantitatively testing concepts about the utilization of evaluations against empirical data.…

The purposes of this article are, first, to argue that analyses based on level of treatment implementation can lead to biased estimates of treatment effects, and second, to discuss alternatives to this approach. (PN)