This study explores the possibility that any drug prevention program might be considered "evidence-based" given the use of data analysis procedures that optimize the chance of producing statistically significant results by reanalyzing data from a Drug Abuse Resistance Education (DARE) program evaluation. The analysis produced a number of…

Examined six published papers using a theory-based evaluation (TBE) approach. Found that authors of the papers did not always make explicit the relation of their data to the theory of the program. Identified some ways in which TBE contributed to the merit of the evaluation. Outlines lessons for the future of TBE. (SLD)

This article evaluates three general types of computer-assisted approaches to multicriteria decision problems in which criteria are attributes as opposed to objectives. Several programs specifically designed for multiattribute problems, as well as spreadsheets and decision-free software, are discussed. (Author/BS)

When procedures for developing recommendations are integrated into evaluation methods, it is easier to produce useful recommendations for program improvement. (RB)

Four aspects of the relationship between auditing and evaluation in their approaches to program assessment are examined: (1) their different origins; (2) the definitions and purposes of both, and the questions they seek to answer; (3) contrasting viewpoints and emphases of auditors and evaluators; and (4) commonalities of interest and potential…

The methodology and design of the process evaluation system of the Pawtucket Heart Health Program (an 11-year project for changing/documenting change in cardiovascular disease risk status of a northeastern city's residents) are described. Examples of the system's use are provided. The maintenance of such a system without substantial evaluation…

Evaluation design decisions for a child care provider training program are discussed as a function of three characteristics: decentralization, local autonomy and multiple delivery strategies. While decentralized process data were gathered, only centralized outcome data were collected. The design decisions made were appropriate for such diverse…

A Monte Carlo study compared performance of linear and logistic mixed-model analyses of simulated community trials having specific event rates, intraclass correlations, and degrees of freedom. Results indicate that in studies with adequate denominator degrees of freedom, the researcher may use either method of analysis, with certain cautions. (SLD)

This response to TM 505 708 briefly reviews the five major points of that article, and adds seven points that evaluators should consider when preparing reports. Illustrations are taken from Project Follow Through. (BW)

A mixed-method program evaluation, concurrently using both qualitative interview data and quantitative questionnaire data, was conducted. It illustrated significant design and analysis issues related to integrating quantitative and qualitative methods, specifically between-method and cross-paradigm triangulation. (Author/GDC)

Strategies are presented for analyzing longitudinal research designs with many waves of data using hierarchical linear modeling. The approach defines well-focused parameters that yield meaningful effect size estimates and significance tests. It is illustrated with data from the Boys Town Follow-Up Study. (SLD)

Design, analysis, and reporting considerations for the application of analysis of covariance (ANCOVA) techniques in educational settings are described. Numerous examples are drawn from the national follow through evaluation, and suggestions for improving reports using ANCOVA-type techniques are presented. (Author/BW)

Data analysis approaches for program evaluation under the conditions of natural experiments are explored, using evaluation of the DARE program of drug use prevention among elementary school students as an example. The suggested methodology uses multiple independent analyses to demonstrate the convergence or divergence of program outcomes. (SLD)

This article presents a discussion of field utilization of staff development activities in the context of three separate training programs. Specifically, classroom implementation of knowledge and skills gained by participants in their training sessions was assessed via the Levels of Use (LoU) interview system. (Author/LMO)

Trends in European practice that relate to qualitative assessment in the evaluation of the impact of research and innovation are discussed and analyzed. To date, European evaluations have been mainly concerned with quality and direct impact with few assessments of medium- or long-term impact. (SLD)