Although experimental evaluations have been labeled the "gold standard" of evidence for policy (U.S. Department of Education, 2003), evaluations without an analysis of costs are not sufficient for policymaking (Monk, 1995; Ross et al., 2007). Funding organizations now require cost-effectiveness data in most evaluations of effects. Yet,…

Advocacy is central to the social work profession's commitment to social betterment and justice, yet much of what we know about it is based on conventional wisdom. We have little evidence on the effectiveness of interventions and even less on the costs and benefits of advocacy campaigns. This article discusses some of the conceptual and…

Although a great deal of time, resources and effort goes into the education of potential or existing entrepreneurs, our knowledge of the effects of this education is still rather limited. It can be argued that an imbalance exists between the substantial amount of finance and manpower invested in entrepreneurship education programmes and the very…

Content analysis of critical events methodology is demonstrated in an evaluation of the Educational Telecommunications for Alaska (ETA) Project. This methodology was used to collect and interpret the data derived from the ETA staff personnel representing five components of the project. The data were analyzed using content analysis procedures. The…

In many evaluations, presenting probability distributions of cost-effectiveness results offers a convenient way to show the likelihood of various conclusions given the uncertainties in the inputs. The techniques presented in this paper should be useful for many programs characterized by controversy over perspectives, assumptions, and dollar…

Presents a detailed research approach, designed for higher institutions, to evaluate their program effectiveness, with respect to students' personal and intellectual growth, and the cost involved. Helps the institutions to make more informed decisions regarding their priorities. (GA)

This paper examines the major methodological advantages of random assignment for the purpose of estimating the effectiveness of current manpower policy. It also reviews the claimed methodological and ethical objections to experiments. The authors argue that the offsetting gain from experimentation is the inherent reliability of experimental…

A program can be evaluated, and a cost-benefit ratio can be calculated to five decimal places, without ever directly examining outcomes. A useful vocabulary in economics and an understanding of the concepts involved is provided evaluators by an economist. (Author/RL)

Intended as a guide for laymen, this book concentrates on basic techniques for evaluating the impact of manpower programs--that is, their success or failure in attaining long-term program goals. Program objectives with clear operational criteria, and certain other typical objectives more difficult to measure, are identified with reference to…

National survey data on the cost-effectiveness and cost-benefits of 11 different juvenile offender treatment program types are reviewed. Best-worst-midpoint, threshold, and convergency analyses are applied to these studies. Meaningful ways of dealing with missing information when evaluating alternative juvenile justice policies and programs are…

The study examining the validity of statistical conclusions of 49 early intervention studies found that 4 percent had adequate power to detect medium intervention effects and 18 percent to detect large intervention effects. Low statistical conclusion validity has practical consequences in program evaluation and cost-effectiveness determinations.…

Effectiveness of a new 72-hour delivery system (USXPRESS) for pharmaceuticals purchased by the Department of Veterans Affairs (VA) from VA depots was evaluated by comparing 33 test sites with 11 matched sites using a pretest posttest quasiexperimental design. The USXPRESS system reduced inventory, decreased space needs, and satisfied service…

Because of declining school budgets and the general economic recession, educational evaluators have become increasingly interested in cost-analysis methods. Although there is a large body of literature on economic and cost-analysis procedures, there are no current bibliographies targeted at the use of cost methods in program evaluation. This…

This guide to program evaluation presents questions that illuminate aspects of the evaluation process. Issues to consider in program evaluation are: (1) the intended results of the program; (2) hypotheses about the possible results of the program; (3) the types of data that will indicate achievement of the intended results and the variables that…