A problem for program evaluators involves a search for ways to maximize internal validity and inferential power of research designs while being able to assess long-term effects of social programs. A multimethodological research strategy combining a delayed control group true experiment with a multiple time series and switching replications design…

Five causal metaphors running throughout youth employment and education programs are reviewed: (1) the functionalist economic model; (2) the institutional socialization model; (3) a psychosocial view of youth development; (4) the subcultural model; and (5) a self-determined community development vision. (Author/GK)

Conducted an economic evaluation of five outpatient adolescent treatment approaches (12 total site-by-conditions) to identify average economic costs to society. Results suggest that some types of substance-abuse intervention for adolescents can reduce social costs immediately after treatment. (SLD)

A simple way to assess the statistical power of experimental designs, based on the concept of a minimum detectable effect, is described. How to compute minimum detectable effects and how to apply the method of assessment of alternative experimental designs are illustrated. (SLD)

The role of program evaluation is examined in relation to policy analysis. Program evaluation is most persuasive as a component of the policy process when its role is clearly understood. Clarity can be achieved by using the program mandate to guide evaluation and by including practitioners in evaluation model developments. (SLD)

Explores the possibility of randomly assigning groups (or clusters) of individuals to a program or control group to estimate the impact of programs designed to affect whole groups. Applies the cluster-assignment approach to the evaluation of education programs targeting whole schools. Discusses statistical implications of the method. (SLD)

The authors' dual-purpose evaluation assesses the effectiveness of formal collaboratives in stimulating organizational changes to improve chronic illness care (the chronic care model or CCM). Intervention and comparison sites are compared before and after introduction of the CCM. Multiple data sources are used to measure the degree of…

The authors contribute to the development of empirical methods for measuring the impacts of place-based local development strategies by introducing the adjusted interrupted time-series (AITS) approach. It estimates a more precise counterfactual scenario, thus offering a stronger basis for drawing causal inferences about impacts. The authors…

The Collegiate Learning Assessment (CLA) is a computer administered, open-ended (as opposed to multiple-choice) test of analytic reasoning, critical thinking, problem solving, and written communication skills. Because the CLA has been endorsed by several national higher education commissions, it has come under intense scrutiny by faculty members,…

In a study of federal funding for nongame wildlife programs, techniques for quantitatively assessing the relative merits of alternative funding sources are examined. Economic efficiency, ability to pay, and benefits received are considered, and the interaction of analysis with political ideologies is discussed. (SLD)

Reasons for not returning a questionnaire were studied among Lutheran church members sent a postcard to indicate no intention of replying. The analysis is based on 431 returned postcards. For most nonresponders, the interest value of the questionnaire topic was not high enough. Many who returned the negative reply card would be resistant…

A group of defenses of qualitative evaluation methods is examined, based on a hard relativistic interpretation of the work of Thomas Kuhn. A promising defense of qualitative evaluation may be found in a soft-relativist interpretation of Kuhn's analysis of the nature of scientific discovery. (Author/LMO)

Four aspects of the relationship between auditing and evaluation in their approaches to program assessment are examined: (1) their different origins; (2) the definitions and purposes of both, and the questions they seek to answer; (3) contrasting viewpoints and emphases of auditors and evaluators; and (4) commonalities of interest and potential…

The normative implications of applying significance tests in evaluation research are examined. The authors conclude that evaluators often make normative decisions, based on the traditional .05 significance level in studies with small samples. Additional reporting of the magnitude of impact, the significance level, and the power of the test is…

The authors demonstrate how exponential smoothing can play a role in the identification of the intervention component of an interrupted time-series design model that is analogous to the role that the sample autocorrelation and partial autocorrelation functions serve in the identification of the noise portion of such a model. (Author/BW)