Evaluation designs for social programs are developed assuming minimal or no disruption from external shocks, such as natural disasters. This is because extremely rare shocks may not make it worthwhile to account for them in the design. Among extreme shocks is the 2010 Chile earthquake. Un Buen Comienzo (UBC), an ongoing early childhood program in…

Recent meta-analyses of drug-court studies recognized the poor methodological quality of the evaluations, with only a few being randomized. This article critiques the design of the randomized studies from a statistical perspective. Learning points are identified for future drug-court studies and are applicable to evaluations both of other…

The determinants of sentencing are of much interest in criminal justice and legal research. Understanding the determinants of sentencing decisions is important for ensuring transparent, consistent, and justifiable sentencing practice that adheres to the goals of sentencing, such as the punishment, rehabilitation, deterrence, and incapacitation of…

The state of California passed the Smoke-Free Workplace Act on January 1, 1995. This legislation effectively banned indoor smoking in all public and private workplaces including restaurants. Many restaurant owners, especially owners of restaurants that served alcohol, opposed the ban for fear that their businesses would be affected adversely…

Comments on the delayed treatment design are offered as an amendment to the Heath et al. discussion by pointing out two important assumptions of their recommended design, and tracing through implications of those assumptions for the interpretation of treatment effects. (Author/PN)

Studied the analytic problems associated with a design in which one identifiable group is allocated to each treatment condition and members of these groups are measured to assess the intervention. Results from a simulation study underscore the analytic problems associated with these quasi-experimental or group-randomized designs. (SLD)

Active parental consent policies have been blamed for low participation rates and selection bias (i.e., loss of "high-risk" youths) in school-based studies. In this article, the authors describe active consent procedures that produced an overall active consent rate of 79% in a sample of more than 4,500 middle school students attending 29…

Changes made in 1981 to the Aid to Families with Dependent Children (AFDC) program under the Omnibus Budget Reconciliation Act were evaluated. Multiple quasi-experimental designs (interrupted time series, non-equivalent comparison groups, and simple pre-post designs) used to address evaluation questions illustrate the issues faced by evaluators in…

A simple way to assess the statistical power of experimental designs, based on the concept of a minimum detectable effect, is described. How to compute minimum detectable effects and how to apply the method of assessment of alternative experimental designs are illustrated. (SLD)

A recent Delphi study on recreational boating safety priorities of 94 safety experts is used to illustrate the utility of applying the modified scree test to Delphi data. The scree test does not oversimplify decisions and can be applied to fairly complicated data. (SLD)

Four aspects of the relationship between auditing and evaluation in their approaches to program assessment are examined: (1) their different origins; (2) the definitions and purposes of both, and the questions they seek to answer; (3) contrasting viewpoints and emphases of auditors and evaluators; and (4) commonalities of interest and potential…

Derives benefit-cost rations for 14 disability cohorts served by the Vocational Rehabilitation Program. Estimates earnings impacts in a quasiexperimental framework using an internal comparison group. Earnings data are from a panel constructed by linking data from the Rehabilitative Services Administration with data from the Social Security…

The use of analysis of variance was examined under the assumption that the treatment had been randomly assigned to students, when in fact, the class had been the unit. Data support the idea that if one can randomly assign treatments to intact classes, consideration should certainly be given to doing so. (Author/GK)

The use of multiple regression for analyzing data from the regression-discontinuity design (RDD) is examined, considering the effects of random measurement error in the pretest, treatment-effect interactions, and curvilinearity in the regression analysis of RDD. Three sets of conditions of increasing generality are reviewed. (SLD)

Evaluation research on vocational counseling in substance dependency treatment should distinguish between the effects of counselors and counseling methods on clients' employment outcomes. Three experimental designs permit investigation of possible confounds between these types of effects: (a) nested designs (each counselor delivers one counseling…