Findings from an evaluation of a model system for delivering mental health services to youth were reassessed to determine the robustness of key findings to the use of methodologies unavailable to the original analysts. These analyses address a key concern about earlier findings--that the quasi-experimental design involved the comparison of two…

Experiments offer more reliable evidence on causation than observational studies, which is not to gainsay the contribution to knowledge from observation. Experiments should be analyzed as experiments, not as observational studies. A simple comparison of rates might be just the right tool, with little value added by "sophisticated" models. This…

Describes the multistage sampling system used in the 1996 national roadside survey of driver blood alcohol and compares it to the sampling methods used in prior surveys in 1973 and 1986. Although many more drivers were sampled in the most recent survey, the procedures are similar enough to allow comparison of results. (SLD)

Advantages of using logistic and hazards regression techniques in assessing the overall impact of a treatment program and the differential impact on client subgroups are examined and compared using data from a juvenile court program for status offenders. Implications are drawn for management and effectiveness of intensive supervision programs.…

The following methods for selecting similar units in performance monitoring are compared: (1) cluster groupings; (2) index groups; and (3) benchmark groups. Advantages and drawbacks of each method are presented, with a discussion that demonstrates the statistical superiority of the benchmark grouping method. (SLD)

Describes a method for coding themes directly from audiotapes without transcription and issues and methods by which reliability can be established. A study of concerns of professionals being trained on 11 school-based support teams coded by 2 raters and based on 19 hours of audiotaped interviews illustrates the method. (SLD)

Effectiveness of a new 72-hour delivery system (USXPRESS) for pharmaceuticals purchased by the Department of Veterans Affairs (VA) from VA depots was evaluated by comparing 33 test sites with 11 matched sites using a pretest posttest quasiexperimental design. The USXPRESS system reduced inventory, decreased space needs, and satisfied service…

Five distribution-free alternatives to parametric analysis of covariance are presented and demonstrated: Quade's distribution-free test, Puri and Sen's solution, McSweeney and Porter's rank transformation, Burnett and Barr's rank difference scores, and Shirley's general linear model solution. The results of simulation studies regarding Type I…

During the winter and spring of 2003, the Survey Research Laboratory conducted a survey of residents of the Ida Wells and Madden Park housing developments on Chicago's near-south side. This article reviews existing research findings on using indigenous interviewers and reports the findings about the benefits and challenges of using residents as…

Uses pretest data collected with passive parental consent for 2,496 middle school students to examine demographic, attitudinal, and behavioral differences between students for whom active parental consent was provided in later phases of the research and those for whom active consent was not provided. Results show the detrimental effects of…

The problem of the appropriate comparison group for bereavement studies is discussed. The use of the retrospective pretest design is illustrated through a longitudinal study of bereavement outcome following pregnancy loss, involving 138 bereaved women and a comparison group of 215 currently pregnant women. (SLD)

This article demonstrates a novel application of propensity score matching techniques: to estimate nonexperimental impacts on program participants within the context of an experimental research design. The author examines the relationship between program participation, defined as qualifying for an earnings supplement by working full-time, and…

Focus group findings were compared with survey findings for three studies in which both methods were used. Studies conducted on voluntary sterilization in Guatemala, Honduras, and Zaire with over 2,000 subjects confirm that focus groups yield information similar to that obtained from surveys and are useful in program planning. (SLD)

Evidence is presented that strengthens the argument against comparison group research strategies. Results from a study of youth attitudes related to the California Conservation Corps involving 528 participants and 668 comparisons indicate that the comparison group may not adequately represent the nontreatment state. (SLD)