Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific…

Evaluating school-based mental health services for children and youth with emotional disturbance (ED) has been a challenge for researchers. One particular challenge is the study design of using the student as the statistical unit of analysis, which in certain cases may lead to a violation of the "independence of error" assumption.…

The importance of addressing the political dynamics inherent in any evaluation research process is discussed. The theoretical orientation contributing to the denial and avoidance of politics is articulated and contrasted with one which posits politics as normative and useful. (Author/LMO)

This paper focuses on the discrepancy the authors personally experienced between the stated principles of social research and experience with several applied social research projects over the last 10 years. Three cases of applied social research are presented and critiqued, and two types of structural problems were found. (Author/LMO)

This special issue presents results of a multisite, multiyear national demonstration project designed to test the effectiveness of integrating street outreach programs aimed at preventing HIV infection with referral to substance abuse treatment for populations that historically have been difficult to reach (Author/SLD)

This special issue focuses on several methodological issues in the evaluation of the largest mental health and substance abuse project for children and adolescents conducted at a single site, the U.S. Army's Fort Bragg Child and Adolescent Mental Health Demonstration program. The introduction and seven articles describe this program and the…

A strategy proposed by T. Cook and D. Campbell (1979) was used to investigate attrition in a community-based literacy program, focusing on 287 Head Start families. Data revealed interactions among intervention program-centered characteristics and person-centered characteristics that have implications for study validity and generalizability.…

An information feedback model and an ideology of evaluation are posed and contrasted with experiences in evaluation research. Impact on policy is the criterion for success of an evaluation and political constraints block this impact. Some ways social researchers might conceptualize and construct an appropriate base of power are considered.…

Strasser and Deniston's own analysis (TM 504 254) shows that post-planned evaluations are unsuitable substitutes for pre-planned evaluations. When viewed as post-experimental interviews, however, post-planned evaluations can produce valuable information which complements traditional experimental and quasi-experimental evaluations. (MH)

Methods of using simplified time series analysis (STSA) in evaluating clinical programs are discussed. STSA assists in addressing problems of attrition/augmentation of subjects in programs with changing populations. Combining individually calculated "C" statistics in a simple aggregate analysis of restraint usage by nursing home staff…

Why conclusions of many outcome evaluations do not stand up to scrutiny is discussed, drawing on examples from evaluations of drug abuse prevention programs. Factors that undermine these studies are largely the result of social-structural problems that influence the design and implementation of the research. (SLD)

Seven qualitative issues associated with randomization that have the potential to weaken or destroy otherwise sound experimental designs are reviewed and illustrated via actual field experiments. Issue areas include ethics and legality, liability risks, manipulation of randomized outcomes, hidden bias, design intrusiveness, case flow, and…

Criticizes Strasser and Deniston's post-planned evaluation (TM 504 253) because of their: (1) emphasis on evaluation research; (2) imposition of experimental rigor; (3) inapplicability to human service projects; (4) inattention to congruity between the program and its environment; (5) distinct characteristics of program evaluation; and (6)…

The six articles of this special section focus on HIV/AIDS outreach efforts with: (1) African-American drug users; (2) homeless substance abusers; (3) women at high risk; (4) Latinos at high risk; and (5) African Americans at high risk. All the programs were part of a federally funded outreach effort aimed at HIV/AIDS prevention. (SLD)

Potential methods are explored for removing or otherwise controlling random measurement error, assessment artifacts, irrelevant variation in outcome measures, and confounding sources of covariation in a structural equations model. Using examples with measures of quality of life and functioning, the authors consider these methods for field…