When and how to survey potential respondents is often determined by budgetary and external constraints, but choice of survey modality may have enormous implications for data quality. Different survey modalities may be differentially susceptible to measurement error attributable to interviewer assignment, known as interviewer effects. In this…

The study dealt with a research environment in which the treatment effect is heterogeneous, and in which individuals use their assessments of the treatment effect to decide whether or not to enroll in an intervention program. In this article, a new methodology is proposed for examining the validity of the specified research environment in a given…

Background: Surveys of community-based programs are difficult to conduct when there is virtually no information about the number or locations of the programs of interest. This article describes the methodology used by the Helping Young Smokers Quit (HYSQ) initiative to identify and profile community-based youth smoking cessation programs in the…

Findings from an evaluation of a model system for delivering mental health services to youth were reassessed to determine the robustness of key findings to the use of methodologies unavailable to the original analysts. These analyses address a key concern about earlier findings--that the quasi-experimental design involved the comparison of two…

This article describes rates of missing item responses in personal digital assistant (PDA) assessments as compared to paper assessments. Data come from the evaluation of a classroom-based leisure, life skills, and sexuality education program delivered to high school students in Cape Town, South Africa. Analyses show that the paper assessments had…

It is common practice to associate recommendations for program improvement with evaluation reports. In this article, several classes of recommendations are identified, and aspects of one class are explored in some detail. Consideration is given to certain logical, methodological, and practical issues relating to the derivation of recommendations…

Presents conversion factors to be used to translate the quality of the respective contraception methods distributed to a single measure of protection for calculating couple-years of protection in family planning studies. Discusses the implications for the evaluation of family planning programs. (SLD)

The choice between experimental research or process-oriented oriented research as the only valid paradigm of evaluation research is rejected. It is argued that there is a middle ground. Suggestions are made for mixing the two approaches to suit particular research settings. (Author/GK)

Explores sequential assignment (SA) and treatment-as-usual (TAU) as two approaches to overcome many of the obstacles of random assignment in field studies of treatment efficacy. Substituting SA and TAU for the standard random assignment may introduce methodological impurities including certain limited biases. (SLD)

This article presents a method for disentangling the effects of an intervention from changes that are due to growth and regression to the mean. The method is illustrated in the context of evaluating the effect of the Special Supplemental Food Program for Women, Infants, and Children (WIC) on infant growth. (Author/LC)

Advantages of using logistic and hazards regression techniques in assessing the overall impact of a treatment program and the differential impact on client subgroups are examined and compared using data from a juvenile court program for status offenders. Implications are drawn for management and effectiveness of intensive supervision programs.…

Describes a method that uses program participants' compliance with program instructions as a means of classifying participants and in that way obtains a randomized control group for a subset of participants. Illustrates two variations of the method through a large smoking-intervention project. (SLD)

Using data from a sales campaign for the Arizona State lottery, a multiplist strategy of program evaluation is analyzed. Several complementary designs are used within the strategy to help remove threats to internal validity associated with the nonequivalent control group design. (SLD)

Trade-offs are implicit in choosing a subjective or objective method for evaluating social programs. The differences between Bayesian and traditional statistics, decision and cost-benefit analysis, and anthropological and traditional case systems illustrate trade-offs in choosing methods because of limited resources. (SLD)

Based on a complex time series evaluation, a 2-year intervention in 40 supermarkets in Washington (DC) and Baltimore (Maryland) indicates that a nutrition education program could produce small but positive changes in consumers' food purchasing behavior. Limitations of the study and its implications for future evaluations are discussed. (SLD)