Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

Used findings from the evaluations of California's Greater Avenues for Independence program and the National Evaluation of Welfare-to-Work Strategies to illustrate why it is important to question the legitimacy of such syntheses. Results show how tempting generalizations are not justified. (SLD)

Findings of a review of 64 meta-analytic articles show that experimental data and quasi-experimental or nonexperimental data are sometimes combined incorrectly. Discusses how guidance from proponents of meta-analysis fails to make clear the importance of not synthesizing different kinds of data. (SLD)

The article suggests supplementing the social problem study groups and data synthesis approaches to building knowledge with emphasis on synthesizing reviews. Such reviews would strengthen the evaluation profession and promote utilization of the knowledge base generated by evaluators. (DWH)

Problems and illustrations are presented from a meta-analysis of crime reduction programs. Eight criteria are specified for including studies in a meta-analysis, and some problematic studies are discussed using the criteria. Rules for handling problem studies in order to retain consistency throughout the analysis are discussed. (SLD)

Methods for recording information derived from focus groups are described as follows: (1) transcribe the entire discussion from a tape; (2) expand reporter's notes by using a tape; and (3) work from reporter's notes only. Three approaches are also suggested for synthesizing the discussion into an accurate text. (SLD)

Synthesizes the long-term findings of three major evaluations of programs that began in the late 1980s and were designed to improve the self-efficacy of teenage mothers on welfare. Economic outcomes for the mothers improved over time, and the interventions had some positive effects, although they did not affect fertility. (SLD)