Research syntheses are appealing because they enable decision makers to determine quickly whether policies, programs, and practices will have effects on student achievement and, if so, the magnitudes of the likely effects. Such syntheses should present objective, clear, scientifically accurate, and defensible evidence in terms that educators can…

Traditional methods for preparing systematic reviews and syntheses of effectiveness studies rely on a limited set of methodological criteria to include studies that measure and report effects too narrowly to forward the mission of evidence-based practice. This article discusses why and how the criteria for study selection, evidence screening, and…

This response to Slavin's article (2008) explores the issues of transparency, representation, and warranting of claims in Slavin's descriptions of the work of others and his suggestions for program evaluation syntheses. Through contrastive analyses between Slavin's representations of the program evaluation synthesis efforts of five organizations…

This objection to M. Scriven's claim that the basic logic of evaluation is criterial and standards-based notes that valuing is an integral part of perception. Disciplining the synthesis process through critiques of interpretations and values and by using competing conceptual organizers is discussed. (SLD)

Reviews synthesis as an important task of evaluation, putting evidence together for a coherent assessment. Types of synthesis are described from the case of two variables to more complex situations, ending with metanalysis. Syntheses help identify common patterns and regularities and can help progress toward positive social change. (SLD)

Discusses the historical development of "hard" and "soft" systems thinking traditions and examines how these traditions have been understood and applied in the field of instructional development. Proposes the need for a synthesis of the two traditions in planning, implementing, and evaluating instructional programs. (AEF)

Qualitative evaluation and quantitative evaluation are discussed, examining how the perspective of each can and should create a critical debate that encourages inquiry instead of hostility. To achieve the major goal of linking evaluation information to the organization's culture, the evaluator needs to use multiple methods in a responsive,…

This document reports on how key stakeholders in work force preparedness nationwide are responding to pressures of the skills race. Part 1 presents an overview of the skills challenge and the economic and social consequences of failing to meet the challenge. Part 2 examines the impact of the skills shortage on major stakeholders and explains how…