A randomized experiment that measures the impact of a social policy in a sample of the population reveals whether the policy will work on average with universal application. An experiment that includes only the subset of the population that volunteers for the intervention generates narrower "proof-of-concept" evidence of whether the…

While policy analysis is currently the most popular research strategy for educational administration, it is more effective when used in conjunction with program evaluation. The relationship between these methods is illustrated by examining alternative research designs for a hypothetical school drug abuse program. (BS)

This paper focuses on transition programs for youth to postsecondary education, broadly considered. It addresses the following questions: (1) What models or programs of transition exist? (2) On what basis can we say one transition program is more effective than another? In other words, how is successful transition defined? (3) How are…

This article provides a case study of the use of emergent design, which asks evaluators to adapt their inquiry processes as understanding develops, in the evaluation of a family support program, tracing the emergence of evaluation procedures through three phases. Two phases produced data that policymakers found very helpful. (SLD)

Provides a detailed introduction to the variety of purposes for which evaluation research may be used and to the range of methods currently employed in the practice of that field. Uses specific examples, where appropriate, to provide concrete illustrations of both the goals of evaluation researchers and the methods used. (Author)

A survey of existing research designs and accompanying techniques if presented along with brief assessments of their usefulness for programs of different types. The authors stress particularly the use of field experiments for the assessment of prospective social policies and programs. (Author/MV)

This report for researchers in rural sociology develops a conceptual and analytic framework for evaluating policies or programs through interrelated models. Three models--structural analysis, control programming, and simulation--allow researchers to assess policy/program impact, determine why expected impacts did or did not occur, and modify…

Develops a conceptual and analytic framework for rural sociologists to document program results and consequences and to aid policy and program decisions. Addresses program/policy evaluation from perspectives of structural analysis, control programming, and simulation. Emphasizes dynamic, nonrecursive nature of evaluation processes. (LFL)

The National Study of Effective Title I Schoolwide Programs was initiated to address the lack of information on how schoolwide programs affect teaching and learning and student outcomes and to develop a critical empirical base for strengthening the implementation of Title I programs in service of students in high poverty schools. This paper…

Utilizing the regression-discontinuity research design, this article explores the effectiveness of a developmental English program in a large, multicampus community college. Routinely collected data were extracted from existing records of a cohort of first-time college students followed for approximately 6 years (N = 1,473). Results are consistent…

Obtaining accurate, comprehensive data for vocational education has been one of the more elusive objectives of federal policy. Given the long history of unsuccessful attempts to improve the quality and scope of data on vocational education, it is important to understand the lessons of the past before embarking on a new data collection effort…

The politics of program evaluation are discussed from the personal perspective of the Director of the General Accounting Office's Program Evaluation and Methodology Division, which has produced reports for committees of the United States Congress. It is concluded that successful evaluations must be useful to others and must understand the…

This report describes the design of an implementation evaluation of the Massachusetts Basic Skills Improvement Policy, to be conducted during 1982-83. The Policy and Regulations were enacted in 1978-79 when school districts were required to develop basic skills improvement plans. In 1980-81 districts were required to implement their plans.…

The relationship between research and educational policy in the areas of school system decentralization and community control is analyzed in this dissertation. The literature on decentraliztion and community control is reviewed. It is contended that existing empirical research on these subjects has not systematically tested the assumptions…

This study of evaluation utilization identified organizational, political, and practical arrangements facilitating the wide use of "The Interim Report Evaluation" in policymaking for California's Early Childhood Education Program. In a program fraught by tensions, where evaluations had been political tools, this evaluation was special.…