The impact of various definitions of the term "policy" on the nature and outcomes of policy analysis is illustrated by noting a variety of definitions which are implied in the literature. These definitions are applied to exemplar policy arenas to note their differential effect. The policy arenas discussed include the community…

Introspective interviewing can often determine the magnitude of relations more meaningfully than statistical analysis. Deduction from empirically validated premises avoids many research design problems. Guesswork can be combined with sensitivity analysis to determine the effects of guesses and missing information on conclusions. (Author/DWH)

Although important progress has been made in educational evaluation during the past decade new problems believed to be more serious threaten the progress that has been made. These problems are said to be a mixture of logistics and politics and are in large part an outgrowth of the increasing pluralism of American society. (Author/AM)

This paper focuses on transition programs for youth to postsecondary education, broadly considered. It addresses the following questions: (1) What models or programs of transition exist? (2) On what basis can we say one transition program is more effective than another? In other words, how is successful transition defined? (3) How are…

In this context, ethics refers to a set of normative standards for resolving dilemmas that policy analysts or evaluators often face with regard to what they should do in performing their roles in the interests of societal desirability. The dilemmas relate to: (1) prediction versus prediction plus prescription; (2) evaluation versus evaluation plus…

This report discusses considerations involved in placing the evaluation process for criminal justice agencies within an organizational and practical context. The discussion proceeds from the following perspectives: (1) program evaluation is a policy/management tool; (2) various levels of policy and management personnel have numerous and varied…

Policy analysis, or policy study, is defined as the study of the nature, causes, and effects of alternative public policies; sometimes policy analysis refers to specific methods used. Two new developments associated with policy analysis are discussed. One is the concern for deducing the effects of alternative policies before they are adopted, as…

One problem faced by researchers is the selection of the most appropriate research method or methods, given the context of the research setting. This dilemma does not concern the choice of the best research method given the program objectives or research questions, nor the selection of the best state-of-the-art methods. The issue concerns the…

Evaluation issues pertaining to the Intelligent Vehicle Highway System are discussed. Transportation is an area that clearly illustrates how technology is outrunning social science. Those responsible for the evaluation of programs and options must assume responsibility for spelling out the destructive consequences of focusing only on technology.…

Obtaining accurate, comprehensive data for vocational education has been one of the more elusive objectives of federal policy. Given the long history of unsuccessful attempts to improve the quality and scope of data on vocational education, it is important to understand the lessons of the past before embarking on a new data collection effort…

Title I Evaluation models using uniform procedures and data collection for state and national comparisons are interpreted as federal endorsement of basic, common competencies in reading and mathematics. Basic competencies, content homogeneity, conversion methodology, and validity of the evaluation are discussed. (MH)

Deliberations about social policy often center on estimates of harm or benefit generated by different interest groups. Problems in what is measured and how it is measured are illustrated by a discussion of research into sexual abuse and rape. Advocacy research is an unreliable foundation for social policy formation. (SLD)

Theory behind modern evaluative bibliometric techniques is reviewed at three levels: (1) policy application; (2) strategic analysis; and (3) tactical analysis. New techniques developed at each level and limitations of each approach are discussed. At all levels, the process begins with assembling data and then moves to a data-based evaluation. (SLD)

This study of the federal government's evaluation of social programs indicates that it is virtually impossible to establish a bias-free, valid, and reliable system of inquiry to determine the effects of social programs. Divided into five chapters, the document examines the aspirations and limitations of evaluations, methodology, evaluation in the…

The Wisconsin "Learnfare" policy requires that teenagers receiving Aid to Families with Dependent Children (AFDC) attend school regularly until they have completed high school. The population of teen parents and dependent teens receiving AFDC from September 1988 through December 1989 included 22,241 males and 30,995 females. About half…