Drug studies are often cited as the best exemplars of evaluation design. However, many of these studies are seriously biased in favor of positive findings for the drugs evaluated, even to the point where dangerous effects are hidden. In spite of using randomized designs and double blinding, drug companies have found ways of producing the results…

Presents a framework for judging evaluations on the basis of their potential for democratic deliberation that includes the interrelated requirements of inclusion, dialogue, and deliberation. Operationalizes these requirements in 10 questions to guide evaluation and meta-evaluation from a democratic viewpoint. (SLD)

Our scientific conceptions of evaluation are strongly influenced by underlying, deep-seated metaphors. This analysis draws upon recent philosophic work concerning the role of metaphors in all thought processes. (Author/PN)

Chelimsky, former head of the Program Evaluation and Methodology Division of the General Accounting Office, suggested that advocacy by evaluators destroys their credibility. Evaluators should, this author argues, be advocates for democracy and the public interest, with the question being how explicitly and how defensibly. (SLD)

Outlines problems with the U. S. Office of Education sponsored report on Project Follow Through. The problems are in the areas of classification of models, measurement techniques, methods of analysis, and fairness. (Author/IRT)

The thesis of this paper is that the humanistic mode of inquiry is underemployed in evaluation studies and the future evaluation of Follow Through could profitably use humanistic approaches. The original Follow Through evaluation was based on the assumption that the world consists of a single system explainable by appropriate methods; the…

The large government market in evaluation that has developed in recent years does not follow the idealized image of open markets because of the contracting process, which means that a few firms conduct most evaluations. To produce honest, unbiased evaluations, evaluation ethics must take government market factors into consideration. (SLD)

The evaluators of Push/Excel assumed that it was a systematically developed program with measurable outcomes, not a charismatically inspired movement whose effects would be hard to pin down. As a result, neither the program nor the evaluation approach used were adequately tested. (Author)

Different approaches to evaluation are described: systems analysis, behavioral objectives, professional review, and case study. For an evaluation system to operate, it must be perceived as being fair; the legitimacy of evaluation is dependent on the issue of fairness. (MLW)

Evaluation techniques and practices do not belong to a particular theory of justice. Systems analysis evaluation consists of defining quantitative outcome measures of program success and the establishment of causal links between this measure and the program by experimental design. (JN)

This paper suggests methodologies and guidelines appropriate for evaluating projects in the Jacob K. Javits Gifted and Talented Program. The paper aims to help projects carry out their evaluations, assist the Javits staff in determining the success of the evaluations, and aid in long-range program planning. (JDD)

A state system of about 20 demonstration centers was developed in Illinois to exhibit a variety of model programs for gifted children, ranging from kindergarten to high school. Subjects ranged from foreign language to dance and dramatics. Evaluation indicated low quality in too many centers. The centers performed best on the awareness function,…

In 1965, Robert Kennedy initiated federal evaluation policy with ESEA. His conception of political accountability was converted into a system of cost benefit analysis, which periodically justified funding curtailments. This systems approach, similar to Taylor's Scientific Management, is inadequate as the sole evaluation tool for federal programs.…

Discusses the following aspects of educational evaluation: (1) structural changes; (2) conceptual changes; (3) mixed methods and unraveling consensus; (4) utilization of findings; (5) the role of values; and (6) the role of politics. Discusses how evaluation moved from monolithic to pluralistic, reflecting the change from consensus to pluralism in…

Discusses the use of transaction-cost economics in measuring the impact of educational reforms and whether these reforms are likely to succeed in the "real life" of schools. Several current educational reforms are judged on the basis of their transaction costs and consequent prospects for success. (GR)