Summarizes a report from Northwestern University that reviewed Federal evaluation practices of federally supported educational programs at the national, state, and local levels. Considers: (1) evaluation purposes and methods; (2) evaluators' capabilities; (3) use of evaluation results; and (4) ways that evaluation procedures/practices can be…

This paper shows how several of Cook and Gruder's meta-evaluation models have been applied in the national evaluation of Project Follow Through. Participants in the evaluation are identified, their roles are described, and the degree to which these roles map onto the meta-evaluation models is assessed. (Author/BW)

A symbolic interactionist approach to evaluation views the evaluator as an observer of group behavior in which individual action aligns with collective action. The evaluator attempts to discover what is actually going on in the program being evaluated. Though the interactionist approach frees the program manager from having to articulate goals, it…

Discusses problems with reviews and criticisms of popular social science books: the quality and background of reviewers, the difficulty of distinguishing between fact and opinion, and the scarcity of competent reviewers. Analyzes reviews of Robert Ardrey's "African Genesis" and "The Territorial Imperative," Konrad Lorenz's "On Aggression," and…

An information feedback model and an ideology of evaluation are posed and contrasted with experiences in evaluation research. Impact on policy is the criterion for success of an evaluation and political constraints block this impact. Some ways social researchers might conceptualize and construct an appropriate base of power are considered.…

The reasons for Doherty's successful, concurrent activities in national and regional research and evaluation projects and publications and his career as an evaluator for a public school system are discussed. (MH)

Results of a survey completed by 60 representatives of institutions and a questionnaire answered by 55 employers suggest that there will continue to be a shortfall in the number of measurement professionals graduating from educational programs in measurement relative to the number of available employment opportunities, and that this is especially…

The evaluator's role in planning/implementing an evaluation of a new program to train school administrators in performance appraisal skills is described. This case study of the evaluators' broadening roles uses E. Chelimsky's continuum (1987) to analyze political processes and decision making involved in the evaluation of a state-funded program.…

Examines the major transactions regarding violence during the course of transcribed psychiatric evaluations for 92 recently violent patients. Coded and cross-tabulated the mentioning and action taken for patients describing violence. Findings support a progressive decrease in the discussion of violence and apparent breaches in the flow of…

Some of the major issues related to planning evaluations of federal human services national demonstration programs are discussed. Barriers to conducting evaluations are discussed for the policy level and cross-site and within-site evaluation contexts. Among the proposed solutions is the use of an explicit programmatic developmental sequence. (SLD)

The Senate confirmation hearings concerning Robert Gates as director of the Central Intelligence Agency (CIA) highlight the problems evaluators share with the CIA of keeping policy imperatives out of the search for truth. The CIA at least has a structure for keeping information pure, but many evaluations do not. (SLD)

Survey items representing 30 standards of the Joint Committee on Standards for Educational Evaluation were used to examine violations in program evaluations. Twenty-nine novice graduate students, 57 graduate students with moderate knowledge about evaluation, and 61 expert evaluators viewed propriety and accuracy standards as suffering the most…

Effects of numbers of experts (NOEs) and common items (CIs) on the scaling of cutting scores from expert judgments were studied for 11,917 physicians taking 2 forms of a medical specialty examination. Increasing NOEs and CIs reduced error; beyond 5 experts and 25 CIs, error differences were small. (SLD)

Unintended effects of evaluation are discussed, with reference to the Hawthorne Effect, where unintended effects overshadow the manipulations controlled by researchers. Unintended effects are categorized as (1) affective reactions; (2) political dimensions; (3) importance of individual differences; and (4) expectations concerning evaluation.…

Ways to use standard-setting data to adjust cutoff scores on examinations are reviewed. Ten sources of information to be used in determining standards are listed. The decision to modify passing scores should be based on these types of information and consideration of adverse impact or rating process irregularities. (SLD)