Opposes the practice of aggregating impacts on outcome dimensions to arrive at one summary assessment of program merit. Suggests that impacts should be kept separate and unweighted, expressed in their own measurement scales. Illustrates this method through an evaluation of the effects of research grants on a university. (SLD)

Evaluation of teaching at universities is traditionally realized in terms of student ratings. Curriculum evaluation is rarely done in a systematic manner. More often, the emphasis is placed on a particular aspect, which is only of little help in terms of modifying education. A very prominent example is that of medical education. Here, evaluations…

The Collegiate Learning Assessment (CLA) is a computer administered, open-ended (as opposed to multiple-choice) test of analytic reasoning, critical thinking, problem solving, and written communication skills. Because the CLA has been endorsed by several national higher education commissions, it has come under intense scrutiny by faculty members,…

A study was designed to test ordinal and interval properties of rating scales, similar to those commonly employed in evaluation research. The analysis was based on data generated by the use of paired comparisons and direct scales. The conclusion was reached that such rating scales appear to possess metric properties. (Author/LMO)

Considers how performance standards should be set and applied in the face of problems caused by auxiliary outcomes (outcomes other than those of interest) and counterfactual outcomes (the threshold standard not observed). Makes the case that the proper way to implement standards varies with the prior information an evaluator can credibly bring to…

A procedure for the analysis of judgmental estimates is derived. It uses a t-distribution concept to derive the relative experience of an expert and uses the derived experience as weight to obtain a weighted mean. Using this method, error in estimation was reduced by an average of one-half. (Author/BW)

The linked judgments approach is offered as a potential solution to problems of statistical conclusion validity when judges' ratings are employed in pretest-posttest designs. (Author/GK)

Microcomputer simulations in evaluation research are useful for (1) improving student understanding of research principles and analytic techniques; (2) investigating problems arising in research implementations; and (3) exploring the accuracy and utility of novel analytic techniques. This article describes these simulation uses for the context of…

The impact of an undergraduate course on Acquired Immune Deficiency Syndrome (AIDS) was studied. Results of a post-test, completed by 352 students (including 96 controls), suggested that the course had a beneficial impact on knowledge, attitudes, and behavior relevant to the transmission of AIDS. Implications for AIDS education are discussed. (SLD)

This study examined 38 textbooks, published between 1977 and 1981 in the fields of social work and education. Evaluations were frequently cited. Compared to social work texts, education texts cited significantly more program outcome findings; social work texts tended to cite more references dealing with recipient characteristics. (Author/PN)

Challenges of collecting and using photographic evidence and photo-interviewing to evaluate technology infusion programs in higher education are discussed. A five-phase study for using photo-interviewing is presented, using evaluation of a hypermedia workshop attended by 1 instructor, 1 graduate assistant, 26 graduate students, and 1 art…

A methodology is developed for producing a well-designed problem in policy analysis. This evaluative context methodology is defined as an iterative process based on a series of checklist questions. Use of the methodology is demonstrated in a policy development project in New Zealand devoted to encouraging use of the Maori language. (SLD)

Two quasiexperimental designs--nonequivalent dependent variable and reversed treatment designs--illustrate pattern matching logic as a basis for evaluation, examining college health services. Three pattern matches are significant: (1) program pattern match indicates implementation; (2) measurement match assesses test validity; and (3) effect…

Theory behind modern evaluative bibliometric techniques is reviewed at three levels: (1) policy application; (2) strategic analysis; and (3) tactical analysis. New techniques developed at each level and limitations of each approach are discussed. At all levels, the process begins with assembling data and then moves to a data-based evaluation. (SLD)