The Judicial Evaluation Method (JEM) is useful for aiding decision-making bodies to formulate policies. Broad public participation in complex issues is provided by JEM. (The conceptualization, policy formulation stages, and participant roles are identified; and the model is applied in two case studies). (MH)

Whether 12 university students could discriminate validly between the correctness and originality of responses of 150 elementary school children to 3 creativity tests was studied as a determination of the discriminant validity of the tests through the multitrait-multimethod procedure. There was compelling evidence for convergent and discriminant…

The modified caution index's use in identifying judges whose patterns of item judgment appear aberrant when compared with the pattern produced by the entire group (N=158) of judges was studied. Effects on test standards and passing rates of removing test standards of these judges were also assessed. (TJH)

Reports on a study of 614 experienced music teachers, non-music teachers, college-level music students, and non-music students on the effect of sequential patterns and different modes of presentation of music teaching. Finds that experienced teachers' evaluations were significantly higher than those of university students. (CFR)

An optimistic view of the potential of evaluation to be a force for social improvement is presented. The most important unfinished task for evaluation may be to expand the logic of value judgments. In addition, the social usefulness of evaluation will depend on its credibility and the professionalism of evaluators. (SLD)

The author's optimistic view of evaluation in the future includes increased utilization, especially in the private sector; more professionalization, with potential for conflict; more academic program development; more use in policy; increase in the use of complex methods; and more involvement in program development. (SLD)

Conjectures about the future use of controlled randomized experiments for planning and evaluating social programs suggest that they will frequently involve institutions and organizations rather than individuals and that their applications and the publicity surrounding them will increase as they are used in new and controversial ways. (SLD)

In spite of many inherent problems, impact evaluation should remain an integral part of program evaluation, both because impact evaluation brings its budget justification with it, and because its focus on causal hypotheses is an essential part of evaluation. Methodology based on the author's body of work is reviewed. (SLD)

Development of a multistage dominant profile method for setting standards on complex performance assessments is detailed. The method grew from experiences with a judgmental policy-capturing procedure and an extended Angoff method. The design of an early adolescence English language arts assessment illustrates the complexity of decisions panelists…

Describes a study conducted at a large west coast state university, comparing holistic scores on developmental writing program final essays when the same essays were handwritten and computer typed. Reveals a bias against typed final essays, especially in essays which received high scores in the handwritten form. (DMM)

Possible sources of intrajudge inconsistency in standard setting are reviewed, and approaches are presented to improve the accuracy of rating. Procedures for providing judges with feedback through discussion or computerized communication are discussed. Monitoring and maintaining judges' consistency throughout the rating process are essential. (SLD)

Two frame-of-reference rater training approaches were compared for effects on reliability and accuracy of cutoff scores generated by 21 raters using Angoff methods on tests taken by 155 undergraduates. Both approaches result in higher interrater reliability and more accuracy than does a non-frame-of-reference method. (SLD)

Five papers and an introduction discuss internal evaluation (IE), concentrating on the various sources of authority for IE and ways of enhancing IE authority. The roles of internal evaluators, conflicts in the evaluation process, and evaluation in a state education agency are reviewed. (SLD)

Perceptions of the current and ideal functioning roles of the principal were compared using responses of 147 Alabama teachers. Differences between current and ideal roles were found for categories of counselor, evaluator, motivator, and supervisor. These results emphasize the varying perceptions teachers have of principals. (SLD)

Describes a 3-year project designed to serve the needs of artistically talented students, focusing on the project's assessment as a "cautionary tale" for people involved in large-scale, authentic assessments. Describes project evaluations for years two and three and provides recommendations concerning outside evaluators and large-scale educational…