Studied the feasibility of including children's perceptions of their experiences in early childhood programs and, therefore, their perceptions of its quality. Found that children's responses did provide valuable information about program quality and that educators willing to invest the time to view their program through the eyes of the children…

Large sample chi-square tests of the significance of the difference between two correlated kappas, weighted or unweighted, are derived. Cases are presented with one judge in common between the two kappas and no judge in common. An illustrative calculation is included. (Author/SLD)

The internal consistency of a scale and various indices of rating scale response styles (such as halo, leniency, and positive or negative response bias) are related to mean scale item intercorrelation. The consequent relationship between internal consistency and rating scale response styles is discussed. (Author/SLD)

This study investigated the relationship between the temporal-acoustic parameters of the speech of 15 adults with motor neuron disease. Differences in predictions of the progression of the disease and clinician judgments of dysarthria severity were found to relate to the linguistic systems of both speaker and judge. (Author/JDD)

A stakeholder-focused approach to the assessment of racial/ethnic bias and gender bias in the Michigan State Court system is presented. The approach ensures that findings are used to improve the court's response to attorneys and litigants. The process should help evaluators work with client groups involved in politically charged issues. (TJH)

Age and rank of assessor were the only characteristics significantly affecting scores given in three police and six fire service assessment centers, but the magnitude of the effect was quite small. Results were attributed to assessor selection processes, the way centers were conducted, and type of assessor training. (SK)

Tacit knowledge and judgment associated with vocational education requires high levels of expertise on the part of assessors. A new model of competency-based education emphasizes the exchange of tacit knowledge and exercise of tacit judgment on learning, shedding new light on old debates about competency-based education and training. (SK)

Content analysis of nursing dissertations and survey responses from 43 of 171 nursing programs uncovered tremendous variability in tenure processes, including who makes tenure recommendations and decisions. Significant differences appeared in the number and proportion of tenured faculty between programs with nursing-only tenure committees and…

Explores how evaluation leads to transformative learning in organizations and addresses the increased use of evaluation processes and findings and evaluators' roles and practices. Also describes the theories underlying constructivist and transformative learning. (SLD)

A general approach to the analysis of nominal-scale ratings is discussed that is based on a simple measurement error model for a rater's judgments. The basic measurement error model gives rise to an agreement model for the agreement matrix of two or more raters. (SLD)

Explores the nature of 360 degree feedback, investigates factors that have influenced its emergence, and contrasts it with more traditional performance management processes. Identifies benefits and problems, considers issues surrounding sources of feedback, and discusses issues related to the use of multirater feedback. (Contains 99 references and…

Reviews the conclusions drawn in articles in this special issue and comments on some of the major themes, including paradigm debates, context issues, the role of evaluators and evaluation, the performance measurement movement, and the impact of new technologies on evaluation. (SLD)

Discusses what it means to be a caring stakeholder and a participatory evaluator in the context of public and private domains using the example of a parent who is an evaluator of an afterschool program. Offers a perspective on the capacity of individual evaluators to deal with role strain. (SLD)

Data limitations severe enough to undermine the validity of findings discomfort evaluators whenever they occur. Unfortunately, such occurrences are not infrequent, faced not only by a "freshly minted graduate of a respected doctoral program in evaluation" but also by seasoned professionals (Bamberger, Rugh, & Mabry, forthcoming). Data may be…

Describes the training in program evaluation received at Northwestern University and the ways in which that training and the program experience have influenced the career of an evaluator working for the federal government. (SLD)