Scores from four samples each of 250 and 1,000 physicians demonstrated that a linear procedure for equating scores and rescaling judges' standards for a certification test could be applied to individual item data gathered through the Angoff standard-setting method. Equated and rescaled values were close to those actually assigned. (SLD)

A teacher appraisal instrument was developed and validated for a system of teacher evaluation in Rivers State (Nigeria). The developed Likert scale for teacher scoring was tested for 410 teachers evaluated by 16 headteacher evaluators. Initial findings suggest areas in which the appraisal process and instrument can be improved. (SLD)

The political context of evaluation is compared for the United States and developing countries, and a framework is proposed for discussing the political context of evaluation. Significant differences are the role that international donor agencies play in developing countries and the emphasis on stakeholder evaluation in the United States. (SLD)

A procedure for evaluating a variety of rater reliability models is presented. A multivariate linear model is used to describe and assess a set of ratings. Parameters are represented in terms of a factor analytic model, and maximum likelihood methods test the model parameters. Illustrative examples are presented. (SLD)

Patterns in the content of three commercial magazines ("Sassy,""Seventeen," and "Young Miss") oriented toward adolescent female consumers were analyzed by three trained raters. Findings are discussed in terms of print media utilization by adolescents; themes of self-improvement, identity development, and achievement;…

Seventy physicians and two nurse practitioners rated colposcopic photographs. Results showed that leaders in the field of child sexual abuse assessment made significantly more accurate assessments than pediatricians, pediatric and family practice residents, and intern physicians. Predictors of agreement with standard assessments, although weak,…

Critiques the ways in which evaluators and professional organizations have come to terms with research on, issues about, and interests that impact people of color. Focuses on ways to create institutional change, including fostering the participation of researchers of color. (SLD)

The benefits that accrued to 14 agriculturalists as they performed evaluators' roles on a team examining water quality demonstration projects were studied. Results suggest that collaboration between the agriculturalists and evaluators strengthened study recommendations and were personally and professionally rewarding to the participating…

In recognition of the reduction in the number of educational evaluators functioning in the nation's schools, it is argued that educational evaluation must be promoted because of its direct and personal benefit to the individuals who authorize such evaluations. An argument is presented to use with authorizers of evaluation studies. (Author/SLD)

This paper explores library evaluation in Australia and proposes a return to research fundamentals in which evaluators are asked to consider the centrality of philosophical issues and the role of different research methods. A critique of current evaluation examples demonstrates a system-centred, quantitative, input/output focus which fails to…

This study investigated the similarity of information provided from a daily behavior report card (DBRC) as rated by the teacher to direct observation data obtained from external observers. In addition, the similarity of ratings was compared with variations of problem severity (mild, severe) and teacher training (none, some). Results suggested a…

Previous studies have compared the accuracy of parent, teacher, and clinician ratings of children behavior, especially in diagnostic analysis. However, many have questioned the validity of the tests and the value of each rater. While some research has found differences among raters, few had looked at samples of non-referred children. We wanted to…

Entry into professions, such as medicine, law, and the clergy, is typically controlled. In contrast, evaluation has multiple pathways leading into the field. For evaluators, a graduate degree from a university program is one of several ways to become an evaluator. What university programs exist to prepare evaluators and what is their nature? In…

The purposes of this study were to examine (a) whether grade-level differences exist on self-evaluation tendencies over time, (b) if grade-level differences and evaluator differences exist, alone and in combination, on music performance evaluation, (c) if relationships exist between student self-evaluation and expert evaluations of music…

A life cycle metaphor characterizes the evolving relationship between the evaluator and program staff. This framework suggests that common developmental dynamics occur in roughly the same order across groups and settings. There are stage-specific dynamics that begin with Pre-History, which characterize the relationship between the grantees and…