Discusses panels for standard setting and presents 10 guidelines for the selection of panel members for such studies. Panel members should themselves hold the license for which they are producing a cutting score, and they must be familiar with the requirements of the profession and the characteristics of the candidates. (SLD)

Themes that emerged when a team of postgraduate assessors attempted to change their processes included the following: what we assess is what we value; does critique encourage or stifle creativity and innovation?; and should there be an affective/cognitive split? (SK)

Forecasts the future of evaluation, predicting an era of stability or expansion for the profession, with increased communication among evaluators and a flowering of evaluation theories. Among the unknowns that give pause are the possibility of underprepared users and the risks of promising more than can be delivered. Some suggestions are made for…

Discusses ways in which a community-based program evaluation can be enhanced by using a screening tool to delineate the program's evaluative needs, resources, and commitments. Describes use of the Evaluation Pre-Screening Tool and reports on some examples of successful use. (SLD)

Responding to the call for more research on the practice of evaluation and its link to theory, this article uses the interviews conducted with exemplary evaluators or exemplars in the "American Journal of Evaluation" as cases to describe and analyze the practice of exemplary evaluators. Dimensions of analysis included context, purpose, advance…

Community-based organizations (CBOs), typically small and underfunded with transient staff members, are told by funders to care for clients and verify program value. To assist CBOs with evaluations that speak to program effectiveness, many funders wish to expand the evaluation capacity of CBO staff members so that evaluation will occur as long as…

The purpose of this study was to ascertain whether judgments of solo performances recorded at a well-known international piano competition would be affected by musical characteristics such as style (classic period versus early 20th-century Russian) and tempo (slow versus fast). Evaluators rated performances on six test items: tone quality, note…

The editors give each of the theorists a chance to respond to questions posed about the context of the situation in relation to their own experience in the field, exploring how the exercise had an impact on their evaluation designs.

This meta-analysis reviews research on the achievement effects of comprehensive school reform (CSR) and summarizes the specific effects of 29 widely implemented models. There are limitations on the overall quantity and quality of the research base, but the overall effects of CSR appear promising. The combined quantity, quality, and statistical…

In participatory evaluations of K-12 programs, evaluators develop school faculty's and administrators' evaluation capacity by training them to conduct evaluation tasks and providing consultation while the tasks are conducted. A strong case can be made that the capacity building in these evaluations can be examined using a Vygotskian approach. We…

Expert testimony by clinical social workers concerning a criminal defendant's competence to stand trial has increasingly been admitted in certain state courts over the past two decades, yet most state laws still require that court-appointed competence evaluators be psychiatrists or psychologists. Pressure to admit social workers' testimony will…

The authors present an approach for educating future evaluators by connecting evaluation theory and practice, organizational development, and grant making through experiential learning. They position this discussion on the conceptual framework of a newly developed graduate-level evaluation course, Advanced Program Development and Evaluation, which…

This research describes, classifies, and comparatively evaluates national models and mechanisms used to evaluate research and allocate research funding in 16 countries. Although these models and mechanisms vary widely in terms of how research is evaluated and financed, nearly all share the common characteristic of relating funding to some measure…

Evaluation capacity building, or ECB, is an area of great interest within the field of evaluation as well as in Extension evaluation. Internal Extension evaluators have long offered training and technical assistance to help Extension educators conduct evaluation. Today ECB in Extension encompasses myriad activities and processes to advance…

Audit trail analysis can provide valuable insights to researchers and evaluators interested in comparing and contrasting designers' expectations of use and students' actual patterns of use of educational technology environments (ETEs). Sequence analysis techniques are particularly effective but have been neglected to some extent because of real…