Assessment lies at the centre of PhD degree quality standards, with quality assurance relying on independent external examiners. This study investigates the role of the viva and the selection of external examiners from within the accounting and finance discipline across UK institutions. A questionnaire survey and follow-up interviews with…

As states, districts, and schools transition toward more rigorous educator evaluation systems, they are placing additional weight on judgments about educator practice. Since teacher and principal observation ratings inherently rely on evaluators' professional judgment, there is always a question of how much the ratings depend on the particular…

Background: Those involved in school health education programs generally believe that health-education programs can play an important role in helping young people make positive health decisions. Thus, it is to document the effects of such programs through rigorous evaluations published in peer-reviewed journals. Methods: This paper helps the…

Provides ten suggestions to help in choosing and using an outside evaluator. (IRT)

The selection of a programming language for introductory courses has long been an informal process involving faculty evaluation, discussion, and consensus. As the number of faculty, students, and language options grows, this process becomes increasingly unwieldy. As it stands, the process currently lacks structure and replicability. Establishing a…

Discusses panels for standard setting and presents 10 guidelines for the selection of panel members for such studies. Panel members should themselves hold the license for which they are producing a cutting score, and they must be familiar with the requirements of the profession and the characteristics of the candidates. (SLD)

Value judgments are central to the process of stakeholder-based evaluations. The selection of stakeholder participants involves a value judgment about the power and the legitimacy of the stakeholders. Consequences of stakeholder evaluation may include pseudoempowerment. Suggestions for evaluators for improving stakeholder evaluations are made.…

The following models which provide an estimate of the reliability of a rating scale are described: (1) disattenuation; (2) common factor; (3) external criterion; (4) treatment effects; and (5) regression. Such models are especially useful in selecting, evaluating, and training participants in clinical research. (SLD)

An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)

Issues concerning the selection of judges for standard setting are discussed. Determining the consistency of judges' recommendations, or their congruity with other expert recommendations, would help in selection. Enough judges must be chosen to allow estimation of recommendations by an entire population of judges. (SLD)

Criteria for the selection of judges (evaluators) for setting item-based standards involved in tests for which cutting scores must be established are investigated. Focus is on cases in which test standards are based on specialists' judgments concerning the difficulty of test items in tests used to determine who will be awarded a diploma, admitted…