Doctoral examiners judge the quality of a thesis and give the student assessment feedback if the student fails to reach certain goals. This paper investigates if and how examiners take on the evaluator or teaching role. We analysed doctoral examination reports from three disciplines. Most examiners provided assessment and feedback, but this often…

Objective: The aim of this pilot project was to explore the extent to which judgments made by psychiatrist examiners accord with those of patients in postgraduate clinical examinations, so as to inform further consideration of the role of patients in such assessments. Method: Senior psychiatrist examiners (N=8) and patients (N=30) rated 16 aspects…

This study investigated factors that could affect inter-examiner reliability in the pronunciation assessment component of speaking tests. We hypothesized that the rating of pronunciation is susceptible to variation in assessment due to the amount of exposure examiners have to nonnative English accents. An inter-rater variability analysis was…

The oral examination is an important component of the high-stakes "O" Level examination in Singapore taken by 16-17 year olds whose first language may or may not be English. In spite of this, there has been sparse research into the examination. This paper reports findings of an exploratory study which attempted to determine whether there…

There is a growing body of research literature that considers how the mode of assessment, either computer-based or paper-based, might affect candidates' performances. Despite this, there is a fairly narrow literature that shifts the focus of attention to those making assessment judgements and which considers issues of assessor consistency when…

The examination of doctoral theses controls an important academic threshold, yet practices are often private, codes non-specific, and individuals isolated. This article adds to recent investigation of the examination culture by reporting informal panel discussion amongst a total of 23 University of Auckland (New Zealand) faculty members as to…

Examinations were analyzed using the Rasch model to determine differences in judge severity and grading period stringency for (1) essay examination (subjects were 12 judges and 32 examinees); (2) clinical examination (subjects were 18 judges and 217 examinees); and (3) oral examination (subjects were 46 judges and 270 examinees). (SLD)

A four-level taxonomy is proposed to define the usefulness of rater written comments for supporting letters of recommendation. The taxonomy is used to classify comments on 220 rating forms by 25 raters from two surgery departments regarding performance by third-year medical students. Written comments were classified by the following taxonomy: (1)…

Whether adequate levels of interrater reliability could be obtained on a national, standardized examination using one examiner per observation was studied with 101 paired candidate observations on an examination for optometry. Results indicate that psychometrically sound judgments can be obtained with one examiner. (SLD)

A method for understanding and controlling the multiple facets of an oral examination (OE) or other judge-intermediated examination is presented and illustrated. This study focused on determining the extent to which the facets model (FM) analysis constructs meaningful variables for each facet of an OE involving protocols, examiners, and…

Researchers examined the management and conduct of assessments at the diploma and advanced diploma levels within training packages across Australia. The principal data collection activities were as follows: (1) a literature review; (2) examination of seven training packages; (3) a survey completed by 28 registered training organizations and 33…