Great opportunities for language testing practitioners are enabled through language program administration. Local language tests lend themselves to multiple purposes--for placement and diagnosis, as a means of tracking progress, and as a contribution to program evaluation and revision. Administrative choices, especially those involving a test, are…

Doctoral examiners judge the quality of a thesis and give the student assessment feedback if the student fails to reach certain goals. This paper investigates if and how examiners take on the evaluator or teaching role. We analysed doctoral examination reports from three disciplines. Most examiners provided assessment and feedback, but this often…

Objective: The aim of this pilot project was to explore the extent to which judgments made by psychiatrist examiners accord with those of patients in postgraduate clinical examinations, so as to inform further consideration of the role of patients in such assessments. Method: Senior psychiatrist examiners (N=8) and patients (N=30) rated 16 aspects…

This study investigated factors that could affect inter-examiner reliability in the pronunciation assessment component of speaking tests. We hypothesized that the rating of pronunciation is susceptible to variation in assessment due to the amount of exposure examiners have to nonnative English accents. An inter-rater variability analysis was…

The oral examination is an important component of the high-stakes "O" Level examination in Singapore taken by 16-17 year olds whose first language may or may not be English. In spite of this, there has been sparse research into the examination. This paper reports findings of an exploratory study which attempted to determine whether there…

There is a growing body of research literature that considers how the mode of assessment, either computer-based or paper-based, might affect candidates' performances. Despite this, there is a fairly narrow literature that shifts the focus of attention to those making assessment judgements and which considers issues of assessor consistency when…

The examination of doctoral theses controls an important academic threshold, yet practices are often private, codes non-specific, and individuals isolated. This article adds to recent investigation of the examination culture by reporting informal panel discussion amongst a total of 23 University of Auckland (New Zealand) faculty members as to…

This is a mixed methods investigation of consistency in PhD examination. At its core is the quantification of the content and conceptual analysis of examiner reports for 804 Australian theses. First, the level of consistency between what examiners say in their reports and the recommendation they provide for a thesis is explored, followed by an…