Quantitative measures of systematic differences in OSCE scoring across examiners (often termed examiner stringency) can threaten the validity of examination outcomes. Such effects are usually conceptualised and operationalised based solely on checklist/domain scores in a station, and global grades are not often used in this type of analysis. In…

Visual inference involves using prior knowledge and contextual cues to make educated guesses about incomplete or ambiguous information. This study explores the role of visual inference as a function of expertise in the context of fingerprint examination, where professional examiners need to determine whether two fingerprints were left by the same…

Great opportunities for language testing practitioners are enabled through language program administration. Local language tests lend themselves to multiple purposes--for placement and diagnosis, as a means of tracking progress, and as a contribution to program evaluation and revision. Administrative choices, especially those involving a test, are…

The 2022-2023 Indiana Assessments Policy Manual serves as the foundation for established guidelines regarding appropriate test administration in Indiana for key stakeholders including educators and Test Coordinators. The following document contains policy guidance and contains appendices which pertain to specific aspects of test implementation,…

Manual composition of tasks and exams is a challenging and time-consuming task. Especially when exams are taken remotely without the personal monitoring by examiners, most exams can easily lose their integrity with the use of previously done exercises or student communication. This research introduces an approach that incorporates the principles…

Multilingual summative assessments face significant challenges due to tensions that exist between multiple language provision and comparability. Yet, conventional approaches for investigating comparability in multilingual assessments fail to accommodate assessments that comprise extended responses that target complex constructs. This article…

Experts outperform novices on many cognitive and perceptual tasks. Extensive training has tuned experts to the most relevant information in their specific domain, allowing them to make decisions quickly and accurately. We compared a group of fingerprint examiners to a group of novices on their ability to search for information in fingerprints…

Due to the coronavirus disease 2019 (COVID-2019) and the sudden shift to online learning, higher education institutions adopted various approaches to reduce cheating in online assessments, mainly involving online live proctoring (OLP). The international assessment integrity regulation trend also applied to a university in South Africa, where…

This study aims to better understand the learning experiences of doctoral examiners in relation to their assessment practices in the PhD viva, which directly impacts the PhD candidates' success in doctoral assessment. A narrative approach was employed to uncover the narratives of learning to examine in the PhD viva from twelve doctoral examiners…

Intelligence tests are used in a variety of settings such as schools, clinics, and courts to assess the intellectual capacity of individuals of all ages. Intelligence tests are used to make high-stakes decisions such as special education placement, employment, eligibility for social security services, and determination of the death penalty.…

The examination of a PhD thesis marks an important stage in the PhD student journey. Here, the student's research, thinking and writing are assessed by experts in their field. Yet, in the early stages of candidature, students often do not know what is expected of their thesis, nor what examiners will scrutinise and comment on. However, what…

We explored three approaches to resolving or re-scoring constructed-response items in mixed-format assessments: rater agreement, person fit, and targeted double scoring (TDS). We used a simulation study to consider how the three approaches impact the psychometric properties of student achievement estimates, with an emphasis on person fit. We found…

In recent decades the doctorate and its purposes have undergone fundamental change. The scholarly model has evolved from one of 'apprentice' to independent, supported learner and the doctoral training process has been revolutionised; many candidates now experience cohort-based, structured research. The UK's final PhD examination, however, has…

Purpose: This paper aims to investigate doctoral examiners' narratives on their expectations of the candidate's oral performance in the PhD viva. Both the PhD examiners and handbooks that offer advice on the PhD viva preparation appear to share the same expectation of the candidate's oral performance in the viva. That is, candidates must answer…

Taking into consideration the unique relational position of convenors (Chairs) in PhD oral examinations, this qualitative study explores insights from 55 convenors at a research-intensive university in New Zealand into the ways academic staff developers can better prepare doctoral supervisors and examiners for oral examinations. One striking…