Quantitative measures of systematic differences in OSCE scoring across examiners (often termed examiner stringency) can threaten the validity of examination outcomes. Such effects are usually conceptualised and operationalised based solely on checklist/domain scores in a station, and global grades are not often used in this type of analysis. In…

Visual inference involves using prior knowledge and contextual cues to make educated guesses about incomplete or ambiguous information. This study explores the role of visual inference as a function of expertise in the context of fingerprint examination, where professional examiners need to determine whether two fingerprints were left by the same…

Manual composition of tasks and exams is a challenging and time-consuming task. Especially when exams are taken remotely without the personal monitoring by examiners, most exams can easily lose their integrity with the use of previously done exercises or student communication. This research introduces an approach that incorporates the principles…

Due to the coronavirus disease 2019 (COVID-2019) and the sudden shift to online learning, higher education institutions adopted various approaches to reduce cheating in online assessments, mainly involving online live proctoring (OLP). The international assessment integrity regulation trend also applied to a university in South Africa, where…

We explored three approaches to resolving or re-scoring constructed-response items in mixed-format assessments: rater agreement, person fit, and targeted double scoring (TDS). We used a simulation study to consider how the three approaches impact the psychometric properties of student achievement estimates, with an emphasis on person fit. We found…

In recent decades the doctorate and its purposes have undergone fundamental change. The scholarly model has evolved from one of 'apprentice' to independent, supported learner and the doctoral training process has been revolutionised; many candidates now experience cohort-based, structured research. The UK's final PhD examination, however, has…

Taking into consideration the unique relational position of convenors (Chairs) in PhD oral examinations, this qualitative study explores insights from 55 convenors at a research-intensive university in New Zealand into the ways academic staff developers can better prepare doctoral supervisors and examiners for oral examinations. One striking…

COVID-19 has revolutionised assessment design and practices in higher education; however, there has been no shift in the objective of enhancing the relationship between assessment and learning that promote the holistic development of students. In this study, we provide an empirical evaluation of the perceived effects of assessment practices…

The New York State Education Department (NYSED) has a partnership with NWEA for the development of the 2024 Grades 3-8 English Language Arts Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2024 Grades 6 and 7 English Language…