Multilingual summative assessments face significant challenges due to tensions that exist between multiple language provision and comparability. Yet, conventional approaches for investigating comparability in multilingual assessments fail to accommodate assessments that comprise extended responses that target complex constructs. This article…

We explored three approaches to resolving or re-scoring constructed-response items in mixed-format assessments: rater agreement, person fit, and targeted double scoring (TDS). We used a simulation study to consider how the three approaches impact the psychometric properties of student achievement estimates, with an emphasis on person fit. We found…

The present case study explores the assessment practice of two examiners from different academic backgrounds on an undergraduate thesis work in mathematics education. Reflection notes and feedback from two instances of a thesis-writing process are interrogated using a framework based on a semiotics perspective to meaning-making. It is shown that…

Administration and scoring of cognitive assessments have evolved from a paper-based platform to a digital format. Since this advancement, Pearson has created a system (Q-interactive) that allows examiners to administer the WISC-V via two iPads. However, limited research exists exploring the effects of this new method of administration when…

COVID-19 has revolutionised assessment design and practices in higher education; however, there has been no shift in the objective of enhancing the relationship between assessment and learning that promote the holistic development of students. In this study, we provide an empirical evaluation of the perceived effects of assessment practices…

Doctoral examiners judge the quality of a thesis and give the student assessment feedback if the student fails to reach certain goals. This paper investigates if and how examiners take on the evaluator or teaching role. We analysed doctoral examination reports from three disciplines. Most examiners provided assessment and feedback, but this often…

These guidelines describe considerations relevant to the assessment of test takers in or across countries or regions that are linguistically or culturally diverse. The guidelines were developed by a committee of experts to help inform test developers, psychometricians, test users, and test administrators about fairness issues in support of the…

Objective: The aim of this pilot project was to explore the extent to which judgments made by psychiatrist examiners accord with those of patients in postgraduate clinical examinations, so as to inform further consideration of the role of patients in such assessments. Method: Senior psychiatrist examiners (N=8) and patients (N=30) rated 16 aspects…

Some methods of determining grade boundaries within examinations, such as awarding, paired comparisons, and rank ordering, entail expert judgements of script quality. We aimed to identify the features of examinees' scripts that most influence judgements in the three methods. For contrasting examinations in biology and English, a Latin square…

In case of an emergency, a fast and structured patient management is crucial for patient's outcome. The competencies needed should be acquired and assessed during medical education. The objective structured clinical examination (OSCE) is a valid and reliable assessment format to evaluate practical skills. However, traditional OSCE stations examine…

Objective: The authors investigated whether curriculum change could produce improved performance, despite a reduction in clerkship length from 8 to 4 weeks. Methods: The exam performance of medical students completing a 4-week clerkship in psychiatry was compared to national data from the National Board of Medical Examiners' Psychiatry Subject…

Accurate marking is crucial to the reliability and validity of public examinations, in England and internationally. Factors contributing to accuracy have been conceptualised as affecting either marking task demands or markers' personal expertise. The aim of this empirical study was to develop this conceptualisation through investigating the…

Purpose: The purpose of this paper is to outline some of the issues related to enabling the accreditation of prior experiential learning (APEL) in doctoral level awards, and illustrate the effects for candidates, others involved in the process and higher education (HE). Design/methodology/approach: The paper is a mainly qualitative evaluation…

This paper reports on the results of a 3-year study conducted at the Centre for Schooling and Learning Technologies (CSaLT) at Edith Cowan University in collaboration with the Curriculum Council of Western Australia which concerns the potential to use digital technologies to represent the output from assessment tasks in the senior secondary…

This article focuses on the assessment system at Western Governors University from the perspective of candidate assessment and performance and on the way in which this system is presented to the Board of Examiners of the National Council for Accreditation of Teacher Education (NCATE). Central to a successful review by the NCATE Board of Examiners…