This article explores the issue of identifying guessers -- with a specific focus on multiple-choice tests. Guessing has long been considered a problem due to the fact that it compromises validity. A test taker scoring higher than they should through guessing does not provide a picture of their actual ability. After an initial description of issues…

Bots are destined to dominate how humans interact with the internet of things that continues to grow around them. Despite their still budding intellectual capacity, major companies (e.g., Apple, Google and Amazon) have already placed (chat)bots at the centre of their flagship devices. (Chat)Bots currently fill the internet acting as guides,…

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…

This paper reports reactions by candidates to the use of online proctoring (OLP), 'invigilation', in the delivery of high-stakes English language examinations. The paper first sets the scene in terms of the move from face-to-face to online modes of delivery. It explores the challenges and benefits that both modes offer, in terms of accessibility,…

Over the past two decades awareness has been growing that English language teachers need good English language proficiency and professional training to teach effectively. To address this issue, a benchmark--minimum standards assessment test--was initiated, developed, and introduced in Hong Kong in 2001. Because more than a decade and a half has…

Background: The Common European Framework of Reference (CEFR) (Council of Europe 2001) has, over the past decade, come to be widely used as a reference tool for teaching, learning and assessment (Alderson 2002; North 2014). The focus of the current study is on scaling the China Standards of English (CSE) vocabulary descriptors for College English…

This study investigates the perceptions of stakeholders on the impact of a high-stakes assessment of English language teachers' proficiency--the minimum language standards Language Proficiency Assessment for Teachers (English) [LPATE], which was introduced in 2000. Given that the test has now been in place for 17 years, the study investigates the…