This article explores the issue of identifying guessers -- with a specific focus on multiple-choice tests. Guessing has long been considered a problem due to the fact that it compromises validity. A test taker scoring higher than they should through guessing does not provide a picture of their actual ability. After an initial description of issues…

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…

This paper reports reactions by candidates to the use of online proctoring (OLP), 'invigilation', in the delivery of high-stakes English language examinations. The paper first sets the scene in terms of the move from face-to-face to online modes of delivery. It explores the challenges and benefits that both modes offer, in terms of accessibility,…

Over the past two decades awareness has been growing that English language teachers need good English language proficiency and professional training to teach effectively. To address this issue, a benchmark--minimum standards assessment test--was initiated, developed, and introduced in Hong Kong in 2001. Because more than a decade and a half has…

This study investigates the perceptions of stakeholders on the impact of a high-stakes assessment of English language teachers' proficiency--the minimum language standards Language Proficiency Assessment for Teachers (English) [LPATE], which was introduced in 2000. Given that the test has now been in place for 17 years, the study investigates the…

Background: This article reports a study into the double marking of Liberal Studies in Hong Kong. This is now a compulsory subject in Hong Kong's Years 10-12 curriculum which, when first examined in the new Hong Kong Diploma of Secondary Education in 2012, will increase its candidature from its current 3,300 to 80,000. Aims: To examine the…

Describes the design and implementation of a computer-based listening test--the "Text dictation." The article first discusses the importance of listening centering on a coherent text, rather than short listening fragments, and discusses drawbacks of listening programs wherein the required responses consist of noninteractive test types, such as…

Evaluates a multimedia program produced to support test takers facing a new performance test for English-as-a-Second-Language (ESL) teachers in Hong Kong as part of a language certification test. Describes how groups of trainee ESL teachers in Hong Kong were first introduced to the test via the print syllabus produced by the Hong Kong…

Within the context of the overall development of a range of assessment instruments for setting standards (language benchmarks) for primary and secondary teachers in Hong Kong, this article describes the origins of a project that developed the Benchmarks Test. Looks at the process of piloting, moderating, ratifying, and implementing the test of…

Describes the process for generating, from a text, three types of multiple-choice vocabulary cloze tests: one based on n-th word deletion, one using user-specified frequency ranges, and one based on a particular word class. The article discusses the extent to which good test material can be produced realistically by computer-aided systems and the…

A study investigated the validity of a second-language student's actual speed of delivery of a passage read aloud as an indicator of second-language fluency. The study, conducted in Hong Kong with 83 secondary school students, used the oral dialogue test in a standardized secondary school-leaving examination. The dialogues were timed and the rate…