This paper reports reactions by candidates to the use of online proctoring (OLP), 'invigilation', in the delivery of high-stakes English language examinations. The paper first sets the scene in terms of the move from face-to-face to online modes of delivery. It explores the challenges and benefits that both modes offer, in terms of accessibility,…

Onscreen marking (OSM) has been used for the majority of Hong Kong public examinations since 2012. The current study compares marker reactions to OSM, ie, perceived ease of use and acceptance of OSM, against the backdrop of virtually all subject areas being marked on screen. The data were collected from three major sources: (1) survey data…

In Hong Kong, onscreen marking (OSM) is superseding paper-based marking (PBM) across the entire national examinations system. This paper describes a qualitative study of the attitudes of Liberal Studies markers towards OSM. This becomes a compulsory subject in Hong Kong's new senior secondary school curriculum to be first examined in 2012, with a…

This article details an investigation into the onscreen marking (OSM) of Liberal Studies (LS) in Hong Kong--where paper-based marking (PBM) of public examinations is being phased out and wholly superseded by OSM. The study involved 14 markers who had previously rated Liberal Studies scripts on screen in the 2009 Hong Kong Advanced Level…

This article details an investigation into onscreen marking (OSM) in Hong Kong--where paper-based marking (PBM) is being phased out, to be completely superseded by OSM. It is a specific follow-up to a larger study (Coniam, 2009a) involving 30 raters who had previously rated English language essay scripts on screen in the 2007 Hong Kong Certificate…

This article reports the move from paper-based marking (PBM) to onscreen marking (OSM) in Hong Kong for the subject Liberal Studies--whose objectives involve broadening students' horizons through critical examination of current issues. While currently a small candidature subject of approximately 3300, from 2009, the subject will become compulsory…

This paper describes a study comparing paper-based marking (PBM) and onscreen marking (OSM) in Hong Kong utilising English language essay scripts drawn from the live 2007 Hong Kong Certificate of Education Examination (HKCEE) Year 11 English Language Writing Paper. In the study, 30 raters from the 2007 HKCEE Writing Paper marked on paper 100…

This paper describes a study of the computer essay-scoring program BETSY. While the use of computers in rating written scripts has been criticised in some quarters for lacking transparency or lack of fit with how human raters rate written scripts, a number of essay rating programs are available commercially, many of which claim to offer comparable…

Describes the design and implementation of a computer-based listening test--the "Text dictation." The article first discusses the importance of listening centering on a coherent text, rather than short listening fragments, and discusses drawbacks of listening programs wherein the required responses consist of noninteractive test types, such as…

Describes the construction and small-scale implementation of a computer program that can be used on a self-access basis to assess English-as-a-Second-Language listening proficiency. The test involves an extended dictation in dialog form. Results indicate a good correlation with traditional pen-and-paper tests and suggests that the concept has…

Analyzes results of a previous study on speech recognition (SR) technology for its ability to distinguish between native- and nonnative English speakers. The current study concludes that SR technology has potential for testing the oral proficiency of English-as-a-Second-Language students.(ER)

Describes the process for generating, from a text, three types of multiple-choice vocabulary cloze tests: one based on n-th word deletion, one using user-specified frequency ranges, and one based on a particular word class. The article discusses the extent to which good test material can be produced realistically by computer-aided systems and the…

Examines the process of developing an English-as-a-Second-Language (ESL) cloze test by computer based on a language corpus. Two such tests developed and pilot-tested in Hong Kong were found to have test items that were not as good as they would have been if designed by a competent human, but better than expected. (Author/MSE)

This paper describes an English language listening test intended as computer-based testing material for secondary school students in Hong Kong, where considerable attention is being invested in online and computer-based testing. As well as providing a school-based testing facility, the study aims to contribute to the knowledge base regarding the…

Describes a computer program that takes multiple-choice cloze passages and compiles them into proofreading exercises. Results reveal that such a computerized test type can be used to accurately measure the proficiency of students of English as a Second Language in Hong Kong. (14 references) (Author/CK)