The same L2 speaking performance may be analysed and evaluated in very different ways by different teachers or raters. We present a new, technology-assisted research design which opens up to investigation the trajectories of convergence and divergence between raters. We tracked and recorded what different raters noticed when, whilst grading a…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

Many overseas students in Higher Education in the UK struggle to understand the compulsory texts for their course, and obtain lower scores for their modules than their monolingual peers. While the existence of this achievement gap is well established in the literature, little is known about the ways in which overseas students in HE with limited…

The present study aimed at investigating whether academic IELTS candidates perform differently in writing on either a chart topic or a table topic of the IELTS writing task 1 with regard to the four IELTS writing marking criteria i.e. task achievement, coherence and cohesion, lexical resource, and grammar range and accuracy. The study adopted a…

This paper examines some of the best known proficiency tests in English, with particular focus on the oral component. Attention is paid to the following issues, among others: the weighting of oral elements in testing, the criteria used for the assessment of oral skills and the relation of these to the general guidelines in the "Common…