This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

This study conducts a comprehensive analysis of the assessment of journal writing in English as a Foreign Language (EFL) at the secondary school level, comparing the performance of a Generative Artificial Intelligence (GenAI) platform with two human graders. Employing a convergent parallel mixed methods design, quantitative data were collected…

Scoring language learners' speaking skills is open to a number of measurement errors since raters' personal judgements could involve in the process. Different grading designs in which raters score a student's whole speaking skills or a specific dimension of the speaking performance could be settled to control and minimize the amount of the error…

This study aims to identify how feasible it is to use comparative judgement (CJ) and student judges to assess the writing performance of English language learners. For this purpose, 35 paragraphs written by the students who were enrolled in a freshman Academic Writing course at a semi-private university located in the Turkish Republic of Northern…

Analytic rubrics are promoted as important tools to assess learner performance and to improve learning outcomes. Rubrics, however, are not appropriate for every classroom assessment, particularly given the time and effort required to construct well-designed rubrics. In classroom assessment, instructors must balance the beneficial consequences of…

The primary goal of this project is to assess the students' better communication attainment after applying a series of five interactive strategies to an experiment group of subjects. This class will be compared with a control group of other participants, and in their class, the interactive approaches are not emphasized and practiced openly. The…

This mixed methods study examined holistic, analytic, and part marking models (MMs) in terms of their measurement properties and impact on candidate CEFR classifications in a semi-direct online speaking test. Speaking performances of 240 candidates were first marked holistically and by part (phase 1). On the basis of phase 1 findings--which…

Standard language cultures are characterised by beliefs in idealised standard forms of the language in question. In this paper, these beliefs are connected to the concepts of referee design and speech community, through analysis of how Swedish adolescents reflect upon and self-assess their language proficiencies. The data consist of interviews…

Email has become the most preferred form of business communication. Writing "good" email has become an essential skill required in the industry. "Good" email writing not only facilitates clear communication, but also makes a positive impression on the recipient, whether it be one's colleague or a customer. The aim of this paper…

The present study aimed at investigating whether academic IELTS candidates perform differently in writing on either a chart topic or a table topic of the IELTS writing task 1 with regard to the four IELTS writing marking criteria i.e. task achievement, coherence and cohesion, lexical resource, and grammar range and accuracy. The study adopted a…

Previous studies comparing native English speaking (NES) and non-native English speaking teachers have stressed how each group can contribute their respective language advantages to language teaching and assessment. However, in an interpreting classroom where both groups know each other's native language, little is known about the different…

In the high-stakes accountability English educational system, decisions made by government and agencies about curriculum, pedagogy and assessment drive school planning and actions. This paper analyses the drivers for the recent change to French German and Spanish GCSEs and highlights particular areas of the new specification which may damage the…

Each year the National Reference Test (NRT) reports the proportions of students achieving at or above three key GCSE grades in English and mathematics. The NRT is therefore uniquely placed as a Key Stage 4 assessment which compares performance directly at ability level, to contribute to the evidence on the impact of disruption to education due to…

The role that teachers have in assessing student coursework is crucial. Their "determination" that a particular piece of student's work is "acceptable" has many serious consequences. With a lack of debate surrounding assessment, practices may become mired in conventions and disconnected from issues such as knowledge, power and…

Background: Marking of essays is mainly carried out by human raters who bring in their own subjective and idiosyncratic evaluation criteria, which sometimes lead to discrepancy. This discrepancy may in turn raise issues like reliability and fairness. The current research attempts to explore the evaluation criteria of markers on a national level…