ChatGPT has been demonstrated to possess significant capabilities in generating intricate human-like text, and recent studies have established that its performance in theory of mind (ToM) tasks is strikingly comparable to a nine-year-old child's. However, it remains unknown whether ChatGPT outperforms children of this age group in Chinese writing,…

This study explores the writing quality of two AI chatbots, OpenAI ChatGPT and Google Gemini. The research assesses the quality of the generated texts based on five essay models using the T.E.R.A. software, focusing on ease of understanding, readability, and reading levels using the Flesch-Kincaid formula. Thirty essays were generated, 15 from…

Automatic essay scoring (AES) is an essential educational application in natural language processing. This automated process will alleviate the burden by increasing the reliability and consistency of the assessment. With the advances in text embedding libraries and neural network models, AES systems achieved good results in terms of accuracy.…

Reflective practice holds critical importance, for example, in higher education and teacher education, yet promoting students' reflective skills has been a persistent challenge. The emergence of revolutionary artificial intelligence technologies, notably in machine learning and large language models, heralds potential breakthroughs in this domain.…

Writing is generally assessed internationally using rubric-based approaches, but there is a growing body of evidence to suggest that the reliability of such approaches is poor. In contrast, comparative judgement studies suggest that it is possible to assess open ended tasks such as writing with greater reliability. Many previous studies, however,…

Human essay grading is a laborious task that can consume much time and effort. Automated Essay Scoring (AES) has thus been proposed as a fast and effective solution to the problem of grading student writing at scale. However, because AES typically uses supervised machine learning, a human-graded essay corpus is still required to train the AES…

Self-Regulated Strategy Development (SRSD) is a method designed to explicitly teach students self-regulation skills and help them implement them. While SRSD's beneficial effect on writing quality has been confirmed in a large body of literature, the questions of why, how, and for whom SRSD works remain unclear. To investigate the underlying…

Writing is hard for students who are learning English; they often find it challenging to transform what is on their mind in writing. Therefore, this study examined the relationship between the writing test and assessment writing through argumentative writing. Data was analyzed using the correlation test to determine the close relationship between…

As the development and application of large language models (LLMs) in physics education progress, the well-known AI-based chatbot ChatGPT4 has presented numerous opportunities for educational assessment. Investigating the potential of AI tools in practical educational assessment carries profound significance. This study explored the comparative…

The impact of self- and peer-assessment strategies (assessment as learning) on the development of writing skill of EFL learners is a research area requiring more research studies. The present study aimed to investigate the impact of language assessment literacy enhancement (LALE) on Iranian high school English as Foreign Language (EFL) students'…

This article reports on assessments of business letters assigned to students in a business communication course. Assessments were performed by faculty in other disciplines and local business professionals, with each sampled assignment evaluated by one faculty and one business professional. Overall, the assessments by the two groups were similar in…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Comparative Judgement (CJ) is an evaluation method, typically conducted online, whereby a rank order is constructed, and scores calculated, from judges' pairwise comparisons of performances. CJ has been researched in various educational contexts, though only rarely in English as a Foreign Language (EFL) writing settings, and is generally agreed to…

One of the missions of language education internationally is to enable students to use language in a context-appropriate manner. Against this backdrop, students' ability to linguistically encode formality emerges as an important issue. Using extracts of writing produced by 16-year-old students in 2004 and 2014, this study sought to investigate…

Testing English writing skills could be multi-dimensional; thus, the study aimed to compare students' writing scores calculated according to Classical Test Theory (CTT) and Multi-Facet Rasch Model (MFRM). The research was carried out in 2019 with 100 university students studying at a foreign language preparatory class and four experienced…