This study explores the writing quality of two AI chatbots, OpenAI ChatGPT and Google Gemini. The research assesses the quality of the generated texts based on five essay models using the T.E.R.A. software, focusing on ease of understanding, readability, and reading levels using the Flesch-Kincaid formula. Thirty essays were generated, 15 from…

This dissertation explores the relationship between language production processes and recorded typing behaviors among native speakers of English writing in their native language. Typing is quite prevalent in modern societies, as its use is becoming increasingly required in professional and personal settings but it remains largely understudied in…

One of the challenges of discussing validity arguments for machine scoring of essays centers on the absence of a commonly held definition and theory of good writing. At best, the algorithms attempt to measure select attributes of writing and calibrate them against human ratings with the goal of accurate prediction of scores for new essays.…

The present study performs a three-level meta-analysis to investigate the overall effectiveness of automated writing evaluation (AWE) on EFL/ESL student writing performance. 24 primary studies representing 85 between-group effect sizes and 34 studies representing 178 within-group effect sizes found from 1993 to 2021 were separately meta-analyzed.…

Automatic essay scoring (AES) is an essential educational application in natural language processing. This automated process will alleviate the burden by increasing the reliability and consistency of the assessment. With the advances in text embedding libraries and neural network models, AES systems achieved good results in terms of accuracy.…

Background: Writing is integral to educational success at all levels and to success in the workplace. However, low literacy is a global challenge, and many students lack sufficient skills to be good writers. With the rapid advance of technology, computer-based tools that provide automated feedback are being increasingly developed. However, mixed…

The Georgian educational system was not familiar with the concept of plagiarism during the Soviet era. The purpose of the article is to study whether the mechanisms for plagiarism prevention in Georgian higher education institutions have been improved as a result of the application of new authorisation standards and international practices; it…

The ability to think critically is an important and valuable skill that students should develop to successfully solve problems. The process of writing requires critical thinking (CT), and the subsequent piece of text can be viewed as a product of CT. One of the strategies educators may use to develop CT is modelling. Given ChatGPT's ability to…

Human essay grading is a laborious task that can consume much time and effort. Automated Essay Scoring (AES) has thus been proposed as a fast and effective solution to the problem of grading student writing at scale. However, because AES typically uses supervised machine learning, a human-graded essay corpus is still required to train the AES…

Automated Essay Scoring (AES) tools aim to improve the efficiency and consistency of essay scoring by using machine learning algorithms. In the existing research work on this topic, most researchers agree that human-automated score agreement remains the benchmark for assessing the accuracy of machine-generated scores. To measure the performance of…

In recent years, various strategies have been employed to integrate ChatGPT into the field of second language (L2) teaching and learning. In line with such efforts, this study investigates the potential of ChatGPT as an automated writing evaluation (AWE) tool for L2 assessment, given the lack of systematic and quantitative investigation into human…

As the development and application of large language models (LLMs) in physics education progress, the well-known AI-based chatbot ChatGPT4 has presented numerous opportunities for educational assessment. Investigating the potential of AI tools in practical educational assessment carries profound significance. This study explored the comparative…

Automated Writing Evaluation (AWE) is one of the machine techniques used for assessing learners' writing. Recently, this technique has been widely implemented for improving learners' editing strategies. Several studies have been conducted to compare self-editing with peer editing. However, only a few studies have compared automated peer and…

Although it has been suggested that automated writing evaluation (AWE) can liberate teachers' time to focus more on higher-order concerns as it can take care of lower-order concerns, AWE's impact on teachers' feedback practice is underexplored. Additionally, scant literature exists on teachers' perception of AWE when they use it to complement…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…