This study explores the writing quality of two AI chatbots, OpenAI ChatGPT and Google Gemini. The research assesses the quality of the generated texts based on five essay models using the T.E.R.A. software, focusing on ease of understanding, readability, and reading levels using the Flesch-Kincaid formula. Thirty essays were generated, 15 from…

This dissertation explores the relationship between language production processes and recorded typing behaviors among native speakers of English writing in their native language. Typing is quite prevalent in modern societies, as its use is becoming increasingly required in professional and personal settings but it remains largely understudied in…

The present study performs a three-level meta-analysis to investigate the overall effectiveness of automated writing evaluation (AWE) on EFL/ESL student writing performance. 24 primary studies representing 85 between-group effect sizes and 34 studies representing 178 within-group effect sizes found from 1993 to 2021 were separately meta-analyzed.…

Automatic essay scoring (AES) is an essential educational application in natural language processing. This automated process will alleviate the burden by increasing the reliability and consistency of the assessment. With the advances in text embedding libraries and neural network models, AES systems achieved good results in terms of accuracy.…

Background: Writing is integral to educational success at all levels and to success in the workplace. However, low literacy is a global challenge, and many students lack sufficient skills to be good writers. With the rapid advance of technology, computer-based tools that provide automated feedback are being increasingly developed. However, mixed…

The ability to think critically is an important and valuable skill that students should develop to successfully solve problems. The process of writing requires critical thinking (CT), and the subsequent piece of text can be viewed as a product of CT. One of the strategies educators may use to develop CT is modelling. Given ChatGPT's ability to…

In recent years, various strategies have been employed to integrate ChatGPT into the field of second language (L2) teaching and learning. In line with such efforts, this study investigates the potential of ChatGPT as an automated writing evaluation (AWE) tool for L2 assessment, given the lack of systematic and quantitative investigation into human…

As the development and application of large language models (LLMs) in physics education progress, the well-known AI-based chatbot ChatGPT4 has presented numerous opportunities for educational assessment. Investigating the potential of AI tools in practical educational assessment carries profound significance. This study explored the comparative…

Background: Psychology instructors frequently assign writing-to-learn exercises that include personal reflection. Generative Artificial Intelligence (GenAI) can write text that passes for humans in other domains. Objective: Do students and faculty rate a reflection written by GenAI differently than reflections written by students? Do students and…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Broadly defined, academic language (AL) is a set of lexical-grammatical norms and registers commonly used in educational and academic discourse. Mastery of academic language in writing is an important aspect of writing instruction and assessment. The purpose of this study was to use Natural Language Processing (NLP) tools to examine the extent to…

This article examined student experiences before and after an essay writing assignment that required the use of ChatGPT within an undergraduate engineering course. Utilizing a pre-post study design, we gathered data from 24 participants to evaluate ChatGPT's support for both completing and grading an essay assignment, exploring its educational…

Research on the use of ChatGPT in education has proliferated in the past years. However, there is limited understanding of how English as a Foreign Language (EFL) learners engage emotionally with and utilize ChatGPT during the pre-writing stage. Furthermore, how learners' affective engagement (emotional responses) with this tool in the planning…

With the burgeoning popularity and swift advancements of automated writing evaluation (AWE) systems in language classrooms, scholarly and practical interest in this area has noticeably increased. This systematic review aims to comprehensively investigate current research on three prominent AWE systems: Grammarly, Pigai, and Criterion. Objectives…

Manually scoring and revising student essays has long been a time-consuming task for educators. With the rise of natural language processing techniques, automated essay scoring (AES) and automated essay revising (AER) have emerged to alleviate this burden. However, current AES and AER models require large amounts of training data and lack…