ERIC Number: EJ1461370
Record Type: Journal
Publication Date: 2025-Mar
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0141-8211
EISSN: EISSN-1465-3435
Available Date: 2025-01-31
A Comparison of Human-Written versus AI-Generated Text in Discussions at Educational Settings: Investigating Features for ChatGPT, Gemini and BingAI
European Journal of Education, v60 n1 e70014 2025
Generative artificial intelligence (GenAI) models, such as ChatGPT, Gemini, and BingAI, have become integral to educational sciences, bringing about significant transformations in the education system and the processes of knowledge production. These advancements have facilitated new methods of teaching, learning, and information dissemination. However, the widespread adoption of these technologies raises serious concerns about academic ethics, content authenticity, and the potential for misuse in academic settings. This study aims to evaluate the linguistic features and differences between AI-generated and human-generated articles in educational contexts. By analysing various linguistic attributes such as singular word usage, sentence lengths, and the presence of repetitive or stereotypical phrases, the study identifies key distinctions between the two types of content. The findings indicate that human-generated articles exhibit higher average singular word usage and longer sentence lengths compared to AI-generated articles, suggesting a more complex and nuanced language structure in human writing. Furthermore, the study employs ensemble learning models, including Random Forest, Gradient Boosting, AdaBoost, Bagging, and Extra Trees, to classify and distinguish between AI-generated and human-generated texts. Among these, the Extra Trees model achieved the highest classification accuracy of 93%, highlighting its effectiveness in identifying AI-generated content. Additionally, experiments using the BERTurk model, a transformer-based language model, demonstrated a classification accuracy of 95%, particularly in distinguishing human-generated articles from those produced by Gemini. The results of this study have significant implications for the future of education, as they underscore the critical need for robust tools and methodologies to differentiate between human and AI-generated content.
Descriptors: Writing (Composition), Discussion, Artificial Intelligence, Natural Language Processing, Technology Uses in Education, Language Usage, Linguistics
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Department of Educational Science, Eregli Faculty of Education, Necmettin Erbakan University, Konya, Turkey; 2Department of Computer Engineering, Software Engineering, Izmir Katip Celebi University, Izmir, Turkey