ERIC Number: EJ1475186
Record Type: Journal
Publication Date: 2025-Jun
Pages: 26
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1360-2357
EISSN: EISSN-1573-7608
Available Date: 2025-01-07
Effect of Large Language Models Artificial Intelligence ChatGPT Chatbot on Achievement of Computer Education Students
Education and Information Technologies, v30 n9 p11863-11888 2025
In spite of the emergence of studies seeking to integrate chatbot into education, there is a wide literature gap in the Nigerian contexts. While most studies focus on the design and development of chatbots, there exists a very scarce literature on the effect of ChatGPT chatbot on students' achievement. To address this gap, this study checked the effect of ChatGPT chatbot on computer education students. Using a repeated measures approach, 68 year one undergraduates participated in the study. A 50-item Computer Education Achievement Test (CEAT), which was subjected to expert validation and pilot study, was used to obtain data. The students were given two pre-test and posttest measures before and after the treatment. Data were computed using mixed design repeated measures analysis of variance and the findings revealed that the use of ChatGPT chatbot improved students' performance (F[subscript](3,201) = 408.793, P = 0.000) with an effect size ([partial eta-squared]) of 0.859. The finding also revealed no significant moderating influence of gender, age and experience on the effect of ChatGPT chatbot on students' performance. The study has some implication for lecturers, researchers and policy experts on the need to incorporate ChatGPT chatbot in education given that it has the potential to improve students' performance and equally promote self-paced individualized learning.
Descriptors: Natural Language Processing, Artificial Intelligence, Academic Achievement, Computer Science Education, Foreign Countries, Undergraduate Students, Achievement Tests, Effect Size, Gender Differences, Age Differences, Technology Integration, Individualized Instruction, Independent Study, Pacing
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Nigeria
Grant or Contract Numbers: N/A
Author Affiliations: 1Federal University of Kashere, Department of Science Education, Gombe State, Nigeria