ERIC Number: EJ1465704
Record Type: Journal
Publication Date: 2025
Pages: 22
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1925-4741
EISSN: EISSN-1925-475X
Available Date: 0000-00-00
Meta-Analysis of Artificial Intelligence in Education
Jincheng Zhang; Thada Jantakoon; Rukthin Laoha
Higher Education Studies, v15 n2 p189-210 2025
This meta-analysis examined the effectiveness of artificial intelligence (AI) technologies in educational settings through a systematic review of 13 empirical studies conducted across eight countries. We analysed the impact of various AI technologies on educational outcomes using PRISMA guidelines and multiple analytical approaches, including novel applications of Naive Bayes, TF-IDF, and BERT-based algorithms. The overall analysis revealed a significant positive effect size (Hedges' g = 0.86, 95% CI [0.45, 1.27], p < 0.0001), indicating substantial benefits of AI integration in education. Particularly noteworthy were the effects of chatbots and generative AI (effect size = 1.02, 95% CI [0.45, 1.59], p < 0.0001), which demonstrated the most substantial positive impact on student learning outcomes. Online learning and virtual reality applications showed moderate positive effects (effect size = 0.79, 95% CI [-0.04, 1.62], p < 0.07) while learning management systems and AI platforms demonstrated promising but more modest impacts (effect size = 0.62, 95% CI [0.03, 1.21], p < 0.05). Although significant heterogeneity was observed across studies (I[superscript 2]ranging from 54.03% to 93.23%), the consistent positive effects across different educational contexts suggest the robust potential of AI technologies in enhancing educational practices. Implementing a novel weighted hybrid model, combining random and fixed effects approaches, provided additional methodological insights for analysing educational technology effectiveness. These findings provide empirical support for integrating AI technologies in educational settings while highlighting the importance of considering specific contextual factors and implementation strategies for optimal outcomes.
Descriptors: Literature Reviews, Meta Analysis, Artificial Intelligence, Technology Uses in Education, Educational Technology, Technology Integration, Foreign Countries, Influence of Technology
Canadian Center of Science and Education. 1595 Sixteenth Ave Suite 301, Richmond Hill, Ontario, L4B 3N9
Canada. Tel: 416-642-2606; Fax: 416-642-2608; e-mail: hes@ccsenet.org; Web site: http://www.ccsenet.org/journal/index.php/hes
Publication Type: Journal Articles; Information Analyses; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A