ERIC Number: ED675678
Record Type: Non-Journal
Publication Date: 2025
Pages: 7
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
Enhancing LLM-Based Short Answer Grading with Retrieval-Augmented Generation
Yucheng Chu; Peng He; Hang Li; Haoyu Han; Kaiqi Yang; Yu Xue; Tingting Li; Yasemin Copur-Gencturk; Joseph Krajcik; Jiliang Tang
International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (18th, Palermo, Italy, Jul 20-23, 2025)
Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly popular in assisting human graders to reduce their workload. However, LLMs' limitations in domain knowledge restrict their understanding in task-specific requirements and hinder their ability to achieve satisfactory performance. Retrieval-augmented generation (RAG) emerges as a promising solution by enabling LLMs to access relevant domain-specific knowledge during assessment. In this work, we propose an adaptive RAG framework for automated grading that dynamically retrieves and incorporates domain-specific knowledge based on the question and student answer context. Our approach combines semantic search and curated educational sources to retrieve valuable reference materials. Experimental results in a science education dataset demonstrate that our system achieves an improvement in grading accuracy compared to baseline LLM approaches. The findings suggest that RAG-enhanced grading systems can serve as reliable support with efficient performance gains. [For the complete proceedings, see ED675583.]
Descriptors: Artificial Intelligence, Science Education, Technology Uses in Education, Natural Language Processing, Grading, Evaluation Methods, Automation, Accuracy, Knowledge Level, Middle School Students
International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Authoring Institution: N/A
Grant or Contract Numbers: 2446701; 1813760; 2405483; 2234015
Author Affiliations: N/A

Peer reviewed
