ERIC Number: EJ1449091
Record Type: Journal
Publication Date: 2024-Oct
Pages: 34
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1360-2357
EISSN: EISSN-1573-7608
Available Date: N/A
The Unified Difficulty Ranking Mechanism for Automatic Multiple Choice Question Generation in Digital Storytelling Domain
Lae Lae Shwe; Sureena Matayong; Suntorn Witosurapot
Education and Information Technologies, v29 n15 p20317-20350 2024
Multiple Choice Questions (MCQs) are an important evaluation technique for both examinations and learning activities. However, the manual creation of questions is time-consuming and challenging for teachers. Hence, there is a notable demand for an Automatic Question Generation (AQG) system. Several systems have been created for this aim, but the generated questions failed to meet the requirements for student assessment effectively. Consequently, research in education technology, natural language processing, and KG development technology to support the AQG systems is still in its infancy. In this paper, the innovative integrated AQG framework for creating MCQs with difficulty levels is presented. The improved KG is first built as a source for question generation through corresponding queries. The distractors or wrong choices are generated by proposing a unified difficulty ranking mechanism, which includes the hybrid technique of WordNet-based and Linked Data (LD)-based semantic similarity together with property filtering score. Furthermore, the syntactic feature i.e. part-of-speech is utilized for the best distractors generation. The experimental results of the proposed unified difficulty ranking mechanism demonstrate an accuracy of 94% on the KG test dataset and 75% on public datasets. The accuracy of distractors' correctness is 60% on the test dataset while it is 72% on the public dataset. The results highlight the efficiency of the proposed unified difficulty ranking mechanism for automatic MCQs generation in the digital storytelling domain.
Descriptors: Difficulty Level, Computer Assisted Testing, Adaptive Testing, Multiple Choice Tests, Educational Technology, Story Telling, Student Evaluation, Testing, Test Items, Natural Language Processing
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A