NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1472945
Record Type: Journal
Publication Date: 2025-Jun
Pages: 33
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1360-2357
EISSN: EISSN-1573-7608
Available Date: 2024-12-27
Beyond ChatGPT: Benchmarking Speech-Recognition Chatbots for Language Learning Using a Novel Decision-Making Framework
Samar Ibrahim1; Ghazala Bilquise2
Education and Information Technologies, v30 n8 p11151-11183 2025
Language is an essential component of human communication and interaction. Advances in Artificial Intelligence (AI) technology, specifically in Natural Language Processing (NLP) and speech-recognition, have made is possible for conversational agents, also known as chatbots, to converse with language learners in a way that mimics human speech. Numerous researchers have provided empirical evidence supporting the beneficial impact of voice-based chatbots on language acquisition. As a result, benchmarking Language Learning Chatbot (LLC) for effectiveness is crucial for not only for language learners but also for designers and developers of LLC applications. Three challenges make this process a Multiple Criteria Decision-Making (MCDM) problem, namely multiple language learning features, uncertainty of the feature's importance level, and data variation. Hence, addressing these issues requires the implementation of an MCDM solution. This research proposes a novel MCMD method to rank LLC applications. Our study extends the Multi Criteria Ranking by Alternative Trace (MCRAT) technique with the Fuzzy Weighted with Zero Inconsistency (FWZIC) approach under the T-Spherical (TS) fuzzy environment. The research methodology is initiated by formulating a decision matrix based on the intersection of LLC applications and nine application features. Subsequently, the TS-FWZIC method is developed to ascertain the weights of the application features. Utilizing these weights and the formulated decision matrix, the MCRAT method is employed to rank the LLC applications. The effectiveness of the proposed method is then assessed through sensitivity analysis and comparative evaluation.
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1American University in Dubai, School of Arts and Science, Dubai, United Arab Emirates; 2Higher Colleges of Technology, Computer Information Science, Dubai, United Arab Emirates