On Opportunities and Challenges of Large Multimodal Foundation Models in Education.

Stefan Küchemann; Karina E. Avila; Yavuz Dinc; Chiara Hortmann; Natalia Revenga; Verena Ruf; Niklas Stausberg; Steffen Steinert; Frank Fischer; Martin Fischer; Enkelejda Kasneci; Gjergji Kasneci; Thomas Kuhr; Gitta Kutyniok; Sarah Malone; Michael Sailer; Albrecht Schmidt; Matthias Stadler; Jochen Weller; Jochen Kuhn

Notes FAQ Contact Us

Back to results

Peer reviewed

Direct link

ERIC Number: EJ1461161

Record Type: Journal

Publication Date: 2025-Dec

Pages: 11

Abstractor: As Provided

ISBN: N/A

ISSN: N/A

EISSN: EISSN-2056-7936

Available Date: 2025-02-26

On Opportunities and Challenges of Large Multimodal Foundation Models in Education

Stefan Küchemann¹; Karina E. Avila¹; Yavuz Dinc¹; Chiara Hortmann¹; Natalia Revenga¹; Verena Ruf¹; Niklas Stausberg¹; Steffen Steinert¹; Frank Fischer²; Martin Fischer³; Enkelejda Kasneci⁴; Gjergji Kasneci⁵; Thomas Kuhr⁶; Gitta Kutyniok^7,8,9; Sarah Malone¹⁰; Michael Sailer¹¹; Albrecht Schmidt¹²; Matthias Stadler³; Jochen Weller⁶; Jochen Kuhn¹

npj Science of Learning, v10 Article 11 2025

Recently, the option to use large language models as a middleware connecting various AI tools and other large language models led to the development of so-called large multimodal foundation models, which have the power to process spoken text, music, images and videos. In this overview, we explain a new set of opportunities and challenges that arise from the integration of large multimodal foundation models in education.

Descriptors: Artificial Intelligence, Technology Uses in Education, Models, Intermode Differences, Multimedia Materials, Barriers, Opportunities, Learning Modalities, Multimedia Instruction

Nature Portfolio. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://www.nature.com/npjscilearn/

Publication Type: Journal Articles; Reports - Descriptive

Education Level: N/A

Audience: N/A

Language: English

Sponsor: N/A

Authoring Institution: N/A

Grant or Contract Numbers: N/A

Author Affiliations: ¹Ludwig-Maximilians-Universität München, Chair of Physics Education, Faculty of Physics, Munich, Germany; ²Ludwig-Maximilians-Universität München, Chair of Education and Educational Psychology, Munich, Germany; ³University Hospital, Ludwig-Maximilians-Universität München, Institute of Medical Education, Munich, Germany; ⁴Technical University of Munich (TUM), Chair for Human-Centered Technologies for Learning, Munich, Germany; ⁵Technical University of Munich (TUM), Chair for Responsible Data Science, Munich, Germany; ⁶Ludwig-Maximilians-Universität München, Faculty of Physics, Munich, Germany; ⁷Ludwig-Maximilians-Universität München, Chair of Mathematical Foundations of Artificial Intelligence, Munich, Germany; ⁸The Arctic University of Norway, Department of Physics and Technology, Tromsø, Norway; ⁹DLR - German Aerospace Center, Oberpfaffenhofen, Germany; ¹⁰Saarland University, Department of Education, Campus A 4.2., Saarbrücken, Germany; ¹¹University of Augsburg, Chair of Learning Analytics and Educational Data Mining, Augsburg, Germany; ¹²Ludwig-Maximilians-Universität München, Chair of Human-Centered Ubiquitous Media, Munich, Germany