Recently, the option to use large language models as a middleware connecting various AI tools and other large language models led to the development of so-called large multimodal foundation models, which have the power to process spoken text, music, images and videos. In this overview, we explain a new set of opportunities and challenges that…

Metaverse has evolved as one of the popular research agenda that let users learn, socialize, and collaborate in a networked 3-D immersive virtual world. Due to the rich multimedia streaming capability and immersive user experience with high-speed communication, the metaverse is an ideal model for education, training, and skill development tasks.…

Background: Multimedia learning, encapsulating both visual and verbal information, has become pivotal in educational settings, with extensive research underscoring its influence. However, a notable research gap exists concerning the application and effectiveness of multimedia learning principles, precisely segmenting, pre-training and modality,…

The goal of this qualitative study was to answer the question: How do educators make sense of learning in virtual reality? This study utilized multimedia learning theory and cognitive load theory to explore how educators understand virtual reality in education. Pre- and post-interviews as well as a VR experience were conducted with 13 educators…

Scholars have long praised the ways in which film can provide students with an opportunity for deep intellectual and emotional connections to classroom material. With contemporary technology, however, instructors are instead turning toward shorter audiovisual material that can be accessed with little preparation, take up less class time, and cater…

The application and investigation of various virtual world experiences in language learning have been on the rise. However, mixed reality (MR) has received limited attention due to its ambiguous concepts, unclear affordances, and insufficient incorporation of theoretical frameworks. To promote the investigation and implementation of MR-enhanced…

The current study introduced and assessed the effectiveness of a multimedia-based instructional strategy to enhance the technology integration self-efficacy of 98 special education pre-service teachers. 78% of participants demonstrated growth in their self-efficacy scores. Specifically, pre-service teachers with initial low and medium…

Principles derived from the Cognitive Theory of Multimedia Learning (CTML; Mayer in: Multimedia learning, Cambridge University Press, Cambridge, 2021) provide valuable guidance for enlisting commonly-available technologies to create effective online multimedia lessons. Specifically, CTML can guide instructional designers on the use of…

Immersive storytelling (IST) is usually conceptualized within the framework of technologically immersive tools such as virtual, augmented, and mixed reality. While these tools offer some unique features (such as visual fidelity, interactivity, and embodied, first-person perspective), their level of technological immersion (based on the system's…

In this article, the research of multimedia teaching video content feature extraction is carried out. According to the file structure, data type, and storage mechanism of the teaching video, a program is developed to automatically extract the structural features of the teaching video content, and a storage and retrieval database is established.…

Technology provides instant information. Appropriate use of diverse types of technology is important in the classroom including a virtual classroom, and integration of technology will enhance the student learning experience. Utilizing a variety of technology will actively engage students with learning objectives, generate communications among…

Background: Given the current technological advancements and the growing need for remote education, multimedia learning has become more popular among teachers and students. Therefore, the creation of multimedia teaching programmes that can improve learning outcomes has become increasingly important. However, there is a lack of research on whether…

Two studies were conducted to ascertain whether or not the embodiment principle of the Cognitive Theory of Multimedia Learning would apply to student's use of cameras in synchronous online instruction. Results from a cross-sectional dataset indicate that students who utilize their cameras report more positive outcomes than students who do not…

This article is based on the application research of multimedia feature extraction technology in the development of vocal performance teaching in universities. Combining with the core image and sound modules in feature extraction technology, this article proposes an application model of multimedia feature extraction technology based on image HOG…

While the challenges of collecting multiple streams of digital trace data are diminishing with the help of the rapid development of learning technologies, the challenges of analyzing and understanding multimodal interactions remain substantial. Diverse multimodal data sources, such as digital tool use, speech, gesture, and more, can make it…