Recently, the option to use large language models as a middleware connecting various AI tools and other large language models led to the development of so-called large multimodal foundation models, which have the power to process spoken text, music, images and videos. In this overview, we explain a new set of opportunities and challenges that…

Ubiquitous acoustic sensors and actuators, i.e., microphones and loudspeakers, are among the most common components in consumer electronic devices. Traditionally, these components have been primarily used for sound-related tasks, including voice-user interfaces, sound playback, and sound event detection. However, with the growing demand for…

Research in languages and literacies in science education (LLSE) has developed substantial theoretical and pedagogical insights into how students learn science through language, discourse, and multimodal representations. At the same time, language is central to the functioning of generative artificial intelligence (GenAI). On this common basis…

Throughout the COVID-19 pandemic, faculty have had to restructure classes to new formats, and expectations of flexibility may remain if and when the pandemic subsides. Quizizz[TM] is an online platform for quizzing and interactive lessons suitable for in-person, online, and hybrid/hyflex classes. Quizizz, which is available for free or with an…

The goal of this chapter is to propose a cyclical process of how teachers can use multimodal multichannel data of cognitive, affective, metacognitive, motivational, and social processes to assist with the understanding of their own and their students' self-regulated learning (SRL), and their subsequent instructional decision making. What…

Most college students take lecture notes to prepare for tests. With technology development, more students are recording notes on laptops rather than writing them longhand. Previous studies comparing laptop and longhand note taking mediums yielded mixed results, highlighting the need to identify influencing factors. The present study investigated a…

Background: The COVID-19 pandemic has brought significant changes to medical education, particularly for procedural and surgical skills, which inherently require face-to-face education. The utility of adding an instructional video remains uncertain. To guide future curricula, our aim was to assess whether the addition of an optional instructional…

This study examined the impact of augmented reality (AR) on engineering education, focusing on spatial visualisation skills and cognitive load in an engineering drawing course. The research is based on cognitive load theory and spatial visualisation frameworks. It compares three AR methods--marker-based (MBAR), markerless (MLAR) and Web-based…

Due to the rapid development of internet technology, the field of education is undergoing a revolutionary change. The purpose of this study is to explore how new media mobile terminals affect the learning style of college students, paying special attention to the changes in learners' participation and autonomous learning ability. Traditional…

In various technology-enhanced learning (TEL) environments, knowledge co-creation progresses through multimodal interactions that integrate verbal and nonverbal modalities, such as speech and gestures. This study investigated two distinct analytical approaches for analyzing multimodal interactions--triangulating and interleaving--by applying them…

Online technology in academia offers an opportunity to improve high school students' academic achievement and graduation status. The purpose of this quantitative comparative study was to determine if or to what extent a statistically significant difference exists in the graduation status of full-time online versus traditional high school students…

Purpose: Multimedia facilitates knowledge acquisition, which has a significant impact on students' learning and is a big potential of information and communication technology. Learning through multimedia has psychological benefits for the learner in addition to being used for recreational learning. To define the cognitive theory of multimedia in…

This study employs a transcendental phenomenology case study approach to explore graduate student perspectives on multimodal assessments (MMAs) within an online environment. The primary objective is to understand how these students experience and perceive MMAs. To achieve this, semi-structured interviews were conducted to collect in-depth data…

The objective of this study was to determine the differential effects of the presentation position of the augmented reality--head worn display (AR-HWD) interface and the audiovisual-dominant multimodal learning material on learning performance and cognitive load across different learning tasks in training for high-speed train driving. We selected…

One of the factors associated with the educational use of video games is the conception that teachers and students have about their educative usefulness. However, there are no studies that identify what aspects are considered more effective to learn with video games and what kind of learning is more accessible using them. This study aims at…