Recently, the option to use large language models as a middleware connecting various AI tools and other large language models led to the development of so-called large multimodal foundation models, which have the power to process spoken text, music, images and videos. In this overview, we explain a new set of opportunities and challenges that…

Lecture recording is an increasingly common practice in UK universities, whereby audio, video, and multimedia content from lecture theatres can be captured and distributed online. Despite a large body of recent lecture capture literature, much of the empirical research adopts positivist paradigms, which overlooks the complex and unpredictable…

Although a modality effect indicating better learning from an animation with spoken learning guidance than from an animation with written learning guidance has often been found in research on learning from animation, the effect has hardly been investigated for learning from computer simulation. This study examined the interaction effects between…

Background: "Screen inferiority" refers to a well-established phenomenon observed among adults and teenagers, wherein they demonstrate higher reading comprehension when reading from paper compared to screens. However, there is limited research focusing on readers in the initial stages of reading development. The current study aims to…

Multimedia principles such as segmentation, learner control, and modality have been proposed to ensure animated demonstrations (AD) effectiveness. However, several studies that apply multimedia principles in different learning contexts with different learners have found boundary conditions for several effects. This study thus aimed to investigate…

Current literature mainly focused on one or two multimedia learning principles in traditional learning environments. Studies on multimedia learning principles in AR and VR environments are also limited. To reveal the current situation and gaps of the multimedia learning principles in different learning environments, it is necessary to extend their…

One of the strongest instructional interventions documented in educational literature is the use of feedback to influence learning outcomes. However, there is lack of empirical research specifically pertaining to the use of multimedia in the feedback message. The purpose of this research was to test whether organizational pictures and modality as…

This paper explores work in multimodality and design as it relates to 21st century multiliteracies. After outlining the concept of a multiliteracies pedagogy, this paper describes multimodality and multimodal texts. Moving from the theoretical to the practical, this paper primarily explores selected multimodal works of Shaun Tan and the…

Multimodal texts are now part of the curriculum for school English, but they are by their nature inherently complex, and pose many challenges for the classroom. Not least is finding a way to manage the technical complexity of accounting for these texts, as well as finding a way to move students beyond simple observation and description to critical…

The purpose of this study was to examine if student understanding of new material could be promoted by manipulating the perceptual factors experienced at the time of learning. It was hypothesized that the thematic relevance of perceptual factors would be a significant contributor to learner understanding. To test this hypothesis, one hundred…

In this article, Joshua Block states that his high school students are creators discovering how to express their ideas and emotions in multiple, complex ways. He teaches students who write their lives through words on pages as they fill journal after journal. There are others who constantly write and create in the form of tweets, photos, videos,…

The purpose of the study is to better understand the role of physicality, interactivity, and interface effects in learning with digital content. Drawing on work in cognitive science, human-computer interaction, and multimedia learning, the study argues that interfaces that promote physical interaction can provide "conceptual leverage"…

This article explores disruption of habituated literacy practices through the creation of new possibilities in a digital space. Preservice English method teachers at a Melbourne university were invited to create a digital introduction and to reflect after the presentation on aspects of technology, representation and learning that were brought into…

Contemporary curriculum guidelines, such as those provided in the incoming Australian curriculum, call for English to attend to multimodal forms of text and literacy as well as more traditional forms. Students are expected to become capable and critical readers, users and creators of texts and forms of literacy that span everything from newspapers…

This paper draws from research conducted as part of an Australian Research Council funded Linkage Project "Teaching effective 3D authoring in the middle years: multimedia grammatical design and multimedia authoring pedagogy", which is a collaboration between the University of New England, the University of Tasmania and the Australian…