Recently, the option to use large language models as a middleware connecting various AI tools and other large language models led to the development of so-called large multimodal foundation models, which have the power to process spoken text, music, images and videos. In this overview, we explain a new set of opportunities and challenges that…

Background: "Screen inferiority" refers to a well-established phenomenon observed among adults and teenagers, wherein they demonstrate higher reading comprehension when reading from paper compared to screens. However, there is limited research focusing on readers in the initial stages of reading development. The current study aims to…

This article explores disruption of habituated literacy practices through the creation of new possibilities in a digital space. Preservice English method teachers at a Melbourne university were invited to create a digital introduction and to reflect after the presentation on aspects of technology, representation and learning that were brought into…

This interpretive case study investigated how a fifth-grade teacher's social practices with visual and linguistic signs positioned her students (10- and 11-year-olds) to take up particular modes as they constructed digital compositions. The context of the study was a suburban public school in the northeastern United States. Analysis was threefold.…

This article examines synergies and gaps in the construction of English, literacy, multimodality in policy and curriculum in Australian education with a focus on current assessment practices and educational accountability in order to make recommendations for future practice for teachers and for policy-makers. The article builds on analyses of the…

This paper draws from research conducted as part of an Australian Research Council funded Linkage Project "Teaching effective 3D authoring in the middle years: multimedia grammatical design and multimedia authoring pedagogy", which is a collaboration between the University of New England, the University of Tasmania and the Australian…

In this article, the authors engage the theoretical lens of multimodality in rethinking the practices and processes of composing in classrooms. Specifically, they focus on how learning new composing practices led some fifth-grade students to author new literate identities--what they call authorial stances--in their classroom community. Their…

Given that many young children now enter their early years in education as competent and frequent users of digital technology, this paper examines how this experience influences children's perceptions of reading. Drawing from research conducted with 12 young children (aged 3-6) this paper reports on the ways in which these children were…

This paper reports an application of multimedia in a blended learning environment in which students engaged in multimodal presentations and peer group discussion. Students' presentation files were commented upon by their peers on the discussion board and scored by the researcher, based on questions developed by Levy and Kimber (2009) to apply…

This study investigated the effects of multimedia presentations on the efficiency of learning scientific information (i.e. information on basic anatomy of human brains and their functions, the definition of cognitive psychology, and the structure of human memory). Experiment 1 investigated whether the modality effect could be observed when the…

We present a new and innovative interface that allows the learner's body to move freely in a multimodal learning environment. The Situated Multimedia Arts Learning Laboratory ("SMALLab") uses 3D object tracking, real time graphics, and surround-sound to enhance embodied learning. Our hypothesis is that optimal learning and retention occur when…

Two experiments explored the integration of animated agents into multimedia environments in the context of R. E. Mayer's (2001) cognitive theory of multimedia learning. The spoken-narration-only condition outperformed other conditions, with no differences between printed text and printed text with spoken narration. (Author)