Recently, the option to use large language models as a middleware connecting various AI tools and other large language models led to the development of so-called large multimodal foundation models, which have the power to process spoken text, music, images and videos. In this overview, we explain a new set of opportunities and challenges that…

Background: "Screen inferiority" refers to a well-established phenomenon observed among adults and teenagers, wherein they demonstrate higher reading comprehension when reading from paper compared to screens. However, there is limited research focusing on readers in the initial stages of reading development. The current study aims to…

This study examines the challenges of analyzing texts that are multimodal--that is, combining more than one mode of communication, such as written text, images, video, and/or audio--and considers the theoretical and practical implications of two very different approaches. The more common current approach, which adapts the work of Halliday and…

Academic attention to educational podcasts has grown significantly in recent years. However, to date, the concept of genres in podcasting is yet to gain scholarly attention. By examining genres emergent from a corpus of educational podcasts available online, this paper introduces the value of genre analysis to educational podcast research. It…

The study of comics is an important part of the project of critiquing normative assumptions underlying multimodality and composition. Extending the efforts of the authors of "Multimodality in Motion"--which explains that "multimodality as it is commonly used implies an ableist understanding of the human composer" (Yergeau et…

Although the implementation of multimodalities in education is much lauded by education research, the educational value of such formats is uncertain for education stakeholders. This study relied on the use of focus group interviews and field notes to better understand how a group of middle school students felt about their graphic novel reading…

Although research emphasizes the importance of reflection for productive learning, much of this work has focused on writing as the preferred mode. The goal of this study was to examine how two adolescent composers reflected on their multimodal visions and processes through multimodal means--in particular, how the students remixed research-provided…

In this article we argue that mobile, design, content, and social media technologies have fundamentally redefined the role of the writer in the workplace. Rather than the originator of content, the writer is becoming a sort of multimodal editor who revises, redesigns, remediates, and upcycles content into new forms, for new audiences, purposes,…

In this article we will discuss part of a piece of research that was conducted with two 4ESO groups. Textual learning is opposed to multimedia learning within the context of PLE's (Personal Learning Environment) reading tools and strategies. In the research an analysis was made of whether it would be possible to improve the reading process through…

The continued increase in the number of students participating in online degree programs has led to an increase in the number of students taking online composition courses. Currently, most online writing programs replicate approaches used in face-to-face composition courses and simply transfer them to the online learning environment. However,…

We investigated (1) whether the learning environment perceptions of students in classes frequently exposed to multimedia differed from those of students in classes that were not, (2) whether exposure to multimedia was differentially effective for males and females and (3) relationships between students' perceptions of the learning environment and…

The ability to develop and distribute digital teaching resources in higher education has developed rapidly over the last decade but research into how students use such resources has received limited attention. This study uses questionnaire results, Internet analytic data and semi-structured interviews to examine the use of three types of…

In previous semesters of our IT Ethics course, students created traditional final projects where they presented some topic in IT Ethics that we did not cover during the course. Students were free to choose how they would present their information with most groups choosing a traditional presentation where some members of the group were clearly…

There has been an increase in reliance on pre-recorded lectures (PRL) as a source of learning in place of live-lectures (LL) in higher education today but whether PRL can effectively replace LL remains unknown. We tested how students performed in the exam questions when PRL replaced LL. While PRL+ group included those students who watched the…

This study used eye movement modeling examples (EMME) to support students' integrative processing of verbal and graphical information during the reading of an illustrated text. EMME consists of a replay of eye movements of a model superimposed onto the materials that are processed for accomplishing the task. Specifically, the study investigated…