The emergence of e-literature -- texts created on and for digital devices -- has coincided with innovative, transgressive methods of storytelling. "Pry," an iOS-based text, exemplifies e-literature's potential to rethink traditional narrative conventions. Rather than depict the real-world as we experience it (i.e. mimesis),…

In this article, I examine how forms of new media, or social and digital media (SDM), can serve as conduits of participatory democracy while, at the same time, perpetuate the cannibalization of a cornerstone of democracy: public schools. I discuss how this new era of unprecedented access to content creation and dissemination has opened spaces and…

There is a call for exploring the narrative transportation and reading performance among multimodality readings, i.e., single modality (text), dual modality (text + picture), and tri-modality (text + picture + audio). Altogether 42 junior high-school participants native in Chinese from an urban city in P.R. China were invited to the 90-minute…

Background: Multimedia Advocacy is the use of digital technology for people with intellectual disabilities as means of developing identities, being heard, connecting to family and care networks and, advocating for change. Methods: We explore principles and theories that underpin Multimedia Advocacy, mapping disciplinary approaches that have…

The COVID-19 pandemic forced educators to adapt to remote and hybrid learning environments, resulting in an unprecedented increase in the use of digital resources in secondary mathematics classrooms. The purpose of this dissertation was to explore the impact of COVID-19 on the use of digital resources in secondary mathematics classrooms, and to…

This research aimed to determine the effects of motivational scaffolding and adaptive scaffolding on academic and online self-efficacy in learners interacting with a multimedia learning environment within the field of technology. The study involved 146 students from four tenth-grade classes at a public institution in the municipality of Soacha…

Multimodal text types hold promise for promoting classroom discourse. Because of the ways that language combines with various other modes such as sound and movement, video-based texts can offer access points for meaning-making and engagement that print-only text cannot. Through the lens of New Literacies, this mixed methods study examines one…

Objective: This study aimed to evaluate the long-term effects of multimodal language rehabilitation on second language acquisition and recovery in bilingual aphasic patients. Methods: The data of 78 bilingual aphasic patients who underwent language rehabilitation at the language rehabilitation team consisting of students and experts in this field…

As digital transformation reshapes early childhood education, Science Discovery Children's Museums (SDCMs) emerge as uniquely positioned spaces to foster rich, multimodal learning environments that extend early literacy learning beyond the museum walls through family engagement. This paper presents a case study of an 8-week transmedia program…

Teachers who are flipping instruction face the challenging task of selecting or creating high-quality videos for their students. This article presents a framework for evaluating videos and describes the benefits of including interactive features and considering options beyond lecture videos.

Most research on learning technology uses clickstreams and questionnaires as their primary source of quantitative data. This study presents the outcomes of a systematic literature review of empirical evidence on the capabilities of multimodal data (MMD) for human learning. This paper provides an overview of what and how MMD have been used to…

This study investigated the effectiveness of visual training or verbal training on how to use a text-picture processing strategy for learning from computer-based multimedia instructional material. Sixty-nine university students were randomly assigned to the verbal training group (students received text-based instruction for a text-picture…

With the rise of computer-assisted online learning tools such as the "Language Reactor," advanced captioning options such as dual subtitles (i.e. simultaneous display of on-screen texts in the first language and the second/foreign language) have gained much attention. However, little is known about how dual-subtitled viewing may be…

Research on the multimedia effect in testing indicates that static representational pictures (RPs) and, potentially, dynamic RPs that further subdivide the picture into segments may support students' mental processing. This might be especially relevant for mathematical word problems that pose high mental demands in a multistage solution process.…

Purpose: The paper shows the interpretive impact of different constructions of the point of view available to the reader/viewer in book and animated movie versions of a children's picture book, a novel for pre-adolescents/early teenagers, and a graphic novel for adolescents and adults. Design/Approach/Methods: Excerpts from book and animated movie…