This article contributes to an emerging body of scholarship on multimodal composition in the poetry classroom through a study of Finnish lower secondary students' digital videomaking in response to poetry. The study explores students' use of semiotic resources in their interpretive work in transmediating a poem into a digital video, with a…

While multimodal composing has been systematically explored, there is hardly any research on how undergraduates use video and audio effects to communicate meanings. Effects are important because they facilitate the semiotic sculpting of the source visual and aural elements, making accessible an extra layer of semiotic potential. The present study…

The theorization of multimodality in academic scholarship is disconnected from how it is conceptualized by children. To bridge this gap, we analyzed 75 interviews with children about their digital video making. Analysis of their responses demonstrates children's socially-embedded, age-specific understandings of how modes operate, as well as when…

Classroom communication is increasingly accepted as multimodal, through the orchestrated use of different semiotic modes, resources, and systems. There is growing interest in examining the meaning-making potential of other modes (e.g., gestural, visual, kinesthetic) beyond the semiotic mode of language, in classroom communication and in student…

The meaning-making practices of science are multimodal and include representational forms such as spoken and written language, diagrams, graphs, equations, and images. Science learning proceeds through an ever-increasing grasp of such resources. This study aims at providing insight into how a combination of Interaction Analysis (IA) and social…

With the immense presence of English language video content in the online digital environment and students' everyday exposure to multimedia content, this project aims to explore how to replace traditional in-class presentation with video presentation within an autonomous learning environment, examine the impact of doing so on the development of…

Multimodal studies posit that meaning is not only communicated through spoken and written words, but also through other modes such as images, gesture, gaze, proximity etc. The widespread availability of high-quality, miniaturised audio and video recording and storing technology has made multimodal data collection cheap and easy. However, the…

This article describes the design and implementation of a project from a translanguaging pedagogical stance. The research presented seeks to understand how translanguaging as a multimodal practice shapes the experiences of students in a traditional English Language Arts 8th-grade classroom and how students leveraged their multimodal semiotic…

Purpose: This paper describes a study carried out within an ICLHE training programme in a Northern Italian university. The paper discusses the way an increased awareness of multimodal resources and the ability to deploy them effectively during lectures could offset language deficits of lecturers and enhance overall communicative competence and…

Multimodal composing is the construction of meanings through a combination of semiotic modes such as visual, audio, and textual to create multimodal texts. Studies have investigated the application of multimodal composing in the English language, in content area classrooms, and within various educational ESL and EFL contexts. However, the…

This article presents an analysis of a digital video created by a student (age 13) in a classroom setting. Since sign functioning is a key focus in theories of meaning making as it occurs through language and through other modes, my analysis focuses on the relations between signifiers as they are inscribed in her video. This analysis explores new…

This study develops a framework that integrates multimodality and translanguaging to analyze meaning-making in an online English teaching video. We consider pedagogy as more than teaching approaches and methods, but as a process of design that is realized by the orchestration of multimodal semiotic resources. In terms of multimodal analysis, we…

Translanguaging (TL) theory underscores individuals' agentive deployment of all semiotic resources to construct meaning, highlighting language as part of an integrated repertoire for communication. To explore the potential of pedagogical TL in Chinese vocabulary instruction, this paper focused on one Chinese Language Arts lesson from a larger…

In our civic engagement afterschool program in the southeast of the United States, our youth and adult participants used a wide range of modalities including mapping, rapping, drawing, and performance to construct and convey their unique visions of school and community spaces. The purpose of this methodological paper is to explore systemic…

The digital technology era has profoundly evolved and changed the ways that people consume and produce information. As language itself is recognized as a multimodal resource for communicative purposes, different forms of multimodality have been advocated to nurture students' multiliteracies in educational contexts. This study aims to investigate…