Background: Science teaching and learning, as discursive practices, occur through the utilization of various semiotic modes. Gestures play a pivotal role as an embodied mode that acts in conjunction with speech in oral communication settings, such as classrooms. Previous research on gestures in chemistry and science education has illuminated how…

People communicate through language as well as visual embodied actions like gestures, yet audio remains the default recording technology in interview-based writing research. Given that texts and writing processes are understood to involve semiotic resources beyond language, interview talk should receive similar treatment. In this article, I…

Classroom communication is increasingly accepted as multimodal, through the orchestrated use of different semiotic modes, resources, and systems. There is growing interest in examining the meaning-making potential of other modes (e.g., gestural, visual, kinesthetic) beyond the semiotic mode of language, in classroom communication and in student…

Young children's play is highly multimodal, with gesture, gaze, movement and speech often combined simultaneously in collaborative meaning-making. This article argues for a multimodal social semiotic perspective on play, recognising that this requires representation of data that brings multimodal elements into careful consideration. In this…

Purpose: Our world had always been multimodal, but studying how young children enact and embody literacy practices, especially reading, has often been overlooked. The purpose of this study was to examine how young children respond to nonfiction picturebooks in multimodal ways. This paper aims to answer the question: What multimodal resources do…

In recent years, research in multimodality has established the benefits of using multiple semiotic modes like image, sound, and text in digital second language (L2) communication. However, researchers have yet to investigate how L2 learners make meaning through embodied modes--or gestures and facial expressions. Grounded in the social semiotic…

Purpose: This paper describes a study carried out within an ICLHE training programme in a Northern Italian university. The paper discusses the way an increased awareness of multimodal resources and the ability to deploy them effectively during lectures could offset language deficits of lecturers and enhance overall communicative competence and…

Lectures prevail as a ubiquitous teaching and learning method across universities worldwide. Whereas lectures have been conceptualized from language-centred perspectives, lectures' materiality as linked to their socio-cultural and historical meanings have been scarcely explored. To address this gap, we tackle the materiality of communication in…

Twitter has become a common feature of academic conferences, used by organizers to provide information about the conference and by attendees to engage in discussion about the conference topics, share information, and create social links and networks within the community. This study examines the tweets from two conferences in Applied Linguistics in…

The aim of this study is to better understand how teachers use various embodied semiotic modes -- speech, gestures, gaze, and proxemics -- when they present scientific content to the entire class. To analyse the multimodal practices of these teachers, we integrated the social semiotic theory of multimodality and the joint action theory in…

This research explores young Indigenous children's multimodal meaning-making to carry out social intentions in dramatic and construction/materials play settings. The participants are two teachers and 21 children from two Northern Canadian Indigenous communities. Underpinned by social semiotic theory, the research involves inductive analyses of six…

This article presents an analysis of a digital video created by a student (age 13) in a classroom setting. Since sign functioning is a key focus in theories of meaning making as it occurs through language and through other modes, my analysis focuses on the relations between signifiers as they are inscribed in her video. This analysis explores new…

Translanguaging and trans-semiotizing research has problematized the static view of language and argued that meaning making is a dynamic, material, social, and historical process across multiple timescales in complex eco-social systems. The second author proposed the concept of trans-semiotizing as an alternative lens to study language teaching…

This study's focus was two-fold, first to look at forms of gestures teachers of multilingual mathematics classes use during teaching; and second to find out how teachers of multilingual mathematics classes utilize learners' home language, language of learning and teaching and gestures to foster understanding in the teaching of mathematics. This…

This article reports findings on a case study of Ellie as she participates in a language arts curriculum that incorporates multimodal literacy practices--including photography, drama, and art--to teach reading and writing. Our study was informed by the theoretical framework of multimodal social semiotics, which provides insight into how…