Background: Science teaching and learning, as discursive practices, occur through the utilization of various semiotic modes. Gestures play a pivotal role as an embodied mode that acts in conjunction with speech in oral communication settings, such as classrooms. Previous research on gestures in chemistry and science education has illuminated how…

Collaborative Video Annotation (CVA) is a kludge where learners annotate video together, experiencing both the video and each other's annotations in a dynamic discussion. Three scenes from small group CVA discussions were selected for analysis from 14 CVA discussions where 8-12 learners interacted via the annotation tool on top of a video. The…

Today's use of technology and media in daily life has altered the dominant role the written word has played in communication over centuries. Currently, educational settings take into consideration the combination of different modes of representation that exist in an array of everyday texts. "Developing knowledge about linguistic, visual and…

While multimodal composing has been systematically explored, there is hardly any research on how undergraduates use video and audio effects to communicate meanings. Effects are important because they facilitate the semiotic sculpting of the source visual and aural elements, making accessible an extra layer of semiotic potential. The present study…

In telecollaboration research, scholars have broadened their focus from the purely linguistic details of online intercultural encounters to include its multimodal dimensions. Yet, no study to date has explored spatial repertoires, namely the totality of semiotic resources (e.g., speech, image, objects) embedded in a particular environment and used…

In recent years, research in multimodality has established the benefits of using multiple semiotic modes like image, sound, and text in digital second language (L2) communication. However, researchers have yet to investigate how L2 learners make meaning through embodied modes--or gestures and facial expressions. Grounded in the social semiotic…

Moving from one educational setting to another is often accompanied by various psychological and emotional stressors. In the case of English education in Japan this is exacerbated further by an enduring ideological division in the field between English for test-taking and the use of English as a communicative tool. In order to explore potential…

With the immense presence of English language video content in the online digital environment and students' everyday exposure to multimedia content, this project aims to explore how to replace traditional in-class presentation with video presentation within an autonomous learning environment, examine the impact of doing so on the development of…

"Generation Z" multilingual writers are caught up in a globalized/globalizing and superdiverse linguistic and cultural contact zone as well as a neoliberal political and institutional environment. To understand how they inhabit their idiosyncratic literate worlds and practice their differences, I aligned myself with an ethnographic case…

Purpose: This paper describes a study carried out within an ICLHE training programme in a Northern Italian university. The paper discusses the way an increased awareness of multimodal resources and the ability to deploy them effectively during lectures could offset language deficits of lecturers and enhance overall communicative competence and…

The study of students' use of representations is one of the main topics of physics education research and is guided by the overarching field of semiotics. In this paper we compare two semiotic frameworks, one coming from didactics of mathematics and one from physics education research; "the theory of registers of semiotic…

Multimodal composing is the construction of meanings through a combination of semiotic modes such as visual, audio, and textual to create multimodal texts. Studies have investigated the application of multimodal composing in the English language, in content area classrooms, and within various educational ESL and EFL contexts. However, the…

Integrating concepts and techniques from ethnomethodology and sociomaterialism, this article investigates the observable material processes involving human action and place-based contexts of language use enabled by locative media. The focal pedagogical intervention utilized mobile augmented reality (AR) activities, the development of which was…

Recent research on stakeholders' emotions in English-medium instruction (EMI) higher education settings has demonstrated the importance of engaging students with their emotions about the impact of EMI on their lives. This article presents a pedagogical intervention bridging emotions, creativity, and translingual pedagogy with EMI students in…

Twitter has become a common feature of academic conferences, used by organizers to provide information about the conference and by attendees to engage in discussion about the conference topics, share information, and create social links and networks within the community. This study examines the tweets from two conferences in Applied Linguistics in…