Recently, the option to use large language models as a middleware connecting various AI tools and other large language models led to the development of so-called large multimodal foundation models, which have the power to process spoken text, music, images and videos. In this overview, we explain a new set of opportunities and challenges that…

In various technology-enhanced learning (TEL) environments, knowledge co-creation progresses through multimodal interactions that integrate verbal and nonverbal modalities, such as speech and gestures. This study investigated two distinct analytical approaches for analyzing multimodal interactions--triangulating and interleaving--by applying them…

The purpose of this study was to determine how preservice teachers are being taught to use digital technologies to create multimodal ensembles in teacher preparation programs. A hermeneutic content analysis with a partially mixed sequential equal status designed study was used during this research. The three data sources explored and examined for…

This article explores the possibilities of incorporating collaborative digital storytelling into preservice teacher education to support teachers in learning about their students' rich perspectives on teaching and learning. Data were gathered in an elementary literacy methods course at a public university in the northeastern United States to…

Purpose: The purpose of this study is to examine the use of digital technologies by teachers and students in teaching and learning from a multimodal layer perspective. Design/methodology/approach: The article reviews 64 studies on technology use. A content analysis based on the theoretical concepts of "multimodal layers" was used to…

A fundamental responsibility of higher education institutions, across disciplines, is to develop student research skills. The exponential growth of digital scholarship, however, challenges traditional definitions of research. There is a need for deeper understanding of the ways in which students can develop and implement academic research skills…

Secondary science students still struggle to master scientific concepts and apply content-based knowledge. The instructional design behind the incorporation of innovative technology and the use of game-based learning (GBL) could be a key to increasing student acquisition of science knowledge. Using a mixed methods design, this study examined the…

This research investigates a cohort of bilingual Chinese teachers' use of a multimodal approach in their Chinese as a foreign language (CFL) teaching. The data include the participants' CFL teaching practices and their reflections on multimodal teaching as recorded in their theses and a focus group discussion. The theoretical underpinning of this…

This study examines the role of multimodality in facilitating service-learning goals. We report findings from qualitative interviews with 20 college instructors who have designed and facilitated multimodal community-engaged learning projects, identifying their motivations, goals, and the impact of these projects through reflections. Based on our…

This study examined 94 bilingual and emergent bilingual 10th grade students' perspectives on multimodal composing for academic purposes in their English Language Arts class. A social semiotics theoretical framework was employed to understand students' views of the affordances and constraints when composing three digital multimodal projects--a…

In the wake of all that educators are navigating these days, they've proven to be not only resilient, but also innovative. They continue intentionally finding new and exciting ways to create powerful learning opportunities for all students. Reinvent the Classroom, an initiative by Digital Promise, HP, Microsoft, and Intel, supports, celebrates,…

This book offers an important overview of technology-enhanced education in Southern Africa. With original research from Malawi, Mauritius, Namibia, South Africa, Tanzania and Zimbabwe, this book provides in-depth scientific scholarship focused on the dynamic multimodal learning environments in the region. With the onset of the COVID-19 pandemic,…

Purpose: This study was conducted in ninth- and tenth-grade classrooms with the goal of studying effective scaffolding for improving argumentative writing, both conventional and digital/multimodal. Design/methodology/approach: The author conducted a formative experiment in two high-school classrooms to study ways teachers integrated forms of…

In education the linguistic is the mode most commonly assessed because it is important for students to write clear, complex pieces to show their understanding of content. However, in worlds outside of classrooms additional modes, such as visual, aural, and digital are often used to convey messages. This article demonstrates the value of multimodal…

A student response system (clickers) was introduced into a second year introductory biochemistry class to improve student engagement and performance. The class was delivered in both internal and distance education (DE) modes, with the DE students receiving recordings of the lectures (including clicker activities). However, there was concern over…