This dissertation project began with the development of a Design-Focused Approach (DFA) to First-Year Composition (FYC) curriculum largely informed by multimodal pedagogical theory. In the DFA to FYC curriculum, I highlighted the importance of multiliteracy and the demand for multiple modalities for students to effectively communicate in various…

Recently, the option to use large language models as a middleware connecting various AI tools and other large language models led to the development of so-called large multimodal foundation models, which have the power to process spoken text, music, images and videos. In this overview, we explain a new set of opportunities and challenges that…

Calls for research in multimodality and multiliteracies have provided the field of writing studies with theories and outcomes suggesting that more research is necessary in FYC students' multimodal composing processes and literacy practices. Much of the research in New Literacies Studies (NLS) focuses on students' final products. This dissertation…

This study was an examination of the micro-learning method, which is a mobile learning approach. To examine the preferences of learners regarding the microlearning method, a course consisting of educational videos and information on online tables was presented at Anadolu University using the Moodle Platform AKADEMA. The research methodology used…

Numerous studies have compared the effect of input mode (video-based vs. audio-only) on the listening comprehension of adult second language (L2) learners. However, there is a notable absence of research regarding how various types of audio-visual input in a listening test affect young learners' listening comprehension. To address this gap, this…

Digital gameplay and digital multimodal composition (DMC) are promising multimodal literacy practices. Nevertheless, research on their incorporation in literacy classrooms to foster students' multimodal literacy skills is lacking. This qualitative case study explored how two groups of Chinese adolescents used multimodal literacy in digital…

This article examined the use of film in higher education to inspire imagination and motivate learning in students with learning differences. It highlighted the benefits of film in enhancing education and fostering imagination and diverse, critical thinking. The findings demonstrated that film is a pedagogical instrument that may assist students…

Lecture recording is an increasingly common practice in UK universities, whereby audio, video, and multimedia content from lecture theatres can be captured and distributed online. Despite a large body of recent lecture capture literature, much of the empirical research adopts positivist paradigms, which overlooks the complex and unpredictable…

Purpose: Multimedia facilitates knowledge acquisition, which has a significant impact on students' learning and is a big potential of information and communication technology. Learning through multimedia has psychological benefits for the learner in addition to being used for recreational learning. To define the cognitive theory of multimedia in…

This study examined how seven American undergraduate students leveraged multiple modes to reflect on language, culture, and identity while learning French in a study abroad program. Grounded in the social semiotic framework of multimodality, this qualitative study applied open, axial, and selective coding to analyze students' interviews and…

Engaging second language (L2) students in multimodal academic writing that leverages multiple semiotic resources has the potential to foster their awareness of audience, purpose, and other rhetorical features. This case study explores L2 students' engagement in a multimodal digital storytelling (DST) project. The study reports on how DST was…

Purpose: The paper shows the interpretive impact of different constructions of the point of view available to the reader/viewer in book and animated movie versions of a children's picture book, a novel for pre-adolescents/early teenagers, and a graphic novel for adolescents and adults. Design/Approach/Methods: Excerpts from book and animated movie…

Although a modality effect indicating better learning from an animation with spoken learning guidance than from an animation with written learning guidance has often been found in research on learning from animation, the effect has hardly been investigated for learning from computer simulation. This study examined the interaction effects between…

Technology-mediated communication has become ubiquitous and digital multimodal learning has been increasingly integrated into second language education. Drawing on the concepts of transmediation and interpretant in social semiotic theories, this study explores the potential of digital storytelling (DST) in promoting EFL learners' willingness to…

This essay reevaluates the role of reflection in experiential learning programs, contrasting traditional solitary ref lection methods with contemporary approaches that integrate collaboration and multimodal expression. These new approaches highlight a shift toward more flexible and interactive methods, reflecting the influence of new technologies…