When interacting with young children, adults often self-repeat their own utterances that vary in sequences of adjacent utterances called variation sets (VS) (Küntay and Slobin 1996). These repetitions benefit children's linguistic development because they emphasize form and meaning. This paper analyzes the use of VS during group interaction and…

This longitudinal study (data collected from 2019 to 2023) examines the relation between Spanish-English bilingual Latino toddlers' (n=46; F=22; M=24) early gesture production (Mage=18.67 months; SD[subscript age]=1.02) and later language skills (M[subscript age]=36.87 months; SD[subscript age]=0.81). Video recordings at child-age 18-months…

This article examines verbal and non-verbal communication between the interpreter and the injured party in a video-recorded main hearing of a criminal matter at a court of first instance in Finland. The language of the court was Finnish and the interpreter and injured party communicated in French, the interpreter's B language and the injured…

The study adopts a multimodal perspective, looking at adults' use of gestures in variation sets (VS; i.e. sequences of partial self-repetitions occurring in successive utterances of varying form) addressed to Spanish-learning toddlers in adult-child interactions. We seek to address the following question: Do adults make simultaneous use of VS and…

In face-to-face interaction, speakers spontaneously produce manual gestures that can facilitate listeners' comprehension of spoken language. The present study explores the factors affecting the uptake and influence of gesture cues in situations where a speaker is referring to objects visible to the listener. In this context, the listener's…

We explore multi-modal machine learning-based approaches (facial expression recognition, auditory emotion recognition, and text sentiment analysis) to identify "negative moments" of teacher-student interaction during classroom teaching. Our analyses on a large (957 videos, each 20min) dataset of classroom observations suggest that: (1)…

Studies have shown that iconicity can provide a benefit to non-signers during the learning of single signs, but other aspects of signed messages that might also be beneficial have received less attention. In particular, do other features of signed languages help support comprehension of a message during the process of language learning? The…

This article provides rich insights into the process of data generation for discourse analysis from three separate studies of the video recordings of a single science classroom in action. The central claim is that multimodal transcription can contribute to developments in discourse theory. A three-stage reflective heuristic is developed and used…

Delivery strategy is paramount in presentations regardless it is employed using video recording or live presentation. Nevertheless, demonstrating appropriate delivery strategies is challenging for many presenters, mainly when video recorded. The present study analyses tertiary level students' delivery strategies when they were required to prepare…

Cues to prominence such as beat gesture and contrastive pitch accent play an important role in constraining what is remembered. However, it is currently unclear how beat gesture affects online discourse processing alone and in combination with contrastive accenting. Using an adaptation of the visual world eye-tracking paradigm, we orthogonally…

This research investigates the enhancement of English public speaking skills among Thai EFL (English as a Foreign Language) students through imitating TED Talks videos. By applying Vygotsky's Zone of Proximal Development (ZPD) and Krashen's Input Hypothesis, the study integrates authentic materials for effective learning. A mixed methods approach,…

In teacher-fronted kindergarten classrooms, questions are an efficient strategy to attract students' attention and guide them through a lesson. However, few studies have examined the related issues by taking co-speech hand gestures into consideration. By annotating and analyzing a videotaped lesson in a Chinese public kindergarten, the present…

Children with autism spectrum disorders have been reported to be less influenced by a speaker's face during speech perception than those with typically development. To more closely examine these reported differences, a novel visual phonemic restoration paradigm was used to assess neural signatures (event-related potentials [ERPs]) of audiovisual…

Successful face-to-face communication involves multiple channels, notably hand gestures in addition to speech for spoken language, and mouth patterns in addition to manual signs for sign language. In four experiments, we assess the extent to which comprehenders of British Sign Language (BSL) and English rely, respectively, on cues from the hands…

Past research suggests that speakers gesture more when motor simulations are more strongly activated. We investigate whether simulations of a perceptual nature also influence gesture production. Participants viewed animations of a spider moving with a manner of motion that was either highly salient (n = 29) or less salient (n = 31) and then…