In the current study we examine how hearing parents use multimodal cuing to establish joint attention with their hearing (n = 9) or deaf (n = 9) children during a free-play session. The deaf children were all candidates for cochlear implantation who had not yet been implanted, and each hearing child was age-matched to a deaf child. We coded…

Hugs are a pervasive practice characterizing human sociality. They involve the persons engaged in hugging as well as other persons who might witness it for various purposes. This article examines the social organization of hugging in family photography sessions. This organization integrates instructions to hug, orchestrated by photographers and…

This study investigated the role of contextual and prosodic information in turn-end estimation by means of a button-press task. We presented participants with turns extracted from a corpus of telephone calls visually (i.e., in transcribed form, word-by-word) and auditorily, and asked them to anticipate turn ends by pressing a button. The…

Psycholinguistic research on metaphor has focused on verbal material. Yet, metaphors frequently occur in a multimodal format, blending words and pictures to convey meaning. Here we compared verbal and multimodal metaphors by using item pairs where stimulus one was always a word (e.g., "language" in the metaphorical conditions and…

Although it is clear that unaccented referring expressions are associated with given information in a discourse, it is less clear what aspects of givenness are relevant. We examine whether listeners' expectation of givenness depends on repetition of a referring expression or on contextual evocation of a referent. The results from two visual world…

Speech in everyday conversations is riddled with discourse markers (DMs), such as "well," "you know," and "like." However, in many lab-based studies of speech comprehension, such DMs are typically absent from the carefully articulated and highly controlled speech stimuli. As such, little is known about how these DMs…

There is now a well-established literature showing that people anticipate upcoming concepts and words during language processing. Commonsense knowledge about typical event sequences and verbal selectional preferences can contribute to anticipating what will be mentioned next. We here investigate how temporal discourse connectives…

During face-to-face communication, people use visual cues about what their partners are attending to as they process language. An eyetracking experiment explored how addressees use speakers' eye gaze and head orientation while interpreting references to objects in a spatial task. Thirty-six naive director/matcher pairs seated face-to-face were…

When two people interact, reference presentation is shaped with the intention of supporting addressee understanding, allowing for ease of acceptance, thus minimizing overall collaborative effort. To date, analysis of such "audience design" has focused largely on adult-adult or adult-child interaction but seldom on adult-teenager…

It has been argued that people construct situation models during text reception and that these are analogous, multimodal representations of text grounded in perception and action. On the one hand, abundant evidence has been generated that recipients perceptually simulate features of the situation described in the text. On the other hand, findings…

The public debate on the use of the German nonbinary gender asterisk ("Lehrer*in" 'teacher') is emotionally charged. While it has been adopted by political and educational institutions, opponents argue that it is inappropriate for making persons identifying themselves beyond the male-female-dichotomy more visible. We investigated this…

It is well established in studies of two-party conversation that conversational partners jointly establish brief labels for repeatedly mentioned entities. When speaking to a new partner who is unfamiliar with the labels, speakers use longer expressions to facilitate understanding. How this process of audience design scales up to multiparty…

Taken together, the Coherence Principle of Multimedia Learning Theory and the Integrated Systems Hypothesis propose that co-occurring and semantically congruent verbal and visual information should be integrated into one mental representation that enhances memory. The purpose of this paper was to examine how learning pseudowords with matching…

In two experiments this study tested the "Graded Salience Hypothesis" and the "Defaultness Hypothesis." It weighs the effects of linguistic versus pictorial contexts in terms of activation (or suppression) of default, salient meanings when context invites nondefault, less-salient alternatives. Using a naming task, Experiments 1…

We often use pronouns like it or they without explicitly mentioned antecedents. We asked whether the human processing system that resolves such indirect pronouns uses the immediate visual-sensory context in multimodal discourse. Our results showed that people had no difficulty understanding conceptually central referents, whether explicitly…