Children with autism spectrum disorders have been reported to be less influenced by a speaker's face during speech perception than those with typically development. To more closely examine these reported differences, a novel visual phonemic restoration paradigm was used to assess neural signatures (event-related potentials [ERPs]) of audiovisual…

Despite immense variability across languages, people can learn to understand any human language, spoken or signed. What neural mechanisms allow people to comprehend language across sensory modalities? When people listen to speech, electrophysiological oscillations in auditory cortex entrain to slow (<8 Hz) fluctuations in the acoustic envelope.…

Although hearing often declines with age, prior research has shown that older adults may benefit from multisensory input to a greater extent when compared to younger adults, a concept known as inverse effectiveness. While there is behavioral evidence in support of this phenomenon, less is known about its neural basis. The present functional MRI…

Seeing articulatory gestures enhances speech perception. Perception of auditory speech can even be changed by incongruent visual gestures, which is known as the McGurk effect (e.g., dubbing a voice saying /mi/ onto a face articulating /ni/, observers often hear /ni/). In children, the McGurk effect is weaker than in adults, but no previous…

Successful communication in everyday life crucially involves the processing of auditory and visual components of speech. Viewing our interlocutor and processing visual components of speech facilitates speech processing by triggering auditory processing. Auditory phoneme processing, analyzed by event-related brain potentials (ERP), has been shown…

Studies have suggested that supramodal attentional resources are biased rightward due to asymmetric spatial fields of the two hemispheres. This bias has been observed especially in right-handed subjects. We presented left and right-handed subjects with brief uniform grey visual stimuli in either the left or right visual hemifield. Consistent with…

Many current theories of false memories propose that, when we retrieve a memory, we are not reactivating a veridical, fixed representation of a past event, but are rather reactivating incomplete fragments that may be accurate or distorted and may have arisen from other events. By presenting the two phases of the misinformation paradigm in…

During speech communication, visual information may interact with the auditory system at various processing stages. Most noteworthy, recent magnetoencephalography (MEG) data provided first evidence for early and preattentive phonetic/phonological encoding of the visual data stream--prior to its fusion with auditory phonological features [Hertrich,…

Infants' speech perception abilities change through the first year of life, from broad sensitivity to a wide range of speech contrasts to becoming more finely attuned to their native language. What remains unclear, however, is how this perceptual change relates to brain responses to native language contrasts in terms of the functional…

Everyday conversation is both an auditory and a visual phenomenon. While visual speech information enhances comprehension for the listener, evidence suggests that the ability to benefit from this information improves with development. A number of brain regions have been implicated in audiovisual speech comprehension, but the extent to which the…

When presented with alternating low and high tones, listeners are more likely to perceive 2 separate streams of tones ("streaming") than a single coherent stream when the frequency separation ([delta]f) between tones is greater and the number of tone presentations is greater ("buildup"). However, the same large-[delta]f sequence reduces streaming…

Speech is not a purely auditory signal. From around 2 months of age, infants are able to correctly match the vowel they hear with the appropriate articulating face. However, there is no behavioral evidence of integrated audiovisual perception until 4 months of age, at the earliest, when an illusory percept can be created by the fusion of the…

Two experiments were conducted to examine the performance of normal adults, normal children, and children diagnosed with central auditory dysfunction presumed to involve the interhemispheric pathways on a dichotic digits test in common clinical use for the diagnosis of central auditory processing disorder (CAPD) and its corresponding visual…

Patients with lesions of the left hemisphere often suffer from oral-facial apraxia, apraxia of speech, and aphasia. In these patients, visual features often play a critical role in speech and language therapy, when pictured lip shapes or the therapist's visible mouth movements are used to facilitate speech production and articulation. This demands…

Event-related potential (ERP) studies have demonstrated impaired auditory sensory processing in patients with schizophrenia, as reflected in abnormal mismatch negativity (MMN). We sought to extend this finding by evaluating MMN in 13 treatment-refractory patients with schizophrenia, and 14 age- and gender-matched healthy controls. Subjects…