Noise is a common impedance to easy and accurate speech understanding. In the presence of noise, speech processing mechanisms proceed with partial or ambiguous inputs, and listeners will engage additional cognitive resources to make sense of what they hear. The extent to which this is situation is affected by diminished exposure to a language is…

To build an Artificial Intelligence system that can assist us in daily lives, the ability to understand the world around us through visual input is essential. Prior studies train visual perception models by defining concept vocabularies and annotate data against the fixed vocabulary. It is hard to define a comprehensive set of everything, and thus…

Recent studies reported a differential multisensory integration (MSI) in autism spectrum disorder (ASD). Much of the research on MSI differences has focused on how visual stimuli influence speech processing. The present study takes a reverse perspective. We investigated if speech processing can affect the construction of low-level visual…

In real-world settings, vision language models (VLMs) should robustly handle naturalistic, noisy visual content as well as domain-specific language and concepts. For example, K-12 educators using digital learning platforms may need to examine and provide feedback across many images of students' math work. To assess the potential of VLMs to support…