The current study investigated whether those with higher levels of autism-like traits process emotional information from speech differently to those with lower levels of autism-like traits. Neurotypical adults completed the autism-spectrum quotient and an emotional priming task. Vocal primes with varied emotional prosody, semantics, or a combination, preceded emotional target faces. Prime-target pairs were congruent or incongruent in their emotional content. Overall, congruency effects were found for combined prosody-semantic primes, however no congruency effects were found for semantic or prosodic primes alone. Further, those with higher levels of autism-like traits were not influenced by the prime stimuli. These results suggest that failure to integrate emotional information across modalities may be characteristic of the broader autism phenotype.