Neurocognition of speech-specific audiovisual percpetion
نویسندگان
چکیده
We have studied neurocognitive mechanisms of audiovisual perception of non-meaningful speech. We demonstrate different event-related brain potential (ERP) differences to non-speech and speech audiovisual stimuli. Our imaging studies show that viewing and listening to speech activate overlapping areas in the frontal cortex, which is also activated during speech production. We also demonstrate that subjects have to expect the auditory stimuli to be speech to integrate auditory and visual speech.
منابع مشابه
Neurocognition of speech-specific audiovisual perception
We have studied neurocognitive mechanisms of audiovisual perception of non-meaningful speech. We demonstrate different event-related brain potential (ERP) differences to non-speech and speech audiovisual stimuli. Our imaging studies show that viewing and listening to speech activate overlapping areas in the frontal cortex, which is also activated during speech production. We also demonstrate th...
متن کاملElectrophysiological evidence for speech-specific audiovisual integration.
Lip-read speech is integrated with heard speech at various neural levels. Here, we investigated the extent to which lip-read induced modulations of the auditory N1 and P2 (measured with EEG) are indicative of speech-specific audiovisual integration, and we explored to what extent the ERPs were modulated by phonetic audiovisual congruency. In order to disentangle speech-specific (phonetic) integ...
متن کاملA General Audiovisual Temporal Processing Deficit in Adult Readers With Dyslexia.
Purpose Because reading is an audiovisual process, reading impairment may reflect an audiovisual processing deficit. The aim of the present study was to test the existence and scope of such a deficit in adult readers with dyslexia. Method We tested 39 typical readers and 51 adult readers with dyslexia on their sensitivity to the simultaneity of audiovisual speech and nonspeech stimuli, their ...
متن کاملSpeech-specificity of two audiovisual integration effects
Seeing the talker’s articulatory mouth movements can influence the auditory speech percept both in speech identification and detection tasks. Here we show that these audiovisual integration effects also occur for sine wave speech (SWS), which is an impoverished speech signal that naïve observers often fail to perceive as speech. While audiovisual integration in the identification task only occu...
متن کاملAudiovisual asynchrony detection in human speech.
Combining information from the visual and auditory senses can greatly enhance intelligibility of natural speech. Integration of audiovisual speech signals is robust even when temporal offsets are present between the component signals. In the present study, we characterized the temporal integration window for speech and nonspeech stimuli with similar spectrotemporal structure to investigate to w...
متن کامل