Binding and unbinding in audiovisual speech fusion: removing the Mcgurk effect by an incoherent preceding audiovisual context
نویسندگان
چکیده
The McGurk effect demonstrates the existence of a fusion process in audiovisual speech perception. We consider here the assumption that fusion is controlled by an upstream conditional binding process, which can block fusion in the case of strong audiovisual inconsistencies, as in the case of a dubbed film. To test this hypothesis, we designed two experiments in which a consistent or inconsistent audiovisual context is placed before McGurk stimuli, and we show that inconsistent contexts can remove the McGurk effect..
منابع مشابه
Effect of context, rebinding and noise, on audiovisual speech fusion
In a previous set of experiments we showed that audio-visual fusion during the McGurk effect may be modulated by context. A short context (2 to 4 syllables) composed of incoherent auditory and visual material significantly decreases the McGurk effect. We interpreted this as showing the existence of an audiovisual “binding” stage controlling the fusion process, incoherence producing “unbinding”,...
متن کاملBinding and unbinding the Mcgurk effect in audiovisual speech fusion: follow-up experiments on a new paradigm
The McGurk effect demonstrates the existence of a fusion process in audiovisual speech perception: the combination of the sound "ba" with the face of a speaker who pronounces "ga" is frequently perceived as "da". We assume that in the upstream of this phonetic fusion process, there is a “binding” process, which controls the combination of image and sound, and can block or reduce it in the case ...
متن کاملAudio-visual speech scene analysis: characterization of the dynamics of unbinding and rebinding the McGurk effect.
While audiovisual interactions in speech perception have long been considered as automatic, recent data suggest that this is not the case. In a previous study, Nahorna et al. [(2012). J. Acoust. Soc. Am. 132, 1061-1077] showed that the McGurk effect is reduced by a previous incoherent audiovisual context. This was interpreted as showing the existence of an audiovisual binding stage controlling ...
متن کاملModulating fusion in the McGurk effect by binding processes and contextual noise
In a series of experiments we showed that the McGurk effect may be modulated by context: applying incoherent auditory and visual material before an audiovisual target made of an audio “ba” and a video “ga” significantly decreases the McGurk effect. We interpreted this as showing the existence of an audiovisual “binding” stage controlling the fusion process. Incoherence would produce “unbinding”...
متن کاملBinding and unbinding the auditory and visual streams in the McGurk effect.
Subjects presented with coherent auditory and visual streams generally fuse them into a single percept. This results in enhanced intelligibility in noise, or in visual modification of the auditory percept in the McGurk effect. It is classically considered that processing is done independently in the auditory and visual systems before interaction occurs at a certain representational stage, resul...
متن کامل