Mixing faces and voices: a study of the influence of faces and voices on audiovisual intelligibility
نویسندگان
چکیده
This study examined the influence of mixing faces and voices on the audiovisual intelligibility. The goal is to study the effect of combining two sources of information on the audiovisual intelligibility. Cross-talker dubbing was performed between faces and voices of 10 meaningful sentences pronounced by 10 talkers: 5 females and 5 males. Human subjects were asked to rate the articulation of the output videos. Comparisons were made between results of original and dubbed video. Almost across all the combinations, the audiovisual intelligibility was acceptable. The intelligibility of the speakers varied, however. We observed an influence of the audio/visual channel on the overall intelligibility that can increase or decrease depending the intelligibility results of this channel.
منابع مشابه
Benefits for Voice Learning Caused by Concurrent Faces Develop over Time.
Recognition of personally familiar voices benefits from the concurrent presentation of the corresponding speakers' faces. This effect of audiovisual integration is most pronounced for voices combined with dynamic articulating faces. However, it is unclear if learning unfamiliar voices also benefits from audiovisual face-voice integration or, alternatively, is hampered by attentional capture of ...
متن کاملEnhanced attention to speaking faces versus other event types emerges gradually across infancy.
The development of attention to dynamic faces versus objects providing synchronous audiovisual versus silent visual stimulation was assessed in a large sample of infants. Maintaining attention to the faces and voices of people speaking is critical for perceptual, cognitive, social, and language development. However, no studies have systematically assessed when, if, or how attention to speaking ...
متن کاملPerception of emotional congruency in multimodal speech synthesis
This working paper experimentally investigates the perception of emotional congruency in multimodal speech synthesis. Therefor two perceptual experiments are described. Experiment 1 is a preliminary test exploring inhowfar subjects are able to identify emotions in synthetic speech as well as in faces presented in short video-clips. Results show that subjects find it easier to recognize emotions...
متن کاملPerceptions of human attractiveness comprising face and voice cues.
In human mate choice, sexually dimorphic faces and voices comprise hormone-mediated cues that purportedly develop as an indicator of mate quality or the ability to compete with same-sex rivals. If preferences for faces communicate the same biologically relevant information as do voices, then ratings of these cues should correlate. Sixty participants (30 male and 30 female) rated a series of opp...
متن کاملConcordant Cues in Faces and Voices
Information from faces and voices combines to provide multimodal signals about a person. Faces and voices may offer redundant, overlapping (backup signals), or complementary information (multiple messages). This article reports two experiments which investigated the extent to which faces and voices deliver concordant information about dimensions of fitness and quality. In Experiment 1, particip...
متن کامل