This paper examines the problem of estimating stream weights for a multistream audio-visual speech recogniser in the context of a simultaneous speaker task. The task is challenging because signalto-noise ratio (SNR) cannot be readily inferred from the acoustics alone. The method proposed employs artificial neural networks (ANNs) to estimate the SNR from HMM state-likelihoods. SNR is converted t...

Speech recognition can be improved by using visual information in the form of lip movements of the speaker in addition to audio information. To date, state-of-the-art techniques for audio-visual speech recognition continue to use audio and visual data of the same database for training their models. In this paper, we present a new approach to make use of one modality of an external dataset in ad...

It is well known that simultaneous presentation of incongruent audio and visual stimuli can lead to illusory percepts. Recent data suggest that distinct processes underlie non-specific intersensory speech as opposed to non-speech perception. However, the development of both speech and non-speech intersensory perception across childhood and adolescence remains poorly defined. Thirty-eight observ...

To find objects of interest in a cluttered and continually changing visual environment, humans must often ignore salient stimuli that are not currently relevant to the task at hand. Recent neuroimaging results indicate that the ability to prevent salience-driven distraction depends on the current level of attentional control activity in frontal cortex, but the specific mechanism by which this c...

We investigate the neural basis of two routes to visual distraction: salient stimuli capture attention in a bottom-up fashion and the reappearance of task-irrelevant items that are being actively maintained in working memory can lead to distraction via top-down, but automatic, guidance of attention. Bottom-up, stimulus-driven distraction has typically been associated with a ventral network inco...

Audio-visual quality assessment remains as a complex research field. A great effort is being made to understand how visual and auditory domains are integrated processed by humans. In this work, we analyzed compared the results of three psychophisical experiments that collected content scores given pool subjects. The include diverse audio-visual material, e.g., Sports, TV Commercials, Interviews...

After exposure to asynchronous sound and light stimuli, perceived audio-visual synchrony changes to compensate for the asynchrony. Here we investigate to what extent this audio-visual recalibration effect transfers to visual-tactile and audio-tactile simultaneity perception in order to infer the mechanisms responsible for temporal recalibration. Results indicate that audio-visual recalibration ...