Viewing a speaker's articulatory movements substantially improves a listener's ability to understand spoken words, especially under noisy environmental conditions. It has been claimed that this gain is most pronounced when auditory input is weakest, an effect that has been related to a well-known principle of multisensory integration--"inverse effectiveness." In keeping with the predictions of ...

Many electronic devices that we use in our daily lives provide inputs that need to be processed and integrated by our senses. For instance, ringing, vibrating, and flashing indicate incoming calls and messages in smartphones. Whether the presentation of multiple smartphone stimuli simultaneously provides an advantage over the processing of the same stimuli presented in isolation has not yet bee...

Temporal proximity is a critical determinant for cross-modal integration by multisensory neurons. Information content may serve as an additional binding factor for more complex or less natural multisensory information. Letters and speech sounds, which form the basis of literacy acquisition, are not naturally related but associated through explicit learning. We investigated the relative importan...

Currently debate exists relating to the interplay between multisensory processes and bottom-up and top-down influences. However, few studies have looked at neural responses to newly paired audiovisual stimuli that differ in their prescribed relevance. For such newly associated audiovisual stimuli, optimal facilitation of motor actions was observed only when both components of the audiovisual st...

Superior colliculus (SC) neurons have the ability to synthesize information from different sensory modalities, resulting in enhancements (or depressions) of their activity. This physiological capacity is, in turn, closely tied to changes in overt attentive and orientation responses. The present study shows that, in contrast to more altricial species, many deep layer SC neurons in the rhesus mon...

UNLABELLED How multiple sensory cues are integrated in neural circuitry remains a challenge. The common hypothesis is that information integration might be accomplished in a dedicated multisensory integration area receiving feedforward inputs from the modalities. However, recent experimental evidence suggests that it is not a single multisensory brain area, but rather many multisensory brain ar...

The topic of this presentation is the use of additive-factor designs in combination with functional MRI to assess multisensory integration. Unisensory and multisensory stimuli were presented across two different pairings of sensory systems, audio-visual (AV) and visuohaptic (VH). In addition to stimulus modality, signal-to-noise ratio (SNR) was included as an additive factor. Previous research ...

The deep layers of the superior colliculus (SC) integrate multisensory inputs and initiate an orienting response toward the source of stimulation (target). Multisensory enhancement, which occurs in the deep SC, is the augmentation of a neural response to sensory input of one modality by input of another modality. Multisensory enhancement appears to underlie the behavioral observation that an an...

Multisensory plasticity enables us to dynamically adapt sensory cues to one another and to the environment. Without external feedback, "unsupervised" multisensory calibration reduces cue conflict in a manner largely independent of cue reliability. But environmental feedback regarding cue accuracy ("supervised") also affects calibration. Here we measured the combined influence of cue accuracy an...

According to conventional wisdom, multisensory development is a progressive process that results in the growth and proliferation of perceptual skills. We review new findings indicating that a regressive process - perceptual narrowing - also contributes in critical ways to perceptual development. These new data reveal that young infants are able to integrate non-native faces and vocalizations, t...