A well-known definition of visualization is the mapping of initial data to a visual representation, which can be perceived and interpreted by humans. Human senses include not only vision, but also hearing, sense of touch, smell and others including their combinations. We discuss in this article multisensory scientific visualization, in other words scientific visualization extended with sound, h...

Effects of auditory training with bimodal audio-visual stimuli on monomodal aural speech intelligibility were examined in individuals with normal hearing using highly degraded noise-vocoded speech sound. Visual cue simultaneously presented with auditory stimuli during the training session significantly improved auditory speech intelligibility not only for words used in the training session, but...

Some sound changes seem to proceed at different rates depending on lexical frequency; these are often interpreted as reflecting phonetically detailed exemplar memories, with spreading via diffusion (Pierrehumbert 2002; Bybee 2012). However, such patterns do not necessarily require word-specific phonetic details. Variation associated frequency also exists when there is no evidence for a change i...

Auditory cortical plasticity can be induced through various approaches. The medial geniculate body (MGB) of the auditory thalamus gates the ascending auditory inputs to the cortex. The thalamocortical system has been proposed to play a critical role in the responses of the auditory cortex (AC). In the present study, we investigated the cellular mechanism of the cortical activity, adopting an in...

It has been argued that labels play a special role in cognitive development: hearing the same label associated with different entities facilitates categorization by directing infants’ attention to commonalities. The current study assessed 8-month-olds’ attention to commonalities and processing of visual input more generally when visual stimuli were presented without auditory input (baseline), a...

Size perception can be influenced by several visual cues, such as spatial (e.g., depth or vergence) and temporal contextual cues (e.g., adaptation to steady visual stimulation). Nevertheless, perception is generally multisensory and other sensory modalities, such as auditory, can contribute to the functional estimation of the size of objects. In this study, we investigate whether auditory stimu...

Food stimuli are multisensorial. Eating a particular type of food is associated with specific sound, odor, taste, color, form, texture, etc., that allows people to enjoy the diversity meals. The understanding consumers’ emotional experiences requires study each sensory component, isolated from other’s or combined, in different contexts and conditions. Virtual reality recent development offers u...

In autism, severe abnormalities in social behavior coexist with aberrant attention and deficient language. In the attentional domain, attention to people and socially relevant stimuli is impaired the most. Because socially meaningful stimulus events are physically complex, a deficiency in sensory processing of complex stimuli has been suggested to contribute to aberrant attention and language i...

Virtual and augmented reality applications provide us with increasingly compelling multisensory worlds. Although spatial sound technologies are often used in such applications, headphone based sound reproduction may result in an undesired ‘‘mediation awareness’’ for an enduser. An alternative can be provided by bone-conducted sound technologies, traditionally used in hearing aids applications. ...