We assessed the human brain network for sound-motion processing using the same virtual stimulus in three independent functional imaging experiments. All experiments show a bilateral posterior network of activation, including planum temporale (PT) and parieto-temporal operculum (PTO). This was demonstrated in contrasts between sound movement and two control conditions: externalized stationary st...

The acoustic wave received at the ears is processed by the human auditory system to separate different sounds along the intensity, pitch, and timbre dimensions. Conventional Fourier-based signal processing, while endowed with fast algorithms, is unable to easily represent a signal along these attributes. In this paper, we discuss the creation of maximally separable sounds in auditory user inter...

Sound coding strategies for cochlear implants have evolved over the past 30 years with advances in research and technology. Processing schemes have transitioned from the delivery of a diffuse, broad signal in single channel devices to the transmission of detailed sound information to multi-channel devices. This evolution has involved the addition of more channels and more parameter options for ...

This article describes a set of modules for Max/MSP for real-time sound analysis and synthesis combining various models, representations and timing paradigms. Gabor provides a unified framework for granular synthesis, PSOLA, phase vocoder, additive synthesis and other STFT techniques. Gabor’s processing scheme allows for the treatment of atomic sound particles at arbitrary rates and instants. G...

Mixed sounds can be separated from multiple sound sources by utilizing a microphone array and signal processing. We believe that promotion of interest in this technique can lead to significant developments in future science and technology. Consequently, in order to experience this technique, we designed a language game for children called “KIKIWAKE 3D” that uses a sound source separation system...

We describe an approach and framework for integrating synthesis and processing of digital image and sound. The approach is based on creating an analogy between sound and image by introducing the notion of the soxel, a representation analogous to the pixel. We describe some simple mappings between two domains that map pitch, time, spatial coordinates and timbre to bitmap mode, gray-scale mode, R...

A technique for segmenting sounds using processing based on mammalian early auditory processing is presented. The technique is based on features in sound which neuron spike recording suggests are detected in the cochlear nucleus. The sound signal is bandpassed and each signal processed to enhance onsets and offsets. The onset and offset signals are compressed, then clustered both in time and ac...

Evidence from activation studies suggests that sound recognition and localization are processed in two distinct cortical networks that are each present in both hemispheres. Sound recognition and/or localization may, however, be disrupted by purely unilateral damage, suggesting that processing within one hemisphere may not be sufficient or may be disturbed by the contralateral lesion. Sound reco...

In this paper, we present an approach to estimate mobile sound source trajectory. An artificially created sound source signal is used in this work. The main aim of this paper is to estimate the mobile object trajectory via sound processing methods. The performance of generalized cross correlation techniques is compared with that of noise reduction filters for the success of trajectory estimatio...