A hierarchical system for audio classi cation and retrieval based on audio content analysis is presented in this paper. The system consists of three stages. The rst stage is called the coarse-level audio classi cation and segmentation, where audio recordings are classi ed and segmented into speech, music, several types of environmental sounds, and silence, based on morphological and statistical...

In two previous papers, we proposed an audio Informed Source Separation (ISS) system which can achieve the separation of I > 2 musical sources from linear instantaneous stationary stereo (2-channel) mixtures, based on audio signal’s natural sparsity, pre-mix source signals analysis, and side-information embedding (within the mix signal). In the present paper and for the first time, we apply thi...

In two previous papers, we proposed an audio Informed Source Separation (ISS) system which can achieve the separation of I > 2 musical sources from linear instantaneous stationary stereo (2-channel) mixtures, based on audio signal’s natural sparsity, pre-mix source signals analysis, and side-information embedding (within the mix signal). In the present paper and for the first time, we apply thi...

This paper deals with a presentation of an experimental system (called WebSubDub) for creating a high-quality alternative audio track for TV broadcasting. The system is used to create subtitles for TV shows in such a format which allows to automatically generate an alternative audio track with multiple voices employing a specially adapted TTS system. This alternative audio track is intended for...

With digital technologies, music content providers face serious challenges to protect their rights. Due to the widespread nature of music sources, it is very difficult to centralize the audio management. Audio fingerprinting allows the identification of audio content regardless of the audio format and without the need of additional metadata. Monitoring the audio being broadcasted by the TV and ...

Marsyas is an open source software framework for audio analysis, synthesis and retrieval with specific emphasis on Music Information Retrieval. It is developed by an international team of programmers and researchers led by George Tzanetakis. In MIREX 2009 the Marsyas team participated in the following tasks: Audio Classical Composer Identification, Audio Genre Classification (Latin and Mixed), ...

An analytic means to evaluate the error sensitivity of a personal audio system is proposed. The personal audio system, which focuses acoustic energy into a zone of interest using multiple loudspeakers, is subject to various errors when implemented. The performance of a personal audio system, defined as an energy ratio between the zone of interest and the rest, is inevitably influenced by errors...

We describe an audio-visual automatic continuous speech recognition system, which significantly improves speech recognition performance over a wide range of acoustic noise levels, as well as under clean audio conditions. The system utilizes facial animation parameters (FAPs) supported by the MPEG-4 standard for the visual representation of speech. We also describe a robust and automatic algorit...

3. Assess the realism of the talking face. We plan to perform several psychophysical tests to evaluate the realism of our system. 4. Extend our approach using morphable model from TTVS to TTS. We plan to first study morphing of audio sequences. The system will take as input 2 audio sequences, and produce as output intermediate audio sequences that approximate natural exemplars lying between the...

Structured audio uses a high level representation of a signal to produce audio output. When it was first introduced in 1998, creating a structured audio representation from an audio signal was beyond the state-of-the-art. Inspired by object coding and structured audio, we present a system to reproduce audio using Expressive MIDI, high-level parameters being used to represent pitch expression fr...