This paper reports our on-going efforts to exploit multiple features derived from an audio stream using source material such as broadcast news, teleconferences, and meetings. These features are derived from algorithms including automatic speech recognition, automatic speech indexing, speaker identification, prosodic and audio feature extraction. We describe our research prototype – the Audio Ho...

In this thesis, I designed a system for augmenting a space with linked audio. Using this system, individuals can associate audio clips with a location in real-world space. When an individual using the system passes through this augmented space, he or she can hear the audio clips that have been left by traveling through the associated locations. Furthermore, audio clips in the environment can be...

Automatic identification of music titles and copyright enforcement of audio material has become a topic of great interest. One of the main problems with broadcast audio is that the received audio suffers several transformations before reaching the listener (equalizations, noise, speaker over the audio, parts of the songs are changed or removed, etc.) and, therefore, the original and the broadca...

Soundscape composition is the creative practice of processing and combining sound recordings to evoke auditory associations and memories within a listener. We present Audio Metaphor, a system for creating novel soundscape compositions. Audio Metaphor processes natural language queries derived from Twitter for retrieving semantically linked sound recordings from online user-contributed audio dat...

The recent interest in multimedia conferencing is a result of the incorporation of cheap audio and video hardware in today’s workstations, and also as a result of the development of a global infrastructure capable of supporting multimedia traffic the Mbone. Audio quality is impaired by packet loss and variable delay in the network, and by lack of support for real-time applications in today’s ge...

In this paper we introduce a corpus based 2D videorealistic audio-visual synthesis system. The system combines a concatenative Text-to-Speech (TTS) System with a concatenative Text-to-Visual (TTV) System to an audio lipmovement synchronized Text-to-Audio-Visual-Speech System (TTAVS). For the concatenative TTS we are using a Finite State Machine approach to select non-uniform variablesize audio ...

A rule-based system for automatic melody harmonization is presented. It models the cognitive process a human arranger undergoes when confronted with the same task, namely: segmenting the melody into phrases, tagging melody notes with harmonic functions, establishing a palette of possible chords for each note, and finding the most agreeable voicing through these chords. The system is designed to...

Data hiding in audio signal enables acoustic data transmission by playing back the data-embedded audio and by recording the signal and extracting the data at receiver like mobile devices. In our previous work, we proposed an audio data hiding system for acoustic data transmission, of which the audio quality and transmission performance are suitable, based on phase modification of the modulated ...

Audio presentation is an important modality in virtual storytelling. In this paper we present our work on audio presentation in our intelligent multimodal storytelling system, CONFUCIUS, which automatically generates 3D animation speech, and non-speech audio from natural language sentences. We provide an overview of the system and describe speech and non-speech audio in virtual storytelling by ...