Internet technology allows companies and individuals to overcome many of the physical constraints that often prevent them interacting from a distant. In the past several years, communication using data, audio, and video applications has become increasingly popular to overcome this burden. These applications help people to control/view their remote systems and to share ideas between employees an...

MUVIS is a PC-based framework, which supports indexing, browsing and querying of various multimedia types such as audio, video, audio/video interlaced in several formats. It allows real-time audio and video capturing, encoding by last generation codecs such as MPEG-4, H.263+, MP3 and AAC. MUVIS also supports several audio/video file format such as AVI, MP4, MP3 and AAC. Almost all image types i...

Audio-visual documents obtained from German TV news are classified according to the IPTC topic categorization scheme. To this end usual text classification techniques are adapted to speech, video, and non-speech audio. For each of the three modalities word analogues are generated: sequences of syllables for speech, “video words” based on low level color features (color moments, color correlogra...

The transmission of the entire video and audio sequences over an internal or external network during the implementation of audio-visual recognition over internet protocol is inefficient especially when only selected data out of the entire video and audio sequences are actually used for the recognition process. Hence, in this paper, we propose an efficient method of implementing audio-visual rec...

In this paper, we propose a robust multilevel fusion strategy involving cascaded multimodal fusion of audio–lip–face motion, correlation and depth features for biometric person authentication. The proposed approach combines the information from different audio–video based modules, namely: audio–lip motion module, audio–lip correlation module, 2D + 3D motion-depth fusion module, and performs a h...

This paper reports recent work at ORL on segmentation of digital audio/video recordings. Firstly, we describe an audio segmentation algorithm that partitions a soundtrack into manageably sized segments for speech recognition. Secondly, we present an algorithm for detecting camera shot-break locations in the video. The output of these two algorithms is combined to produce a semantically meaningf...

Current efforts in the area of MPEG-I audio/video synchronization have been limited to single audio, single video applications. The MPEG-I specification includes provisions for the interleaving of up to 16 separate video streams with up to 32 distinct audio streams. This paper explores the possible uses of this capability as well as the design of a robust encoder and playback system. Perceived ...

13 I magine sitting at your desk at home and checking your electronic mail. An audiovisual clip of your family members hundreds of miles away pops up with warm greetings and family news. This scenario lies within the capability of the integrated multimedia mailing system, called VistaMail, developed at the University of Illinois at Urbana-Champaign. VistaMail provides smooth and seamless transi...

In this paper, we propose a robust multilevel fusion strategy involving cascaded fusion of hybrid multimodal fusion of audio-lip-face motion, correlation and depth features for biometric person authentication. The proposed approach combines the information from different audio-video based modules, namely: audio-lip motion module, audio-lip correlation module, 2D+3D motiondepth fusion module, an...

In this paper, we propose a robust spatiotemporal face modelling approach based on multilevel fusion strategy involving cascaded fusion of hybrid multimodal fusion of audio-lip-face motion, correlation and depth features for biometric security application. The proposed approach combines the information from different audio-video based modules, namely: audio-lip motion module, audio-lip correlat...