We present a method for rapidly and robustly extracting audio excerpts without the overhead of speech recognition or speaker segmentation. An immediate application is to automatically augment keyframe-based video summaries with informative audio excerpts associated with the video segments represented by the keyframes. Short audio clips combined with keyframes comprise an extremely lightweight a...

Audio and video watermarking enable the copyright protection with owner or customer authentication and the detection of media manipulations. The available watermarking technology concentrates on single media like audio or video. But the typical multimedia stream consists of both video and audio data. Our goal is to provide a solution with robust and fragile aspects to guarantee authentication a...

artist usually adds the musical accompaniment to video. Employing such artists is expensive and not feasible for a home video presentation. Our automatic audio–video mixing technique is suited for home videos. It uses a pivot vector space mapping method that matches video shots with music segments based on aesthetic cinematographic heuristics. A udio mixing is an important aspect of cinematogra...

artist usually adds the musical accompaniment to video. Employing such artists is expensive and not feasible for a home video presentation. Our automatic audio–video mixing technique is suited for home videos. It uses a pivot vector space mapping method that matches video shots with music segments based on aesthetic cinematographic heuristics. A udio mixing is an important aspect of cinematogra...

Two studies examined user engagement in two types of multimedia training systems -a more passive medium, videotape, and a less passive medium, interactive software. Each study compared engagement in three formats: the Text format contained text and still images, the Audio format contained audio and still images, and the Video format contained audio and video images. In both studies, engagement ...

To many people, the word “multimedia” simply means the combination of various forms of information: text, speech, music, images, graphics and video. What is often overlooked is the interaction among these forms. In this paper, we will present our recent results in exploiting the audio-visual interaction that is very significant in multimedia communication. The applications include lip synchroni...

To represent an approach in video and audio configuration. Two modalities were used i.e., visual and audio tracks. From audio track, rhythms of music were described by segmentation and detection of music beats. From visual track, dancer’s features and trajectories were extracted to estimate rhythm of motion. Then configuration of visual and audio extractions were performed with two more applica...

Audio-visual speech recognition leads to significant improvements compared to pure audio recognition especially when the audio signal is corrupted by noise. In this article we investigate the consequences of additional degradations in the video signal on the audio-visual recognition process.. We degrade the images with noise, a JPEG compression, and errors in the localization of the mouth regio...

This paper presents a comparative analysis of communicative breakdowns experienced by participants collaboratively performing a task in three communication environments: face-to-face, mediated by an audio connection, and mediated by both an audio and a video connection. A quantitative analysis showed significantly less breakdown in the copresent condition than in either of the two technological...

Speaker diarization currently focuses on using audio features to partition an audio stream into speaker homogeneous speech regions, in other words to determine “who spoke when”. Recent speaker diarization corpora contains video recordings in addition to the commonly used audio. Thus, we investigated the benefits of incorporating video features, namely histograms of weighted oriented optical flo...