In this paper we describe an interactive video object segmentation tool developed in the framework of the ACTSAC098 MOMUSYS project. The Video Object Generator with User Environment (VOGUE) combines three different sets of automatic and semi-automatic tools (spatial segmentation, object tracking and temporal segmentation) with general purpose tools for user interaction. The result is an integra...

Video Object Segmentation, and video processing in general, has been historically dominated by methods that rely on the temporal consistency and redundancy in consecutive video frames. When the temporal smoothness is suddenly broken, such as when an object is occluded, or some frames are missing in a sequence; the result of these methods can deteriorate significantly or they may not even produc...

We have developed a moving-object segmentation method for standard-compliant DCT-based video coder. To be compliant with current block-based video coding standards, the proposed algorithm uses the DCT coefficients and motion vector of a block, respectively, as spatial and temporal features of segmentation. Since block-based motion vector may not be sufficient to represent true motion of object,...

Extracting spatio-temporally consistent segments from a video sequence is a challenging problem due to the complexity of color, motion and occlusions. Most existing spatio-temporal segmentation approaches rely on pairwise motion estimation, which have inherent difficulties in handling large displacement with significant occlusions. This paper presents a novel spatio-temporal segmentation method...

Segmentation, Index and Summarization of Digital Video Content Di Zhong In this thesis, we propose and develop unique frameworks and methods for temporal and spatial video segmentation as well as object based video representation, indexing and retrieval at both the syntactic and the semantic level. First we demonstrate a robust and real-time temporal scene cut detection system that combines col...

We propose a temporal segmentation and procedure learning model for long untrimmed and unconstrained videos, e.g., videos from YouTube. The proposed model segments a video into segments that constitute a procedure and learns the underlying temporal dependency among the procedure segments. The output procedure segments can be applied for other tasks, such as video description generation or activ...

This paper proposes a content-based temporal video segmentation system that integrates syntactic (domain-independent) and semantic (domain-dependent) features for automatic management of video data. Temporal video segmentation includes scene change detection and shot classiication. The proposed scene change detection method consists of two steps: detection and tracking of semantic objects of in...

Temporal video segmentation is the "rst step towards automatic annotation of digital video for browsing and retrieval. This article gives an overview of existing techniques for video segmentation that operate on both uncompressed and compressed video stream. The performance, relative merits and limitations of each of the approaches are comprehensively discussed and contrasted. The gradual devel...

This paper presents a video object segmentation scheme based on global motion estimation and compensation. For video sequences with or without camera motion, we propose a unified approach to extract the moving object models. This approach combines both the spatial information from current frame and the temporal information derived from global motion compensated f inme. Experimental results demo...