Object-based video data representations enable unprecedented functionalities of content access and manipulation. In this paper, we present an integrated approach using region-based analysis for semantic video object segmentation and retrieval. We first present an active system that combines low-level region segmentation with user inputs for defining and tracking semantic video objects. The prop...

Segmentation, Index and Summarization of Digital Video Content Di Zhong In this thesis, we propose and develop unique frameworks and methods for temporal and spatial video segmentation as well as object based video representation, indexing and retrieval at both the syntactic and the semantic level. First we demonstrate a robust and real-time temporal scene cut detection system that combines col...

In this paper, we present an overview of the state of the art of segmentation based video coding aimed at low-bit rate application. The most significant contribution is the algorithm for the segmentation of videoconference image sequences for content-based coding. The segmentation is based on motion estimation trough the computation of the optical flow field and motion segmentation by applying ...

The new MPEG-4 video coding standard enables content-based functionalities. In order to support the philosophy of the MPEG-4 visual standard, each frame of video sequences should be represented in terms of video object planes (VOP’s). In other words, video objects to be encoded in still pictures or video sequences should be prepared before the encoding process starts. Therefore, it requires a p...

To enable content based functionalities in video processing algorithms, decomposition of scenes into semantic objects is necessary. A semi-automatic Markov random field based multiresolution algorithm is presented for video object extraction in a complex scene. In the first frame, spatial segmentation and user intervention determine objects of interest. The specified objects are subsequently tr...

A scheme based on a difference scheme using object structures and color analysis is proposed for video object segmentation in rainy situations. Since shadows and color reflections on the wet ground pose problems for conventional video object segmentation, the proposed method combines the background construction-based video object segmentation and the foreground extraction-based video object seg...

In this paper, we propose an original framework for an intuitive tuning of parameters in image and video segmentation algorithms. The proposed framework is very flexible and generic and does not depend on a specific segmentation algorithm, a particular evaluation metric, or a specific optimization approach, which are the three main components of its block diagram. This framework requires a manu...

We address the problem of on-line sprite-based video coding in cases where scene segmentation is not available a priori or transmission of such segmentation information cannot be afforded due to low bit rate requirements. We propose an on-line segmentation method that can be integrated into an MPEG4 online sprite based video codec. The proposed method uses macroblock types as well as motion com...

MOTION-BASED SEGMENTATION BY PRINCIPAL SINGULAR VECTOR (PSV) CLUSTERING METHOD S.Y. Kung Yun-Ting Lin Yen-Kuang Chen Princeton University ABSTRACT Motion-based segmentation has recently drawn a lot of attentions. The task of identifying independent objects is called segmentation, which can use cues such as edge (boundary), color, texture, etc. Motion-based segmentation has a broad video applica...

This paper presents an approach to the segmentation of video sequences that is inspired by Markov random eld (MRF) models and is aimed at region-based video compression. Two goals of the segmentation algorithm are considered: to assure a rate-e cient partitioning of video sequences and to provide regions that are meaningful for human observers (\coding for content"). To address both issues we e...