In this chapter we overview methods that represent video sequences in terms of their content. These methods differ from those developed for MPEG/H.26X coding standards in that sequences are described in terms of extended images instead of collections of frames. We describe how these extended images, e.g., mosaics, are generated by the basically same principle: the incremental composition of vis...

Introduction: An important issue in object-based image coding is the efficient description of image segments having arbitrary shapes [1]. Kaup described an algorithm based on Matching Pursuits (MP) [2] to represent arbitrarily shaped image segments by selecting a small set of discrete cosine basis from a larger basis set defined on a rectangle circumscribing the region[3] (we denote it as MP-DC...

In spite of the success of the standard wavelet transform (WT) in image processing in recent years, the efficiency and sparsity of its representation is limited by the spatial symmetry and separability of its basis functions built in the horizontal and vertical directions. One-dimensional (1-D) discontinuities in images (edges or contours) that are very important elements in visual perception, ...

We present a geometry-independent radiosity representation which stems from image-based methodologies. Our image-based representation is inspired by the concept of layered depth images. To construct the radiosity function we render shaded depth images and warp them into the representation. This enables us to alter Keller’s instant radiosity algorithm to a view-independent variant, allowing inte...

Automatic speechreading systems through their use of visual information to support the acoustic signal have been shown to yield better recognition performance than purely acoustic systems, especially when background noise is present. In this paper an answer is sought to the most important questions of speechreading: Which features can represent visual information well? How can they be extracted...

The paper discusses the role of invariance in image processing, specifically the desire to discriminate against unwanted variations in the scene while maintaining the power to tell the difference between object-intrinsic characteristics and scene-accidental conditions. It provides an analysis and references of what are directly observables in a general scene.

We describe a new form of representation of image velocities, which does not rely on vector elds. For each local spatio-temporal region of the input image, we desire a function over the space of velocities describing the presence of a given velocity in that region. This function may be interpreted as a probability distribution over velocity, although it is not necessary to do so. A primary adva...

Image representation is an active area of research with increasing applications in military and defense. Image representation aims at representing an image with lesser number of coefficients than the actual image, without affecting the image quality. It is the first step in image compression. Once the image is represented by using some set of coefficients, it is further encoded using various co...