Given one or more images of an object (or a scene), is it possible to synthesize a new image of the same instance observed from an arbitrary viewpoint? In this paper, we attempt to tackle this problem, known as novel view synthesis, by re-formulating it as a pixel copying task that avoids the notorious difficulties of generating pixels from scratch. Our approach is built on the observation that...

In data management, and in particular in data integration, data exchange, query optimization, and data privacy, the notion of view plays a central role. In several contexts, such as data integration, data mashups, and data warehousing, the need arises of designing views starting from a set of known correspondences between queries over different schemas. In this paper we deal with the issue of a...

Given a number of images of a scene, Virtual View Generation (VVG) is the process of generating the images that would have been seen from viewpoints other than the one of the input images. As shown in Fig. 1, the movie industry already uses VVG for visual effect generation in films such as “The Matrix.” It could also allow a director to modify a scene by changing the viewpoint without the troub...

Light field rendering (LFR) is a fundamental method for generating new views from a set of pre-acquired images. We use densely-aligned cameras for the process of acquiring the set of images. In most practical cases, the density of the aligned cameras is not high enough to synthesize appropriate views. This “under-sampling” condition causes focus-like effects in the synthesized views. This paper...

Synthesizing the image of a 3-D scene as it would be captured by a camera from an arbitrary viewpoint is a central problem in Computer Graphics. Given a com­ plete 3-D model, it is possible to render the scene from any viewpoint. The construction of models is a tedious task. Here, we propose to bypass the model construction phase altogether, and to generate images of a 3-D scene from any novel ...

This paper proposes a real-time 3D user interface using multiple possibly uncalibrated cameras. It tracks the user’s pointer in real-time and solves point correspondences across all the cameras. These correspondences form spatiotemporal “traces” that serve as a medium for sketching in a true 3-D space. Alternatively, they may be interpreted as gestures or control information to elicit some part...

In this paper we present a novel image quality assessment technique for evaluating virtual synthesized views in the context of multi-view video. In particular, Free Viewpoint Videos are generated from uncompressed color views and their compressed associated depth maps by means of the View Synthesis Reference Software, provided by MPEG. Prior to the synthesis step, the original depth maps are en...

Light field (LF) is a 4-D function representing the light radiance in free space in terms of rays. A dense grid of cameras, parameterized by two planes, captures an LF: the sensor plane and the focal plane. Multi-camera images stack in volumes, and when sliced, form epipolar plane images (EPI). In EPI, lines with the same slope represent object points at the same scene depth. Thus, the synthesi...

This paper describes a novel method of real-time virtual view generation for augmented virtuality system. The aim is to rectify the displacement between virtual eye position and video cameras which are attached on the head mounted display. It consists of three steps: Firstly, stereo calibration was used to generate cameras' internal and external parameters, and then image planes were rectified ...