Multi-view dense depth map estimation
نویسندگان
چکیده
A novel dense depth map estimation algorithm is proposed in order to meet the requirements of N-view plus N-depth representation, which is one of the standardization efforts for the upcoming 3D display technologies. Hence, extraction of multiple depth maps is achieved from multi-view video. Starting from the piecewise planarity assumption of the scene, estimation of 3D structure of the patches, obtained through color-based oversegmentation, is achieved by planeand angle-sweeping for every view independently. Markov Random Field (MRF) modeling is utilized for each view in pixel-wise manner in order to relax and refine the estimated planar models while incorporating visibility and consistency constraints. In this algorithm, the fusion of multiple depth maps is performed by updating belief values on the observed nodes based on depth and color consistency during the refinement step. The proposed method handles untextured surfaces, as well as depth discontinuities at object boundaries, due to its initial modeling of the scene as piecewise planar regions. The experimental results illustrate reliability and the robustness of the proposed algorithm for different type of scenes.
منابع مشابه
Image-Based Rendering from Handheld Cameras Using Quad Primitives
In this paper we will present a novel approach of using surface patches for Image Based Rendering. Based on image sequences acquired with a freely moving portable multi-camera-rig we can extrapolate novel views of complex real scenes in realtime. The cameras are calibrated from the image sequence itself and dense depth maps are computed for each camera view using an improved multiview depth est...
متن کاملFast and Accurate Optical Flow based Depth Map Estimation from Light Fields
Depth map estimation is a crucial task in computer vision, and new approaches have recently emerged taking advantage of light fields, as this new imaging modality captures much more information about the angular direction of light rays compared to common approaches based on stereoscopic images or multi-view. In this paper, we propose a novel depth estimation method from light fields based on ex...
متن کاملEstimation of temporally consistent depth maps using noise removal from video
We propose a novel approach to problem of temporal consistency. To tackle temporal inconsistency we propose to eliminate its cause. Depth map fluctuations are caused by noise, mainly temporal. We propose to employ noise reduction on video before depth estimation. Each view of a multi-view video sequence, is independently denoised in time and then feed to a depth estimation algorithm (Fig. 1). A...
متن کاملA New High Resolution Depth Map Estimation System Using Stereo Vision and Kinect Depth Sensing
Depth map estimation is an active and long standing problem in image/video processing and computer vision. Conventional depth estimation algorithms which rely on stereo/multi-view vision or depth sensing devices alone are limited by complicated scenes or imperfections of the depth sensing devices. On the other hand, the depth maps obtained from the stereo/multi-view vision and depth sensing dev...
متن کاملReal-time multi-stereo depth estimation on GPU with approximative discontinuity handling
This paper describes a system for dense depth estimation for multiple images in real-time. The algorithm runs almost entirely on standard graphics hardware, leaving the main CPU free for other tasks as image capture, compression and storage during scene capture. We follow a plain-sweep approach extended by truncated SSD scores, shiftable windows and best camera selection. We do not need special...
متن کامل