An FPGA-Based Real-Time System for 3D Stereo Matching, Combining Absolute Differences and Census with Aggregation and Belief Propagation
نویسندگان
چکیده
The implementation of 3D stereo matching in real time is an important problem for many vision applications and algorithms. The current work, extending previous results by the same authors, presents in detail an architecture which combines the methods of Absolute Differences, Census, and Belief Propagation in an integrated architecture suitable for implementation with Field Programmable Gate Array (FPGA) logic. Emphasis on the present work is placed on the justification of dimensioning the system, as well as detailed design and testing information for a fully placed and routed design to process 87 frames per sec (fps) in 1920 × 1200 resolution, and a fully implemented design for 400 × 320 which runs up to 1570 fps.
منابع مشابه
A fast stereo matching algorithm suitable for embedded real-time systems
In this paper, the challenge of fast stereo matching for embedded systems is tackled. Limited resources, e.g. memory and processing power, and most importantly real-time capability on embedded systems for robotic applications, do not permit the use of most sophisticated stereo matching approaches. The strengths and weaknesses of different matching approaches have been analyzed and a well-suited...
متن کاملEstimation and Image Segmentation of a Sparse Disparity Map for 3D Reconstruction
In this paper, a stereo matching algorithm based on image segments is presented. We propose the hybrid segmentation algorithm that is based on a combination of the Belief Propagation and K-Means algorithms with aim to refine the final sparse disparity map by using a stereo pair of images. Firstly, a color based segmentation method is applied for segmenting the left image of the input stereo pai...
متن کاملReal-Time Stereo Matching using Adaptive Window based Disparity Refinement
In this paper, we propose a real-time stereo matching method based on adaptive window, aiming at the trade-off between accuracy and efficiency in current local stereo matching, Considering that the Census transform has good adaptability to image amplitude distortion, but may introduce matching ambiguities in regions with noise or similar local structures, we combine the Census transform with AD...
متن کاملA Local Adaptive Approach for Dense Stereo Matching in Architectural Scene Reconstruction
In recent years, a demand for 3D models of various scales and precisions has been growing for a wide range of applications; among them, cultural heritage recording is a particularly important and challenging field. We outline an automatic 3D reconstruction pipeline, mainly focusing on dense stereo-matching which relies on a hierarchical, local optimization scheme. Our matching framework consist...
متن کاملEfficient Belief Propagation with Census and Intensity Measure
Stereo matching is one of the most active research areas in computer vision. In this paper, a novel stereo matching is proposed that utilizes Census measure and pixels-based intensity measure into data term of Belief Propagation algorithm. Traditional data term of Belief Propagation lies on pixels-based intensity measure, and its effect is not very well. We combine intensity and Census algorith...
متن کامل