2D-3D Model Correspondence for Camera Pose Estimation using Sensor Fusion
نویسندگان
چکیده
Augmented reality requires accurate position and orientation estimates of a camera. In our approach inertial and visual data are fused using the conditional probability framework to estimate camera pose. We propose a measurement equation for 2D-3D model correspondence, i.e., detecting known 3D features of the scene in a camera image. The probability density of this measurement equation is investigated and results from a first application are reported.
منابع مشابه
Accurate Single Image Multi-modal Camera Pose Estimation
A well known problem in photogrammetry and computer vision is the precise and robust determination of camera poses with respect to a given 3D model. In this work we propose a novel multi-modal method for single image camera pose estimation with respect to 3D models with intensity information (e.g., LiDAR data with reflectance information). We utilize a direct point based rendering approach to g...
متن کاملRelative Pose Estimation and Fusion of 2D Spectral and 3D Lidar Images
This paper presents a unified approach for the relative pose estimation of a spectral camera 3D Lidar pair without the use of any special calibration pattern or explicit point correspondence. The method works without specific setup and calibration targets, using only a pair of 2D-3D data. Pose estimation is formulated as a 2D-3D nonlinear shape registration task which is solved without point co...
متن کاملA new method of camera pose estimation using 2D-3D corner correspondence
Estimation of camera pose from image to space feature correspondence is a basic problem in image analysis and understanding. This paper presents a new method for the estimation of camera pose from 2D to 3D corner correspondence. Two cases are considered: the orthogonal corner and the general corner. The contribution of the work is in two folds: one is that the camera pose parameters, i.e., the ...
متن کامل3D Recognition and Pose Estimation Using Model Reconstructed by Pairwise Correspondence
This paper focuses on pose estimation of 3D object from 2D images. The base system of Structure from Motion is applied. A 3D model with feature points and descriptors is prebuilt. 3D-2D matching is employed in recognition and pose estimation process. The method of pairwise correspondence is proposed. To reduce reprojection error of the model, a weighting step is added. Viewpoint change of camer...
متن کاملA Multi-Sensor Information Fusion Approach for Efficient 3D Reconstruction in Smart Phone
Despite the recent advancements, camera pose estimation using smart phone’s sensor data is still errorprone due to various environmental noise and variability of the force applied on the phone during data acquisition. Here, we propose a novel framework to mitigate these drawbacks of camera pose estimation using various sensor’s data. The directional information of accelerometer is utilized to o...
متن کامل