Real-time Structure from Motion for Augmented Reality
نویسندگان
چکیده
Our work is focused on developing a real-time structure from motion (SfM) algorithm that is usable in an augmented reality system. We envisage augmented reality applications involving a head-mounted camera and display system. This requires an SfM algorithm that is robust to different scene structure and camera motion and will invariably have to deal with the problems of occlusion, clutter and multiple objects. We aim to develop a system that would be capable of providing camera ego-motion and scene structure in a variety of such head-mounted video sequences. This report reviews current approaches to SfM and describes our current work on a Monte Carlo approach to the structure from motion problem.
منابع مشابه
InAR: Inverse Augmented Reality
Augmented reality is the art to seamlessly fuse virtual objects into real ones. In this short note, we address the opposite problem, the inverse augmented reality, that is, given a perfectly augmented reality scene where human is unable to distinguish real objects from virtual ones, how the machine could help do the job. We show by structure from motion (SFM), a simple 3D reconstruction techniq...
متن کاملEditing Real World Scenes: Augmented Reality with Image-based Rendering
We present a method that using only an uncalibrated camera allows the capture of object geometry and appearance, and then at a later stage registration and AR overlay into a new scene. Using only image information first a coarse object geometry is obtained using structure-from-motion, then a dynamic, view dependent texture is estimated to account for the differences between the reprojected coar...
متن کاملRobust Estimation of 3-D Camera Motion for Uncalibrated Augmented Reality
We describe initial work on a system for augmenting video sequences with 3-D graphics or animations so that they appear to be present within the scene. Our aim is to do this in real-time for sequences captured by uncalibrated ‘live’ cameras, such as a hand-held or wearable. These sequences typically contain jitter and can have narrow baselines between frames over extended time intervals. The pa...
متن کاملReal-Time Motion Tracking for Mobile Augmented/Virtual Reality Using Adaptive Visual-Inertial Fusion
In mobile augmented/virtual reality (AR/VR), real-time 6-Degree of Freedom (DoF) motion tracking is essential for the registration between virtual scenes and the real world. However, due to the limited computational capacity of mobile terminals today, the latency between consecutive arriving poses would damage the user experience in mobile AR/VR. Thus, a visual-inertial based real-time motion t...
متن کاملAugmented Mirror: Interactive Augmented Reality System Based on Kinect
In this paper we present a virtual character controlled by an actor in real time, who talks with an audience through an augmented mirror. The application, which integrates video images, the avatar and other virtual objects within an Augmented Reality system, has been implemented using a mixture of technologies: two kinect systems for motion capture, depth map and real images, a gyroscope to det...
متن کامل