Event-based, 6-DOF Camera Tracking for High-Speed Applications
نویسندگان
چکیده
In contrast to standard cameras, which produce frames at a fixed rate, event cameras respond asynchronously to pixel-level brightness changes, thus enabling the design of new algorithms for high-speed applications with latencies of microseconds. However, this advantage comes at a cost: because the output is composed by a sequence of events, traditional computer-vision algorithms are not applicable, so that a new paradigm shift is needed. We present an event-based approach for ego-motion estimation, which provides pose updates upon the arrival of each event, thus virtually eliminating latency. Our method is the first work addressing and demonstrating event-based pose tracking in six degrees-of-freedom (DOF) motions in realistic and natural scenes, and it is able to track high-speed motions. The method is successfully evaluated in both indoor and outdoor scenes.
منابع مشابه
The Cyclope: A 6 DOF Optical Tracker Based on a Single Camera
In this paper we describe a low-cost infrared optical device capable of tracking two targets with six DOF (Degrees Of Freedom) for interaction within both desktop and large projection applications. We use off-the-shelf components for the hardware and open-source libraries for the software.
متن کاملReal-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera
We propose a method which can perform real-time 3D reconstruction from a single hand-held event camera with no additional sensing, and works in unstructured scenes of which it has no prior knowledge. It is based on three decoupled probabilistic filters, each estimating 6-DoF camera motion, scene logarithmic (log) intensity gradient and scene inverse depth relative to a keyframe, and we build a ...
متن کاملHigh-speed visual servoing of a 6-d.o.f. manipulator using multivariable predictive control
This paper presents a new approach to model and control high speed 6 DOF visual servo loops. The modeling and control strategy take into account the dynamics of the velocity controlled 6 DOF manipulator as well as a simplified model of the camera and acquisition system in order to significantly increase the bandwidth of the servo loop. Multi-Input Multi-Output (MIMO) Generalized Predictive Cont...
متن کاملREBECQ, HORSTSCHAEFER, SCARAMUZZA: EVENT-BASED VISUAL-INERTIAL ODOMETRY1 Real-time Visual-Inertial Odometry for Event Cameras using Keyframe-based Nonlinear Optimization
Event cameras are bio-inspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. They offer significant advantages over standard cameras, namely a very high dynamic range, no motion blur, and a latency in the order of microseconds. We propose a novel, accurate tightly-coupled visual-inertial odometry pipeline for such cameras that leverages their ou...
متن کاملA new Combination of Vision-Based and Inertial Tracking for Fully Mobile, Wearable, and Real-Time Operation
Real-time tracking of an object’s pose (position and orientation) is a prerequisite for many potential new applications in mobile systems. We present a new combination of a full six degree of freedom (6 DoF) inertial tracking system with a vision-based tracking system. Inertial tracking is based on silicon micromachined accelerometers and gyroscopes, and the vision-based tracker recovers camera...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1607.03468 شماره
صفحات -
تاریخ انتشار 2016