Event-based, 6-DOF Camera Tracking for High-Speed Applications

نویسندگان

  • Guillermo Gallego
  • Jon E. A. Lund
  • Elias Mueggler
  • Henri Rebecq
  • Tobi Delbrück
  • Davide Scaramuzza
چکیده

In contrast to standard cameras, which produce frames at a fixed rate, event cameras respond asynchronously to pixel-level brightness changes, thus enabling the design of new algorithms for high-speed applications with latencies of microseconds. However, this advantage comes at a cost: because the output is composed by a sequence of events, traditional computer-vision algorithms are not applicable, so that a new paradigm shift is needed. We present an event-based approach for ego-motion estimation, which provides pose updates upon the arrival of each event, thus virtually eliminating latency. Our method is the first work addressing and demonstrating event-based pose tracking in six degrees-of-freedom (DOF) motions in realistic and natural scenes, and it is able to track high-speed motions. The method is successfully evaluated in both indoor and outdoor scenes.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Cyclope: A 6 DOF Optical Tracker Based on a Single Camera

In this paper we describe a low-cost infrared optical device capable of tracking two targets with six DOF (Degrees Of Freedom) for interaction within both desktop and large projection applications. We use off-the-shelf components for the hardware and open-source libraries for the software.

متن کامل

Real-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera

We propose a method which can perform real-time 3D reconstruction from a single hand-held event camera with no additional sensing, and works in unstructured scenes of which it has no prior knowledge. It is based on three decoupled probabilistic filters, each estimating 6-DoF camera motion, scene logarithmic (log) intensity gradient and scene inverse depth relative to a keyframe, and we build a ...

متن کامل

High-speed visual servoing of a 6-d.o.f. manipulator using multivariable predictive control

This paper presents a new approach to model and control high speed 6 DOF visual servo loops. The modeling and control strategy take into account the dynamics of the velocity controlled 6 DOF manipulator as well as a simplified model of the camera and acquisition system in order to significantly increase the bandwidth of the servo loop. Multi-Input Multi-Output (MIMO) Generalized Predictive Cont...

متن کامل

REBECQ, HORSTSCHAEFER, SCARAMUZZA: EVENT-BASED VISUAL-INERTIAL ODOMETRY1 Real-time Visual-Inertial Odometry for Event Cameras using Keyframe-based Nonlinear Optimization

Event cameras are bio-inspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. They offer significant advantages over standard cameras, namely a very high dynamic range, no motion blur, and a latency in the order of microseconds. We propose a novel, accurate tightly-coupled visual-inertial odometry pipeline for such cameras that leverages their ou...

متن کامل

A new Combination of Vision-Based and Inertial Tracking for Fully Mobile, Wearable, and Real-Time Operation

Real-time tracking of an object’s pose (position and orientation) is a prerequisite for many potential new applications in mobile systems. We present a new combination of a full six degree of freedom (6 DoF) inertial tracking system with a vision-based tracking system. Inertial tracking is based on silicon micromachined accelerometers and gyroscopes, and the vision-based tracker recovers camera...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1607.03468  شماره 

صفحات  -

تاریخ انتشار 2016