Learning Scene Dynamics from Point Cloud Sequences

نویسندگان

چکیده

Understanding 3D scenes is a critical prerequisite for autonomous agents. Recently, LiDAR and other sensors have made large amounts of data available in the form temporal sequences point cloud frames. In this work, we propose novel problem—sequential scene flow estimation (SSFE)—that aims to predict all pairs clouds given sequence. This unlike previously studied problem which focuses on two We introduce SPCM-Net architecture, solves by computing multi-scale spatiotemporal correlations between neighboring then aggregating correlation across time with an order-invariant recurrent unit. Our experimental evaluation confirms that processing results significantly better SSFE compared using only Additionally, demonstrate approach can be effectively modified sequential forecasting (SPF), related demands future are evaluated new benchmark both SPF consisting synthetic real datasets. Previously, datasets been limited provide non-trivial extensions these multi-frame prediction. Due difficulty obtaining ground truth motion real-world datasets, use self-supervised training metrics. believe will pivotal research area. All code models accessible at ( https://github.com/BestSonny/SPCM ).

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Towards 4d Virtual City Reconstruction from Lidar Point Cloud Sequences

In this paper we propose a joint approach on virtual city reconstruction and dynamic scene analysis based on point cloud sequences of a single car-mounted Rotating Multi-Beam (RMB) Lidar sensor. The aim of the addressed work is to create 4D spatio-temporal models of large dynamic urban scenes containing various moving and static objects. Standalone RMB Lidar devices have been frequently applied...

متن کامل

Learning 3D Point Cloud Histograms

In this paper we show how using histograms based on the angular relationships between a subset of point normals in a 3D point Cloud can be used in a machine learning algorithm in order to recognize different classes of objects given by their 3D point clouds. This approach extends the work done by Gary Bradski at Willow Garage on point clouds recognition by applying a machine learning approach t...

متن کامل

Object Recognition in 3D Point Cloud of Urban Street Scene

In this paper we present a novel street scene semantic recognition framework, which takes advantage of 3D point clouds captured by a high-definition LiDAR laser scanner. An important problem in object recognition is the need for sufficient labeled training data to learn robust classifiers. In this paper we show how to significantly reduce the need for manually labeled training data by reduction...

متن کامل

Cluster-Based Point Cloud Analysis for Rapid Scene Interpretation

A histogram-based method for the interpretation of three-dimensional (3D) point clouds is introduced, where point clouds represent the surface of a scene of multiple objects and background. The proposed approach relies on a pose-invariant object representation that describes the distribution of surface point-pair relations as a model histogram. The models of the used objects are previously trai...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: International Journal of Computer Vision

سال: 2022

ISSN: ['0920-5691', '1573-1405']

DOI: https://doi.org/10.1007/s11263-021-01551-y