Learning Scene Dynamics from Point Cloud Sequences
نویسندگان
چکیده
Understanding 3D scenes is a critical prerequisite for autonomous agents. Recently, LiDAR and other sensors have made large amounts of data available in the form temporal sequences point cloud frames. In this work, we propose novel problem—sequential scene flow estimation (SSFE)—that aims to predict all pairs clouds given sequence. This unlike previously studied problem which focuses on two We introduce SPCM-Net architecture, solves by computing multi-scale spatiotemporal correlations between neighboring then aggregating correlation across time with an order-invariant recurrent unit. Our experimental evaluation confirms that processing results significantly better SSFE compared using only Additionally, demonstrate approach can be effectively modified sequential forecasting (SPF), related demands future are evaluated new benchmark both SPF consisting synthetic real datasets. Previously, datasets been limited provide non-trivial extensions these multi-frame prediction. Due difficulty obtaining ground truth motion real-world datasets, use self-supervised training metrics. believe will pivotal research area. All code models accessible at ( https://github.com/BestSonny/SPCM ).
منابع مشابه
Towards 4d Virtual City Reconstruction from Lidar Point Cloud Sequences
In this paper we propose a joint approach on virtual city reconstruction and dynamic scene analysis based on point cloud sequences of a single car-mounted Rotating Multi-Beam (RMB) Lidar sensor. The aim of the addressed work is to create 4D spatio-temporal models of large dynamic urban scenes containing various moving and static objects. Standalone RMB Lidar devices have been frequently applied...
متن کاملLearning 3D Point Cloud Histograms
In this paper we show how using histograms based on the angular relationships between a subset of point normals in a 3D point Cloud can be used in a machine learning algorithm in order to recognize different classes of objects given by their 3D point clouds. This approach extends the work done by Gary Bradski at Willow Garage on point clouds recognition by applying a machine learning approach t...
متن کاملObject Recognition in 3D Point Cloud of Urban Street Scene
In this paper we present a novel street scene semantic recognition framework, which takes advantage of 3D point clouds captured by a high-definition LiDAR laser scanner. An important problem in object recognition is the need for sufficient labeled training data to learn robust classifiers. In this paper we show how to significantly reduce the need for manually labeled training data by reduction...
متن کاملCluster-Based Point Cloud Analysis for Rapid Scene Interpretation
A histogram-based method for the interpretation of three-dimensional (3D) point clouds is introduced, where point clouds represent the surface of a scene of multiple objects and background. The proposed approach relies on a pose-invariant object representation that describes the distribution of surface point-pair relations as a model histogram. The models of the used objects are previously trai...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Computer Vision
سال: 2022
ISSN: ['0920-5691', '1573-1405']
DOI: https://doi.org/10.1007/s11263-021-01551-y