Dense non-rigid structure-from-motion made easy - A spatial-temporal smoothness based solution
نویسندگان
چکیده
This paper proposes a simple spatial-temporal smoothness based method for solving dense non-rigid structure-frommotion (NRSfM). First, we revisit the temporal smoothness and demonstrate that it can be extended to dense case directly. Second, we propose to exploit the spatial smoothness by resorting to the Laplacian of the 3D non-rigid shape. Third, to handle real world noise and outliers in measurements, we robustify the data term by using the L1 norm. In this way, our method could robustly exploit both spatial and temporal smoothness effectively and make dense non-rigid reconstruction easy. Our method is very easy to implement, which involves solving a series of least squares problems. Experimental results on both synthetic and real image dense NRSfM tasks show that the proposed method outperforms state-of-the-art dense non-rigid reconstruction methods.
منابع مشابه
Learning Spatially-Smooth Mappings in Non-Rigid Structure From Motion
Non-rigid structure from motion (NRSFM) is a classical underconstrained problem in computer vision. A common approach to make NRSFM more tractable is to constrain 3D shape deformation to be smooth over time. This constraint has been used to compress the deformation model and reduce the number of unknowns that are estimated. However, temporal smoothness cannot be enforced when the data lacks tem...
متن کاملA Globally Optimal Approach for 3D Elastic Motion Estimation from Stereo Sequences
Dense and markerless elastic 3D motion estimation based on stereo sequences is a challenge in computer vision. Solutions based on scene flow and 3D registration are mostly restricted to simple non-rigid motions, and suffer from the error accumulation. To address this problem, this paper proposes a globally optimal approach to non-rigid motion estimation which simultaneously recovers the 3D surf...
متن کاملUsing Priors for Improving Generalization in Non-Rigid Structure-from-Motion
This paper describes how the generalization ability of methods for non-rigid Structure-from-Motion can be improved by using priors. Most point tracks are often visible only in some of the images; predicting the missing data can be important. Previous Maximum-Likelihood (ML)-approaches on implicit non-rigid Structure-from-Motion generalize badly. Although the estimated model fits well to the vis...
متن کاملSequential Bayesian Non-Rigid Structure from Motion
This thesis1 addresses the problem of recovering simultaneously camera motion and the 3D reconstruction of deformable objects from monocular video. We propose several methods to solve this problem in a sequential fashion, frame-by-frame estimation, as the data arrives. Deformable structures appear constantly in our everyday life, from human non-rigid motion (e.g., a smiling face or performing d...
متن کاملSpatio-temporal union of subspaces for multi-body non-rigid structure-from-motion
Non-rigid structure-from-motion (NRSfM) has so far been mostly studied for recovering 3D structure of a single non-rigid/deforming object. To handle the real world challenging multiple deforming objects scenarios, existing methods either pre-segment different objects in the scene or treat multiple non-rigid objects as a whole to obtain the 3D non-rigid reconstruction. However, these methods fai...
متن کامل