Shape Based Learning for Grasping Novel Objects in Cluttered Scenes
نویسندگان
چکیده
This paper presents a novel approach to clearing a table with a heap of objects. Form, size, position, orientation and constellation of the objects are a priori unknown. Coping with incomplete point cloud data is an additional challenge. There are three key contributions. First, we introduce Height Accumulated Features (HAF) which provide an efficient way of calculating grasp related feature values. The second contribution is an extensible machine learning system for binary classification of grasp hypotheses based on raw point cloud data. Finally, a practical heuristic for selection of the most robust grasp hypothesis is introduced. We evaluate our system in experiments where a robot was required to autonomously clear a table with a heap of unknown objects. Despite the complexity of the scenarios, our system cleared the table each time without human interaction and with a grasp failure rate below three percent.
منابع مشابه
Monocular Depth Perception and Robotic Grasping of Novel Objects a Dissertation Submitted to the Department of Electrical Engineering and the Committee on Graduate Studies of Stanford University in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy
The ability to perceive the 3D shape of the environment is a basic ability for a robot. We present an algorithm to convert standard digital pictures into 3D models. This is a challenging problem, since an image is formed by a projection of the 3D scene onto two dimensions, thus losing the depth information. We take a supervised learning approach to this problem, and use a Markov Random Field (M...
متن کاملRecognizing Objects in Range Data Using Regional Point Descriptors
Recognition of three dimensional (3D) objects in noisy and cluttered scenes is a challenging problem in 3D computer vision. One approach that has been successful in past research is the regional shape descriptor. In this paper, we introduce two new regional shape descriptors: 3D shape contexts and harmonic shape contexts. We evaluate the performance of these descriptors on the task of recognizi...
متن کاملDistributed Neural Plasticity for Shape Learning in the Human Visual Cortex
Expertise in recognizing objects in cluttered scenes is a critical skill for our interactions in complex environments and is thought to develop with learning. However, the neural implementation of object learning across stages of visual analysis in the human brain remains largely unknown. Using combined psychophysics and functional magnetic resonance imaging (fMRI), we show a link between shape...
متن کاملProbabilistic Models of Object Geometry with Application to Grasping
Robot manipulators typically rely on complete knowledge of object geometry in order to plan motions and compute grasps. But when an object is not fully in view it can be difficult to form an accurate estimate of the object’s shape and pose, particularly when the object deforms. In this paper we describe a generative model of object geometry based on Mardia and Dryden’s “Probabilistic Procrustea...
متن کاملStatistical Approaches to Inferring Object Shape from Single Images
Depth inference is a fundamental problem of computer vision with a broad range of potential applications. Monocular depth inference techniques, particularly shape from shading dates back to as early as the 40's when it was rst used to study the shape of the lunar surface. Since then there has been ample research to develop depth inference algorithms using monocular cues. Most of these are based...
متن کامل