Simultaneous Visual Recognition of Manipulation Actions and Manipulated Objects
نویسندگان
چکیده
The visual analysis of human manipulation actions is of interest for e.g. human-robot interaction applications where a robot learns how to perform a task by watching a human. In this paper, a method for classifying manipulation actions in the context of the objects manipulated, and classifying objects in the context of the actions used to manipulate them is presented. Hand and object features are extracted from the video sequence using a segmentation based approach. A shape based representation is used for both the hand and the object. Experiments show this representation suitable for representing generic shape classes. The action-object correlation over time is then modeled using conditional random fields. Experimental comparison show great improvement in classification rate when the action-object correlation is taken into account, compared to separate classification of manipulation actions and manipulated objects.
منابع مشابه
Recognition of Manipulated Objects by Motor Learning
We present two neural network controller learning schemes based on feedbackerror-learning and modular architecture for recognition and control of multiple manipulated objects. In the first scheme, a Gating Network is trained to acquire object-specific representations for recognition of a number of objects (or sets of objects). In the second scheme, an Estimation Network is trained to acquire fu...
متن کاملVisual object-action recognition: Inferring object affordances from human demonstration
This paper investigates object categorization according to function, i.e., learning the affordances of objects from human demonstration. Object affordances (functionality) are inferred from observations of humans using the objects in different types of actions. The intended application is learning from demonstration, in which a robot learns to employ objects in household tasks, from observing a...
متن کاملExploiting Three-Dimensional Gaze Tracking for Action Recognition During Bimanual Manipulation to Enhance Human–Robot Collaboration
Human–robot collaboration could be advanced by facilitating the intuitive, gaze-based control of robots, and enabling robots to recognize human actions, infer human intent, and plan actions that support human goals. Traditionally, gaze tracking approaches to action recognition have relied upon computer vision-based analyses of two-dimensional egocentric camera videos. The objective of this stud...
متن کاملFingertip Radius Effect of an on-Surface-Manipulated Object
Cooperative arms are two or more arms in series which assume the structure of a parallel robot on account of gripping an intermediary object, and are commonly used in accurate assembly industries, coaxialization, movement of object, etc. Gripping an intermediary object is one of the complicated subjects in analysis of cooperative arms, whose analysis is mostly dependent upon the manner the obje...
متن کاملVisual perception for the 3D recognition of geometric pieces in robotic manipulation
Physics, Systems Engineering and Signal Theory Department University of Alicante PO Box 99, 03080, Alicante. Spain. [email protected], [email protected], [email protected] Abstract: During grasping and intelligent robotic manipulation tasks, the camera position relative to the scene changes dramatically because the robot is moving to adapt its path and correctly grasp objects. This...
متن کامل