An Integrated System for Learning Multi-Step Robotic Tasks from Unstructured Demonstrations
نویسنده
چکیده
We present an integrated system for segmenting demonstrations, recognizing repeated skills, and generalizing multi-step tasks from unstructured demonstrations. This method combines recent work in Bayesian nonparametric statistics and learning from demonstration with perception using an RGBD camera to generalize a multi-step task on the PR2 mobile manipulator. We demonstrate the potential of our framework to learn a large library of skills over time and discuss how it might be improved with additional integration of components such as active learning, interactive feedback from humans, and more advanced perception.
منابع مشابه
Multi-Modal Imitation Learning from Unstructured Demonstrations using Generative Adversarial Nets
Imitation learning has traditionally been applied to learn a single task from demonstrations thereof. The requirement of structured and isolated demonstrations limits the scalability of imitation learning approaches as they are difficult to apply to real-world scenarios, where robots have to be able to execute a multitude of tasks. In this paper, we propose a multi-modal imitation learning fram...
متن کاملLearning Dexterous Manipulation for a Soft Robotic Hand from Human Demonstration
Dexterous multi-fingered hands can accomplish fine manipulation behaviors that are infeasible with simple robotic grippers. However, sophisticated multi-fingered hands are often expensive and fragile. Low-cost soft hands offer an appealing alternative to more conventional devices, but present considerable challenges in sensing and actuation, making them difficult to apply to more complex manipu...
متن کاملIntentionGAN: Multi-Modal Imitation Learning from Unstructured Demonstrations
Traditionally, imitation learning has focused on using isolated demonstrations of a particular skill [3]. The demonstration is usually provided in the form of kinesthetic teaching, which requires the user to spend sufficient time to provide the right training data. This constrained setup for imitation learning is difficult to scale to real world scenarios, where robots have to be able to execut...
متن کاملComplex Task Learning from Unstructured Demonstrations
A simple system that allows end-users to intuitively program robots is a key step in getting robots out of the laboratory and into the real world. Although in many cases it is possible for an expert to successfully program a robot to perform complex tasks, such programming requires a great deal of knowledge, is time-consuming, and is often task-specific. In response to this, much recent work ha...
متن کاملExtreme Sensitive Robotic - A Context-Aware Ubiquitous Learning
Our work focuses on Extreme Sensitive Robotic that is on multi-robot applications that are in strong interaction with humans and their integration in a highly connected world. Because human-robots interactions have to be as natural as possible, we propose an approach where robots Learn from Demonstrations, memorize contexts of learning and self-organize their parts to adapt themselves to new co...
متن کامل