A Multimodal Human-Robot-Dialog Applying Emotional Feedbacks
نویسندگان
چکیده
This paper presents a system for human-robot communication situated in an ambient assisted living scenario, where the robot performs an orderand-serve-procedure. The interaction is based on different modalities that extract information from the auditory and the visual channel in order to obtain an intuitive and natural dialog. The required interaction dialog structure is represented in first-order logic, which allows to split a complex task into simpler subtasks. The different communication modalities are utilized to conclude these subtasks by determining information about the human interaction partner. The system works in real-time and robust and utilizes emotional feedback to enrich the communication process.
منابع مشابه
User Localization During Human-Robot Interaction
This paper presents a user localization system based on the fusion of visual information and sound source localization, implemented on a social robot called Maggie. One of the main requisites to obtain a natural interaction between human-human and human-robot is an adequate spatial situation between the interlocutors, that is, to be orientated and situated at the right distance during the conve...
متن کاملRapid simulation-driven reinforcement learning of multimodal dialog strategies in human-robot interaction
In this work we propose a procedure model for rapid automatic strategy learning in multimodal dialogs. Our approach is tailored for typical task-oriented human-robot dialog interactions, with no prior knowledge about the expected user and system dynamics being present. For such scenarios, we propose the use of stochastic dialog simulation for strategy learning, where the user and system error m...
متن کاملA Multimodal Emotion Detection System during Human-Robot Interaction
In this paper, a multimodal user-emotion detection system for social robots is presented. This system is intended to be used during human-robot interaction, and it is integrated as part of the overall interaction system of the robot: the Robotics Dialog System (RDS). Two modes are used to detect emotions: the voice and face expression analysis. In order to analyze the voice of the user, a new c...
متن کاملUsing Spatial Language in a Human-Robot Dialog
In conversation, people often use spatial relationships to describe their environment, e.g., “There is a desk in front of me and a doorway behind it”, and to issue directives, e.g., “Go around the desk and through the doorway.” In our research, we have been investigating the use of spatial relationships to establish a natural communication mechanism between people and robots, in particular, for...
متن کاملApplying the Wizard-of-Oz Technique to Multimodal Human-Robot Dialogue
Our overall program objective is to provide more natural ways for soldiers to interact and communicate with robots, much like how soldiers communicate with other soldiers today. We describe how the Wizard-of-Oz (WOz) method can be applied to multimodal human-robot dialogue in a collaborative exploration task. While the WOz method can help design robot behaviors, traditional approaches place the...
متن کامل