Man-machine oral and multimodal communication

Man - machine oral and multimodal communication Rennes

Multimodal Cooperative Resolution of Referential Expressions in the DenK System

In this paper, we focus on the problem of the resolution of multimodal referential expressions in a cooperative man-machine communication setting. We do not only concentrate on how to resolve references involving multiple modalities, but we also indicate how the system can respond cooperatively in case this resolution should fail.

Achieving Multimodal Cohesion during Intercultural Conversations

How do English as a lingua franca (ELF) speakers achieve multimodal cohesion on the basis of their specific interests and cultural backgrounds? From a dialogic and collaborative view of communication, this study focuses on how verbal and nonverbal modes cohere together during intercultural conversations. The data include approximately 160-minute transcribed video recordings of ELF interactions ...

Context-Aware Multimodal Human-Computer Interaction

In the recent years multimodal interfaces have acquired an important role in human computer interaction applications. Humans use multimodality to reduce ambiguity and incompleteness of information. Seemingly they are able to switch easily from one modality to the other and fuse the information from different multimodal sources. The goal of our research was to develop a crisis based human like m...

An integrated system for cooperative man-machine interaction

An Integrated System for Cooperative Man-Machine Interaction C. Bauckhage, G.A. Fink, J. Fritsch, F. Kummert, F. L omker, G. Sagerer, S. Wachsmuth Technical Faculty, Bielefeld University P.O. Box 33594, Bielefeld, Germany http://www.techfak.uni-bielefeld.de/techfak/ags/ai/ Abstract To establish robotic applications in human environments as e.g. o ces or private homes the robotic systems must b...