The design of cooperative dialog systems, new human-computer interfaces (cf. Schomacher et al 1995) and avatars in various types of virtual environments can all be improved by better knowledge of features of real human-human multimodal communication. In this paper I discuss the nature of cooperation in dialog. I will also discuss what might be called features of flexibility and conflict prevent...

The purpose of this project is to develop a platform for human-robot and human-humanoid interface. One application of this platform is to study the impact of the feedbacks provided by the robot and the humanoid on the interaction. Several studies have shown the benefit of verbal and non-verbal analysis and synthesis for the improvement of Human-Agent Interaction and of HumanRobot Interaction (H...

In natural communication situations, multimodal referent specification is frequent and efficient. The linguistic component are deictic expressions, e.g. 'this' and 'here'. Extralinguistic devices in dialogs are different body movements, mainly pointing gestures. Their functional equivalent in texts are means like arrows and indices. This paper has two intentions. First, it discusses the advanta...

The paper presents an architecture for multimodal mood-based annotation systems. The architecture aims at the implementation of interactive multimodal systems to support communities of users in the creation and management of annotations in locative media projects. The annotations are multimodal in that they can be created and accessed through visual and audio interaction. The annotations are mo...

In this paper the project MobilTel is presented. The communication itself is becoming a multimodal interactive process. The MobilTel project provides research and development activities in multimodal interfaces area. The result is a functional architecture for mobile multimodal telecommunication system running on handheld device. The MobilTel communicator is a multimodal Slovak speech and graph...

This special issue was launched in parallel with the “speech and face to face communication” workshop organized in Grenoble in October 2008 and dedicated to the memory of Christian Benoît who died in 1998. The aim of this workshop was to show how and why speech communication must be increasingly studied in a face-to-face perspective in continuation of Christian Benoît’s researches. Speech commu...

Socially interactive robot needs the same behaviors and capabilities of human to be accepted as a member in human society. The environment, in which this robot should operate, is the human daily life. The interaction capabilities of current robots are still limited due to complex inter-human interaction system. Humans usually use different types of verbal and nonverbal cues in their communicati...

This paper reports on ongoing research of various aspects of multi-modal interactions in a Virtual Reality environment in which visitors can interact in diverse ways with agents and objects in the environment. The virtual environment is a copy of a theatre and is inhabited by both embodied and non-embodied agents that can assist the visitor: providing information about the performances, selling...

A well-annotated dance media is an essential part of a nation’s identity, transcending cultural and language barriers. Many dance video archives suffer from tremendous problems concerning authoring and access, because of the multimodal nature of human communication and complex spatio-temporal relationships that exist between dancers. A multimodal dance document consists of video of dancers in s...

This paper discusses software considerations for multimodal user interfaces, that is, systems able to support human-to-human modalities of communication (such as gesture and natural language). A definition and a classification of multimodal systems is proposed and the distinction between multimodal and multimedia systems is clarified. Then multiagent models and techniques used in graphical user...