Identifying objects in conversation is a fundamental human capability necessary to achieve efficient collaboration on any real world task. Hence the deepening of our understanding of human referential behaviour is indispensable for the creation of systems that collaborate with humans in a meaningful way. We present the construction of REX-J, a multi-modal Japanese corpus of referring expression...

Cross-modal data retrieval has been the basis of various creative tasks performed by Arti€cial Intelligence (AI). One such highly challenging task for AI is to convert a book into its corresponding movie, which most of the creative €lm makers do as of today. In this research, we take the €rst step towards it by visualizing the content of a book using its corresponding movie visuals. Given a set...

The paper presents the experiments made to adapt and to synchronise the linguistic resources of the French language processing modules integrated in the MIAMM prototype, designed to handle multi-modal human-machine interactions. These experiments allowed us to identify a methodology for adapting multilingual resources for a dialogue system. In the paper, we describe the iterative joint process ...

When humans interact with spoken dialogue systems, parameters can be logged which quantify the flow of the interaction, the behavior of the user and the system, and the performance of individual system modules during the interaction. Although such parameters are not directly linked to the quality perceived by the user, they provide useful information for system development, optimization, and ma...

This study examines coordination of referring expressions in multimodal human-computer dialogue, i.e. to what extent users’ choices of referring expressions are affected by the referring expressions that the system is designed to use. An experiment was conducted, using a semi-automatic multimodal dialogue system for apartment seeking. The user and the system could refer to areas and apartments ...

In the development of spoken dialog systems, domain adaptation and dialog state-dependent language model are usually researched separately. This paper proposes a new approach for domain adaptation augmented by the dialog state-dependence, which means a dialog turn based cache model decaying synchronously with the dialog state change. Through this approach it’s more simple and rapid to adapt a C...

Statistical dialog management techniques have the main advantage of allowing an easy adaptation of the dialog model to different application domains. In this paper we propose to also adapt the operation of the dialog manager to the different subtasks that conform the structure of the dialog in each domain. To do so, we present a variation of a statistical dialog management technique to address ...