In this article we propose a dialog-system for mobile software agents which allows a multi-modal interaction. The user interacts with the agent by means of a complex dialog, which is summarized and translated in an agent communication language. Hence, this approach solves the problem of natural language understanding for mobile software agents.

Multi-modal systems which can handle spontaneous speech have been popular in these days. But there are only a few multi-domain systems which consider about extensibility and scalability. This paper proposes an open architecture for the multi-domain spoken dialog systems which satis es extensibility and scalability. The key concept of the architecture is distribution and integration of the data ...

In order to achieve intuitive and easy operations for home network system (HNS), the authors have previously proposed user interface with virtual agent (called HNS virtual agent user interface, HNS-VAUI). The HNS-VAUI was implemented with MMDAgent toolkit. A user can operate appliances and services interactively through dialog with a virtual agent in a screen. However, the previous prototype he...

This paper presents a speech understanding component for enabling robust situated human-robot communication. The aim is to gain semantic interpretations of utterances that serve as a basis for multi-modal dialog management also in cases where the recognized word-stream is not grammatically correct. For the understanding process, we designed semantic processable units, which are adapted to the d...

Dialog systems for mobile robots operating in the real world should enable mixedinitiative dialog style, handle multi-modal information involved in the communication and be relatively independent of the domain knowledge. Most dialog systems developed for mobile robots today, however, are often system-oriented and have limited capabilities. We present an agentbased dialog model that are speciall...

August, a Swedish multi-modal spoken dialogue system featuring an animated agent, was used to collect a database of spontaneous computer-directed speech. The system was designed with several simple domains rather than a single complex one. It was installed in a public location in the center of Stockholm and was available for the general public during six months. The people who interacted with t...

This master’s thesis presents experiences from an evaluation of AdApt, a multi modal, conversational dialogue system, using PARADISE, PARAdigm for Dialogue System Evaluation, a general framework for evaluation. The purpose of this master’s thesis was to assess PARADISE as an evaluation tool for such a system. An experimental study with 26 subjects was performed. The subjects were asked to inter...