Varieties of multi-modal menu outputs were examined in a real driving situation with respect to efficient system interaction and aspects of safety. An electronic manual served as an exemplary application. The speech output was combined with four different display-versions concerning the timing of the output. The test was based on a within-subject-design. Every subject performed one control cond...

The flow of spoken interaction between human interlocutors is a widely studied topic. Amongst other things, studies have shown that we use a number of facial gestures to improve this flow – for example to control the taking of turns. This type of gestures ought to be useful in systems where an animated talking head is used, be they systems for computer mediated human-human dialogue or spoken di...

In this paper we present our work on the integration of human pointing gestures into a spoken dialog system in Spanish for conversational service robots. The dialog system is composed by a dialog manager, an interpreter that guides the spoken dialog and robot actions, in terms of user intentions and relevant environment stimuli associated to the current conversational situation. We demonstrate ...

Quality of Telephone-Based Spoken Dialogue Systems. Quality of Human-Machine Interaction over the Phone.Quality prediction models for telephone-based spoken dialogue systems. Perform to guarantee an acceptable overall quality for the user. In order to.action HHI as one reference for telephonebased humanmachine interaction HMI. The quality of interactions with spoken dialogue systems is difficul...

A conversational approach to spoken human-machine interaction, the primary and most stable mode of interaction for many people with cognitive impairments, can require proactive control of the interactive flow from the system side. While spoken technology has primarily focused on unimodal spoken interruptions to this end, we propose a multimodal embodied approach with a virtual agent, incorporat...

This paper describes the integration of a cognitive memory model into a spoken dialog system for an in-car tourguide application. This memory model enhances the capabilities of the system and of the simulated user by estimating if and which information is relevant and useful in a given situation. An evaluation study with 15 human judges is performed to demonstrate the feasibility of the describ...