Visual Cue Streams for Multimodal Dialogue Interaction
نویسندگان
چکیده
This work examines the visual information streams as feedback to users engaging in multimodal interaction during specific settings. It reports on the findings from complexity and frequency of information presentation paired to user acceptance. It also addresses technical design issues by examining how multiple visual streams are presented in real situations, for the specific complex
منابع مشابه
Predicting Dialogue Acts for Intelligent Virtual Agents with Multimodal Student Interaction Data
Recent years have seen a growing interest in intelligent gamebased learning environments featuring virtual agents. A key challenge posed by incorporating virtual agents in game-based learning environments is dynamically determining the dialogue moves they should make in order to best support students’ problem solving. This paper presents a data-driven modeling approach that uses a Wizard-of-Oz ...
متن کاملVisual distraction test setup for an multimodal in-vehicle dialogue system
The goal of the SIMSI (Safe In-vehicle Multimodal Speech Interaction) project is threefold. Firstly, to integrate a dialogue system for menu-based dialogue with a GUI-driven in-vehicle infotainment system. Secondly, to further improve the integrated system with respect to driver distraction, thus making the system safer to use while driving. Thirdly, to verify that the resulting system decrease...
متن کاملEnabling collaborative geoinformation access and decision-making through a natural, multimodal interface
Current computing systems do not support human work effectively. They restrict human-computer interaction to one mode at a time and are designed with an assumption that use will be by individuals (rather than groups), directing (rather than interacting with) the system. To support the ways in which humans work and interact, a new paradigm for computing is required that is multimodal, rather tha...
متن کاملVisual perception, language and gesture: A model for their understanding in multimodal dialogue systems
The way we see the objects around us determines speech and gestures we use to refer to them. The gestures we produce structure our visual perception. The words we use have an influence on the way we see. In this manner, visual perception, language and gesture present multiple interactions between each other. The problem is global and has to be tackled as a whole in order to understand the compl...
متن کاملTutoring in a Spoken Language Dialogue System
We have developed interactive multimodal software tutors to teach users how to use a spoken dialogue timetable by guiding users and monitoring their interaction. They feature a visual representation of the spoken dialogue to support error recognition and recovery and thus helping the users to learn the required interaction style. Two different versions of tutoring were compared to a static web ...
متن کامل