Robust Multimodal Hand- and Head Gesture Recognition for Controlling Automotive Infotainment Systems
نویسندگان
چکیده
The use of gestures in automotive environments provides an intuitive addition to existing interaction styles for seamlessly controlling various infotainment applications like radio-tuner, cd-player and telephone. In this work, we describe a robust, context-specific approach for a video-based analysis of dynamic handand head gestures. The system, implemented in a BMW limousine, evaluates a continuous stream of infrared pictures using a combination of adapted preprocessing methods and a hierarchical, mainly rule based classification scheme. Currently, 17 different hand gestures and six different head gestures can be recognized in realtime on standard hardware. As a key-feature of the system, the active gesture vocabulary can be reduced with regard to the current operating context yielding more robust performance.
منابع مشابه
Evaluating Multimodal Interaction Patterns in Various Application Scenarios
In this work, we present the results of a comparative user study evaluating multimodal user interactions with regard to two different operation scenarios: a desktop Virtual-Reality application (DVA) and an automotive infotainment application (AIA). Besides classical tactile input devices, like touch-screen and key-console, the systems can be controlled by natural speech as well as by hand and h...
متن کاملTowards Multimodal Error Management: Experimental Evaluation of User Strategies in Event of Faulty Application Behavior in Automotive Environments
In this work, we present the results of a study analyzing the reactions of subjects on simulated errors of a dedicated in-car interface for controlling infotainment and communication services. The test persons could operate the system, using different input modalities, such as natural or command speech as well as head and hand gestures, or classical tactile paradigms. In various situational con...
متن کاملRobust Video-Based Recognition of Dynamic Head Gestures in Various Domains - Comparing a Rule-Based and a Stochastic Approach
This work describes two video-based approaches for detecting and classifying dynamic head-gestures. We compare a simple, fast, and efficient rule-based algorithm with a powerful, robust, and flexible stochastic implementation. In both realizations, the head is localized via a combination of colorand shape-based segmentation. For a continuous feature extraction, the rule-based approach uses a te...
متن کاملComparing an Innovative 3D and a Standard 2D User Interface for Automotive Infotainment Applications
In this work we present the results of a comparative user study of two radically different user interfaces for controlling infotainment applications in an automotive environment: a standard 2D interface and an innovative 3D interface. Based on a generic multimodal architecture, both systems can be operated by conventional key-console and touch-screen as well as by natural speech and dynamic han...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کامل