Detection of Head Pose and Gaze Direction for Human-Computer Interaction
نویسندگان
چکیده
In this contribution we extend existing methods for head pose estimation and investigate the use of local image phase for gaze detection. Moreover we describe how a small database of face images with given ground truth for head pose and gaze direction was acquired. With this database we compare two different computational approaches for extracting the head pose. We demonstrate that a simple implementation of the proposed methods without extensive training sessions or calibration is sufficient to accurately detect the head pose for human-computer interaction. Furthermore, we propose how eye gaze can be extracted based on the outcome of local filter responses and the detected head pose. In all, we present a framework where different approaches are combined to a single system for extracting information about the attentional state of a person.
منابع مشابه
Human-computer Interaction Using Head Movements
This paper presents a real-time gaze direction estimation approach. The face region and facial features are extracted automatically by applying skin detection, gray-scale morphology and a geometrical face model. The Kalman filtering is applied for tracking and estimation of the 3-D pose of the moving head. The rough gaze direction is determined from the orientation of the head. Experiments with...
متن کاملProbabilistic Mapping of Human Visual Attention from Head Pose Estimation
Effective interaction between a human and a robot requires the bidirectional perception and interpretation of actions and behavior. While actions can be identified as a directly observable activity, this might not be sufficient to deduce actions in a scene. For example, orienting our face toward a book might suggest the action toward “reading.” For a human observer, this deduction requires the ...
متن کاملIntegrating Head Pose to a 3d Multi- Texture Approach for Gaze Detection
Lately, the integration of gaze detection systems in human-computer interaction (HCI) applications has been increasing. For this to be available for everyday use and for everybody, the imbedded gaze tracking system should be one that works with low resolution images coming from ordinary webcams and permits a wide range of head poses. We propose the 3D Multi-Texture Active Appearance Model (MT-A...
متن کاملHead Pose Estimation Using Convolutional Neural Networks
Detection and estimation of head pose is fundamental problem in many applications such as automatic face recognition, intelligent surveillance, and perceptual human-computer interface and in an application like driving, the pose of the driver is used to estimate his gaze and alertness, where faces in the images are non-frontal with various poses. In this work head pose of the person is used to ...
متن کاملAugmented saliency model using automatic 3D head pose detection and learned gaze following in natural scenes
Previous studies have shown that gaze direction of actors in a scene influences eye movements of passive observers during free-viewing (Castelhano, Wieth, & Henderson, 2007; Borji, Parks, & Itti, 2014). However, no computational model has been proposed to combine bottom-up saliency with actor's head pose and gaze direction for predicting where observers look. Here, we first learn probability ma...
متن کامل