This paper explores the use of multisensory information fusion technique with Dynamic Bayesian networks (DBNs) for modeling and understanding the temporal behaviors of facial expressions in image sequences. Our approach to the facial expression understanding lies in a probabilistic framework by integrating the DBNs with the facial action units (AUs) from psychological view. The DBNs provide a c...

Abstract This paper presents a novel face detection and gender classification strategy in color images under nonuniform background. This is done by detecting the human skin regions in image given and detecting facial features based on the measurements in pixels. The proposed algorithm converts the RGB image into the YCbCr color space to detect the skin regions in the facial image. But in order ...

We propose a novel approach for detection of the facial midline from a frontal face image. Using midline as a guide reduces computational cost required for facial feature extraction (FFE) because the midline is capable of restricting multi-dimensional searching process into one-dimensional search. The proposed method detects the facial midline from an edge image as the symmetry axis using the g...

We have developed a system that recognizes the facial expressions in Taiwanese Sign Language (TSL) using a phoneme-based strategy. A facial expression is decomposed into three facial phonemes, including eyebrow, eye, and mouth. A fast method is proposed for locating the areas facial phonemes. The shapes of the phonemes were then matched by the deformable template method, giving feature points r...

We present a nonparametric facial feature localization method using relative directional information between regularly sampled image segments and facial feature points. Instead of using any iterative parameter optimization technique or search algorithm, our method finds the location of facial feature points by using a weighted concentration of the directional vectors originating from the image ...

Facial caricature as a facial image media acts as an interface between the user and the computer. We developed the facial caricaturing robot “COOPER” (Fig. 1) that was exhibited at the Prototype Robot Exhibition of EXPO 2005 [1]. COOPER watches the face of a person seated at the chair, obtains facial images, and analyzes the images to extract 251 feature points to generate his facial line drawi...

The Facial Action Coding System, (FACS), devised by Ekman and Friesen (1978), provides an objective meanS for measuring the facial muscle contractions involved in a facial expression. In this paper, we approach automated facial expression analysis by detecting and classifying facial actions. We generated a database of over 1100 image sequences of 24 subjects performing over 150 distinct facial ...

This paper proposes an accurate, rotation invariant, and fast approach for detection of facial features from thermal images. The proposed approach combines both appearance and geometric information to detect the facial features. A texture based detector is performed using Haar features and AdaBoost algorithm. Then the relation between these facial features is modeled using a complex Gaussian di...

The Facial Action Coding System, (FACS), devised by Ekman and Friesen (1978), provides an objective means for measuring the facial muscle contractions involved in a facial expression. In this paper, we approach automated facial expression analysis by detecting and classifying facial actions. We generated a database of over 1100 image sequences of 24 subjects performing over 150 distinct facial ...

Automatic human emotion recognition from facial expressions has grabbed the attention of computer scientists for long, as it is necessary to understand the underlying emotions for effective communication. Over the last decade, many researchers have done a lot of work on emotion recognition from facial expressions using the techniques of image processing and computer vision. In this paper we exp...