There has recently been high interest in affective computing, especially in interfaces which can analyse their users’ emotional state. Automatic emotion recognition in faces is a hard problem, requiring a number of pre-processing steps which attempt to detect or track the face, to locate characteristic facial regions such as eyes, mouth and nose on it, to extract and follow the movement of faci...

In current dialogue systems the use of speech as an input modality is common. But this modality is only one of those human beings use. In human–human interaction people use gestures to point or facial expressions to show their moods as well. To give modern systems a chance to read information from all modalities used by humans, these systems must have multimodal user interfaces. The SMARTKOM sy...

In this paper we address the problem of facial expression recognition. We have developed a new facial model based only on visual information. This model describes a set of bidimensional regions corresponding to those elements which most clearly define a facial expression. The problem of facial gestures classification has been divided into three subtasks: face segmentation, finding and describin...

This paper addresses the problem of human emotion estimation. Human emotion understanding will play a very important role in future humancomputer interaction systems. Human emotion is a complicated temporal behavior. The technical difficulty in human emotion estimation lies in that the inherent emotional states are not measured directly. The only way to estimate the emotional states is from obs...

expression recognition (happy, sad, disgust, surprise, angry, fear expressions) is application of advanced object detection, pattern recognition and classification task. Facial expression recognition techniques detecting emotion of people’ using their facial expressions. This has found applications in technical fields such as Human-computer-Interaction (HCI) and security monitoring. It generall...

Emotionally-aware Man-Machine Interaction (MMI) systems are presently at the forefront of interest of the computer vision and artificial intelligence communities, since they give the opportunity to less technology-aware people to use computers more efficiently, overcoming fears and preconceptions. Most emotion-related facial and body gestures are considered to be universal, in the sense that th...

Despite the fact that there is critical grammatical information expressed through facial expressions and head gestures, most research in the field of sign language recognition has primarily focused on the manual component of signing. We propose a novel framework for robust tracking and analysis of non-manual behaviours, with an application to sign language recognition. The novelty of our method...

As a novel approach to perform user authentication, we propose a multimodal biometric system that uses faces and gestures obtained from a single vision sensor. Unlike typical multimodal biometric systems using physical information, the proposed system utilizes gesture video signals combined with facial images. Whereas physical information such as face, fingerprints, and iris is fixed and not ch...

The animation of an ECA, for a large range of animation systems, implies that the behaviour of this ECA is encoded in a representation language giving a form of realization for speech, prosody, facial expressions, gaze, head and torso movements, gestures, and so on. Interested in gestures, some representation languages already exist that are suited for a particular application or domain, or eve...