In three studies, children aged 22 to 46 months (N = 180) needed integrate pointing gestures or gaze cues with positive and negative facial expressions succeed in an object-choice task. Finding a toy required either choose (positive expression) avoid (negative the indicated target. Study 1 showed that 22-month-olds are better at integrating expression gesture compared gesture. 2 tracked integra...

This paper presents results of three surveys of natural interactivity and multimodal resources carried out by a Working Group in the ISLE project on International Standards for Language Engineering. Information has been collected on a large number of corpora, coding schemes and coding tools world-wide. The paper presents the information collection process, the description and validation methods...

Facial Expressions play an important role in recognizing the human emotions without any verbal communication. Face emotion recognition is one of the main applications of computer vision. The research of emotion recognition includes facial expressions, voice recognition, gesture recognition, text etc. For efficient human-computer interaction, recognizing human emotional state is an important com...

We present a dynamic data-driven framework for tracking gestures and facial expressions from monocular sequences. Our system uses two cameras, one for the face and one for the body view for processing in different scales. Specifically, and for the gesture tracking module, we track the hands and the head, obtaining as output the blobs (ellipses) of the ROIs, and we detect the shoulder positions ...

Facial features tracking is widely used in face recognition, gesture, expression analysis, etc. AAM (Active Appearance Model) is one of the powerful methods for objects feature localization. Nevertheless, AAM still suffers from a few drawbacks, such as the view angle change problem. We present a method to solve it by using the depth data acquired from Kinect. We use the depth data to get the he...

In this work, we explore the relation between expressive head movement and user profile information in game play settings. Facial gesture analysis cues are statistically correlated with players’ demographic characteristics in two different settings, during game-play and at events of special interest (when the player loses during game play). Experiments were conducted on the Siren database, whic...

Automatic Facial Expression Recognition has been an active topic in computer science for over two decades, in particular Facial Action Coding System (FACS) Action Unit (AU) detection and classification of a number of discrete emotion states from facial expressive imagery. Standardisation and comparability has received some attention; for instance, there exist a number of commonly used facial ex...

The role of the face and mouth in speech production as well as non-verbal communication suggests the use of facial action to control musical sound. Here we document work on the Mouthesizer, a system which uses a headworn miniature camera and computer vision algorithm to extract shape parameters from the mouth opening and output these as MIDI control changes. We report our experience with variou...