Many human{machine interfaces based on face gestures are strongly user-dependent. We want to overcome this limitation by using common facial features like eyes, nose and mouth for gaze recognition. In a rst step an adaptive color histogram segmentation method roughly determines the region of interest including the user's face. Within this region we then use a hierarchical recognition approach t...

This paper describes a 2D realistic talking face. The facial appearance model is constructed with a parameterised 2D sample based model. This representation supports moderated head movements, facial gestures and emotional expressions. Two main contributions for talking heads applications are proposed. First, the image of the lips is synthesized by means of shape and texture information. Secondl...

This paper reports the results of a preliminary cross-evaluation experiment run in the framework of the European research project PF-Star1, with the double aim of evaluating the possibility of exchanging FAP data between the involved sites and assessing the adequacy of the emotional facial gestures performed by talking heads. The results provide initial insights in the way people belonging to v...

Automatic facial image analysis is a long standing research problem in computer vision. A key component in facial image analysis, largely conditioning the success of subsequent algorithms (e.g. facial expression recognition), is to define a vocabulary of possible dynamic facial events. To date, that vocabulary has come from the anatomically based Facial Action Coding System (FACS) or taxonomies...

Designing robots that interact naturally with people requires the integration of technologies and algorithms for communication modalities such as gestures, movement, facial expressions and user interfaces. To understand interdependence among these modalities, evaluating the integrated design in feasibility studies provides insights about key considerations regarding the robot and potential inte...

In this paper I describe ongoing research that seeks to provide a common framework for the generation and interpretation of spontaneous gesture in the context of speech. I present a testbed for this framework in the form of a program that generates speech, gesture, and facial expression from underlying rules specifying (a) what speech and gesture are generated on the basis of a given communicat...

Automatic facial image analysis is a long standing research problem in computer vision. A key component in facial image analysis, largely conditioning the success of subsequent algorithms (e.g. facial expression recognition), is to define a vocabulary of possible dynamic facial events. To date, that vocabulary has come from the anatomically based Facial Action Coding System (FACS) or taxonomies...

Although it is prevalent to use embodied modes of information (e.g., instructors’ movements and gestures) in instructional videos, there a lack comprehensive review elucidating how this type designed investigated research studies. This scoping the literature examined 55 empirical articles with 71 separate studies regarding videos reveal their characteristics design factors provide key findings ...

this paper presents a study examining how persian speakers use metaphoric gestures to represent different adverbs of time, and what these gestures reveal about the concept of time in their minds. a questionnaire containing 10 ambiguous questions, which made the participant use different adverbs of time, was given to 22 participants. they were filmed while trying to answer the questions. the cor...