$%675$&7 In this paper we discuss an extension of the Algebra of Expressions, an algebraic structure introduced in an earlier paper, consisting of a set of operators and related properties defined over a set that is a generalization of the MPEG-4’s Facial Animation Parameters. In particular, we extend the definition of the operators acting on whole animations, i.e. sequences of frames represent...

In this paper, an approach that animates facial expressions through speech analysis is presented. An individualized 3D head model is first generated by modifying a generic head model, where a set of MPEG-4 Facial Definition Parameters (FDPs) has been pre-defined. To animate realistic facial expressions of the 3D head model, key frames of facial expressions are calculated from motion-captured da...

Facial expression is one of the most expressive ways for human beings to deliver their emotion, intention, and other nonverbal messages in face to face communications. In this chapter, a layered parametric framework is proposed to synthesize the emotional facial expressions for an MPEG4 compliant talking avatar based on the three dimensional PAD model, including pleasure-displeasure, arousal-no...

MPEG-4 is the international coding standard developed for information transfer via low bit-rate communication channels. This article is the report on an experimental implementation of full-automatic pipeline MPEG-4 Synthetic Video Facial Animation (Simple Profile). This REAL-TIME pipeline includes the automatic detection, encoding, network transfer, and decoding of the facial animation paramete...

We present a novel Facial Motion Cloning method relying on the combination of the radial basis functions (RBF) based scattered data interpolation with the encoding capabilities of the MPEG-4 Facial and Body Animation (FBA) international standard. Beside from an initial manual selection of feature points, our method works fully automatically without user interaction. The produced talking head is...

Both the AVSP and FAA conferences have a common focus on facial communication research. The AVSP conference concentrates on how auditory and visual speech information plays a role in human perception, machine recognition, and human-machine interaction. FAA focuses on facial animation analysis and synthesis addressed in the fields of computer graphics, computer vision and psychology. The aim of ...

Facial feature tracking for model–based coding has evolved over the past decades. Of particular interest is its application in very low bit rate coding in which optimization is used to analyze head and shoulder sequences. We present the results of a computational experiment in which we apply a combination of non-dominated sorting genetic algorithm and a deterministic search to find optimal faci...

Speech animation is traditionally considered as important but tedious work for most applications, especially when taking lip synchronization (lip-sync) into consideration, because the muscles on the face are complex and interact dynamically. Although there are several methods proposed to ease the burden on artists to create facial and speech animation, almost none are fast and efficient. In thi...

In this paper, we present a real-time facial animation system in which speech drives mouth movements and facial expressions synchronously. Considering five basic emotions, a hierarchical structure with an upper-layer of emotion classification is established. Based on the recognized emotion label, the under-layer classification at sub-phonemic level has been modelled on the relationship between ...