Facial animation has been combined with text-to-speech synthesis to create innovative multimodal interfaces. In this paper, we present an architecture for this multimodal interface. A face model is downloaded from a server into a client. The client uses an MPEG-4 compliant speech synthesizer that animates the head. The server sends text and animation data to the client in addition to regular co...

Our goal is to build a system of 3-D animation of facial expressions of emotion correlated with the intonation of the voice. Up till now, the existing systems did not take into account the link between these two features. Many linguists and psychologists have noted the importance of spoken intonation for conveying different emotions associated with speakers' messages. Moreover, some psychologis...

Approach: In this work, we plan instead to explore the use of structured light techniques for acquiring 3D. These techniques [4] acquire 3D shape by projecting a grid on a subject’s face. By analyzing the deformations of these lines, the 3D shape is inferred. The advantage of using structured light is that it enables frame-rate capture of 3D (unlike Cyberware), and acquires more accurate 3D tha...

The primary aim of automated facial animation is to allow us to take a 3D head model of a subject in a single expression (usually neutral) and to generate a range of expressions and facial poses without requiring the intervention of a traditional animator. Given the ability to automatically generate a full range of expressions and head poses for a specific model we are able to use the model as ...

This thesis proposes a novel approach for automated 3D speech animation from audio. An end-to-end system is presented which undergoes three principal phases. In the acquisition phase, dynamic articulation motions are recorded and amended. The learning phase studies the correlation of these motions in their phonetic context in order to understand the visual nature of speech. Finally, for the syn...

The enforcement of intellectual property rights is dif-cult for digital data. One possibility to support the enforcement is the embedding of digital watermarks containing information about copyright owner and/or receiver of the data. Watermarking methods have already been presented for audio, images, video, and polygonal 3D models. In this paper, we present a method for digital watermarking of ...

Character Animation has a crucial role in modern videogames: it is essential to provide a realistic and immersive experience to the users. This chapter presents the main problems when preparing characters for animation, describes current solutions, and discusses published research and future directions in the fields of character rigging and animation. Its main focus is on facial animation, whic...

We present a new facial animation approach that produces a wide variety of realistic facial expressions with advantages over existing geometry deformation and morphing methods for performance-driven animation systems. These systems sense and reconstruct a real person's facial expressions from an image sequence. The novelty of our approach is to sense and animate both textures and geometry using...

We present a system for tracking facial expression and head pose with one camera and no special markers, and generating a face animation to imitate these expressions simultaneously. The tracking is based on Gabor wavelet coefficients (jets) of the facial feature points, a saccadic searching strategy, and a model-based adjustment. Using Principal Components Analysis (PCA), we established an expr...

The importance of modeling speech articulation for high-quality audiovisual (AV) speech synthesis is widely acknowledged. Nevertheless, while state-of-the-art, data-driven approaches to facial animation can make use of sophisticated motion capture techniques, the animation of the intraoral articulators (viz. the tongue, jaw, and velum) typically makes use of simple rules or viseme morphing, in ...