Automatic Generation of Non-Verbal Facial Expressions from Speech
نویسندگان
چکیده
Speech synchronized facial animation that controls only the movement of the mouth is typically perceived as wooden and unnatural. We propose a method to generate additional facial expressions such as movement of the head, the eyes, and the eyebrows fully automatically from the input speech signal. This is achieved by extracting prosodic parameters such as pitch flow and power spectrum from the speech signal and using them to control facial animation parameters in accordance to results from paralinguistic research.
منابع مشابه
Facial Expression Recognition Based on Anatomical Structure of Human Face
Automatic analysis of human facial expressions is one of the challenging problems in machine vision systems. It has many applications in human-computer interactions such as, social signal processing, social robots, deceit detection, interactive video and behavior monitoring. In this paper, we develop a new method for automatic facial expression recognition based on facial muscle anatomy and hum...
متن کاملMay I talk to you? : -)" - Facial Animation from Text
We introduce a facial animation system that produces real-time animation sequences including speech synchronization and non-verbal speech-related facial expressions from plain text input. A state-of-the-art text-to-speech synthesis component performs linguistic analysis of the text input and creates a speech signal from phonetic and intonation information. The phonetic transcription is addition...
متن کاملAutomatic Facial Expression Recognition Using Image Processing and Bayesian Regularized Recurrent Neural Network
Facial expressions can be considered as a means of communication by non-verbal signals. They are essential part of human relations. Automatic facial expressions recognition can be imperative for natural human-machine interaction. Automatic facial expressions recognition can be utilized in the field of behavioral science and in the health care department. Although humans perceive the facial expr...
متن کاملRUNNING HEAD : Mapping Facial Expression Mapping and Manipulating Facial Expression
opinions, findings, conclusions, or recommendations expressed herein are those of the authors and do not reflect the views of NSF or Carnegie Mellon University. ABSTRACT Non-verbal visual cues accompany speech to supplement the meaning of spoken words, signify emotional state, indicate position in discourse, and provide back-channel feedback. This visual information includes head movements, fac...
متن کاملInterplay between Linguistic and Affective Goals in Facial Expression during Emotional Utterances
Communicative goals are simultaneously expressed through gestures and speech to convey messages enriched with valuable verbal and non-verbal clues. This paper analyzes and quantifies how linguistic and affective goals are reflected in facial expressions. Using a database recorded from an actress with markers attached to her face, the facial features during emotional speech were compared with th...
متن کامل