INTERFACE: a new tool for building emotive/expressive talking heads

نویسندگان

  • Graziano Tisato
  • Piero Cosi
  • Carlo Drioli
  • Fabio Tesser
چکیده

In order to speed-up the procedure for building an emotive/expressive talking head such as LUCIA, an integrated software called INTERFACE was designed and implemented in Matlab©. INTERFACE simplifies and automates many of the operations needed for that purpose. A set of processing tools, focusing mainly on dynamic articulatory data physically extracted by an automatic optotracking 3D movement analyzer, was implemented in order to build up the animation engine, that is based on the Cohen-Massaro coarticulation model, and also to create the correct WAV and FAP files needed for the animation. LUCIA, our animated MPEG-4 talking face, in fact, can copy a real human by reproducing the movements of some markers positioned on his face and recorded by an optoelectronic device, or can be directly driven by an emotional XML tagged input text, thus realizing a true audio visual emotive/expressive synthesis. LUCIA’s voice is based on an Italian version of FESTIVAL MBROLA packages, modified for expressive/emotive synthesis by means of an appropriate APML/VSML tagged language.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Describing "INTERFACE" a matlabÉ tool for building talking heads

INTERFACE is a Matlab©.tool for simplifying and automating many of the operations needed for building a talking head. INTERFACE consists of set of processing tools, focusing on dynamic articulatory data physically extracted by an automatic optotracking 3D movement analyzer. The final aim of INTERFACE is that of building up the animation engine of LUCIA our emotive/expressive Italian talking hea...

متن کامل

Describing "INTERFACE" a Matlab© Tool for Building Talking Heads

INTERFACE is a Matlab©.tool for simplifying and automating many of the operations needed for building a talking head. INTERFACE consists of set of processing tools, focusing on dynamic articulatory data physically extracted by an automatic optotracking 3D movement analyzer. The final aim of INTERFACE is that of building up the animation engine of LUCIA our emotive/expressive Italian talking hea...

متن کامل

INTERFACE Toolkit: A New Tool for Building IVAs

INTERFACE is an integrated software implemented in Matlab© and created to speed-up the procedure for building an emotive/expressive talking head. Various processing tools, working on dynamic articulatory data physically extracted by an optotracking 3D movement analyzer called ELITE, were implemented to build the animation engine and also to create the correct WAV and FAP files needed for the an...

متن کامل

Data-Driven Tools for Designing Talking Heads Exploiting Emotional Attitudes

Audio/visual speech, in the form of labial movement and facial expression data, was utilized in order to semi-automatically build a new Italian expressive and emotive talking head capable of believable and emotional behavior. The methodology, the procedures and the specific software tools utilized for this scope will be described together with some implementation examples.

متن کامل

A MPEG-4 Virtual Human Animation Engine for Interactive Web Based Applications

This paper presents a novel, MPEG-4 compliant animation engine (body player). It has been designed to synthesize virtual human full-body animations in interactive multimedia applications for the web. We believe that a full-body player can provide a more expressive and interesting interface than the use of animated faces only (talking heads). This is one of the first implementations of a MPEG-4 ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2005