ArtiSynth: A Biomechanical Simulation Platform for the Vocal Tract and Upper Airway
نویسندگان
چکیده
We describe ArtiSynth, a 3D biomechanical simulation platform directed toward modeling the vocal tract and upper airway. It provides an open-source environment in which researchers can create and interconnect various kinds of dynamic and parametric models to form a complete integrated biomechanical system which is capable of articulatory speech synthesis. An interactive graphical Timeline runs the simulation and allows the temporal arrangement of input/output channels to control or observe properties of the model’s components. Library support is available for particle-spring and rigid body systems, finite element models, and spline-based curves and surfaces. To date, these have been used to create a dynamic muscle-based model of the jaw, a deformable tongue model, a deformable airway, and a linear acoustics model, which have been connected together to form a complete vocal tract that produces speech and is drivable both by data and by dynamics.
منابع مشابه
Developing Physically-Based, Dynamic Vocal Tract Models using ArtiSynth
We describe the process of using ArtiSynth, a 3D biomechanical simulation platform, to build models of the vocal tract and upper airway which are capable of simulating speech sounds. ArtiSynth allows mass-spring, finite element, and rigid body models of anatomical components (such as the face, jaw, tongue, and pharyngeal wall) to be connected to various acoustical models (including source filte...
متن کاملArtisynth: an extensible, cross-platform 3d articulatory speech synthesizer
We describe our progress on the construction of a combined 3D face and vocal tract simulator for articulatory speech synthesis called ArtiSynth. The architecture provides six main modules: (1) a simulator engine and synthesis framework, (2) a two and three-dimensional model development component, (3) a numerics engine, (4) a graphical renderer, (5) an audio synthesis engine and (6) a graphical ...
متن کاملTailoring biomechanical model meshes for aero-acoustic simulations
To simulate the airflow and acoustic wave propagation associated with voice production, a closed surface mesh representing the vocal tract is needed. Biomechanically, the vocal tract is composed of surfaces from several different anatomical structures. We present a method for assembling a dynamic vocal tract mesh by trimming and stitching surface meshes tracking biomechanical models of relevant...
متن کاملUsing a Biomechanical Model and Articulatory Data for the Numerical Production of Vowels
We introduce a framework to study speech production using a biomechanical model of the human vocal tract, ArtiSynth. Electromagnetic articulography data was used as input to an inverse tracking simulation that estimates muscle activations to generate 3D jaw and tongue postures corresponding to the target articulator positions. For acoustic simulations, the vocal tract geometry is needed, but si...
متن کاملTools for Predicting Biomechanical Consequences of Alterations to Orofacial Anatomy
We are extending our biomechanics simulation toolkit, ArtiSynth [Fels 2006], with new methods relevant to surgical planning. Our research directions are focused on upper-airway and cranio-facial anatomy and predicting functional deficits associated with jaw surgery, such as mandible reconstruction [Curtis et al. 1997]. The principle features of ArtiSynth include simulation of constrained rigid-...
متن کامل