Speech robot mimicking human articulatory motion
نویسندگان
چکیده
We have developed a mechanical talking robot, Waseda Talker No. 7 Refined II, to study the human speech mechanism. The conventional control method for this robot is based on a concatenation rule of the phoneme-specific articulatory configurations. With this method, the speech mechanism of the robot is much slower than is required for human speech, because the robot requires momentary movement of motors. To resolve this problem, we have developed a control method that mimics human articulatory trajectory data. The human trajectory data for continuous speech was obtained by using an electromagnetic articulography (EMA) system. The EMA data was converted to the robot control parameters by applying inverse kinematics as well as geometric transformation. Experimental results show that the robot can produce continuous speech with human-like speed and smooth movement.
منابع مشابه
Control System for Talking Articulatory Movement
The ultimate goal of our study is to create a new speech production system, in which an anthropomorphic hardware talking robot is handled so as to imitate human articulatory movement. We have developed a software motion simulator, which generates control parameter sequences for the talking robot Waseda Talker No. 2 (WT-2) using the trajectories of human articulatory organs during continuous utt...
متن کاملHuman Feature Extraction the Role of the Articulatory Rhythm
Neuro-physical investigations [1] hint to a new paradigm for feature extraction not used in ASR. This paradigm is based on synchronized brain to brain oscillations, active during speech production and speech perception. This mechanism leads to an evolving theory, the author calls the Unified Theory of Human Speech Processing (UTHSP). The core elements of this theory are the articulatory rhythm ...
متن کاملRecognizing Speech with Anthropomorphic Models For Voice Synthesis Application to Humanoid Robotics
In order to emulate in robots the speech production and learning capabilities of human infants, exploratory strategies in articulatory synthesizers have been proposed for the creation of acoustic to motor associations. However, commonly used articulatory speech synthesis models are based on an unconstrained modeling of the physiology of the human vocal tract which contain many redundant paramet...
متن کاملArticulatory synthesis from x-rays and inversion for an adaptive speech robot
This paper describes a speech robotic approach to articulatory synthesis. An anthropomorphic speech robot has been built, based on a real reference subject’s data. This speech robot, called the Articulotron, has a set of relevant degrees of freedom for speech articulators, jaw, tongue, lips, and larynx. The associated articulatory model has been elaborated from cineradiographic midsagittal prof...
متن کاملArticulatory features for speech-driven head motion synthesis
This study investigates the use of articulatory features for speech-driven head motion synthesis as opposed to prosody features such as F0 and energy that have been mainly used in the literature. In the proposed approach, multi-stream HMMs are trained jointly on the synchronous streams of speech and head motion data. Articulatory features can be regarded as an intermediate parametrisation of sp...
متن کامل