We present a method that determines articulatory movements from speech acoustics using an HMM (Hidden Markov Model)-based speech production model. The model statistically generates speech acoustics and articulatory movements from a given phonemic string. It consists of HMMs of articulatory movements for each phoneme and an articulatory-to-acoustic mapping for each HMM state. For a given speech ...

OROFACIAL AND VOCAL-TRACT SHAPES Hani Yehia1 Philip Rubin2 Eric Vatikiotis-Bateson1 [email protected] [email protected] [email protected] 1ATR Human Information Research Laboratories 2-2 Hikaridai, Seika-cho, Soraku-gun, Kyoto 619-02, Japan 2Haskins Laboratories 270 Crown St. New Haven{CT 06511, U.S.A. ABSTRACT This paper examines the degrees of correlation among vocal tract and orof...

C. W. Barnes, “Roundoff noise and overflow in normal digital filters,” IEEE Tram. Circuits Syst., vol. CAS-26, pp. 154159, Mar. 19’79. W. L. Mills, C. T. Mullis, and R. A.-Roberts, “Normal realizations of IIR digital filters,” in 1979 IEEE Int. Qnf. Acoustics, Speec,h, Signal Processing Rec., pp. 340-343, Apr. 1979. M. Atjmattd and R. A. Roberts, “Reduced multiplier, low roundoff noise digital ...

The goal of the proposed research is to test a statistical model of speech recognition that incorporates the knowledge that speech is produced by relatively slow motions of the tongue, lips, and other speech articulators. This model is called Maximum Likelihood Continuity Mapping (Malcom). Many speech researchers believe that by using constraints imposed by articulator motions, we can improve o...

In this paper, we present and discuss an educational system in the fields of acoustics and speech science using a series of physical models of the human vocal tract. Because education in acoustics is relevant for several fields related to speech communication, it hosts students from a variety of educational backgrounds. Moreover, we believe that an education in acoustics is important for studen...

We investigated dynamic programming (DP) and statemodel (SM) approaches for estimating gestural scores from speech acoustics. We performed a word-identification task using the gestural pattern vector sequences estimated by each approach. For a set of 75 randomly chosen words, we obtained the best word-identification accuracy (66.67%) using the DP approach. This result implies that considerable ...

This paper introduces a new dynamical model which enhances the relationship between face movements and speech acoustics. Based on the autocorrelation of the acoustics and of the face movements, a causal and a non-causal filter are proposed to approximate dynamical features in the speech signals. The database consisted of sentences recorded acoustically, and by using a Qualisys system to capture...