This paper argues that automatic speech recognition (ASR) should accommodate dysarthric speech by incorporating knowledge of the production characteristics of these speakers. We describe the acquisition of a new database of dysarthric speech that includes aligned acoustics and articulatory data obtained by electromagnetic articulography. This database is used to train theoretical and empirical ...

1 Introduction No two students are the same. Pronunciation teaching should be started after teachers know exactly how individual students are in their development. In one-to-fifty situations such as classrooms, it is difficult for a teacher to know their pronunciations precisely. Computers have provided us with tools to visualize the pronunciations based on acoustics. In this case, however, goo...

Recent work on end-to-end automatic speech recognition (ASR) has shown that the connectionist temporal classification (CTC) loss can be used to convert acoustics to phone or character sequences. Such systems are used with a dictionary and separately-trained Language Model (LM) to produce word sequences. However, they are not truly end-to-end in the sense of mapping acoustics directly to words w...

One area of voice research that has historically been understudied is the interaction between voice pathology and acoustic aspects of the speech signal that affect intelligibility. Landmark-based software tools are particularly suited to fast, automatic analysis of small, non-lexical differences in the acoustic signal reflecting the production of speech. We are building a tool set that provides...

As a part of our effort to develop a unified computational framework for speech-to-speech translation, so that sub-optimizations or local optimizations can be avoided, we are developing direct models for speech recognition. In direct model, the focus is on the creation of one single integrated model p(text| acoustics), rather than a complex series of artifices, therefore various factors such as...

This paper presents current research activities for developing a Concept Prototype for the Beijing 2008 Olympic Games (CPBOG) at the Institute of Acoustics, Chinese Academy of Sciences. The System is to provide live sports, touring, traveling information for visitors to Beijing, China during 2008 Olympic periods. Our in house up-todate speech recognition, speech understanding, multimedia proces...

Past investigations demonstrate that the acoustical environment of a classroom is a critical factor in the academic, psychoeducational, and psychosocial achievement of children with normal hearing and with hearing impairment. This article examines several acoustical variables, such as noise, reverberation, and speaker-listener distance, which can deleteriously affect speech perception in classr...

PURPOSE In this study, the authors explored articulatory information as a means of improving the recognition of dysarthric speech by machine. METHOD Data were derived chiefly from the TORGO database of dysarthric articulation (Rudzicz, Namasivayam, & Wolff, 2011) in which motions of various points in the vocal tract are measured during speech. In the 1st experiment, the authors provided a bas...