We present a method to combine standard and throat microphone signals for noise-robust speech recognition. Our approach is to extend the probabilistic optimum filter (POF) mapping algorithm to estimate standard microphone clean speech feature vectors from both microphones’ noisy speech feature vectors. We tested the proposed approach in two noisy speech recognition tasks. In the first task we u...

Microphone arrays are central players in hands-free speech interface applications. The main duty of a microphone array is capturing distant-talking speech with high quality. A microphone array can acquire the desired speech signals selectively by leading the beampattern towards the desired speaker. The foreseen application of ubiquitous sensing motivated by the abundance of microphone-embedded ...

The backscattered travel-time structure is obtained by cross-correlating air-acoustic ocean surf noise recorded on microphone pairs (separation ∼2 m) on the beach. The scatterer is a 20 cm radius Polyvinyl chloride pipe 2.5 m landside of the microphone array. Arrivals corresponding to the time-difference (travel-time difference between two scatterer-receiver paths) and scattered (travel time fo...

This paper outlines a new method to extract F0 from distanttalking speech signals acquired by a microphone network, which exploits the redundancy across the signals proceeding from each microphone, by jointly processing the different contributes. To this purpose, a multi-microphone periodicity function is derived from the magnitude spectrum computed on each microphone signal. This function allo...

Abstract—This paper describes a novel sensor device, a pressure pulse wave meter, which uses a bidirectional condenser microphone. The microphone work as a microphone as well as a sensor with high gain over a wide frequency range; they are also highly reliable and economic. Currently aging is becoming a serious social issue in Japan causing increased medical expenses in the country. Hence, it i...

In this paper we describe our initial efforts to make SPHINX, the CMU continuous speech recognition system, environmentally robust. Our work has two major goals: to enable SPHINX to adapt to changes in microphone and acoustical environment, and to improve the performance of SPHINX when it is trained and tested using a desk-top microphone. This talk will describe some of our work in acoustical p...

This thesis investigates the theory and design of recording the spherical harmonic components of an arbitrary three-dimensional sound field. The approach taken is based on capturing the spherical harmonic components using a spherical microphone. This choice led to the investigation of various design issues including the inherent limitations of the spherical microphone, discretization of the the...

We propose on-line unsupervised compensation technique for robust speech recognition that combines standard and throat microphone feature vectors. The solution, called MultiEnvironment Model-based LInear Normalization with Throat microphone information, MEMLINT, is an extension of MEMLIN formulation. Hence, standard microphone noisy space and throat microphone space are modelled as GMMs and a s...