Probabilistic Integration of Partial Lexical Information for Noise Robust Haptic Voice Recognition
نویسنده
چکیده
This paper presents a probabilistic framework that combines multiple knowledge sources for Haptic Voice Recognition (HVR), a multimodal input method designed to provide efficient text entry on modern mobile devices. HVR extends the conventional voice input by allowing users to provide complementary partial lexical information via touch input to improve the efficiency and accuracy of voice recognition. This paper investigates the use of the initial letter of the words in the utterance as the partial lexical information. In addition to the acoustic and language models used in automatic speech recognition systems, HVR uses the haptic and partial lexical models as additional knowledge sources to reduce the recognition search space and suppress confusions. Experimental results show that both the word error rate and runtime factor can be reduced by a factor of two using HVR.
منابع مشابه
A Robust Controller with Online Authority Transformation for Dual User Haptic Training System
In this study, a force reflection control structure is developed for the surgery training haptic system. In the surgery training haptic system, the surgical operation is cooperatively performed by a trainer and a trainee. The participation of each surgeon in the operation is established through their own haptic consoles. Although the operation is primarily performed by the trainee, the trainer ...
متن کاملTwo-layered audio-visual integration in voice activity detection and automatic speech recognition for robots
Automatic Speech Recognition (ASR) which plays an important role in human-robot interaction should be noise-robust because robots are expected to work in noisy environments. Audio-Visual (AV) integration is one of the key ideas to improve the robustness in such environments. This paper proposes two-layered AV integration for ASR which applies AV integration to Voice Activity Detection (VAD) and...
متن کاملIntegration of Color Features and Artificial Neural Networks for In-field Recognition of Saffron Flower
ABSTRACT-Manual harvesting of saffron as a laborious and exhausting job; it not only raises production costs, but also reduces the quality due to contaminations. Saffron quality could be enhanced if automated harvesting is substituted. As the main step towards designing a saffron harvester robot, an appropriate algorithm was developed in this study based on image processing techniques to recogn...
متن کاملThe recognition of Japanese-accented and unaccented English words by Japanese listeners
This study investigated whether Japanese listeners learning English employ two types of lexical information (word frequency and neighborhood density) when they recognize English words. English words recorded by a native speaker of English and a native speaker of Japanese were presented to Japanese university students in a noise condition. The results of word recognition scores showed that Japan...
متن کاملA New Algorithm for Voice Activity Detection Based on Wavelet Packets (RESEARCH NOTE)
Speech constitutes much of the communicated information; most other perceived audio signals do not carry nearly as much information. Indeed, much of the non-speech signals maybe classified as ‘noise’ in human communication. The process of separating conversational speech and noise is termed voice activity detection (VAD). This paper describes a new approach to VAD which is based on the Wavelet ...
متن کامل