Empirical Evaluation of Interactive Multimodal Error Correction
نویسنده
چکیده
Recently, the first commercial dictation systems for continuous speech have become available. Although they generally received positive reviews, error correction is still limited to choosing from list of alternatives, speaking again or typing. We developed a set of multimodal interactive correction methods which allow the user to switch modality between continuous speech, spelling, handwriting and pen gestures. We integrated these correction methods with our large vocabulary speech recognition system to build a prototypical multimodal listening typewriter. We designed an experiment to empirically evaluate the efficiency of different error correction methods. The experiment compares multimodal correction with methods available in current speech recognition applications. We confirm the hypothesis that switching modality can significantly expedite corrections. However in applications where a keyboard is acceptable, typing correction remains the fastest method to correct errors for users with good typing skills. If the keyboard is not desired, either due to application constraints or user preferences, our multimodal error correction enables state-ofthe-art speech recognition technology to deliver keyboard-free text input which beats fast unskilled typing in input speed, including the time necessary to correct errors.
منابع مشابه
Fuzzy particle swarm optimization with nearest-better neighborhood for multimodal optimization
In the last decades, many efforts have been made to solve multimodal optimization problems using Particle Swarm Optimization (PSO). To produce good results, these PSO algorithms need to specify some niching parameters to define the local neighborhood. In this paper, our motivation is to propose the novel neighborhood structures that remove undesirable niching parameters without sacrificing perf...
متن کاملEffective error recovery strategies for multimodal form-filling applications
The goal of the research described in this article is to determine in what way speech recognition errors can be handled best in a multimodal form-filling interface. Besides two well-known error correction mechanisms (re-speaking the value and choosing the correct value from a list of alternatives), the interface offers a novel correction mechanism in which the user selects the first letter of t...
متن کاملCharacter-Level Interaction in Multimodal Computer-Assisted Transcription of Text Images
To date, automatic handwriting text recognition systems are far from being perfect and heavy human intervention is often required to check and correct the results of such systems. As an alternative, an interactive framework that integrates the human knowledge into the transcription process has been presented in previous works. In this work, multimodal interaction at character-level is studied. ...
متن کاملField Trial, Evaluation and Error Correction methods of an IVR based Commodity Price Retrieval System
Present study illustrates the entire evaluation and improvement process of an IVR based agricultural commodity price information retrieval system developed mainly for the semiliterate or illiterate farmers. Like evaluation of any real world speech recognition application, the system also has to face challenge regarding spoken language conventions, pronunciation variations, recognition in noisy ...
متن کامل