Prosodic Synchrony for Error Management in Human-Computer Interaction
نویسندگان
چکیده
This paper presents a new direction for managing the speech recognition errors of a computer with spoken dialogue functions. Our approach uses an implicit control of human voice prosody by focusing on human behavior characteristics, i.e., interactional synchrony at the prosodic level as one of errorprevention methods. In this paper, we introduce a simple experiment to examine the same prosodic synchrony between a subject and a computer at the same acoustic power level as that in human-human conversation. Consequently, we obtained the asymmetric results: subjects follow the change in sound power level in a computer voice when it’s in the increasing direction but not in the decreasing direction.
منابع مشابه
Quantification of prosodic entrainment in affective spontaneous spoken interactions of married couples
Interaction synchrony among interlocutors happens naturally as people adapt their speaking style gradually to promote efficient communication. In this work, we quantify one aspect of interaction synchrony prosodic entrainment, specifically pitch and energy, in married couples’ problem-solving interactions using speech signal-derived measures. Statistical testings demonstrate that some of these ...
متن کاملProsody change and response timing analysis in spontaneously spoken dialogs and their modeling in a spoken dialog system
If a dialog system were to respond to a user as naturally as a human, interaction would be smoother. Imitating the human prosodic behavior of utterances is important in computer-human natural conversations. In this paper, to develop a cooperative/friendly spoken dialog system, we analyzed the correlations between F0 synchrony tendency or overlap frequency and subjective measures: “liveliness,” ...
متن کاملAn Information Theoretic Analysis of the Temporal Synchrony Between Head Gestures and Prosodic Patterns in Spontaneous Speech
We analyze the temporal co-ordination between head gestures and prosodic patterns in spontaneous speech in a data-driven manner. For this study, we consider head motion and speech data from 24 subjects while they tell a fixed set of five stories. The head motion, captured using a motion capture system, is converted to Euler angles and translations in X, Y and Z-directions to represent head gest...
متن کاملExit from Synchrony in Joint Improvised Motion
Motion synchrony correlates with effective and well-rated human interaction. However, people do not remain locked in synchrony; Instead, they repeatedly enter and exit synchrony. In many important interactions, such as therapy, marriage and parent-infant communication, it is the ability to exit and then re-enter synchrony that is thought to build strong relationship. The phenomenon of entry int...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کامل