Developing Multimodal Spoken Dialogue Systems : Empirical Studies of Spoken Human-Computer Interaction
نویسنده
چکیده
This paper describes the data collected in Wizard of Oz experimentsin a spoken dialogue system, WAXHOLM, that provides informationon boat traffic in the Stockholm archipelago. The data consist ofutterance-length speech files, their corresponding transcriptions,and log files of the dialogue sessions. Apart from the spontaneousdialogue speech, the speech material also comprise recordings ofphonetically balanced reference sentences uttered by all 66 subjects.The recording procedure is described as well as somecharacteristics of the speech data and the dialogue.
منابع مشابه
On the Role of the NIMITEK Corpus in Developing an Emotion Adaptive Spoken Dialogue System
This paper reports on the creation of the multimodal NIMITEK corpus of affected behavior in human-machine interaction and its role in the development of the NIMITEK prototype system. The NIMITEK prototype system is a spoken dialogue system for supporting users while they solve problems in a graphics system. The central feature of the system is adaptive dialogue management. The system dynamicall...
متن کاملOlga - a conversational agent with gestures
The Olga project has developed an animated agent interface for information services. The interface combines a graphical interface, spoken dialogue and an animated 3D ‘human-like’ character for multimodal input and output. The interaction is intelligently managed using techniques derived from spoken dialogue but extended for the graphical modality. The Olga agent is innovative in combining a spo...
متن کاملA Testbed for Evaluating Multimodal Dialogue Systems for Small Screen Devices
This paper discusses the requirements for developing a multimodal spoken dialogue system for mobile phone applications. Since visual output as part of the multimodal system is limited through the restricted screen size of mobile phones, research in the field of information visualisation for small screen devices are discussed and combinations of these techniques with spoken output are sketched. ...
متن کاملPositive and negative user feedback in a spoken dialogue corpus
This paper examines feedback strategies in a Swedish corpus of multimodal human–computer interaction. The aim of the study is to investigate how users provide positive and negative feedback to a dialogue system and to discuss the function of these utterances in the dialogues. User feedback in the AdApt corpus was labeled and analyzed, and its distribution in the dialogues is discussed. The ques...
متن کاملThe NICE Fairy-tale Game System
This paper presents the NICE fairy-tale game system, in which adults and children can interact with various animated characters in a 3D world. Computer games is an interesting application for spoken and multimodal dialogue systems. Moreover, for the development of future computer games, multimodal dialogue has the potential to greatly enrichen the user’s experience. In this paper, we also prese...
متن کامل