Experiments on Building Language Resources for Multi-Modal Dialogue Systems
نویسندگان
چکیده
The paper presents the experiments made to adapt and to synchronise the linguistic resources of the French language processing modules integrated in the MIAMM prototype, designed to handle multi-modal human-machine interactions. These experiments allowed us to identify a methodology for adapting multilingual resources for a dialogue system. In the paper, we describe the iterative joint process used to build linguistic resources for the two cooperative modules: speech recognition for speech modality and syntactic/semantic parsing.
منابع مشابه
Language Resources for Multi-Modal Dialogue Systems
This paper reviews a resource base of software agents for hub-based architectures, which can be used generally for advanced dialogue systems research and deployment. The problem of domain-specificity of dialogue managers is discussed, and we describe an approach to it developed at CSLI, involving a domain-general dialogue manager with application specific “Activity Models”. We also describe rel...
متن کاملRules for Automatic Grapheme-to-Allophone Transcription in Slovene
The domain of spoken language technologies ranges from speech input and output systems to complex understanding and generation systems, including multi-modal systems of widely differing complexity (such as automatic dictation machines) and multilingual systems (for example, automatic dialogue and translation systems). The definition of standards and evaluationmethodologies for such systems invo...
متن کاملHuman-Machine Dialogue for Multi-Modal Decision Support Systems
In this paper we describe some of the research on multi-modal dialogue being performed in the Interactive Systems group at the Navy Center for Applied Research in Artificial Intelligence at the Naval Research Laboratory. Our concern with multi-modal interfaces arises from our past work in developing general-purpose natural language interfaces that can be applied to a variety of decision support...
متن کاملA Portuguese spoken and multi
This paper presents an overview of the spoken and multimodal dialog Portuguese corpora collected in the context of the FASiL (Flexible and Adaptive Spoken Language and Multi-Modal Interfaces) project. The project developed a Virtual Personal Assistant application in the Personal Information Management domain, exploiting the state-of-theart of speech and multi-modal technology. The FASiL corpora...
متن کاملAnnotation of negotiation processes in joint-action dialogues
Situated dialogue corpora are invaluable resources for understanding the complex relationships among language, perception, and action. Accomplishing shared goals in the real world can often only be achieved via dynamic negotiation processes based on the interactants’ common ground. In this paper, we investigate ways of systematically capturing structural dialogue phenomena in situated goal-dire...
متن کامل