Referring in Installments: A Corpus Study of Spoken Object References in an Interactive Virtual Environment
نویسندگان
چکیده
Commonly, the result of referring expression generation algorithms is a single noun phrase. In interactive settings with a shared workspace, however, human dialog partners often split referring expressions into installments that adapt to changes in the context and to actions of their partners. We present a corpus of human–human interactions in the GIVE-2 setting in which instructions are spoken. A first study of object descriptions in this corpus shows that references in installments are quite common in this scenario and suggests that contextual factors partly determine their use. We discuss what new challenges this creates for NLG systems.
منابع مشابه
Easy Things First: Installments Improve Referring Expression Generation for Objects in Photographs
Research on generating referring expressions has so far mostly focussed on “oneshot reference”, where the aim is to generate a single, discriminating expression. In interactive settings, however, it is not uncommon for reference to be established in “installments”, where referring information is offered piecewise until success has been confirmed. We show that this strategy can also be advantage...
متن کاملSpeech and 2D Deictic Gesture Reference to Virtual Scenes
Humans make ample use of deictic gesture and spoken reference in referring to perceived phenomena in the spatial environment, such as visible objects, sound sources, tactile objects, or even sources of smell and taste. Multimodal and natural interactive systems developers are beginning to face the challenges involved in making systems correctly interpret user input belonging to this general cla...
متن کاملRefer-iTTS: A System for Referring in Spoken Installments to Objects in Real-World Images
Commonly, the output of a referring expression generation system is written text which is, typically, presented to a human user as a one-shot expression. Consequently, the majority of existing REG systems interact with users in a very rigid and strictly turnbased fashion: only after the system has fully completed and delivered the result of the REG process, the user is able to read it and react...
متن کاملThe Assessment of Pragmatic Knowledge in the Online General IELTS-Practice Resources: A Corpus Analysis of Writing Tasks
Motivated by the concept of Communicative Language Ability and the eminence of the IELTS exam, this study intended to scrutinize the representation of functional knowledge (FK) and socio-linguistic knowledge (SK) as sub-components of pragmatic knowledge in the writing performances of both tasks of the online General IELTS-practice resources across three band scores. This quantitative inter-scor...
متن کاملA Comparative Study of Metadiscourse Markers in English and Persian University Lectures
The purpose of this study was to compare metadiscourse markers in forty English and Persian university lectures. Twenty of them were selected from the British Academic Spoken English corpus. The other 20 were selected from an Iranian website (www.maktoobkhane.com). We used Hyland’s (2005) model of metadiscourse. The metadiscourses were collected. Further, the frequency of each type was studied....
متن کامل