Representing Communicative Function and Behavior in Multimodal Communication
نویسنده
چکیده
In this paper I discuss how communicative behavior can be represented at two levels of abstraction, namely the higher level of communicative intent or function, which does not make any claims about the surface form of the behavior, and the lower level of physical behavior description, which in essence instantiates intent as a particular multimodal realization. I briefly outline the proposed SAIBA framework for multimodal generation of communicative behavior, which is an international research platform that fosters the exchange of components between different systems. The SAIBA framework currently contains a first draft of the lower level Behavior Markup Language (BML) and is starting work on the higher level Function Markup Language (FML). I also briefly explain the usefulness of this distinction by using examples of several implemented systems that each draws different strengths from it. These systems range from autonomous conversational agents to computer mediated communication.
منابع مشابه
Integrated Communicative Robot “BUGNOID”
A communicative robot “BUGNOID” that integrates various sensory data and behavior modules is introduced with some experimental results. For the achievement of flexible communication with humans, the robot has multimodal interface holding diverse channels of communication. Moreover, the robot can recognize the environment taking a human’s behavior into account in order to co-exist with them.
متن کاملApplying Theories of Communicative Action in Generation Using Logic Programming
One of the most attractive arguments for taking a logical approach to communication, action and knowledge is the prospect of accounting for the ability of agents to perform inference in performing and recognizing communicative actions. In this squib, I illustrate how NLG systems can pose and evaluate logical queries inspired by the work of (Moore, 1985; Morgenstern, 1987; Davis, 1994) to assess...
متن کاملRepresenting Communicative Functions in SAIBA with a Unified Function Markup Language
The SAIBA framework proposes two interface languages to represent separately an intelligent agent’s communicative functions (or intents) and the multimodal behavior determining how the functions are accomplished with a particular multimodal realization. For the functional level, the Function Markup Language (FML) has been proposed. In this paper we summarize the current status of FML as discuss...
متن کاملQualitative and Quantitative Crying Analysis of New Born Babies Delivered Under High Risk Gestation
Multimodal Human Machine Interactions in Virtual and Augmented Reality p. 1 Speech through the Ear, the Eye, the Mouth and the Hand p. 24 Multimodality Issues in Conversation Analysis of Greek TV Interviews p. 40 Representing Communicative Function and Behavior in Multimodal Communication p. 47 Using the iCat as Avatar in Remote Meetings p. 60 Using Context to Disambiguate Communicative Signals...
متن کاملA framework for analyzing embodied communicative feedback in multimodal corpora
Communicative feedback refers to unobtrusive (usually short) vocal or bodily expressions whereby a recipient of information can inform a contributor of information about whether he/she is able and willing to communicate, perceive the information, and understand the information. This paper provides a theory for embodied communicative feedback, describing the different dimensions and features inv...
متن کامل