Representing Communicative Function and Behavior in Multimodal Communication

نویسنده

  • Hannes Högni Vilhjálmsson
چکیده

In this paper I discuss how communicative behavior can be represented at two levels of abstraction, namely the higher level of communicative intent or function, which does not make any claims about the surface form of the behavior, and the lower level of physical behavior description, which in essence instantiates intent as a particular multimodal realization. I briefly outline the proposed SAIBA framework for multimodal generation of communicative behavior, which is an international research platform that fosters the exchange of components between different systems. The SAIBA framework currently contains a first draft of the lower level Behavior Markup Language (BML) and is starting work on the higher level Function Markup Language (FML). I also briefly explain the usefulness of this distinction by using examples of several implemented systems that each draws different strengths from it. These systems range from autonomous conversational agents to computer mediated communication.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Integrated Communicative Robot “BUGNOID”

A communicative robot “BUGNOID” that integrates various sensory data and behavior modules is introduced with some experimental results. For the achievement of flexible communication with humans, the robot has multimodal interface holding diverse channels of communication. Moreover, the robot can recognize the environment taking a human’s behavior into account in order to co-exist with them.

متن کامل

Applying Theories of Communicative Action in Generation Using Logic Programming

One of the most attractive arguments for taking a logical approach to communication, action and knowledge is the prospect of accounting for the ability of agents to perform inference in performing and recognizing communicative actions. In this squib, I illustrate how NLG systems can pose and evaluate logical queries inspired by the work of (Moore, 1985; Morgenstern, 1987; Davis, 1994) to assess...

متن کامل

Representing Communicative Functions in SAIBA with a Unified Function Markup Language

The SAIBA framework proposes two interface languages to represent separately an intelligent agent’s communicative functions (or intents) and the multimodal behavior determining how the functions are accomplished with a particular multimodal realization. For the functional level, the Function Markup Language (FML) has been proposed. In this paper we summarize the current status of FML as discuss...

متن کامل

Qualitative and Quantitative Crying Analysis of New Born Babies Delivered Under High Risk Gestation

Multimodal Human Machine Interactions in Virtual and Augmented Reality p. 1 Speech through the Ear, the Eye, the Mouth and the Hand p. 24 Multimodality Issues in Conversation Analysis of Greek TV Interviews p. 40 Representing Communicative Function and Behavior in Multimodal Communication p. 47 Using the iCat as Avatar in Remote Meetings p. 60 Using Context to Disambiguate Communicative Signals...

متن کامل

A framework for analyzing embodied communicative feedback in multimodal corpora

Communicative feedback refers to unobtrusive (usually short) vocal or bodily expressions whereby a recipient of information can inform a contributor of information about whether he/she is able and willing to communicate, perceive the information, and understand the information. This paper provides a theory for embodied communicative feedback, describing the different dimensions and features inv...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008