Previous research has found that iconic gestures (i.e., gestures that depict the actions, motions or shapes of entities) identify referents that are also lexically specified in the co-occurring speech produced by proficient speakers. This study examines whether concrete deictic gestures (i.e., gestures that point to physical entities) bear a different kind of relation to speech, and whether thi...

We present an overview of research at UEA into the animation of sign language using a gesture notation, outlining applications that have been developed and key aspects of the implementation. We argue that the requirements for virtual human signing involve the development of expressive characters. Although the principal focus of work has been on sign language, we believe that the work can be gen...

This paper presents a generic ,modular and interactive architecture for embodied conversational agent called Greta. It is 3D agent able to communicate with users using verbal and non verbal channels like gaze, head and torso movements, facial expressions and gestures. Our architecture follows the SAIBA framework that defines modular structure, functionalities and communication protocols for ECA...

This paper deals with the MUMIN multimodal annotation scheme, which is dedicated to the study of hand gestures and facial displays in interpersonal communication, with focus on the role played by multimodal expressions for feedback, turn management and sequencing. The scheme has been tested on the analysis of multimodal behaviour in short video clips in Swedish, Finnish and Danish. These prelim...

Our researches focus on Sign Language (SL) gestures, which can be manual or non-manual (like facial expressions). This abstract presents the study we conduct in the field of French SL (LSF) processing. We intend to propose a coarticulation model of signs of LSF, thus we need accurate analysis of both isolated and in utterance signs. We follow a several step methodology: video corpus creation, a...

This work attempts to enhance telepresence by empowering nonverbal communication i.e. head gestures communication with an implementation of a robotic rear-projection head device. The feature of this implementation which is considered to be novel is the containment of all the necessary components for rear-head projection within the volume of a typical human head. This provides a natural look to ...

Emotion can be expressed in many ways that can be seen such as facial expression and gestures, speech and by written text. Emotion Detection in text documents is essentially a content – based classification problem involving concepts from the domains of Natural Language Processing as well as Machine Learning. In this paper emotion recognition based on textual data and the techniques used in emo...

Introduction In this technical sketch we introduce a new interaction paradigm: using facial gestures and expressions to control musical sound. The mouthesizer, a prototype of this general concept, consists of a miniature head mounted camera which acquires video input from the region of the mouth, extracts the mouth shape using a simple computer vision algorithm, and converts shape parameters to...

option is using avatars’ facial expressions to show warmth, surprise, anger and so on. Players can control avatars’ gestures and body movements. They can also ‘whisper’ messages to each other: these are audible only to the other partner in the conversation, and to the tutor. Finally, they can communicate with the tutor to ask for advice or clarification or to raise any other question that conce...

The style of humans is a source of information about the person, her personality and enjoyment in every-day life. We wish to endow virtual characters with style of nonverbal communication. We outline the diversity in gesturing style among humans, and identify the decisive factors. We propose a computational model for defining the styled virtual characters and generate gestures accordingly. The ...