In this article, we compare feedback-related multimodal behaviours in two different types of interactions: first encounters between two participants who do not know each in advance, and naturally-occurring conversations between two and three participants recorded at their homes. All participants are Danish native speakers. The interactions are transcribed using the same methodology, and the mul...

Individuals with Autism Spectrum Condition (ASC) face a number of challenges during social interaction due to their limited ability to decode non-verbal cues. Interactive digital games can help as tools to teach such people how to express and recognise non-verbal cues and interpret their emotional meanings. In this paper, we present a set of interactive interfaces that can assist in teaching pe...

The improvements of automatic face recognition during the last 2 decades have disclosed new applications like border control and camera surveillance. A new application field is forensic face recognition. Traditionally, face recognition by human experts has been used in forensics, but now there is a quickly developing interest in automatic face recognition as well. At the same time there is a tr...

Change in a speaker’s emotion is a fundamental component in human communication. Automatic recognition of spontaneous emotion would significantly impact human-computer interaction and emotion-related studies in education, psychology and psychiatry. In this paper, we explore methods for detecting emotional facial expressions occurring in a realistic human conversation setting—the Adult Attachmen...

In this chapter, a nonverbal way of communication for human–robot interaction by understanding human upper body gestures will be addressed. The human– robot interaction system based on a novel combination of sensors is proposed. It allows one person to interact with a humanoid social robot with natural body language. The robot can understand the meaning of human upper body gestures and express ...

Affective computing researchers adopt a variety of methods in analysing or synthesizing aspects of human behaviour. The choice of method depends on which behavioural cues are considered salient or straightforward to capture and comprehend, as well as the overall context of the interaction. Thus, each approach focuses on modelling certain information and results to dedicated representations. How...

In this paper, we present a new text-driven avatar system, which consists of three major components, a text-to-speech (TTS) unit, a speech driven facial animation (SDFA) unit and a text-to-sign language (TTSL) unit. A new visual prosody time control model and an integrated learning framework are proposed to realize synchronization among speech synthesis, face animation and gesture animation, wh...

We describe a method based on Principal Component Analysis for extracting a small number of parameters from the whole of an image. These parameters can then be used for characterisation, recognition and reconstruction. The method itself is by no means new, and has a number of obvious flaws. In this paper we suggest improvements, based on purely theoretical considerations, in which the image is ...

In face recognition system, the efficiency and face detection rate is the key issue for designing the algorithm because the computer can recognize very large number of faces with high computational speed but it is not as efficient as human. There are many modern face recognition algorithms which efficiently detect face but also have false recognition. In this paper, we propose a new hybrid algo...

INTRODUCTION Visual object recognition, particularly face recognition, is a difficult computational problem. Each face might appear as an infinite number of different 2-D images. The face could vary relative to the viewer in position, pose, lighting, gesture, aging and background.