The paper overviews previous works on acidity and acid communication, their nature and causes. Then it presents a qualitative study on a real case of acid communication in an Italian politician. An annotation scheme is proposed to single out ingredients of multimodal acid communication, and the mental ingredients of annoyance, distance, defiance are found as characterizing acidity.

Gogate, Bahrick, and Watson (2000) found that American mothers of pre-lexical infants (5-8 months) taught their infants novel words using temporal synchrony between the spoken words and objects' motions (multimodal motherese) more often than mothers of lexically advanced infants (21-30 months). In the present study, we examined the communicative interactions between Asian-Indian mothers and the...

This paper presents a knowledge-based method of early-stage high level multimodal fusion of data obtained from speech input and visual scene. The ultimate goal is to develop a human-computer multimodal interface to assist elderly people living alone at home to perform their daily activities, and to support their active ageing and social cohesion. Crucial for multimodal high level fusion and suc...

A user experiment on multimodal interaction (speech, hand position and hand shapes) to study two major relationships: between the level of cognitive load experienced by users and the resulting multimodal interaction patterns; and how the semantics of the information being conveyed affected those patterns. We found that as cognitive load increases, users’ multimodal productions tend to become se...

This paper explores the possibilities of using audio and haptics for interpersonal communication via mobile devices. Drawing on the literature on current messaging practises, a new concept for multimodal messaging has been designed and developed. The Shake2Talk system allows users to construct audio-tactile messages through simple gesture interactions, and send these messages to other people. S...

In human communication, people adapt to each other and jointly activate behavior in different ways. In this pilot study, focusing on one individual (Cf2) in four interactions two types of co-activation, i.e. repetition and reformulation in two modalities, vocal-verbal and gestural are investigated in two ChineseChinese and two Chinese-Swedish videorecordings of university students’ first encoun...