The number of cars provided with an in-car communication system has considerably increased during the past few years. Using a mobile phone whilst driving is a safety-critical task and can cause usability issues. Speech modality has been incorporated in order to allocate hands and eyes solely to the driving task speech. This paper discusses an investigation into in-car communication systems and ...

In this paper I will present my approach on how to merge the HCI field with the new growing field of agent technology, especially from the point of view of the use and need of a personal assistant. Multimodality is a must if we are ever to implement a user-friendly, intuitive and effective interface for a user to interact with a system (agent or other). Selecting modality for presentation can b...

1. Why is the topic of multimodal communication interesting? Face-to-face communication is the evolutionary primary and most common way of communicating for humans. It is not unlikely that vocal-verbal language with more or less intentional control, but still to some extent systematic, developed from being action-and gesture-based to being vocally based (Arbib 2005). In contrast to the hundreds...

Over the last decade, most studies in Computer-Mediated Communication (CMC) have highlighted how online synchronous learning environments implement a new literacy related to multimodal communication. The environment used in our experiment is based on a synchronous audio-graphic conferencing tool. This study concerns false beginners in an English for Specific Purposes (ESP) course, presenting a ...

This study examined the relationship between the number of communication technologies used for social interactions (i.e., multimodal connectedness) and well-being across the lifespan. Consistent with the assumptions of media multiplexity, multimodal connectedness and frequency of strong-tie communication enhancedwell-being, but only for older-age cohorts (35–54 and 55–70+). For young adults (18...

This paper deals with the MUMIN multimodal annotation scheme (Allwood et al 2004), which was developed for the study of gestures and facial displays in interpersonal communication, with particular regard to the role played by multimodal expressions for feedback, turn management and sequencing. The scheme has been applied to the analysis of multimodal behaviour in short video clips in Swedish, F...

This paper deals with a multimodal annotation scheme dedicated to the study of gestures in interpersonal communication, with particular regard to the role played by multimodal expressions for feedback, turn management and sequencing. The scheme has been developed under the framework of the MUMIN network and tested on the analysis of multimodal behaviour in short video clips in Swedish, Finnish ...