We propose a procedure for unsupervised identification of bimanual high-level object manipulation operations in multimodal data. The presented procedure applies a two-stage segmentation and a selection step to observation sequences. We employ an unsupervised Bayesian segmentation method to identify homogeneous segments which correspond to primitive object manipulation operations. The data is re...

This paper describes Dico II+, an in-vehicle dialogue system demonstrating a novel combination of flexible multimodal menu-based dialogueand a “speech cursor” which enables menu navigation as well as browsing long list using haptic input and spoken output.

This paper describes Dico II+, an in-vehicle dialogue system demonstrating a novel combination of flexible multimodal menu-based dialogue and a “speech cursor” which enables menu navigation as well as browsing long list using haptic input and spoken output.

Infants' perception of speech sound contrasts is modulated by their language environment, for example by the statistical distributions of the speech sounds they hear. Infants learn to discriminate speech sounds better when their input contains a two-peaked frequency distribution of those speech sounds than when their input contains a one-peaked frequency distribution. Effects of frequency distr...

the comparative study described in this paper to investigate the use of multimodal metaphors in interface of e-learning application. The primary focus is to present and discuss the experimental results related to users’ views and evaluation of individual avatar and recording video used in the experimental elearning tools. This investigation involved two different interface versions of the exper...

backround: we aimed to evaluate analgesic efficacy, opioid-sparing, and opioid-related adverse effects of intravenous paracetamol and intravenous dexketoprofen trometamol in combination with iv morphine after total abdominal hysterectomy. materials and methods: sixty american society of anesthesiologist physical status classification i-ii patients scheduled for total abdominal hysterectomy were...

This paper introduces the iGesture platform for investigating multimodal gesture based interactions in multimedia contexts. iGesture is a low-cost, extensible system that uses visual recognition of hand movements to support gesturebased input. Computer vision techniques support gesture based interactions that are lightweight, with minimal interaction constraints. The system enables gestures to ...

We are interested in multimodal systems that use the following modes and modalities: speech (and natural language) as input as well as output, gesture as input and visual as output using screen displays. The user exchanges with the system by gesture and/or oral statements in natural language. This exchange, encoded in the different modalities, carries the goal of the user and also the designati...

Copyright is held by the author/owner(s). TEI 2013, February 10-13, 2013, Barcelona, Spain ACM Abstract This paper presents work in progress on applying a Multimodal interaction (MMI) approach to studying interactive music performance. We report on a study where an existing musical work was used to provide a gesture vocabulary. The biophysical sensing already used in the work was used as input ...

The paper discusses usability and communicative capability of mobile multimodal systems. It reports on the evaluation of one particular interactive multimodal route navigation system and discusses the challenges encountered in this task. The main questions concerned the user’s preference of one input mode over the other (speech vs. tactile/graphics input), usefulness of the system in completing...