The emerging area of Multimodality can be well demonstrated in the operation of a Telecom. Within France Telecom there are thriving fixline, Internet and mobile businesses that can benefit from the use of Multimodal interactions. In todays networks, Multimodal interactions are particularly relevant to the mobile space, where constraints of the network and handset have a driving influence on the...

This paper describes a method and a piece of equipment for capturing data about the use of a mobile multimodal device in natural settings . The equipment includes an instrument worn by the user to capture his or her perspective while moving, a means of capturing a wider view of the context and a multimodal data logger.

|This paper presents a statistical approach to developing multimodal recognition systems and, in particular, to integrating the posterior probabilities of parallel input signals involved in the multimodal system. We rst identify the primary factors that innuence multimodal recognition performance by evaluating the multimodal recognition probabilities. We then develop two techniques, an estimate...

Designing and building automated systems with which people can interact naturally is one of the emerging objective of Mechatronics. In this perspective multimodality and adaptivity represent focal issues, enabling users to communicate more freely and naturally with automated systems. One of the basic problem of multimodal interaction is the fusion process. Current approaches to fusion are mainl...

This paper addresses two related topics: Firstly, it presents building-blocks for flexible multimodal dialog interfaces based on standardized components (VoiceXML, XML) to indicate that thanks to well-supported standardizations, mobile multimodal interfaces to heterogeneous data sources are becoming ready for mass-market deployment, provided that adequate modularization is respected. Secondly, ...

This paper deals with classifying ambiguities for Multimodal Languages. It evolves the classifications and the methods of the literature on ambiguities for Natural Language and Visual Language, empirically defining an original classification of ambiguities for multimodal interaction using a linguistic perspective. This classification distinguishes between Semantic and Syntactic multimodal ambig...

We present a multimodal volume-based pre-operative surgical planning system developed around the KRDL Virtual Workbench, a mirror-based Virtual Reality system for precise work with 3D data. The planning system is being developed in collaboration with the Singapore General Hospital (SGH), and is undergoing clinical evaluation at SGH and Tan Tock Seng Hospital where 16 cases have been planned. We...