The development of multimodal applications is still hampered by the necessity to integrate various technologies and frameworks into a coherent application. In 2012, the W3C proposed a multimodal architecture, standardizing the overall structure and events passed between the constituting components in a multimodal application. In this paper, we present our experiences with implementing a multimo...

|This paper presents a statistical approach to developing multimodal recognition systems and, in particular, to integrating the posterior probabilities of parallel input signals involved in the multimodal system. We rst identify the primary factors that innuence multimodal recognition performance by evaluating the multimodal recognition probabilities. We then develop two techniques, an estimate...

Multimodal systems support people with different needs and different features during the interaction process making it more easy and natural. However naturalness can usually produce ambiguous interpretation. This paper discusses ambiguities in multimodal interaction proposing in particular two different examples of ambiguities: a) multimodal ambiguities produced combining un-ambiguous modal inf...

drug abuse has high co-morbidity with mental disorders, thus, controlling and treating it requires multimodal treatment intervention. this cross sectional study evaluates personality traits of 67 ïv heroin abusers in kashan prison. the utilized instruments included two parts: a demographic questionnaire and mmpï. the data obtained from the questionnaires were statistically analyzed by using fis...

advances in optical coherence tomography have enabled a better appreciation of the role of pathologic choroidal changes in a variety of retinal disease. a “pachychoroid” (pachy-[prefix]: thick) is defined as an abnormal and permanent increase in choroidal thickness often showing dilated choroidal vessels and other structural alterations of the normal choroidal architecture. central serous c...

introduction failed back surgery syndrome (fbss) is an increasing cause of chronic pain in most countries. this poses high costs to both patients and national health organizations. case presentation in this report, multimodal pain management based on daily high-dose oxycodone/naloxone (oxn 180/90 mg) led to reduced patient's pain score and improved quality of life. conclusions oxycodone/naloxon...

The grand challenge of multimodal interface creation is to build reliable processing systems able to analyze and understand multiple communication means in real-time. This opens a number of associated issues covered by this chapter, such as heterogeneous data types fusion, architectures for real-time processing, dialog management, machine learning for multimodal interaction, modeling languages,...

Despite the increasing importance of multimodal volumetric data acquisition and the recent progress in advanced volume illumination, interactive multimodal volume illumination remains an open challenge. As a consequence, the perceptual benefits of advanced volume illumination algorithms cannot be exploited when visualizing multimodal data – a scenario where increased data complexity urges for i...

Multimodal interface aims at overcoming the shortcomings of conventional human-computer communication -serialized input, excessive accuracy, and low input efficiency -by exploiting the complementary nature of multiple modalities in interpreting user intent, thus improving the efficiency and naturalness of humancomputer interaction. In this paper, we present motivations driving multimodal interf...

The area of multimodal interaction has expanded rapidly and since the seminal “Put that there” demonstrator of R. Bolt that combines speech, gesture and eye tracking, significant achievements have been made in terms of both modalities and real multimodal systems. Nevertheless the design and development of multimodal systems still remains a difficult task. In this article, we present a graphical...