In this paper, we propose a robot that acquires multimodal information, i.e., visual, auditory, and haptic information, fully autonomously using its embodiment. We also propose batch and online algorithms for multimodal categorization based on the acquired multimodal information and partial words given by human users. To obtain multimodal information, the robot detects an object on a flat surfa...

Nowadays, multimodal data available to us through the Internet and other electronic media are explosively increasing both in number and in variety. Efficiently analyzing these data will save people a large amout of time. However, due to the property of multimodal data, methods used to uni-modal data usually perform ineffectively here. To handle such massive multimodal data for various purposes,...

BACKGROUND To evaluate if an opiate sparing multimodal regimen of dexamethasone, gabapentin, ibuprofen and paracetamol had better analgesic effect, less side effects and was safe compared to a traditional morphine and paracetamol regimen after cardiac surgery. METHODS Open-label, prospective randomized controlled trial. 180 patients undergoing cardiac procedures through median sternotomy, wer...

BACKGROUND The mushroom bodies of the insect brain play an important role in olfactory processing, associative learning and memory. The mushroom bodies show odor-specific spatial patterns of activity and are also influenced by visual stimuli. METHODOLOGY/PRINCIPAL FINDINGS Functional imaging was used to investigate changes in the in vivo responses of the mushroom body of the hawkmoth Manduca ...

Multimodal Interaction has the potential to significantly increase the ease of use of human computer interaction (HCI). At the same time, due to error-prone recognition based inputs, it is merely used in real-world applications. While literature on multimodal input fusion describes modeling of different user behaviors as a key for increased robustness, it still failed to prove it’s practical us...

Many networked systems involve multiple modes of transport. Such systems are called multimodal, and examples include logistic networks, biomedical phenomena, manufacturing process and telecommunication networks. Existing techniques for determining optimal paths in multimodal networks have either required heuristics or else application-specific constraints to obtain tractable problems, removing ...

This article explores the emergence of multimodality as intrinsic to the learning, teaching and assessment of English in the Twenty-First Century. With subject traditions tied to the study of language, literature and media, multimodal texts and new technologies are now accorded overdue recognition in English curriculum documents in several countries, though assessment tends to remain largely pr...

This article presents the development of an adaptive multimodal Digital Talking Book player using FAME. FAME is a conceptual framework for the development of adaptive multimodal applications. FAME's adaptation is based on context changes. The context is defined by three entities: User, Platform and Environment. The adaptation can impact multimodal operations, as well as interaction and presenta...

Multimodal interfaces have been used in helping blind and partially sighted people to access visualization tools such as graphs and numerical tables. However, few studies have been undertaken to improve Web access and navigation using a multimodal approach. This paper describes a novel approach that addresses this Web accessibility issue by using an assistive tool which consists of a multimodal...

When people work together, they often talk about the objects in their environment. Not surprisingly, their dialogues are multimodal, incorporating speech, gesture, gaze, haptics, and perhaps other modalities. However, proponents of technology may be troubled to learn that despite the current state and future promise of spoken and multimodal research, many of these workers do not particularly wa...