Multimodal conversational spoken dialogues using physical and virtual agents provide a potential interface to motivate and support users in the domain of health and fitness. In this paper we present how such multimodal conversational Companions can be implemented to support their owners in various pervasive and mobile settings. We present concrete system architectures, virtual, physical and mob...

numerous algorithms have been proposed to solve the shortest-pathproblem; many of them consider a single-mode network and crispcosts. other attempts have addressed the problem of fuzzy costs ina single-mode network, the so-called fuzzy shortest-path problem(fspp). the main contribution of the present work is to solve theoptimum path problem in a multimodal transportation network, inwhich the co...

abstractthe aim of intercultural translation is to communicate. communication is acted via verbal as well as visual means. the interaction of verbal and visual means of communication makes a set of complex situations which demand special attention in translation. one context in which the interaction of visual and verbal elements gets vital importance is children’s picture books. color is an int...

For many application areas, where a task is most naturally represented by talking or where standard input devices are difficult to use or not available at all, virtual characters can be well suited as an intuitive man-machineinterface due to their inherent ability to simulate verbal as well as nonverbal communicative behavior. This type of interface is made possible with the help of multimodal ...

In this paper, we tackle the problem of multimodal learning for autonomous robots. Autonomous robots interacting with humans in an evolving environment need the ability to acquire knowledge from their multiple perceptual channels in an unsupervised way. Most of the approaches in the literature exploit engineered methods to process each perceptual modality. In contrast, robots should be able to ...

A semi-analytical method is used to illustrate the behavior of a multimodal nonlinear electromechanical system which is under base-excitation. System is considered as piezo-ceramic patches attached to a cantilever beam coupled to a resistive load. The cantilever beam is modeled as a nonlinear Timoshenko beam using Assumed Mode method and equations of motion are derived through Lagrange's equati...

This paper deals with innovative fruition modalities of cultural heritage sites. Based on two ongoing experiments, four pillars are considered, that is, User Localization, Multimodal Interaction, Understanding and Gamification. A survey the existing literature regarding one or more issues related to is proposed. It aims put in evidence exploitation these contributions heritage. discussed how a ...

This paper gives an overview of issues related to extending simple question answering (QA) with dialogue capabilities, when designing a multimodal interactive information extraction system for a large, though restricted, domain. We present the way in which these issues are approached in the IMIX program. The IMIX demonstrator system, under development in this program, may be considered the most...