The visionary goal of developing an easy to use service robot implies several key tasks such as speech understanding, object recognition and scene understanding. Besides the more sensor-oriented capabilities such systems need extensive meta knowledge, e.g., about mental representations of spatial relations to match the view between man and machine. Only if all parts fit together an unrestricted...

In many applications involving multi-media data, the definition of similarity between items is integral to several key tasks, e.g., nearest-neighbor retrieval, classification, and recommendation. Data in such regimes typically exhibits multiple modalities, such as acoustic and visual content of video. Integrating such heterogeneous data to form a holistic similarity space is therefore a key cha...

Swarm construction involves a population of autonomous agents collaboratively organising material into useful persistent structures without recourse to central co-ordination or control. This approach to fabrication has significant potential within nanoscale domains, where explicit centralised control of building activity is prohibitive (e.g., Martel and Mohammadi, 2010). The ultimate value of s...

Compressing real-time input through bandwidth constrained connections has been studied within robotics, wireless sensor networks, and image processing. When there are bandwidth constraints on realtime input the amount of information to be transferred will always be greater than the amount that can be transferred per unit of time. We propose a system that utilizes a local diffusion process and a...

Users with severe motor impairment often depends on alternative input devices like eye-gaze or head movement trackers to access computers. However these devices are not as fast as computer mouse and often turn difficult to use. We have proposed a Neural-network based model that can predict pointing target by analyzing pointing trajectory. We have validated the model for standard computer mouse,...

Using fMRI we investigated the neural basis of audio-visual processing of speech and non-speech stimuli using physically similar auditory stimuli (speech and sinusoidal tones) and visual stimuli (animated circles and ellipses). Relative to uni-modal stimuli, the different multi-modal stimuli showed increased activation in largely non-overlapping areas. Ellipse-Speech, which most resembles natur...

Introduction: Learning is a dominant phenomenon in human life. Learners are different from each other in terms of attitudes and cognitive styles which effect on the learning of people. In this connection, VARK learning style assess the students base their individual abilities and method for obtaining much information from environment in dimensions of visual, aural, read/write, and kinesthetic. ...

This paper describes the first reported grammatical framework for a nmltimodal interface. Although multimodal interfaces offer the promise of a flexible and user fl'iendly means of human-coml)uter interaction, no study has yet appeared on formal granunatical f'l'ame-works for theln. We have developed Multi-Modal Definite Clause Ch'ammar (MM-I)CG), an extension of Definite Clause Gramumr. The ma...