This paper improves visual representations for multi-modal semantic models, by (i) applying standard dimensionality reduction and denoising techniques, and by (ii) proposing a novel technique ContextVision that takes corpus-based textual information into account when enhancing visual embeddings. We explore our contribution in a visual and a multi-modal setup and evaluate on benchmark word simil...

We introduce a family of modal expansions of Belnap-Dunn four-valued logic and related systems, and interpret them in many-valued Kripke structures. Using algebraic logic techniques and topological duality for modal algebras, and generalizing the so-called twist-structure representation, we axiomatize by means of Hilbert-style calculi the least modal logic over the four-element Belnap lattice a...

The ability to orient toward visual, auditory, or tactile stimuli is an important skill for systems intended to interact with and explore their environment. In the brain of mammalian vertebrates, the Superior Colliculus is specialized for integrating multi-modal sensory information, and for using this information to orient the animal to the source sensory stimuli, such as noisy, moving objects....

Management of multi-modal data is a classical problem in data mining and exploration. Geographic Information Systems usually store multi-modal data and employ them in spatial and image analysis. This paper proposes a fusion of multi-modal data in the context of line detection with Fuzzy Hough Transform (FHT). The goal of this work is to simulate the Roman streets according to periods from parti...

The combination of PET and SPECT with MRI is an area of active research at present time and will enable new biological and pathological analysis tools for clinical applications and pre-clinical research. Image processing and reconstruction in multi-modal PET/MRI and SPECT/MRI poses new algorithmic and computational challenges. We investigate the use of Probabilistic Graphical Models (PGM) to co...

Multi-modal human computer interfaces are becoming increasingly widespread, building on more capable and affordable devices along with advances in helper applications utilising advanced pattern recognition. These interfaces promise to improve human-computer interaction, not only for fully-abled people, but also for persons with disabilities. It is currently unclear how to map available multi-mo...

The contribution of this paper is to compare paradigms coming from the classes of parametric, and non-parametric techniques to solve the decision fusion problem encountered in the design of a multi-modal biometrical identity verification system. The multi-modal identity verification system under consideration is built of d modalities in parallel, each one delivering as output a scalar number, c...

This paper aims at improving the well-known local variance segmentation method by adding extra signal modi and specific processing steps. As a key contribution, we extend the uni-modal segmentation method to perform multi-modal analysis, such that any number of signal modi available can be incorporated in a very flexible way. We have found that the use of a combined weight of luminance and dept...

One key message in modern neuroscience is multimodality: the ability of uni-modal areas in the brain such as speech and vision to interact with each other and with hetero-modal areas, areas that are activated by two or more input modalities, to converge the outputs of the uni-modal systems for producing ‘higher cognitive’ behaviour. Such behaviour includes the ability to quantify, the ability t...