In this paper we examine a central issue in cognitive neuroscience: are there separate conceptual representations associated with different input modalities (e.g., Paivio, 1971, 1986; Warrington & Shallice, 1984) or do inputs from different modalities converge on to the same set of representations (e.g., Caramazza, Hillis, Rapp, & Romani, 1990; Lambon Ralph, Graham, Patterson, & Hodges, 1999; R...

Synchronising movements with events in the surrounding environment is an ubiquitous aspect of everyday behaviour. Often, information about a stream of events is available across sensory modalities. While it is clear that we synchronise more accurately to auditory cues than other modalities, little is known about how the brain combines multisensory signals to produce accurately timed actions. He...

Data generated from real world events are usually temporal and contain multimodal information such as audio, visual, depth, sensor etc. which are required to be intelligently combined for classification tasks. In this paper, we propose a novel generalized deep neural network architecture where temporal streams from multiple modalities are combined. There are total M+1 (M is the number of modali...

Biochemical systems such as metabolic and signaling pathways tend to be arranged in a physical space: the product of one reaction must be in the right place to become the reactant for the subsequent reaction in the pathway. Moreover, in some cases, the behavior of the systems can depend on both, the location of the reactants as well as on the time needed for the reaction to occur. We address th...

Here we present two experiments investigating the implicit orienting of attention over time by entrainment to an auditory rhythmic stimulus. In the first experiment, participants carried out a detection and discrimination tasks with auditory and visual targets while listening to an isochronous, auditory sequence, which acted as the entraining stimulus. For the second experiment, we used musical...

urolithiasis has become a worldwide problem with the prevalence of the disease increasing over the past few decades. while various treatment modalities have evolved over the years, discrepancies exist regarding the clinical indications and the efficacy of each of these treatment options. in the present review, we aim to review the current treatment modalities for urinary tract stones to provide...

In this paper we show how it is possible to represent the CARE properties (complementarity, assignment, redundancy, equivalence) modelling the temporal relationships among inputs provided through different modalities. For this purpose we extended GestIT, which provides a declarative and compositional model for gestures, in order to support other modalities. The generic models for the CARE prope...

As people age, they tend to integrate successive visual stimuli over longer intervals than younger adults. It may be expected that temporal integration is affected similarly in other modalities, possibly due to general, age-related cognitive slowing of the brain. However, the previous literature does not provide convincing evidence that this is the case in audition. One hypothesis is that the p...

Epilepsy is a neurological disorder that affects approximately 70 million people worldwide. There are several types and sub-types of epilepsy, with Temporal Lobe Epilepsy being the most common. Temporal Lobe Epilepsy is often amendable with Anti-epileptic Drugs. When these drugs do not work, surgery may alleviate seizures. In this paper 2 case studies are addressed involving patients who both h...

Temporal moment localization aims to retrieve the best video segment matching a specified by query. The existing methods generate visual and semantic embeddings independently fuse them without full consideration of long-term temporal relationship between them. To address these shortcomings, we introduce novel recurrent unit, cross-modal long short-term memory (CM-LSTM), mimicking human cognitiv...