This paper is concerned with the construction of dialogues for speech output with large text, in a Web browser for elderly visually impaired people. Studies made in our research group, show that elderly visually impaired users experience great difficulty in getting going on the Internet when they have no previous experience in computing [6]. Age Associated Memory Impairment (AAMI) is a major pr...

We present a new framework for rapid development of mixed-initiative dialog systems. Using this framework, a developer can author sophisticated dialog systems for multiple channels of interaction by specifying an interaction modality, a rich task hierarchy and task parameters, and domain-specific modules. The framework includes a dialog history that tracks input, output, and results. We present...

We present a new approach to multimodal systems development that enables end-user applications to present information in alternative modalities, thereby making them useful even in situations where the default output modality is unacceptable to the user. We discuss the implementation of a software framework for constructing multimodal applications using the multimedia PCs that are available toda...

In these days of multimodal systems and interfaces, many research teams are investigating the purposes for which novel combinations of modalities can be used. It is easy to forget that we still lack solid foundations for evaluating the functionality of individual families of input/output modalities, such as the speech modalities. The reason why these foundations are missing is the complexity of...

• Using the modality-shared and modality-invariant features for cross-modality Re-ID. Designing a new model to extract features. Introducing loss further decrease variations. Most existing person Re-IDentification works rely on discriminative reducing variations intra-modality Despite their preliminary success, such appearance cannot capture enough information due massive discrepancy between RG...

There has been an encouraging progress in the affective states recognition models based on single-modality signals as electroencephalogram (EEG) or peripheral physiological recent years. However, multimodal signals-based methods have not thoroughly exploited yet. Here we propose Multiscale Convolutional Neural Networks (Multiscale CNNs) and a biologically inspired decision fusion model for reco...

traditional and modern vocabulary instruction techniques have been introduced in the past few decades to improve the learners’ performance in reading comprehension. semantic mapping, which entails drawing learners’ attention to the interrelationships among lexical items through graphic organizers, is claimed to enhance vocabulary learning significantly. however, whether this technique suits all...

background: retinoblastoma is the most common embryonic tumor of retina of children. this tumor include 3-4% of all children malignancies during the age range 0-14 years. in this study, we reported the incidence, therapeutic protocols, and treatment outcome of children with rb in south west iran. methods: we retrospectively investigated the medical reports clinical and pathological features of ...

We consider the problem of multi-modal pattern recognition under the assumption that a kernel-based approach is applicable within each particular modality. The Cartesian product of the linear spaces into which the respective kernels embed the output scales of single sensors is employed as an appropriate joint scale corresponding to the idea of combining modalities at the sensor level. This cont...

We review the development and current status of theories of the organisation and representation of conceptual knowledge in the human brain. The currently known facts from optic aphasia, category-specific semantic deficits, and functional neuroimaging are consistent with a framework in which the first-order constraint on the organisation of conceptual knowledge is domain. Data from functional ne...