While visual signals that accompany spoken language serve to augment the communicative message, the same visual ingredients form the substance of the linguistic system in sign languages. This article provides an analysis of visual signals that comprise part of the intonational system of a sign language. The system is conveyed mainly by particular actions of the upper face, and is shown to patte...

Sign language visual recognition from continuous multi-modal streams is still one of the most challenging fields. Recent advances in human actions are exploiting ascension GPU-based learning massive data, and getting closer to human-like performances. They then prone creating interactive services for deaf hearing-impaired communities. A population that expected grow considerably years come. Thi...

Speakers monitor their speech output by listening to their own voice. However, signers do not look directly at their hands and cannot see their own face. We investigated the importance of a visual perceptual loop for sign language monitoring by examining whether changes in visual input alter sign production. Deaf signers produced American Sign Language (ASL) signs within a carrier phrase under ...

The Spanish Sign Language Dictionary (DILSE) is one of the first truly bilingual (Spanish Sign Language-Spanish) electronic dictionaries for the deaf community. The properties of this format are perfectly matched to a visual language such as sign language, which uses space as a means of expression. Additionally, two-way searches for word entries are possible from either Spanish or signs. The si...

We present a method to dissociate the sign-dependent (linear or odd-order) response from the sign-independent (quadratic or even-order) response of a neuron to sequences of random orthonormal stimulus elements. The method is based on a modification of the classical linear-nonlinear model of neural response. The analysis produces estimates of the stimulus features to which the neuron responds in...

This paper deals with an analysis of lip shapes during speech that accompanies sign language, referred to as sign speech. A new sign speech database is collected and a new framework for the analysis of mouth patterns is introduced. Using a shape model restricted to the outer lip contour, we show that the articulatory parameters for visual speech alone are not sufficient for representing sign sp...