Deaf people cannot properly access the speech information stored in any kind of recording format (audio, video, etc). We present a system that provides with subtitling and Spanish Sign Language representation capabilities to allow Spanish Deaf population can access to such speech content. The system is composed by a speech recognition module, a machine translation module from Spanish to Spanish...

Despite immense variability across languages, people can learn to understand any human language, spoken or signed. What neural mechanisms allow people to comprehend language across sensory modalities? When people listen to speech, electrophysiological oscillations in auditory cortex entrain to slow ([Formula: see text]8 Hz) fluctuations in the acoustic envelope. Entrainment to the speech envelo...

Deaf children from signing programs provide new opportunities to investigate changes in sign and speech acquisition following cochlear implantation. We describe the acquisition of sign phonemes (location, movement, and handshapes) and speech phonemes (consonants) in 22 implanted children with diverse demographic backgrounds. New consonants and new sign phonemes emerged in developmentally expect...

An on-line Spanish-Spanish Sign Language (LSE) translation system is presented in which Spanish speech content is translated into LSE to provide Spanish deaf people access to speech information. It is cloud-based, built over a speech recognition module, a transfer-based machine translation module and a Sign Language synthesis module that employs an avatar to present the signed content.

To investigate the impact of sensory-motor systems on the neural organization for language, we conducted an H2 (15)O-PET study of sign and spoken word production (picture-naming) and an fMRI study of sign and audio-visual spoken language comprehension (detection of a semantically anomalous sentence) with hearing bilinguals who are native users of American Sign Language (ASL) and English. Direct...

The aim of this project is to help the communication of two people, one hearing impaired and one visually impaired by converting speech to fingerspelling and fingerspelling to speech. Fingerspelling is a subset of sign language, and uses finger signs to spell letters of the spoken or written language. We aim to convert finger spelled words to speech and vice versa. Different spoken languages an...

OBJECTIVE Verify if late cochlear implantation allows pre-lingual deafs to convert from visual to oral communication mode only. METHOD Thirteen pre-lingual profoundly deaf patients implanted the ages of 8 and 22 years were included in the study. Before cochlear implantation, none of the patients used the oral language. Six patients used cued speech and seven used the sign language to communic...

Establishing and maintaining reference is a crucial part of discourse. In spoken languages, differential linguistic devices mark referents occurring in different referential contexts, that is, introduction, maintenance, and re-introduction contexts. Speakers using gestures as well as users of sign languages have also been shown to mark referents differentially depending on the referential conte...

Sign language is a visual for communication used by hearing-impaired people with the help of hand and finger movements. Indian Language (ISL) well-developed standard way living in India. However, other who use spoken always face difficulty while communicating person due to lack sign knowledge. In this study, we have developed 3D avatar-based learning system that converts input speech/text into ...