Viseme (visual cue) recognition is one of the steps to be followed in building an automated lip-reading system. In order to recognize a viseme, one has to first detect the lips of the speaker from the video sequences and track them to extract the feature vectors for the final recognition. A novel method for liplocalization based on the color models has been proposed. Also, the basic possible li...

We present two methods for automatic facial gesturing of graphically embodied animated agents. In one case, conversational agent is driven by speech in automatic Lip Sync process. By analyzing speech input, lip movements are determined from the speech signal. Another method provides virtual speaker capable of reading plain English text and rendering it in a form of speech accompanied by the app...

“Langage Parlé Complété (LPC)” is the French manual system – corresponding to Cued Speech – used to complement lip reading and thus enhance speech perception for hearing-impaired people. In an anticipatory rounding context, a French speaker was audiovisually recorded while pronouncing and coding [i#yi] sequences with two different pause durations. The effect of pause duration on hand and lip te...

Lip detection is used in many applications such as face detection and lips reading. In previous works, researchers have considered whole of face image for lip detection. In this paper we propose a new algorithm. In our algorithm for reducing required calculation and increase accuracy of correct detection, we do not consider whole of the face image. We first remove the upper half part of the fac...

Human-lip detection is an important criterion for many automated modern system in present day. Like computerized speech reading, face recognition etc. system can work more precisely if human-lip can detect accurately. There are many processes for detecting human-lip. In this paper an approach is developed so that the region of a human-lip can be detected, we called it lip contour. For this a re...

Lip reading has attracted increasing attention recently due to advances in deep learning. However, most research targets English datasets. The study of Chinese lip-reading technology is still its initial stage. Firstly, this paper, we expand the naturally distributed word-level dataset called ‘Databox’ previously built by our laboratory. Secondly, current state-of-the-art model consists a resid...