Lip Tracking Towards an Automatic Lip Reading Approach
نویسندگان
چکیده
Current era is to make the interaction between humans and their artificial partners (Computers) and make communication easier and more reliable. One of the actual tasks is the use of vocal interaction. Speech recognition may be improved by visual information of human face. In literature, the lip shape and its movement are referred to as lip reading. Lip reading computing plays a vital role in automatic speech recognition and is an important step towards accurate and robust speech recognition. In this paper we proposed method to detect the lips, shape and movement and use towards automatic lip tracking in detail by using Active Appearance Model (AAM). Purposed method shows the how accurate lip detection and tracking which is useful for speech recognition. Appearance-based methods consider the raw image for lip extraction. AAM uses for detection of speaker’s lips features and feature points from faces automatically by appearance parameters of a speaker’s lips. In this paper, we will describe the Lips shape, movement and appearance descriptions for lip detection and detailed information about the automatic lip tracking system. Individual characteristics and efficiency of both approaches towards the Lip reading is also discuss. The efficiency of purposed method will be evaluated individually by characteristics and their performances are then compared. The recognition process of common visual features (i.e. selection of lip, shape and extraction of movement) for an improved lip reading.
منابع مشابه
Automatic Hybrid Approach for Lip POI Localization: Application for Lip-reading System
Automatic Lip-reading system is one of the different assistive technologies for hearing impaired or elderly people. We can imagine, for example, a dependent person ordering a machine with an easy lip movement or by a simple visemes (visual phoneme) pronunciation. The need for an automatic lip-reading system is ever increasing. The lip-reading system is decomposed in three subsystems, first we h...
متن کاملDesigning and implementing a system for Automatic recognition of Persian letters by Lip-reading using image processing methods
For many years, speech has been the most natural and efficient means of information exchange for human beings. With the advancement of technology and the prevalence of computer usage, the design and production of speech recognition systems have been considered by researchers. Among this, lip-reading techniques encountered with many challenges for speech recognition, that one of the challenges b...
متن کاملAutomatic Lip Contour Tracking and Visual Character Recognition for Computerized Lip Reading
Computerized lip reading has been one of the most actively researched areas of computer vision in recent past because of its crime fighting potential and invariance to acoustic environment. However, several factors like fast speech, bad pronunciation, poor illumination, movement of face, moustaches and beards make lip reading difficult. In present work, we propose a solution for automatic lip c...
متن کاملLip Contour Detection Techniques Based on Front View of Face
Lip contour detection and tracking is the most important pre-requisite for computerized speech reading. Several approaches have been proposed for lip tracking after lip contour is accurately initialized on first frame. Detection and tracking of the lip contour is an issue in speech reading. A relatively large class of lip reading algorithms are available based on lip contour analysis. In these ...
متن کاملLip Localization and Viseme Classification for Visual Speech Recognition
The need for an automatic lip-reading system is ever increasing. Infact, today, extraction and reliable analysis of facial movements make up an important part in many multimedia systems such as videoconference, low communication systems, lip-reading systems. In addition, visual information is imperative among people with special needs. We can imagine, for example, a dependent person ordering a ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- JMPT
دوره 5 شماره
صفحات -
تاریخ انتشار 2014