SignPro-An Application Suite for Deaf and Dumb

This application helps the deaf and dumb person to communicate with the rest of the world using sign language. Suitable existing methods are integrated in this application. The key feature in this system is the real time gesture to text conversion. The processing steps include: gesture extraction, gesture matching and conversion to speech. Gesture extraction involves use of various image processing techniques such as histogram matching, bounding box computation, skin colour segmentation and region growing. Techniques applicable for Gesture matching include feature point matching and correlation based matching. We have come up four different approaches based on the methods used for gesture extraction and matching. A Comparative study of these approaches is also carried out to rank them based on time efficiency and accuracy. The other features in the application include voicing out of text and text to gesture conversion. Keywords—Bounding box approach, correlation approach, histogram matching, point matching algorithm, region growing approach, skin color segmentation and text to speech conversion application