Method for visualisation and analysis of hand and head movements in sign language video
نویسندگان
چکیده
This paper presents a method for the visualisation and motion analysis of hand and head movements in videos containing sign language and gestures. The method detects the parts of the person’s bare skin on a video with an adaptive colour model, characterises the shapes of the hands and the head with a point distribution model, and tracks their motion separately by using the Kanade-Lucas-Tomasi algorithm and active shape models. The quantitative results are visualised in ELAN annotation software. The method is demonstrated in the paper in terms of its relevance to the annotation and analysis of sign language.
منابع مشابه
Applying mean shift and motion detection approaches to hand tracking in sign language
Hand gesture recognition is very important to communicate in sign language. In this paper, an effective object tracking and hand gesture recognition method is proposed. This method is combination of two well-known approaches, the mean shift and the motion detection algorithm. The mean shift algorithm can track objects based on the color, then when hand passes the face occlusion happens. Several...
متن کاملVideo Retrieval in Sign Language Videos : How to Model and Compare Signs?
This paper deals with the problem of finding sign occurrences in a sign language (SL) video. It begins with an analysis of sign models and the way they can take into account the sign variability. Then, we review the most popular technics dedicated to automatic sign language processing and we focus on their adaptation to model sign variability. We present a new method to provide a parametric des...
متن کاملA Cooperative Multiagent Architecture for Turkish Sign Tutors
A sign is a combination of hand movements, facial expressions, and head movements. A sign with only hand movements is called manual signs, whereas signs which also include head movements or facial expressions are called non-manual signs. The aim of the Sign Language Tutoring Tool is to help users learn isolated signs by watching recorded videos and enable them try the same signs [1]. The system...
متن کاملThe Phonetics of Head and Body Movement in the Realization of American Sign Language Signs
BACKGROUND/AIMS Because the primary articulators for sign languages are the hands, sign phonology and phonetics have focused mainly on them and treated other articulators as passive targets. However, there is abundant research on the role of nonmanual articulators in sign language grammar and prosody. The current study examines how hand and head/body movements are coordinated to realize phoneti...
متن کاملComputer-based recognition of facial expressions in ASL: From face tracking to linguistic interpretation
Most research in the field of sign language recognition has focused on the manual component of signing, despite the fact that there is critical grammatical information expressed through facial expressions and head gestures. We, therefore, propose a novel framework for robust tracking and analysis of nonmanual behaviors, with an application to sign language recognition. Our method uses computer ...
متن کامل