Gesture coding with the NGCS - ELAN system
نویسنده
چکیده
The NGCS is based on neuroscience research. While previous gesture classification systems were developed on the basis of gesture observation and their categories were heuristical, the NGCS links the phenomenology to the neurobiology of gestures. The theoretical assumption behind the NGCS is that its main kinetic and functional gesture categories are differentially associated with specific cognitive (spatial cognition, language, praxis) and emotional functions. This implies that the different gesture categories are generated in different brain areas. Studies on split-brain patients in whom the production of specific gesture categories in the right and left hemispheres was examined [1-5] and functional Magnetic Resonance Imaging (fMRI) studies [6] provide evidence that, indeed, the different gesture categories of the NGCS are generated in different brain regions. A second theoretical assumption behind the NGCS is that gestures are medium of communication and expression that conveys information per se. Again, this hypothesis is strongly supported by recent splitbrain research: in these subjects, a substantial amount of communicative gestures is generated in the separate right hemisphere, i.e., independently from left-hemispheric language production [1,5]. Thus, the NGCS coding is primarily performed without sound, and only after the gesture analysis has been accomplished, the relation to the verbal context can be analyzed. The NGCS gesture categories are defined by kinetic features only and not by interpretation of the verbal context.
منابع مشابه
Coding gestural behavior with the NEUROGES--ELAN system.
We present a coding system combined with an annotation tool for the analysis of gestural behavior. The NEUROGES coding system consists of three modules that progress from gesture kinetics to gesture function. Grounded on empirical neuropsychological and psychological studies, the theoretical assumption behind NEUROGES is that its main kinetic and functional movement categories are differentiall...
متن کاملNerve guidance channels as drug delivery vehicles.
Nerve guidance channels (NGCs) have been shown to facilitate regeneration after transection injury to the peripheral nerve or spinal cord. Various therapeutic molecules, including neurotrophic factors, have improved regeneration and functional recovery after injury when combined with NGCs; however, their impact has not been maximized partly due to the lack of an appropriate drug delivery system...
متن کاملELAN: a Professional Framework for Multimodality Research
Utilization of computer tools in linguistic research has gained importance with the maturation of media frameworks for the handling of digital audio and video. The increased use of these tools in gesture, sign language and multimodal interaction studies has led to stronger requirements on the flexibility, the efficiency and in particular the time accuracy of annotation tools. This paper describ...
متن کاملAnimated Pedagogical Agents: The Effect of Visual Information on a Historical Figure Application
Animated Pedagogical Agents (APAs) can be defined as computer-based characters with 2D or 3D animated representation and interactive capabilities through one or more modalities (e.g. text, speech, emotion, gesture, eyes movements) (Clarebout, Elan, & Johnson., 2002; Clark & Choi,, 2005, Craig, Driscoll, & Gholson, 2004; Craig, Gholson, & Driscoll, 2002; Gulz & Haake, 2006). Importantly, APAs ha...
متن کاملAnnotation of Sign and Gesture Cross-linguistically
This paper discusses the construction of a cross-linguistic, bimodal corpus containing three modes of expression: expressions from two sign languages, speech and gestural expressions in two spoken languages and pantomimic expressions by users of two spoken languages who are requested to convey information without speaking. We discuss some problems and tentative solutions for the annotation of u...
متن کامل