Continuous Realtime Gesture Following and Recognition
نویسندگان
چکیده
We present a HMM based system for real-time gesture analysis. The system outputs continuously parameters relative to the gesture time progression and its likelihood. These parameters are computed by comparing the performed gesture with stored reference gestures. The method relies on a detailed modeling of multidimensional temporal curves. Compared to standard HMM systems, the learning procedure is simplified using prior knowledge allowing the system to use a single example for each class. Several applications have been developed using this system in the context of music education, music and dance performances and interactive installation. Typically, the estimation of the time progression allows for the synchronization of physical gestures to sound files by time stretching/compressing audio buffers or videos.
منابع مشابه
Reactive Statistical Mapping: Towards the Sketching of Performative Control with Data
This paper presents the results of our participation to the ninth eNTERFACE workshop on multimodal user interfaces. Our target for this workshop was to bring some technologies currently used in speech recognition and synthesis to a new level, i.e. being the core of a new HMM-based mapping system. The idea of statistical mapping has been investigated, more precisely how to use Gaussian Mixture M...
متن کاملRealtime Segmentation and Recognition of Gestures using Hierarchical Markov Models
In this work, we present a realtime system for continuous gesture segmentation and recognition. The model is an extension of the system called Gesture Follower developed at Ircam, which is an hybrid model between Dynamic Time Warping and Hidden Markov Models. This previous model allows for a realtime temporal alignment between a template and an input gesture. Our model extends it by proposing a...
متن کاملA Stable Skeletonization for Tabletop Gesture Recognition
An efficient and stable skeletonization consisting of a Voronoi skeletonization following by a two step pruning is presented. The first pruning step removes Voronoi edges crossing the shape boundary. The second follows a Discrete Curve Evolution approach. Both pruning steps can be done very efficiently because entire Voronoi segments are pruned based on tests on points. The algorithm works in r...
متن کاملAdaptive Models for the Recognition of Human Gesture
Tomorrow's ubiquitous computing environments will go beyond the keyboard, mouse and monitor paradigm of interaction and will require the automatic interpretation of human motion using a variety of sensors including video cameras. I present several techniques for human motion recognition that are inspired by observations on human gesture, the class of communicative human movement. Typically, ges...
متن کاملReal-time continuous gesture recognition for natural multimodal interaction
I have developed a real-time continuous gesture recognition system capable of dealing with two important problems that have previously been neglected: (a) smoothly handling two different kinds of gestures: those characterized by distinct paths and those characterized by distinct hand poses; and (b) determining how and when the system should respond to gestures. The novel approaches in this thes...
متن کامل