titre : User-specific real-time registration and tracking applied to anatomy learning. To make the complex task of anatomy learning easier, there exist many ways to represent and structure anatomical knowledge (drawings, books, cadaver dissections, 3D models, etc.). However, it may be difficult from these static media to understand and analyze anatomy motion, which is essential for medicine stu...

We propose the fusion between two concepts that are very successful in the area of 3D imaging and sensing. Kinect technology permits the registration, in real time, but with low resolution, of accurate depth maps of big, opaque, diffusing 3D scenes. Our proposal consists on transforming the sampled depth map, provided by the Kinect technology, into an array of microimages whose position; pitch ...

This paper proposes a real-time mesh animation framework to animate any kind of virtual characters by using Kinect. A deformation module is first predefined by constructing propagation fields and accordingly the isolines in each field for a character. During animation, motions captured by Kinect are retargeted to movements of users’ specified handle constraints, which induce the deformation mod...

Gestures related to time can reveal implicit representations of the TIME is SPACE metaphor (Núñez & Sweetser, 2006). While past research has shown that gestures illustrate the direction of future and past on timelines, no detailed analysis of timelines has been possible. Using the Kinect depth camera and body tracking technology, we tracked participants’ co-speech gestures while explaining time...

This paper demonstrates how to use multiple Kinect sensors to map a performer’s motion to music. Skeleton data streams from multiple sensors are merged in order to compensate for occlusions of the performer. The skeleton joint positions drive the performance via open sound control data. We discuss how to register the different sensors to each other and how to smoothly merge the resulting data s...

This manuscript details a technique for estimating gesture accuracy within the context of motion-based health video games using the MICROSOFT KINECT. We created a physical therapy game that requires players to imitate clinically significant reference gestures. Player performance is represented by the degree of similarity between the performed and reference gestures and is quantified by collecti...

The growing obesity problem has reinforced policymakers and educators to devise strategies that encourage introduction of novel and engaging physical activities in schools. At the same time, the gaming industry has introduced a game genre that requires the player to be physically involved in the game (e.g. Nintendo Wii, Kinect). In fact, exergames (physically activating games) is an emerging tr...

Facial muscle micro movements for eight emotions were induced via visual and auditory stimuli and were verified according to sex. Thirty-one main facial features were chosen from the Kinect API out of 121 initially obtained facial features; the average change of pixel value was measured after image alignment. The proposed method is advantageous as it allows for comparisons. Facial micro-express...

This paper presents the details of a system capable of recording on video a traditional class. By traditional class it is meant a teacher, a blackboard and a white canvas where course notes are projected. The system is able to track the movements of the lecturer, while recording it on video at the required frame rate (e.g., 25 fps). The system is also capable of understanding five arm gestures ...