User Interface: 3D Feedback

In this project we examine the possibilities of bringing the gesture recognition to Windows Phone and Surface tablet devices by integrating Kinect to the aforementioned devices. We will demonstrate this by designing a physiotherapy application. In physiotherapy exercises, it is very important and critical to the patient to do the exercises as accurately as possible. So our physiotherapy application should have the ability to give feedback to the users in order for them to do the exercises correctly. For this purpose, we decided to render 3D arrows that show users how to adjust incorrectly positioned limbs. One way to do this is to use 3D animation on top of the skeleton image from the Kinect, so the user will know how and how much he or she should change the angle of the wrong joint to correct the position. This paper presents an approach for modeling shapes in an open source 3D application, Blender, and subsequently importing and animating those shapes in an interactive application created in the Microsoft XNA framework.