MusicGlove: A Wearable Musical Controller for Massive Media Library

This research aims to develop a wearable musical interface which enables to control audio and video signals by using hand gestures and human body motions. We have been developing an audio-visual manipulation system that realizes tracks control, time-based operations and searching for tracks from massive music library. It aims to build an emotional and affecting musical interaction, and will provide a better method of music listening to people. A sophisticated glove-like device with an acceleration sensor and several strain sensors has been developed. A realtime signal processing and musical control are executed as a result of gesture recognition. We also developed a stand-alone device that performs as a musical controller and player at the same time. In this paper, we describe the development of a compact and sophisticated sensor device, and demonstrate its performance of audio and video signals control.