Wireless Digital/Analog Sensors for Music and Dance Performances
نویسنده
چکیده
We developed very small and light sensors, each equipped with 3-axes accelerometers, magnetometers and gyroscopes. Those MARG (Magnetic, Angular Rate, and Gravity) sensors allow for a drift-free attitude computation which in turn leads to the possibility of recovering the skeleton of body parts that are of interest for the performance, improving the results of gesture recognition and allowing to get relative position between the extremities of the limbs and the torso of the performer. This opens new possibilities in terms of mapping. We kept our previous approach developed at ARTeM [2]: wireless from the body to the host computer, but wired through a 4-wire digital bus on the body. By relieving the need for a transmitter on each sensing node, we could built very light and flat sensor nodes that can be made invisible under the clothes. Smaller sensors, coupled with flexible wires on the body, give more freedom of movement to dancers despite the need for cables on the body. And as the weight of each sensor node, box included, is only 5 grams (Figure 1), they can also be put on the upper and lower arm and hand of a violin or viola player, to retrieve the skeleton from the torso to the hand, without adding any weight that would disturb the performer. We used those sensors in several performances with a dancing viola player and in one where she was simultaneously controlling gas flames interactively. We are currently applying them to other types of musical performances.
منابع مشابه
An Accelerometer and Gyroscope Based Sensor System for Dance Performance Technical Report: UL-CSIS-07-2
This project explores the use of wearable wireless sensors for the generation and manipulation of music from dance performances. The design of a prototype wireless sensor that includes dual-axis accelerometers and three single-axis gyroscopes is discussed. The input of sensor data to a Pd (Pure Data) patch is explored and possible mapping strategies for a system of sensors is discussed.
متن کاملSensemble: A Wireless, Compact, Multi-User Sensor System for Interactive Dance
We describe the design of a system of compact, wireless sensor modules meant to capture expressive motion when worn at the wrists and ankles of a dancer. The sensors form a high-speed RF network geared toward real-time data acquisition from multiple devices simultaneously, enabling a small dance ensemble to become a collective interface for music control. Each sensor node includes a 6-axis iner...
متن کاملCreating Integrated Music and Video for Dance: Lessons Learned and Lessons Ignored
In his demonstration, the author discusses the sequential progress of his technical and aesthetic decisions as composer and videographer for four large-scale works for dance through annotated video examples of live performances and PowerPoint slides. In addition, he discusses his current real-time dance work with wireless sensor interfaces using sewable LilyPad Arduino modules and Xbee radio ha...
متن کاملAmbient Intelligence on the Dance Floor
With the evolution of intelligent devices, sensors, and ambient intelligent systems, it is not surprising to see many research projects starting to explore the design of intelligent artifacts in the area of art and technology; these projects take the form of art exhibits, interactive performances, and multi-media installations. In this paper, we seek to propose a new architecture for an ambient...
متن کاملReal-time Modification of Music with Dancer's Respiration Pattern
This research aims to improve the correspondence between music and dance, and explores the use of human respiration pattern for musical applications with focus on the motional aspect of breathing. While respiration is frequently considered as an indicator of the metabolic state of human body that contains meaningful information for medicine or psychology, motional aspect of respiration has been...
متن کامل