The sonification of human movement data is a new approach to support motor perception, motor control and learning in sports and rehabilitation. Perceptual and motor control mechanisms both benefit of additional acoustic information, both are performing more accurate compared to unimodal conditions. But how does movement sonification work when supporting perception and action especially when pro...

We present our work with augmented everyday objects transformed into sound sources for music generation. The idea is to give voice to objects through technology. More specifically, the paradigm of the birth of musical instruments as a sonification of objects used in domestic or work everyday environments is here considered and transposed into the technologically augmented scenarios of our conte...

This paper describes further developments of the SUM tool, initially developed for the sonification of images, towards the composition and execution of graphic scores. Closer integration of the SUM user library within the computer-aided composition environment of PWGL has allowed the composition and realization of more complex graphic scores. After first explaining the existing structure and so...

vi

This paper presents a new sonification model for the exploration of topographically ordered high-dimensional data (multi-parameter maps, volume data) where each data item consists of a position and feature vector. The sonification model implements a common metaphor from thermodynamics that heat can be interpreted as stochastic motion of ’molecules’. The latter are determined by the data under e...

This paper argues for a special focus on the use of dynamic human interaction to explore datasets while they are being transformed into sound. We describe why this is a special case of both human computer interaction (HCI) techniques and sonification methods. Humans are adapted for interacting with their physical environment and making continuous use of all their senses. When this exploratory i...

In this work, we present sMax a multimodal toolkit for stock market data sonification. Unlike most research focusing their effort primarily on the sonification of single stock information, sMax provides an auditory display for the user to monitor parallel distributed data. sMax uses a set of Java and Max modules to map real time stock market information into recognizable musical patterns. One o...

This paper describes the sonification of electromyographic (EMG) data and an experiment that was conducted to verify its efficacy as an auditory display of the data. A real-time auditory display for EMG has two main advantages over the graphical representation: it frees the eyes of the analyst, or the physiotherapist, and it can be heard by the patient too who can then try to match with his/her...

This paper introduces a mapping method, overtone mapping, that projects multichannel time-series data onto a harmonic-series structure. Because of the common-fate effect of the Gestalt principle, correlated signals are perceived as a unity, while uncorrelated signals are perceived as segregated. This method is first examined with sonification of simple, generic data sets. Then overtone mapping ...