Synchronizing Gestures with Friction Sounds: work in progress
نویسندگان
چکیده
This paper presents a work in progress dealing with the sensorimotor relation between auditory perception and graphical movements. An experiment where subjects were asked to synchronize their gestures with synthetic friction sounds is presented. A first qualitative analysis enabled to evaluate the influence of di↵erent intrinsic sound parameters on the characteristics of the synchronized gesture. This preliminary experiment provides a formal framework for a wider study which aims to evaluate the relation between audition, vision and gestures.
منابع مشابه
Combining DJ Scratching, tangible Interfaces and a Physics-Based Model of friction sounds
This paper reports on two Short-Term Scientific Missions (STSM) in the ConGAS European Cost Action. Several sound models and (musical instrument) interfaces were combined to study how DJ gestures of scratching can be applied to new situations. In one experiment, the gestures were used to control a physics-based model of friction sounds, for instance to simulate the sound of a bowed violin strin...
متن کاملReenacting Sensorimotor Features of Drawing Movements from Friction Sounds
Even though we generally don’t pay attention to the friction sounds produced when we are writing or drawing, these sounds are recordable, and can even evoke the underlying gesture. In this paper, auditory perception of such sounds, and the internal representations they evoke when we listen to them, is considered from the sensorimotor learning point of view. The use of synthesis processes of fri...
متن کاملScrubber: An Interface for Friction-induced Sounds
The Scrubber is a general controller for friction-induced sound. Allowing the user to engage in familiar gestures and feeling actual friction, the synthesized sound gains an evocative nature for the performer and a meaningful relationship between gesture and sound for the audience. It can control a variety of sound synthesis algorithms of which we demonstrate examples based on granular synthesi...
متن کاملRising tones and rustling noises: Metaphors in gestural depictions of sounds
Communicating an auditory experience with words is a difficult task and, in consequence, people often rely on imitative non-verbal vocalizations and gestures. This work explored the combination of such vocalizations and gestures to communicate auditory sensations and representations elicited by non-vocal everyday sounds. Whereas our previous studies have analyzed vocal imitations, the present r...
متن کاملAudio-Motor Synchronization: The Effect of Mapping Between Kinematics and Acoustic Cues on Geometric Motor Features
This paper presents an experiment dealing with the sensorimotor relation between auditory perception and graphical movements. Subjects were asked to synchronize their gestures with synthetic friction sounds. Some geometrical and dynamical parameters of the motor productions are analyzed according to the different mappings. This preliminary experiment provides a formal framework for a wider stud...
متن کامل