Friction Sounds for Sensorial Substitution
نویسندگان
چکیده
This paper explores the use of a physics-based sound model of continuous contact for auditory display in interactive settings. An audio-visual interactive display is developed in which the sound model is controlled by the user’s gestures. The display is used to investigate to what extent audition can substitute for haptic feedback in conveying perception of inertial properties of a manipulated object. In a first experiment the audio-visual display is controlled through a standard pointing device (a marble mouse, or trackball). A second experiment uses a tangible object and a computer vision system that tracks the object motion. Early results suggest that the perception of effort is a cross-modal phenomenon in which auditory feedback plays a relevant role.
منابع مشابه
Effects of Sugar Substitution with High Fructose Corn Syrup on the Qualitative, Rheological and Sensorial Characteristics of Tomato Ketchup Sauce
Background and Objectives: Nutritional value, color, flavor and consistency are the major quality attributes of tomato ketchup, influencing the buying behavior of the consumers. In this study, the effects of sugar replacement with high fructose corn syrup (HFCS) on the qualitative properties of ketchup sauce were investigated. Materials & Methods: In the present study, sucrose was replaced wi...
متن کاملAcoustics of friction.
This article presents an overview of the acoustics of friction by covering friction sounds, friction-induced vibrations and waves in solids, and descriptions of other frictional phenomena related to acoustics. Friction, resulting from the sliding contact of solids, often gives rise to diverse forms of waves and oscillations within solids which frequently lead to radiation of sound to the surrou...
متن کاملFrom sound to shape: auditory perception of drawing movements.
This study investigates the human ability to perceive biological movements through friction sounds produced by drawings and, furthermore, the ability to recover drawn shapes from the friction sounds generated. In a first experiment, friction sounds, real-time synthesized and modulated by the velocity profile of the drawing gesture, revealed that subjects associated a biological movement to thos...
متن کاملHandheld Device for Substitution from Vision to Audition
Sensorial substitution has great potential in rehabilitation, education, games, and in the creation of music and art. Current technologies allow us to develop sensorial substitution and sonification systems that would not have been imaginable two decades ago. It is desirable to let a large audience use and test sonification systems to provide feedback and improve their design. Handheld devices ...
متن کاملReenacting Sensorimotor Features of Drawing Movements from Friction Sounds
Even though we generally don’t pay attention to the friction sounds produced when we are writing or drawing, these sounds are recordable, and can even evoke the underlying gesture. In this paper, auditory perception of such sounds, and the internal representations they evoke when we listen to them, is considered from the sensorimotor learning point of view. The use of synthesis processes of fri...
متن کامل