Friction Sounds for Sensorial Substitution

نویسندگان

  • Federico Avanzini
  • Davide Rocchesso
  • Stefania Serafin
چکیده

This paper explores the use of a physics-based sound model of continuous contact for auditory display in interactive settings. An audio-visual interactive display is developed in which the sound model is controlled by the user’s gestures. The display is used to investigate to what extent audition can substitute for haptic feedback in conveying perception of inertial properties of a manipulated object. In a first experiment the audio-visual display is controlled through a standard pointing device (a marble mouse, or trackball). A second experiment uses a tangible object and a computer vision system that tracks the object motion. Early results suggest that the perception of effort is a cross-modal phenomenon in which auditory feedback plays a relevant role.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Effects of Sugar Substitution with High Fructose Corn Syrup on the Qualitative, Rheological and Sensorial Characteristics of Tomato Ketchup Sauce

Background and Objectives: Nutritional value, color, flavor and consistency are the major quality attributes of tomato ketchup, influencing the buying behavior of the consumers. In this study, the effects of sugar replacement with high fructose corn syrup (HFCS) on the qualitative properties of ketchup sauce were investigated.  Materials & Methods: In the present study, sucrose was replaced wi...

متن کامل

Acoustics of friction.

This article presents an overview of the acoustics of friction by covering friction sounds, friction-induced vibrations and waves in solids, and descriptions of other frictional phenomena related to acoustics. Friction, resulting from the sliding contact of solids, often gives rise to diverse forms of waves and oscillations within solids which frequently lead to radiation of sound to the surrou...

متن کامل

From sound to shape: auditory perception of drawing movements.

This study investigates the human ability to perceive biological movements through friction sounds produced by drawings and, furthermore, the ability to recover drawn shapes from the friction sounds generated. In a first experiment, friction sounds, real-time synthesized and modulated by the velocity profile of the drawing gesture, revealed that subjects associated a biological movement to thos...

متن کامل

Handheld Device for Substitution from Vision to Audition

Sensorial substitution has great potential in rehabilitation, education, games, and in the creation of music and art. Current technologies allow us to develop sensorial substitution and sonification systems that would not have been imaginable two decades ago. It is desirable to let a large audience use and test sonification systems to provide feedback and improve their design. Handheld devices ...

متن کامل

Reenacting Sensorimotor Features of Drawing Movements from Friction Sounds

Even though we generally don’t pay attention to the friction sounds produced when we are writing or drawing, these sounds are recordable, and can even evoke the underlying gesture. In this paper, auditory perception of such sounds, and the internal representations they evoke when we listen to them, is considered from the sensorimotor learning point of view. The use of synthesis processes of fri...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004