Soundview: Sensing Color Images by Kinesthetic Audio
نویسنده
چکیده
An experimental system called SoundView has been developed, which allows the exploration of a color image through touch and hearing. The image is mapped onto a virtual surface with a fine-grained color dependent roughness texture. The user explores the image by moving a pointer device over the image. The pointer acts like a virtual gramophone needle, and the sound produced depends on the motion as well as on the color of the area explored. The roughness texture is obtained by constructing a mapping of three dimensional color space onto a three dimensional sound space. The mapping tries to achieve maximal alignment of the color and sound spaces by preserving the perceptual metrical and topological structure of color space, as well as by incorporating common associations between sound and color.
منابع مشابه
Geometric Shape Detection with Soundview
We present the results of user studies that were performed on sighted people to test their ability to detect simple shapes with SoundView. SoundView is an experimental vision substitution system for the blind. Visual images are mapped onto a virtual surface with a fine-grained color dependent roughness texture. The user explores an image by moving a pointer device over the image which creates s...
متن کاملLive Video and Sound Processing for Dance
Motion-sensing technology enables dancers to control various computer processes that can alter their own projected video images and generate sound. In turn the altered images and the sonic results influence choreographic decisions and kinesthetic response. This creates a dynamic three-way interaction that opens up new possibilities to explore the body as an agent for technological transformatio...
متن کاملDistribution map of the different lithologic units in loess plateau of eastern Golestan by using remote sensing technique; Aghband research area
Introduction: Along with the climate, Soil is an essential natural resource. Although soil studies in Iran have been started more than 50 years ago, the soil map of the country has not been fully prepared yet, and only 20-25% of the lands have been mapped already. Many soil maps of Iran need to be updated, but the common methods in soil mapping are costly and time-consuming. Hence, using data o...
متن کاملEvaluation of the Lineaments and Faults in the Alborz Province by Remote Sensing
The studied region in this research (Alborz province) is structurally located in Alborz poly_orogenic system of northern Iran. The purpose of this research is combining the remote sensing and geology sciences to show fault lineaments by analyzing satellite data in a vast region and also comparison between lineaments layer and recognized faults in geology maps. Firstly, two scenes of Landsat ETM...
متن کاملJoint Sparsity-based Classification of Color Images
For many years, sampling theory has been based on Shannon and Nyquist who stated that bandlimited signals can be exactly reconstructed using samples acquired at or higher than Nyquist rate (1949). Recently however, the focus has shifted to compressed sensing, where if the underlying signal is sparse, the signal can be represented by a small collection of linear projections. It is now understood...
متن کامل