Haptic-Audio Narrative: From Physical Simulation to Imaginative Stimulation
نویسنده
چکیده
This paper describes the design and development of an interactive narrative for the ‘Experimenta Vanishing Point’ media arts exhibition in 2005. The Cocktail Party Effect tells the story of the imminent extinction of Great Apes in the wild using touch and sound in the absence of visual elements. The narrative is driven by haptic-audio exploration of a virtual cocktail glass which functions as a heterodiegetic narrator, and the traversal of cut-up conversations that make up the story within. The interface was developed through a series of prototypes that explored the perception and mental imagery of a haptic-audio simulation of the invisible glass. These experiments also developed narrative functions of the haptic-audio interface beyond conventional iconic metonyms to include grammatical and dramatic special effects. Observations during the exhibition show promising narrative engagement with the piece but identify problems with the clarity of the sounds, and a conflict between the narrator and the story content.
منابع مشابه
Conflicting Audio-haptic Feedback in Physically Based Simulation of Walking Sounds
We describe an audio-haptic experiment conducted using a system which simulates in real-time the auditory and haptic sensation of walking on different surfaces. The system is based on physical models, that drive both the haptic and audio synthesizers, and a pair of shoes enhanced with sensors and actuators. Such experiment was run to examine the ability of subjects to recognize the different su...
متن کاملThe CORDIS Audio Haptic Real Time Platform for Musical Creation with Instrumental Interaction
In this paper, we describe recent work conducted at ACROE and the ICA laboratory of Grenoble INP on real time audio-haptic interaction with physical models for musical creation. These new developments enable the user to create complex mass-interaction physical models in a high level and user intuitive graphical environment. These models can then be simulated in real time, connected to a high fi...
متن کاملThe Design of a Haptic Simulator for Teaching and Assessing Spinal Anaesthesia
Through an interdisciplinary design process we have created a haptic simulator to mimic the physical and sensory environment surrounding the performance of spinal anaesthesia. Our simulator utilises existing haptic toolkits to reproduce tissues and surfaces in a realistic way. It simulates needle insertion with audio and visual (2D/3D) feedback occurring during the actual procedure. The overall...
متن کاملPhysical modelling concepts for a collection of multisensory virtual musical instruments
This paper discusses how haptic devices and physical modelling can be employed to design and simulate multisensory virtual musical instruments, providing the musician with joint audio, visual and haptic feedback. After briefly reviewing some of the main use-cases of haptics in Computer Music, we present GENESIS-RT, a software and hardware platform dedicated to the design and real-time haptic pl...
متن کامل