This paper proposes a framework for gestural interaction with information sonification in order to both monitor data aurally but, in addition, to interact with it, transform and even modify the source data in a two-way communication model (Figure 1). Typical data sonification uses automatically generated computational modelling of information, represented in parameters of auditory display, to c...

Auditory display is a relatively young field that has nonetheless been applied to many different types of research, including data exploration, musical composition and performance and for studying medical conditions such as epilepsy. Sonification, a type of auditory display which can generally be defined as the transformation of data into sound, has been applied to biofeedback systems, computer...

In this paper we propose a game-based virtual reality platform for evaluation of sonification techniques. We study the task of localization of stationary objects in virtual reality using auditory cues. We further explore sonification techniques and compare the performance in this task using the proposed platform. The virtual reality environment is developed using Unity3D (game engine) and an Oc...

This paper presents an exploration platform for locative sonification based on audio feature vectors extracted from urban spaces. Our locative sonification research is part of a larger project called Citygram[17]. Citygram focuses on geospatial research that is concerend with automatically collecting, visualizing, analyzing, and mapping nonocular energies from urban environments. The acoustic d...

This paper introduces a novel sonification-based interaction support for cooperating users in an Augmented Reality setting. When using head-mounted AR displays, the field of view is limited which causes users to miss important activities such as object interactions or deictic references of their interaction partner to (re-)establish joint attention. We introduce an interactive sonification whic...

Given that embodied interaction is widespread in HumanComputer Interaction, interests on the importance of body movements and emotions are gradually increasing. The present paper describes our process of designing and testing a dancer sonification system using a participatory design research methodology. The end goal of the dancer sonification project is to have dancers generate aesthetically p...

In this paper, a study on sonification of manual wheelchair movements is presented. The aim was to contribute to both rehabilitation contexts and in wheelchair sports contexts, by providing meaningful auditory feedback for training of manual wheelchair operation. A mapping approach was used where key parameters of manual wheelchair maneuvering were directly mapped to different sound models. The...

We introduce a meta-study of previous sonification designs taking physical quantities as input data. The aim is to build a solid foundation for future sonification works so that auditory display researchers would be able to take benefit from former studies, avoiding to start from scratch when beginning new sonification projects. This work is at an early stage and the objective of this paper is ...

Expert musical performance is rich with movements that facilitate performance accuracy and expressive communication. Studying these movements quantitatively using high-resolution motion capture systems has been fruitful, but analysis is arduous due to the size of the data sets and performance idiosyncrasies. Compared to visual-only methods, sonification provides an interesting alternative that ...

This paper describes the design of SoniMime, a system for the sonification of hand motion. Among SoniMime’s applications is the use of auditory feedback to refine fine motor skills in a wide variety of tasks. Our primary sonification method involves mapping movement to timbre parameters. Specifically, we explore the application of the tristimulus timbre model for the sonification of gestural da...