This research aims to develop a wearable musical interface which enables to control audio and video signals by using hand gestures and human body motions. We have been developing an audio-visual manipulation system that realizes tracks control, time-based operations and searching for tracks from massive music library. It aims to build an emotional and affecting musical interaction, and will pro...

Previous research has identified a set of acoustical cues that are important in communicating different emotions in music performance. We have applied these findings in the development of a system that automatically predicts the expressive intention of the player. First, low-level cues of music performances are extracted from audio. Important cues include average and variability values of sound...

This paper examines the ways in which individuals use Mp3 players to shape their experiences of the London commute. To investigate Mp3 listening practices, I conducted semi-structured qualitative interviews with eight DJs and ‘listeners’ living in London. I argue that Mp3 players enable individuals to use music to precisely shape their experiences of space, place, others and themselves while mo...

‘In-time’ representations of music in which the time represented is the same time as inhabited by the agent making or using the representation are contrasted with ‘out-of-time’ representations. Temporal logics with a similar ‘in-time’ perspective, and in particular those using operators S and U for ‘since’ and ‘until’, are explored as a means of representing musical situations, with particular ...

Physiological computing means using physiological sensors in computing. This is a natural and promising continuation of pervasive computing: as smart devices begin to permeate the environment, they can be used to collect information about the user’s emotional, cognitive and physical state to improve the context-awareness of applications. Creating pervasive physiological computing applications i...

— The shuffle mode, where songs are played in a randomized order that is decided upon for all tracks at once, is widely found and known to exist in music player systems. There are only few music enthusiasts who use this mode since it either is too random to suit their mood or it keeps on repeating the same list every time. In this paper, we propose to build a convolutional deep belief network(C...

In this paper, a function-oriented musical interface, named the sound wheel , is presented. This interface is designed to manipulate musical functions like pitch class sets, tonal centers and scale degrees, rather than the musical surface , i.e. the individual notes with concrete note heights. The sound wheel has an interface summarizing harmony theory, and the playing actions have explicit cor...

When envisaging new digital instruments, designers do not have to limit themselves to their sonic capabilities (which can be absolutely any), not even to their algorithmic power; they must be also especially careful about the instruments’ conceptual capabilities, to the ways instruments impose or suggest to their players new ways of thinking, new ways of establishing relations, new ways of inte...

Our goal is to provide a multilingual speech based Human Machine Interface for in-car infotainment and navigation systems. The multilinguality is for example needed for music player control via speech as artist and song names in the globalized music market come from many languages. Another frequent use case is the input of foreign navigation destinations via speech. In this paper we propose app...

As our interactions with computing continue to expand off the desktop, we want to use mobile devices in many, if not all, of our everyday activities. However, the touch screen and physical button centric interfaces of today’s mobile devices offer relatively poor support for interaction in many situations where computing is not our primary task. For example, when wearing gloves in the cold, a mo...