This paper presents a method of integrating two contrasting sensor systems for studying human interaction with a mechanical system, using piano performance as the case study. Piano technique requires both precise small-scale motion of fingers on the key surfaces and planned large-scale movement of the hands and arms. Where studies of performance often focus on one of these scales in isolation, ...

In this paper, we propose an annotated piano performance evaluation dataset with 185 audio pieces and a method to evaluate the performance of piano beginners based on their audio recordings. The proposed framework includes three parts: piano key posterior probability extraction, Dynamic Time Warping (DTW) based matching and performance score regression. First, a deep neural network model is tra...

This paper presents a portable optical measurement system for capturing continuous key motion on any piano. Very few concert venues have MIDI-enabled pianos, and many performers depend on the versatile but discontinued Moog PianoBar to provide MIDI from a conventional acoustic instrument. The scanner hardware presented in this paper addresses the growing need for alternative solutions while sur...

Large-Scale Particle Image Velocimetry (LSPIV) is an extension of a quantitative imaging technique to measure water surface velocities using simple and inexpensive equipment. This paper describes the implementation of imaged-based LSPIV in eight different environmental flow and hydraulic engineering applications for the investigation of complex configurations with and without sediment transport...

The relationship between the key depression force on an upright piano and the level of loudness of a generated tone was examined when pianists hit a force-sensor built-in key with "struck" or "pressed" type of touch. The vertical displacement of the key, and the radiated piano sounds were also recorded. It was found that for both types of touch, simple exponential functions could adequately des...

In this paper, we propose a musical onset detection method, with reference to polyphonic piano music. This method operates on a frame-by-frame basis and exploits a suitable time-frequency representation of the audio signal. The solution proposed consists of an onset detection algorithm based on Short-Time Fourier Transform (STFT) and Non-Negative Matrix Factorization (NMF). To validate this met...

The \commuted piano synthesis" algorithm is described, based on a simpli ed acoustic model of the piano. The model includes multiple coupled strings, a nonlinear hammer, and an arbitrarily large soundboard and enclosure. Simpli cations are employed which greatly reduce computational complexity. Most of the simpli cations are made possible by the commutativity of linear, time-invariant systems. ...

This paper presents our system for transcription of polyphonic piano music – SONIC. SONIC takes an audio signal of a piano performance and tries to determine which notes were played by the performer, thus producing a list of notes and note onset times approximately matching the performance. SONIC is composed of three main parts: partial extractor, onset detector and note recognizer. We present ...