Towards Bridging the Gap between Sheet Music and Audio
نویسندگان
چکیده
Sheet music and audio recordings represent and describe music on different semantic levels. Sheet music describes abstract high-level parameters such as notes, keys, measures, or repeats in a visual form. Because of its explicitness and compactness, most musicologists discuss and analyze the meaning of music on the basis of sheet music. On the contrary, most people enjoy music by listening to audio recordings, which represent music in an acoustic form. In particular, the nuances and subtleties of musical performances, which are generally not written down in the score, make the music come alive. In this paper, we address the problem of bridging the gap between the sheet music domain and the audio domain. In particular, we discuss aspects on music representations, music synchronization, and optical music recognition, while indicating various strategies and open research problems.
منابع مشابه
Automatic organization of digital music documents: sheet music and audio
This thesis presents work towards automatic organization and synchronization of scanned sheet music and digitized audio recordings in the scenario of a digital music library. The organization targeted in the project of this thesis includes the segmentation of sheet music books and audio CD collections into individual songs or movements, mapping the resulting segments to corresponding records in...
متن کاملTowards End-to-End Audio-Sheet-Music Retrieval
This paper demonstrates the feasibility of learning to retrieve short snippets of sheet music (images) when given a short query excerpt of music (audio) – and vice versa –, without any symbolic representation of music or scores. This would be highly useful in many content-based musical retrieval scenarios. Our approach is based on Deep Canonical Correlation Analysis (DCCA) and learns correlated...
متن کاملBridging the ‘Two Cultures’ of Research and Service: Can Complexity Theory Help?; Comment on “Experience of Health Leadership in Partnering With University-Based Researchers in Canada – A Call to ‘Re-imagine’ Research”
This commentary addresses Bowen et al’s empirical study of perspectives of Canadian healthcare staff towards research and their call for multi-faceted action to improve misalignments in the system. This commentary argues that tensions and misalignments between research and service are inherent and can never be eradicated. Building on previous work by Lanham et al, I pro...
متن کاملBridging the Music Semantic Gap
In this paper we present the music information plane and the different levels of information extraction that exist in the musical domain. Based on this approach we propose a way to overcome the existing semantic gap in the music field. Our approximation is twofold: we propose a set of music descriptors that can automatically be extracted from the audio signals, and a top-down approach that adds...
متن کاملTowards Score Following In Sheet Music Images
This paper addresses the matching of short music audio snippets to the corresponding pixel location in images of sheet music. A system is presented that simultaneously learns to read notes, listens to music and matches the currently played music to its corresponding notes in the sheet. It consists of an end-to-end multi-modal convolutional neural network that takes as input images of sheet musi...
متن کامل