A Demonstration of the SyncPlayer System

The SyncPlayer system is an advanced audio player for multimodal presentation, browsing, and retrieval of music data. The system has been extended significantly in the last few years. In this contribution, we describe the current state of the system and demonstrate the functionalities and interactions of the novel SyncPlayer components including combined interand intra-document music browsing. 1 SYNCPLAYER OVERVIEW The SyncPlayer is a client-server based software framework integrating various MIR-techniques such as music synchronization, content-based retrieval, and multimodal presentation of audio recordings and associated annotations [3]. The framework basically consists of three components: a server component, a client component, and a toolset for data administration (see also Figure 1): • The user operates the client component, which in its basic mode acts like a standard software audio player for *.mp3 and *.wav files. Additional interfaces, e.g., for performing content-based queries as well as various visualization tools, are provided through plug-ins (see Figure 2). • A remote computer system runs the server component, which is capable of identifying audio recordings played by the client and which supplies the client with metadata and annotations for those recordings. Furthermore, the server comprises several types of music search engines. • Several server-side administration tools are used for maintaining the databases and indexes underlying the SyncPlayer system. In a typical SyncPlayer scenario we assume that, on the server-side, there exists a large collection of music documents. Here, for each given piece of music, various digital representations (e. g., audio, MIDI, MusicXML, scanned images of sheet music) as well as associated metadata should be accessible by the server. In the following, this kind of data will be referred to as raw data. The raw data is further processed to generate what we refer to as derived c © 2007 Austrian Computer Society (OCG). Raw Data Audio Data MIDI Data Lyrics Metadata · · ·