Slave: A Score-Lyrics-Audio-Video-Explorer
نویسندگان
چکیده
We introduce the music exploration system SLAVE, which is based upon previous developments of our group. SLAVE manages multimedia music collections and allows for multimodal navigation, playback, and visualization in an efficient and user-friendly manner. 1 While previously the focus of our system development has been the simultaneous exploration of digitized sheet music and audio, with SLAVE we enhance the functionalities by video and lyrics to achieve a more comprehensive music interaction. In this paper, we concentrate on two aspects. Firstly, we integrate video documents into our framework. Secondly, we introduce a graphical user interface for semi-automatic feature extraction, indexing, and synchronization of heterogeneous music collections. The output of this GUI is used by SLAVE to offer both high quality audio and video playback with time-synchronous display of digitized sheet music and content-based search.
منابع مشابه
Multi-modal Analysis of Music: A large-scale Evaluation
Multimedia data by definition comprises several different types of content modalities. Music specifically inherits e.g. audio at its core, text in the form of lyrics, images by means of album covers, or video in the form of music videos. Yet, in many Music Information Retrieval applications, only the audio content is utilised. Recent studies have shown the usefulness of incorporating other moda...
متن کاملSong Prompter: an Accompaniment System Based on the Automatic Alignment of Lyrics and Chords to Audio
We present Song Prompter, a software system that acts as a performance guide by showing horizontally scrolling lyrics, chords, beats marks and bar marks in a graphical user interface, together with an audio accompaniment consisting of bass and MIDI drums. A song outline displays the song structure, including names and positions of sections for easy overview and navigation. Song Prompter enables...
متن کاملBoosting for Multi-Modal Music Emotion Classification
With the explosive growth of music recordings, automatic classification of music emotion becomes one of the hot spots on research and engineering. Typical music emotion classification (MEC) approaches apply machine learning methods to train a classifier based on audio features. In addition to audio features, the MIDI and lyrics features of music also contain useful semantic information for pred...
متن کاملReal-time audio-to-score alignment of singing voice based on melody and lyric information
Singing voice is specific in music: a vocal performance conveys both music (melody/pitch) and lyrics (text/phoneme) content. This paper aims at exploiting the advantages of melody and lyric information for real-time audio-to-score alignment of singing voice. First, lyrics are added as a separate observation stream into a template-based hidden semi-Markov model (HSMM), whose observation model is...
متن کاملAutomatic Beat Alignment of Rap Lyrics
Rap is characterized by highly rhythmic delivery of words; the subtle ways in which syllables in the lyrics fit into the beats in the music lead to expressivity in rap music. Unfortunately, given a lack of notated score for the genre of rap, the task of determining the rhythm to existing rap performances must be carried out manually. In this paper, we explore a method of automatically aligning ...
متن کامل