On Accuracy and Time Processing Evaluation of Cover Song Identification Systems. Issue 4 (1st October 2016)

• Record Type: Journal Article
• Authors: Ferreira, Martha Dais; Corrêa, Débora Cristina; Grivet, Marcos Antonio; dos Santos, Geovan Tavares; de Mello, Rodrigo Fernandes; Nonato, Luis Gustavo
• Is Part Of: Journal of new music research. Volume 45:Issue 4(2016)
• Page Start: 333
• Page End: 342
• Publication Date: 2016-10-01
• Subjects: music information retrieval -- cover song identification -- audio processing; Music -- Periodicals; Musicology -- Periodicals; 780.72
• DOI: 10.1080/09298215.2016.1249490
• Languages: English
• ISSNs: 0929-8215

Abstract

Abstract: Cover song identification (CSI) systems typically represent songs as chromagrams which are pairwise compared using different evaluation measurements. Chromagram comparison are usually computationally demanding, making most CSI systems unsuitable for real-world scenarios where millions of songs have to be processed. Evaluation mechanisms such as the ones proposed by Music Information Retrieval Evaluation eXchange (MIREX) handle MIR systems as black boxes, measuring their accuracy as a whole, thus disregarding the effectiveness of each particular component of the system. Moreover, computational times are usually not taken into account in the evaluation process, making difficult to assess the usefulness of the systems when facing large data-sets. In this manuscript, we present a systematic evaluation of the components of two state-of-the-art CSI systems that performed quite well according to MIREX. Our experiments indicate that the performance of those two systems strongly depends on the combination of the song descriptor and the comparison method used to quantify the similarity between songs. Nevertheless, the high computational cost involved in the comparison of song descriptors renders both approaches unfeasible to large data-sets, motivating the development of alternative methods.