[Back]

A. Schindler, P. Knees:
"Multi-Task Music Representation Learning from Multi-Label Embeddings";
Talk: 2019 International Conference on Content-Based Multimedia Indexing (CBMI), Dublin, Ireland; 2019-09-04 - 2019-09-06; in: "Proceedings of the 17th International Conference on Content-Based Multimedia Indexing (CBMI2019)", IEEE, (2019), ISBN: 978-1-7281-4673-7; 1 - 6.

This paper presents a novel approach to music representation learning. Triplet loss based networks have become popular for representation learning in various multimedia retrieval domains. Yet, one of the most crucial parts of this approach is the appropriate selection of triplets, which is indispensable, considering that the number of possible triplets grows cubically. We present an approach to harness multi-tag annotations for triplet selection, by using Latent Semantic Indexing to project the tags onto a high-dimensional space. From this we estimate tag-relatedness to select hard triplets. The approach is evaluated in a multi-task scenario for which we introduce four large multi-tag annotations for the Million Song Dataset for the music properties genres, styles, moods, and themes.

Music Representations Learning, Multi-Task Representation Learning, Multi-Label Embedding, Deep Neural Networks

http://dx.doi.org/10.1109/CBMI.2019.8877462

https://arxiv.org/abs/1909.07730