"Give me happy pop songs in C major and with a fast tempo": A vocal assistant for content-based queries to online music repositories. Issue 173 (May 2023)

• Record Type: Journal Article
• Authors: Turchet, Luca; Zanotto, Carlo; Pauwels, Johan
• Is Part Of: International journal of human-computer studies. Issue 173(2023)
• Publication Date: 2023-05
• Subjects: 00-01 -- 99-00; Music technology -- Internet of Musical Things -- Voice assistant -- Online music repository -- Networked interaction; Human-machine systems -- Periodicals; Systems engineering -- Periodicals; Human engineering -- Periodicals; Human engineering; Human-machine systems; Systems engineering; Periodicals; Electronic journals; 004.019
• DOI: 10.1016/j.ijhcs.2023.103007
• Languages: English
• ISSNs: 1071-5819

Abstract

Abstract: This paper presents an Internet of Musical Things system devised to support recreational music-making, improvisation, composition, and music learning via vocal queries to an online music repository. The system involves a commercial voice-based interface and the Jamendo cloud-based repository of Creative Commons music content. Thanks to the system the user can query the Jamendo music repository by six content-based features and each combination thereof: mood, genre, tempo, chords, key and tuning. Such queries differ from the conventional methods for music retrieval, which are based on the piece's title and the artist's name. These features were identified following a survey with 112 musicians, which preliminary validated the concept underlying the proposed system. A user study with 20 musicians showed that the system was deemed usable, able to provide a satisfactory user experience, and useful in a variety of musical activities. Differences in the participants' needs were identified, which highlighted the need for personalization mechanisms based on the expertise level of the user. Importantly, the system was seen as a concrete solution to physical encumbrances that arise from the concurrent use of the instrument and devices providing interactive media resources. Finally, the system offers benefits to visually-impaired musicians. Highlights: An Internet of Musical Things system is created to support recreational music-making, improvisation, composition, and music learning via vocal queries to an online music repository. Thanks to the system, users can query the Jamendo music repository by six content-based features and combination thereof: mood, genre, tempo, chords, key and tuning. Such queries differ from conventional methods for music retrieval, which are based on the piece's title and the artist's name. A user study showed that the system is deemed usable, able to provide a satisfactory user experience, and useful in a variety of musical activities. The system was seen as a concrete solution to physical encumbrances that arise from the concurrent use of the instrument and devices providing interactive media resources.