A machine learning approach to ornamentation modeling and synthesis in jazz guitar. Issue 2 (3rd May 2016)

• Record Type: Journal Article
• Authors: Giraldo, Sergio; Ramírez, Rafael
• Is Part Of: Journal of mathematics and music. Volume 10:Issue 2(2016)
• Page Start: 107
• Page End: 126
• Publication Date: 2016-05-03
• Subjects: machine learning -- expressive music performance -- ornamentation modeling -- jazz guitar -- concatenative synthesis; Music theory -- Periodicals; Music -- Mathematical models -- Periodicals; Music -- Mathematics -- Periodicals; 781.2
• DOI: 10.1080/17459737.2016.1207814
• Languages: English
• ISSNs: 1745-9737

Abstract

Abstract : We present a machine learning approach to automatically generate expressive (ornamented) jazz performances from un-expressive music scores. Features extracted from the scores and the corresponding audio recordings performed by a professional guitarist were used to train computational models for predicting melody ornamentation. As a first step, several machine learning techniques were explored to induce regression models for timing, onset, and dynamics (i.e. note duration and energy) transformations, and an ornamentation model for classifying notes as ornamented or non-ornamented. In a second step, the most suitable ornament for predicted ornamented notes was selected based on note context similarity. Finally, concatenative synthesis was used to automatically synthesize expressive performances of new pieces using the induced models. Supplemental online material for this article containing musical examples of the automatically generated ornamented pieces can be accessed at doi:10.1080/17459737.2016.1207814 andhttps://soundcloud.com/machine-learning-and-jazz . In the Online Supplement we present an example of the musical piece Yesterdays by Jerome Kern, which was modeled using our methodology for expressive music performance in jazz guitar.