A Recurrent Connectionist Model of Melody Perception: An Exploration Using TRACX2. Issue 4 (16th April 2023)

• Record Type: Journal Article
• Authors: Defays, Daniel; French, Robert M.; Tillmann, Barbara
• Is Part Of: Cognitive science. Volume 47:Issue 4(2023)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2023-04-16
• Subjects: TRACX -- TRACX2 -- RAAM -- Connectionist autoencoder -- Melody perception -- Music modeling -- Music sequence chunking -- Music sequence segmentation -- General chunking mechanism; Cognition -- Periodicals; Psycholinguistics -- Periodicals; Artificial intelligence -- Periodicals; 153.05
• DOI: 10.1111/cogs.13283
• Languages: English
• ISSNs: 0364-0213

Abstract

Abstract: Are similar, or even identical, mechanisms used in the computational modeling of speech segmentation, serial image processing, and music processing? We address this question by exploring how TRACX2, a recognition‐based, recursive connectionist autoencoder model of chunking and sequence segmentation, which has successfully simulated speech and serial‐image processing, might be applied to elementary melody perception. The model, a three‐layer autoencoder that recognizes "chunks" of short sequences of intervals that have been frequently encountered on input, is trained on the tone intervals of melodically simple French children's songs. It dynamically incorporates the internal representations of these chunks into new input. Its internal representations cluster in a manner that is consistent with "human‐recognizable" melodic categories. TRACX2 is sensitive to both contour and proximity information in the musical chunks that it encounters in its input. It shows the "end‐of‐word" superiority effect demonstrated by Saffran et al. (1999) for short musical phrases. The overall findings suggest that the recursive autoassociative chunking mechanism, as implemented in TRACX2, may be a general segmentation and chunking mechanism, underlying not only word‐ and image‐chunking, but also elementary melody processing.