Harmonicity: Behavioral and Neural Evidence for Functionality in Auditory Scene Analysis. Issue 3 (2nd October 2018)

• Record Type: Journal Article
• Authors: Patten, K. Jakob; McBeath, Michael K.; Baxter, Leslie C.
• Is Part Of: Auditory perception & cognition. Volume 1:Issue 3/4(2018)
• Page Start: 150
• Page End: 172
• Publication Date: 2018-10-02
• Subjects: Consonance-Dissonance -- timbre -- multidimensional scaling -- fMRI -- auditory scene analysis -- auditory cortex -- spectral envelope -- harmonic overtones -- natural regularities; Auditory perception -- Periodicals; Cognition -- Periodicals; Auditory perception; Cognition; Electronic journals; Periodicals; 152.16
• DOI: 10.1080/25742442.2019.1609307
• Languages: English
• ISSNs: 2574-2442

Abstract

ABSTRACT: This study examines sound perception and tests the functionality of harmonicity as a metric of auditory preference and regional brain activity. Most salient sounds contain harmonic overtones, a reliable acoustic natural regularity, which we model to computationally define harmonicity. In Experiment 1, listeners rated pairwise similarity of 20 intensity- and f 0 -matched diverse acoustic stimuli. A multidimensional scaling solution revealed two principal timbre dimensions: tone color and harmonicity. These dimensions, respectively, correlated with the computational measures of spectral-envelope slope ( r = 0.51) and RMSE deviation from a harmonic series ( r = 0.78). The harmonicity dimension also correlated with rated preference ( r = 0.48). This enabled creation of an ordered stimulus-preference continuum that ranged from positive (piano) to negative (hawk screech), used for fMRI tests in Experiment 2. Those results revealed a bilateral primary auditory cortical network for all sounds, but with inharmonic exemplars only producing activation in a fronto-insular cortical network, possibly associated with oddball detection. The results are consistent with dissonant sounds violating the regularity of acoustic-object harmonicity, thereby engaging brain regions associated with unexpected stimuli and attentional focus. The findings confirm harmonicity is an important auditory dimension related to preference, with promise to elicit systematic patterns of cortical network activation.