Handling or being the concept: An fMRI study on metonymy representations in coverbal gestures. (31st January 2018)

• Record Type: Journal Article
• Authors: Joue, Gina; Boven, Linda; Willmes, Klaus; Evola, Vito; Demenescu, Liliana R.; Hassemer, Julius; Mittelberg, Irene; Mathiak, Klaus; Schneider, Frank; Habel, Ute
• Is Part Of: Neuropsychologia. Volume 109(2018)
• Page Start: 232
• Page End: 244
• Publication Date: 2018-01-31
• Subjects: Multimodal communication -- Coverbal gestures -- Cognitive linguistics -- Body-part-as-object -- Transitive gestures -- Pantomiming -- Metonymy -- Semantic attention -- Abstract cognition -- FMRI -- TPJ; Neuropsychology -- Periodicals; Neurology -- Periodicals; Psychophysiology -- Periodicals; Neuropsychologie -- Périodiques; Neuropsychology; Periodicals; Electronic journals; 616.8
• DOI: 10.1016/j.neuropsychologia.2017.12.033
• Languages: English
• ISSNs: 0028-3932

Abstract

Abstract: In "Two heads are better than one, " "head" stands for people and focuses the message on the intelligence of people. This is an example of figurative language through metonymy, where substituting a whole entity by one of its parts focuses attention on a specific aspect of the entity. Whereas metaphors, another figurative language device, are substitutions based on similarity, metonymy involves substitutions based on associations. Both are figures of speech but are also expressed in coverbal gestures during multimodal communication. The closest neuropsychological studies of metonymy in gestures have been nonlinguistic tool-use, illustrated by the classic apraxic problem of body-part-as-object (BPO, equivalent to an internal metonymy representation of the tool) vs. pantomimed action ( external metonymy representation of the absent object/tool). Combining these research domains with concepts in cognitive linguistic research on gestures, we conducted an fMRI study to investigate metonymy resolution in coverbal gestures. Given the greater difficulty in developmental and apraxia studies, perhaps explained by the more complex semantic inferencing involved for external metonymy than for internal metonymy representations, we hypothesized that external metonymy resolution requires greater processing demands and that the neural resources supporting metonymy resolution would modulate regions involved in semantic processing. We found that there are indeed greater activations for external than for internal metonymy resolution in the temporoparietal junction (TPJ). This area is posterior to the lateral temporal regions recruited by metaphor processing. Effective connectivity analysis confirmed our hypothesis that metonymy resolution modulates areas implicated in semantic processing. We interpret our results in an interdisciplinary view of what metonymy in action can reveal about abstract cognition. Abstract : Highlights: Metonymy resolution in coverbal gestures implicates the temporal parietal junction. Metonymy resolution modulates semantic processing. Metonymy is supported by different neural resources than for metaphor understanding. Pantomimes/internal metonymy demand more resources than BPO/external metonymy.