Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback. Issue 3 (18th March 2019)

• Record Type: Journal Article
• Authors: Pouw, Wim; Dixon, James A.
• Is Part Of: Cognitive science. Volume 43:Issue 3(2019)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2019-03-18
• Subjects: Hand‐gesture -- Speech -- Synchrony -- Delayed auditory feedback -- Cross‐wavelet analysis; Cognition -- Periodicals; Psycholinguistics -- Periodicals; Artificial intelligence -- Periodicals; 153.05
• DOI: 10.1111/cogs.12721
• Languages: English
• ISSNs: 0364-0213

Abstract

Abstract: Gesture–speech synchrony re‐stabilizes when hand movement or speech is disrupted by a delayed feedback manipulation, suggesting strong bidirectional coupling between gesture and speech. Yet it has also been argued from case studies in perceptual–motor pathology that hand gestures are a special kind of action that does not require closed‐loop re‐afferent feedback to maintain synchrony with speech. In the current pre‐registered within‐subject study, we used motion tracking to conceptually replicate McNeill's (1992 ) classic study on gesture–speech synchrony under normal and 150 ms delayed auditory feedback of speech conditions (NO DAF vs. DAF). Consistent with, and extending McNeill's original results, we obtain evidence that (a) gesture‐speech synchrony is more stable under DAF versus NO DAF (i.e., increased coupling effect), (b) that gesture and speech variably entrain to the external auditory delay as indicated by a consistent shift in gesture‐speech synchrony offsets (i.e., entrainment effect), and (c) that the coupling effect and the entrainment effect are co‐dependent. We suggest, therefore, that gesture–speech synchrony provides a way for the cognitive system to stabilize rhythmic activity under interfering conditions.