FMRI reveals language-specific predictive coding during naturalistic sentence comprehension. (17th February 2020)

• Record Type: Journal Article
• Authors: Shain, Cory; Blank, Idan Asher; van Schijndel, Marten; Schuler, William; Fedorenko, Evelina
• Is Part Of: Neuropsychologia. Volume 138(2020)
• Publication Date: 2020-02-17
• Subjects: Language -- Predictive coding -- Multiple demand network -- Naturalistic -- fMRI -- Sentence processing -- Syntactic structure -- Surprisal; Neuropsychology -- Periodicals; Neurology -- Periodicals; Psychophysiology -- Periodicals; Neuropsychologie -- Périodiques; Neuropsychology; Periodicals; Electronic journals; 616.8
• DOI: 10.1016/j.neuropsychologia.2019.107307
• Languages: English
• ISSNs: 0028-3932

Abstract

Abstract: Much research in cognitive neuroscience supports prediction as a canonical computation of cognition across domains. Is such predictive coding implemented by feedback from higher-order domain-general circuits, or is it locally implemented in domain-specific circuits? What information sources are used to generate these predictions? This study addresses these two questions in the context of language processing. We present fMRI evidence from a naturalistic comprehension paradigm (1) that predictive coding in the brain's response to language is domain-specific, and (2) that these predictions are sensitive both to local word co-occurrence patterns and to hierarchical structure. Using a recently developed continuous-time deconvolutional regression technique that supports data-driven hemodynamic response function discovery from continuous BOLD signal fluctuations in response to naturalistic stimuli, we found effects of prediction measures in the language network but not in the domain-general multiple-demand network, which supports executive control processes and has been previously implicated in language comprehension. Moreover, within the language network, surface-level and structural prediction effects were separable. The predictability effects in the language network were substantial, with the model capturing over 37% of explainable variance on held-out data. These findings indicate that human sentence processing mechanisms generate predictions about upcoming words using cognitive processes that are sensitive to hierarchical structure and specialized for language processing, rather than via feedback from high-level executive control mechanisms. Highlights: fMRI shows linguistic prediction effects using naturalistic stimuli. Prediction is implemented by language-specific, not domain-general networks. Prediction is sensitive both to word-cooccurrences and to hierarchical structure.