Variability in Action Selection Relates to Striatal Dopamine 2/3 Receptor Availability in Humans: A PET Neuroimaging Study Using Reinforcement Learning and Active Inference Models. (21st February 2020)

• Record Type: Journal Article
• Authors: Adams, Rick A; Moutoussis, Michael; Nour, Matthew M; Dahoun, Tarik; Lewis, Declan; Illingworth, Benjamin; Veronese, Mattia; Mathys, Christoph; de Boer, Lieke; Guitart-Masip, Marc; Friston, Karl J; Howes, Oliver D; Roiser, Jonathan P
• Is Part Of: Cerebral cortex. Volume 30:Number 6(2020)
• Page Start: 3573
• Page End: 3589
• Publication Date: 2020-02-21
• Subjects: active inference -- action selection -- decision temperature -- dopamine 2/3 receptors -- go no-go task -- reinforcement learning; Cerebral cortex -- Periodicals; Brain -- Periodicals; 612.825
• DOI: 10.1093/cercor/bhz327
• Languages: English
• ISSNs: 1047-3211

Abstract

Abstract: Choosing actions that result in advantageous outcomes is a fundamental function of nervous systems. All computational decision-making models contain a mechanism that controls the variability of (or confidence in) action selection, but its neural implementation is unclear—especially in humans. We investigated this mechanism using two influential decision-making frameworks: active inference (AI) and reinforcement learning (RL). In AI, the precision (inverse variance) of beliefs about policies controls action selection variability—similar to decision 'noise' parameters in RL—and is thought to be encoded by striatal dopamine signaling. We tested this hypothesis by administering a 'go/no-go' task to 75 healthy participants, and measuring striatal dopamine 2/3 receptor (D2/3 R) availability in a subset ( n = 25) using [ 11 C]-(+)-PHNO positron emission tomography. In behavioral model comparison, RL performed best across the whole group but AI performed best in participants performing above chance levels. Limbic striatal D2/3 R availability had linear relationships with AI policy precision ( P = 0.029) as well as with RL irreducible decision 'noise' ( P = 0.020), and this relationship with D2/3 R availability was confirmed with a 'decision stochasticity' factor that aggregated across both models ( P = 0.0006). These findings are consistent with occupancy of inhibitory striatal D2/3 Rs decreasing the variability of action selection in humans.