Canonical cortical circuits and the duality of Bayesian inference and optimal control. (October 2021)

• Record Type: Journal Article
• Authors: Doya, Kenji
• Is Part Of: Current opinion in behavioral sciences. Volume 41(2021)
• Page Start: 160
• Page End: 167
• Publication Date: 2021-10
• Subjects: Psychology -- Periodicals; 150.5
• DOI: 10.1016/j.cobeha.2021.07.003
• Languages: English
• ISSNs: 2352-1546

Abstract

Highlights: The duality of sensory inference and optimal control has been known since 1960s. The duality stems from the common computations for the posterior distribution in dynamic Bayesian inference and the value function in reinforcement learning. We consider the hypothesis that the sensory and motor cortical circuits implement dual computations of sensory inference and optimal control, or perceptual and value-based decision making, respectively. Abstract : The duality of sensory inference and motor control has been known since the 1960s and has recently been recognized as the commonality in computations required for the posterior distributions in Bayesian inference and the value functions in optimal control. Meanwhile, an intriguing question about the brain is why the entire neocortex shares a canonical six-layer architecture while its posterior and anterior halves are engaged in sensory processing and motor control, respectively. Here we consider the hypothesis that the sensory and motor cortical circuits implement the dual computations for Bayesian inference and optimal control, or perceptual and value-based decision making, respectively. We first review the classic duality of inference and control in linear quadratic systems and then review the correspondence between dynamic Bayesian inference and optimal control. Based on the architecture of the canonical cortical circuit, we explore how different cortical neurons may represent variables and implement computations.