Why and how the brain weights contributions from a mixture of experts. (April 2021)

• Record Type: Journal Article
• Authors: O'Doherty, John P.; Lee, Sang Wan; Tadayonnejad, Reza; Cockburn, Jeff; Iigaya, Kyo; Charpentier, Caroline J.
• Is Part Of: Neuroscience and biobehavioral reviews. Volume 123(2021)
• Page Start: 14
• Page End: 23
• Publication Date: 2021-04
• Subjects: Cognitive control -- Prefrontal cortex -- Basal ganglia -- Theoretical neuroscience -- Decision-making; Psychophysiology -- Periodicals; Human behavior -- Periodicals; Animal behavior -- Periodicals; Neurology -- Periodicals; Behavior -- Periodicals; Ethology -- Periodicals; Neurology -- Periodicals; Psychophysiologie -- Périodiques; Comportement humain -- Périodiques; Animaux -- Mœurs et comportement -- Périodiques; Neurologie -- Périodiques; Animal behavior; Human behavior; Neurology; Psychophysiology; Periodicals; Electronic journals; 573.8
• DOI: 10.1016/j.neubiorev.2020.10.022
• Languages: English
• ISSNs: 0149-7634

Abstract

Highlights: The brain can be thought of as a "Mixture of Experts" in which different expert systems propose strategies for action. This is accomplished by keeping track of the reliability of the predictions within each system. Control over behavior is allocated in a manner that depends on the relative reliability of those predictions. The "Mixture of Experts" manager is domain general, exerting control over diverse experts to yield sophisticated behavior. Abstract: It has long been suggested that human behavior reflects the contributions of multiple systems that cooperate or compete for behavioral control. Here we propose that the brain acts as a "Mixture of Experts" in which different expert systems propose strategies for action. It will be argued that the brain determines which experts should control behavior at any one moment in time by keeping track of the reliability of the predictions within each system, and by allocating control over behavior in a manner that depends on the relative reliabilities across experts. fMRI and neurostimulation studies suggest a specific contribution of the anterior prefrontal cortex in this process. Further, such a mechanism also takes into consideration the complexity of the expert, favoring simpler over more cognitively complex experts. Results from the study of different expert systems in both experiential and social learning domains hint at the possibility that this reliability-based control mechanism is domain general, exerting control over many different expert systems simultaneously in order to produce sophisticated behavior.