A Biologically Plausible Action Selection System for Cognitive Architectures: Implications of Basal Ganglia Anatomy for Learning and Decision‐Making Models. (6th June 2017)

• Record Type: Journal Article
• Authors: Stocco, Andrea
• Is Part Of: Cognitive science. Volume 42:Number 2(2018)
• Page Start: 457
• Page End: 490
• Publication Date: 2017-06-06
• Subjects: Cognitive architectures -- Production systems -- Basal ganglia -- Reinforcement learning -- Neurophysiology -- Decision making; Cognition -- Periodicals; Psycholinguistics -- Periodicals; Artificial intelligence -- Periodicals; 153.05
• DOI: 10.1111/cogs.12506
• Languages: English
• ISSNs: 0364-0213

Abstract

Abstract: Several attempts have been made previously to provide a biological grounding for cognitive architectures by relating their components to the computations of specific brain circuits. Often, the architecture's action selection system is identified with the basal ganglia. However, this identification overlooks one of the most important features of the basal ganglia—the existence of a direct and an indirect pathway that compete against each other. This characteristic has important consequences in decision‐making tasks, which are brought to light by Parkinson's disease as well as genetic differences in dopamine receptors. This paper shows that a standard model of action selection in a cognitive architecture (ACT‐R) cannot replicate any of these findings, details an alternative solution that reconciles action selection in the architecture with the physiology of the basal ganglia, and extends the domain of application of cognitive architectures. The implication of this solution for other architectures and existing models are discussed.