Affective-Associative Two-Process theory: A neural network investigation of adaptive behaviour in differential outcomes training. (February 2017)

• Record Type: Journal Article
• Authors: Lowe, Robert; Billing, Erik
• Is Part Of: Adaptive behavior. Volume 25:Number 1(2017)
• Page Start: 5
• Page End: 23
• Publication Date: 2017-02
• Subjects: Actor–Critic -- reward learning -- animal models -- Associative-Two Process theory -- neo-behaviourism -- decision making; Animal behavior -- Periodicals; Animals -- Adaptation -- Periodicals; Adaptability (Psychology) -- Periodicals; Adaptation, Psychological -- Periodicals; Artificial intelligence -- Periodicals; 591.5
• DOI: 10.1177/1059712316682999
• Languages: English
• ISSNs: 1741-2633

Abstract

In this article we present a novel neural network implementation of Associative Two-Process (ATP) theory based on an Actor–Critic-like architecture. Our implementation emphasizes the affective components of differential reward magnitude and reward omission expectation and thus we model Affective -Associative Two-Process theory (Aff-ATP). ATP has been used to explain the findings of differential outcomes training (DOT) procedures, which emphasize learning differentially valuated outcomes for cueing actions previously associated with those outcomes. ATP hypothesizes the existence of a 'prospective' memory route through which outcome expectations can bring to bear on decision making and can even substitute for decision making based on the 'retrospective' inputs of standard working memory. While DOT procedures are well recognized in the animal learning literature they have not previously been computationally modelled. The model presented in this article helps clarify the role of ATP computationally through the capturing of empirical data based on DOT. Our Aff-ATP model illuminates the different roles that prospective and retrospective memory can have in decision making (combining inputs to action selection functions). In specific cases, the model's prospective route allows for adaptive switching (correct action selection prior to learning) following changes in the stimulus–response–outcome contingencies.