Adversarial retraining attack of asynchronous advantage actor‐critic based pathfinding. Issue 5 (11th February 2021)

• Record Type: Journal Article
• Authors: Tong, Chen; Jiqiang, Liu; Yingxiao, Xiang; Wenjia, Niu; Endong, Tong; Shuoru, Wang; He, Li; Liang, Chang; Gang, Li; Qi Alfred, Chen
• Is Part Of: International journal of intelligent systems. Volume 36:Issue 5(2021)
• Page Start: 2323
• Page End: 2346
• Publication Date: 2021-02-11
• Subjects: A3C -- evasion attack -- pathfinding -- reinforcement learning -- retraining attack; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; 006.3
• DOI: 10.1002/int.22380
• Languages: English
• ISSNs: 0884-8173

Abstract

Abstract: Pathfinding becomes an important component in many real‐world scenarios, such as popular warehouse systems and autonomous aircraft towing vehicles. With the development of reinforcement learning (RL) especially in the context of asynchronous advantage actor‐critic (A3C), pathfinding is undergoing a revolution in terms of efficient parallel learning. Similar to other artificial intelligence‐based applications, A3C‐based pathfinding is also threatened by the adversarial attack. In this paper, we are the first to study the adversarial attack to A3C, that can unexpectedly wake up longtime retraining mechanism until successful pathfinding. We also discover an attack example generation to launch the attack based on gradient band, in which only one baffle of extremely few unit lengths can successfully perform the attack. Experiments with detailed analysis are conducted to show a high attack success rate of 95% with an average baffle length of 2.95. We also discuss defense suggestions leveraging the insights from our analysis.