Adaptive iterative attack towards explainable adversarial robustness. (September 2020)

• Record Type: Journal Article
• Authors: Shi, Yucheng; Han, Yahong; Zhang, Quanxin; Kuang, Xiaohui
• Is Part Of: Pattern recognition. Volume 105(2020:Sep.)
• Publication Date: 2020-09
• Subjects: Adversarial example -- Adversarial attack -- Image classification; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2020.107309
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We demonstrate the relationship between step size and iterative attack effect. We design the first iterative attack adaptively allocates step size. We achieve high attack effect with various models with two different norms. We visualize attack trajectories to show the motivation of adjustment on stepsize. Abstract: Image classifiers based on deep neural networks show severe vulnerability when facing adversarial examples crafted on purpose. Designing more effective and efficient adversarial attacks is attracting considerable interest due to its potential contribution to interpretability of deep learning and validation of neural networks' robustness. However, current iterative attacks use a fixed step size for each noise-adding step, making further investigation into the effect of variable step size on model robustness ripe for exploration. We prove that if the upper bound of noise added to the original image is fixed, the attack effect can be improved if the step size is positively correlated with the gradient obtained at each step by querying the target model. In this paper, we propose Ada-FGSM (Adaptive FGSM), a new iterative attack that adaptively allocates step size of noises according to gradient information at each step. Improvement of success rate and accuracy decrease measured on ImageNet with multiple models emphasizes the validity of our method. We analyze the process of iterative attack by visualizing their trajectory and gradient contour, and further explain the vulnerability of deep neural networks to variable step size adversarial examples.