Towards robust autonomous driving systems through adversarial test set generation. (January 2023)

• Record Type: Journal Article
• Authors: Unal, Devrim; Catak, Ferhat Ozgur; Houkan, Mohammad Talal; Mudassir, Mohammed; Hammoudeh, Mohammad
• Is Part Of: ISA transactions. Volume 132(2023)
• Page Start: 69
• Page End: 79
• Publication Date: 2023-01
• Subjects: Risk-aware autonomous systems -- DL -- Test set generation -- Uncertainty; Engineering instruments -- Periodicals; Engineering instruments; Periodicals; Electronic journals; 629.805
• DOI: 10.1016/j.isatra.2022.11.007
• Languages: English
• ISSNs: 0019-0578

Abstract

Abstract: Correct environmental perception of objects on the road is vital for the safety of autonomous driving. Making appropriate decisions by the autonomous driving algorithm could be hindered by data perturbations and more recently, by adversarial attacks. We propose an adversarial test input generation approach based on uncertainty to make the machine learning (ML) model more robust against data perturbations and adversarial attacks. Adversarial attacks and uncertain inputs can affect the ML model's performance, which can have severe consequences such as the misclassification of objects on the road by autonomous vehicles, leading to incorrect decision-making. We show that we can obtain more robust ML models for autonomous driving by making a dataset that includes highly-uncertain adversarial test inputs during the re-training phase. We demonstrate an improvement in the accuracy of the robust model by more than 12%, with a notable drop in the uncertainty of the decisions returned by the model. We believe our approach will assist in further developing risk-aware autonomous systems. Highlights: A new method for uncertainty-based test set generation for autonomous systems. Support training more robust DL models for autonomous driving. Improved model performance in the existence of data perturbations and adversarial attacks.