A lightweight approach for network intrusion detection in industrial cyber-physical systems based on knowledge distillation and deep metric learning. (15th November 2022)

• Record Type: Journal Article
• Authors: Wang, Zhendong; Li, Zeyu; He, Daojing; Chan, Sammy
• Is Part Of: Expert systems with applications. Volume 206(2022)
• Publication Date: 2022-11-15
• Subjects: Intrusion detection -- Industrial cyber-physical system -- Knowledge distillation -- Triplet neural network; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2022.117671
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: The resource-constrained devices in Cyber-Physical Systems are considered. The KD-TCNN model is utilized with knowledge distillation and metric learning. A neural network training method called K-fold cross training is proposed. The proposed model is tested using benchmark intrusion detection datasets. Proposed mothed outperforms many state-of-the-art models. Abstract: With the rapid development of technology and science, machine learning approaches and deep learning methods have been widely applied in industrial Cyber-Physical Systems. However, there are still some challenging issues for anomaly detection to classify various attacks in industrial CPS to ensure the cyber security, especially when dealing with resource-constrained IoT devices. In this paper, we propose a Knowledge Distillation model based on Triplet Convolution Neural Network to improve the model performance and greatly enhance the speed of anomaly detection for industrial CPS as well as reduce the complexity of the model. Specifically, during the training process, we design a robust model loss function to improve the training stability of the model. A new neural network training method called K-fold cross training is also proposed to enhance the accuracy of anomaly detection. A lot of experimental results demonstrate that the performance metrics of KD-TCNN on the benchmark datasets NSL-KDD and CIC IDS2017 have significant advantages over traditional deep learning approaches and the recent state-of-the-art models. Furthermore, when compared to the original model, our model's computational cost and size are both reduced by roughly 86% with just 0.4% accuracy loss.