Designing online network intrusion detection using deep auto-encoder Q-learning. (October 2019)

• Record Type: Journal Article
• Authors: Kim, Chayoung; Park, JiSu
• Is Part Of: Computers & electrical engineering. Volume 79(2019)
• Publication Date: 2019-10
• Subjects: Network anomalies -- Online learning systems -- Network intrusion detection (NID) -- Deep Q-Network (DQN) -- Reinforcement learning (RL); Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2019.106460
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: Because of the increasing application of reinforcement learning (RL), particularly deep Q-learning algorithm, research organizations utilize it with increasing frequency. The prediction of cyber vulnerability and development of efficient real-time online network intrusion detection (NID) systems are progressions toward becoming RL-powered. An open issues in NID is the model design and prediction of real-time online data composed of a series of time-related feature patterns. There have been concerns regarding the operation of the developed systems because cyber-attack scenarios vary continuously to circumvent NID. These issues have been related to the human interaction significance and the decrease in accuracy verification. Therefore, we employ an RL that permits a deep auto-encoder in the Q-network (DAEQ-N). The proposed DAEQ-N attempts to achieve the maximum prediction accuracy in online learning systems into which continuous behavior patterns are fed and which are trained with more significant weights by classifying it as either "normal" or "anomalous."