Real-time behaviour profiling for network monitoring. (12th April 2010)

• Record Type: Journal Article
• Authors: Xu, Kuai; Wang, Feng; Bhattacharyya, Supratik; Zhang, Zhi-Li
• Is Part Of: International journal of internet protocol technology. Volume 5:Number 1/2(2010)
• Page Start: 65
• Page End: 80
• Publication Date: 2010-04-12
• Subjects: real-time traffic monitoring -- behaviour profiling -- profiling-aware filtering algorithms -- network traffic -- internet links -- data mining -- information theory -- communication patterns; File Transfer Protocol (Computer network protocol) -- Periodicals; Multicasting (Computer networks) -- Periodicals; 004.678
• Languages: English
• ISSNs: 1743-8209

Abstract

This paper presents the design and implementation of a real-time behaviour profiling system for internet links. The system uses flow-level information, and applies data mining and information-theoretic techniques to automatically discover significant events based on communication patterns. We demonstrate the operational feasibility of the system by implementing it and performing benchmarking of CPU and memory costs using packet traces from backbone links. To improve the robustness of this system against sudden traffic surges, we propose a novel filtering algorithm. The proposed algorithm successfully reduces the CPU and memory cost while maintaining high profiling accuracy. Finally, we devise and evaluate simple yet effective blocking strategies to reduce prevalent exploit traffic, and build a simple event analysis engine to generate ACL rules for filtering unwanted traffic.