Detection of variable length anomalous subsequences in data streams. (1st January 2012)

• Record Type: Journal Article
• Authors: Safia, Amany Abou; Al Aghbari, Zaher
• Is Part Of: International journal of intelligent information and database systems. Volume 6:Number 3(2012)
• Page Start: 273
• Page End: 288
• Publication Date: 2012-01-01
• Subjects: anomaly detection -- outliers -- data stream -- data mining -- extracting subsequences -- incremental algorithm; Database management -- Computer programs -- Periodicals; Information retrieval -- Computer programs -- Periodicals; Information storage and retrieval systems -- Computer programs -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Intelligent agents (Computer software) -- Periodicals; 006.33
• Languages: English
• ISSNs: 1751-5858

Abstract

We consider the problem of anomaly detection in data streams, which is the problem of extracting subsequences that do not match an expected behaviour. The main challenge for detecting anomalous subsequences from data streams in the existing techniques is to determine the lengths of the normal and anomalous subsequences. Therefore, creating a robust model for detecting the anomalous subsequences is of critical importance. In this paper, we propose an incremental algorithm based on the dynamic time warping technique to detect anomalous subsequences in data streams. The proposed algorithm is able to detect anomalous subsequences under relaxed length constrains of the normal and/or the anomalous subsequences. That is the proposed algorithm is able to detect variable length anomalous subsequences from among variable length normal sequences. The proposed robust model can be applied in areas such as system health monitoring, event detection in sensor networks, and detecting eco-system disturbances, etc. The cost of the proposed algorithm is linear with time and memory.