Distributed outlier detection in hierarchically structured datasets with mixed attributes. Issue 3 (3rd May 2020)

• Record Type: Journal Article
• Authors: Liang, Qiao; Wang, Kaibo
• Is Part Of: Quality technology & quantitative management. Volume 17:Issue 3(2020)
• Page Start: 337
• Page End: 353
• Publication Date: 2020-05-03
• Subjects: Anomaly detection -- hierarchical structures -- mixed attribute datasets -- outlier detection; Quality control -- Periodicals; Quality control -- Statistical methods -- Periodicals; Industrial management -- Periodicals; Industrial management; Management -- Research -- Methodology -- Periodicals; Qualitative research -- Periodicals; Management; Quality control; Quality control -- Statistical methods; Periodicals; 658.00721
• DOI: 10.1080/16843703.2019.1629679
• Languages: English
• ISSNs: 1684-3703

Abstract

ABSTRACT: Anomaly detection has been extensively studied over the past decades; however, there are still various challenges due to the complex structures of the real-world datasets. First, only a few methods in the literature provide insight into the datasets that have both categorical and continuous attributes, and even fewer of them are sensitive to the dependencies between the two types of attributes. Second, a real-world dataset tends to be more complex in its structure, and the categorical attributes are usually hierarchically correlated, which has been largely ignored by the existing outlier detection approaches. Following this line of reasoning, we propose a distributed outlier detection method for mixed attribute datasets, especially with hierarchical categorical attributes. The proposed method accounts for the dependencies between categorical and continuous attributes rather than treating them as two separate parts. In addition, the proposed method is able to capture the hierarchical structure among categorical attributes. The experimental results on a real-world dataset and a simulation study show its superior performance in terms of both the detection accuracy and time efficiency.