A linear time method for the detection of collective and point anomalies. (3rd June 2022)

• Record Type: Journal Article
• Authors: Fisch, Alexander T. M.; Eckley, Idris A.; Fearnhead, Paul
• Is Part Of: Statistical analysis and data mining. Volume 15:Number 4(2022)
• Page Start: 494
• Page End: 508
• Publication Date: 2022-06-03
• Subjects: dynamic programming -- epidemic changepoints -- exoplanets -- Numenta Anomaly Benchmark -- outliers -- robust statistics; Data mining -- Statistical methods -- Periodicals; 006.312
• DOI: 10.1002/sam.11586
• Languages: English
• ISSNs: 1932-1864

Abstract

Abstract: The challenge of efficiently identifying anomalies in data sequences is an important statistical problem that now arises in many applications. Although there has been substantial work aimed at making statistical analyses robust to outliers, or point anomalies, there has been much less work on detecting anomalous segments, or collective anomalies, particularly in those settings where point anomalies might also occur. In this article, we introduce collective and point anomalies (CAPA), a computationally efficient approach that is suitable when collective anomalies are characterized by either a change in mean, variance, or both, and distinguishes them from point anomalies. Empirical results show that CAPA has close to linear computational cost as well as being more accurate at detecting and locating collective anomalies than other approaches. We demonstrate the utility of CAPA through its ability to detect exoplanets from light curve data from the Kepler telescope and its capacity to detect machine faults from temperature data.