Performance Comparison of Two Statistical Parametric Methods for Outlier Detection and Correction. Issue 16 (2021)

• Record Type: Journal Article
• Authors: Jain, Nimish; Suman, Shraddha; Prusty, B Rajanarayan
• Is Part Of: IFAC-PapersOnLine. Volume 54:Issue 16(2021)
• Page Start: 168
• Page End: 174
• Publication Date: 2021
• Subjects: Clean data -- improved sliding window prediction method -- outlier detection -- correction -- portrait dataset-based method -- synthetic data -- volatile time series; Automatic control -- Periodicals; 629.805
• DOI: 10.1016/j.ifacol.2021.10.089
• Languages: English
• ISSNs: 2405-8963

Abstract

Abstract: Outlier detection and correction referred to as data preprocessing, is crucial in time series analysis and modeling. It has been a challenge to preprocess a volatile time series data possessing intricate trend characteristics. Two well-established statistical parametric methods, such as improved sliding window prediction and portrait dataset-based, perform adequate data preprocessing. While the former is equipped with an optimal window width selection approach, the latter, on the other hand, is based on a data visualization approach named portrait. This paper compares both methods' preprocessing performance when applied to seasonal time series data with varying time resolutions and complex trend patterns for different content of outliers through detailed result analyses. Further, a new metric to measure outlier correction capability is suggested.