A new time adjusting control limits chart for concept drift detection. (September 2021)

• Record Type: Journal Article
• Authors: Mejri, Dhouha; Limam, Mohamed; Weihs, Claus
• Is Part Of: IFAC journal of systems and control. Volume 17(2021)
• Publication Date: 2021-09
• Subjects: Statistical process control -- Adaptive control charts -- Data streams -- Concept drift; Automatic control -- Periodicals; Relay control systems -- Periodicals; Embedded computer systems -- Periodicals; Feedback control systems -- Periodicals; Artificial intelligence -- Periodicals; Artificial intelligence; Automatic control; Embedded computer systems; Feedback control systems; Relay control systems; Electronic journals; Periodicals; 629.89
• DOI: 10.1016/j.ifacsc.2021.100170
• Languages: English
• ISSNs: 2468-6018

Abstract

Abstract: Time varying dynamic systems whose underlying changing distribution should be continuously monitored to track abnormal behaviors are one of the most recent challenges in many practical applications. When the data arrive in a continuous way, the target concept to be monitored may change accordingly causing a problem of concept drift. Thus, distinguishing between true alarms and changes due to the nonstationarity of the loading data is required. Traditional control charts cannot handle such processes since they do not use a change dependent procedure and they are not designed for concept drift problems. This article proposes the first two-stage time adjusting control chart for monitoring data stream processes with concept drift. Stage I updates the control limits each time an adjustment condition is satisfied based on an incremental linear combination of the historical and the new data. Stage II validates the shift detected in Stage I by testing whether the two subsamples around the drift belong to the same distribution. Experiments based on several drift situations and using different performance measures show that the proposed adaptive chart is more robust than the most recent competitive time varying charts existing in the literature. Moreover, it is more efficient in terms of shift recognition by reducing the false negative detections in several cases. Highlights: A new time adjusting control limit chart especially designed for monitoring non-stationary processes with concept drift is proposed. The new method is evaluated in the different change scenarios that may occur in the data. The proposed adaptive chart has better performance than the only time varying control chart competitor existing in the literature.