Automated detection of unusual soil moisture probe response patterns with association rule learning. (July 2018)

• Record Type: Journal Article
• Authors: Yu, Ziwen; Bedig, Alex; Montalto, Franco; Quigley, Marcus
• Is Part Of: Environmental modelling & software. Volume 105(2018)
• Page Start: 257
• Page End: 269
• Publication Date: 2018-07
• Subjects: QAQC -- Association rule learning -- Green infrastructure -- Anomalous pattern detection -- Dynamic time warping; Environmental monitoring -- Computer programs -- Periodicals; Ecology -- Computer simulation -- Periodicals; Digital computer simulation -- Periodicals; Computer software -- Periodicals; Environmental Monitoring -- Periodicals; Computer Simulation -- Periodicals; Environnement -- Surveillance -- Logiciels -- Périodiques; Écologie -- Simulation, Méthodes de -- Périodiques; Simulation par ordinateur -- Périodiques; Logiciels -- Périodiques; Computer software; Digital computer simulation; Ecology -- Computer simulation; Environmental monitoring -- Computer programs; Periodicals; Electronic journals; 363.70015118
• DOI: 10.1016/j.envsoft.2018.04.001
• Languages: English
• ISSNs: 1364-8152

Abstract

Abstract: In-situ field monitoring networks generate vast quantities of continuous data can help to improve the design, management, operation and maintenance of Green Infrastructure (GI) systems. However, such actions require efficient and reliable quality assurance quality control (QAQC). In this paper, we develop a rule-based learning algorithm involving Dynamic Time Warping (DTW) to investigate the feasibility of detecting anomalous responses from soil moisture probes using data collected from a GI site in Milwaukee, WI. As an enhancement to traditional QAQC methods which rely on individual time steps, this method converts the continuous time series into event sequences from which response patterns can be detected. Association rules are developed on both environmental features and event features. The results suggest that this method could be used to identify abnormal change patterns as compared to intra-site historical observations. Though developed for soil moisture, this method could easily be extended to apply on other continuous environmental datasets. Highlights: Environmental and event features can be associated with the similarity of paired soil moisture change event. Better accuracy can be achieved by involving more features related to the soil moisture chang and learning from larger data set from longer observations or monitoring network with multiple probes. Such association rules can help to efficiently checking the validity of a soil moisture change pattern This method, as an enhancement to traditional QAQC methods, can also be applied on other continuous environmental monitoring data streams.