A novel Domain Adaptive Deep Recurrent Network for multivariate time series prediction. (November 2021)

• Record Type: Journal Article
• Authors: Yang, Tao; Yu, Xia; Ma, Ning; Zhao, Yuhang; Li, Hongru
• Is Part Of: Engineering applications of artificial intelligence. Volume 106(2021)
• Publication Date: 2021-11
• Subjects: Multivariate time series prediction -- Deep learning -- Transfer learning -- Domain adaptation -- Recurrent neural network; Engineering -- Data processing -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Ingénierie -- Informatique -- Périodiques; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; Artificial intelligence; Engineering -- Data processing; Expert systems (Computer science); Periodicals; 620.00285
• DOI: 10.1016/j.engappai.2021.104498
• Languages: English
• ISSNs: 0952-1976

Abstract

Abstract: Multivariate time series prediction has attracted growing interest in many research fields. Recently, deep learning has been applied to multivariate time series prediction and has achieved encouraging results. However, in real-world scenarios, the insufficient data of multivariate time series at the beginning of the observation causes the deep learning model unable to exert its expected performance. Furthermore, there is the distribution discrepancy between different multivariate time series caused by many factors, making it unfeasible to reuse existing data or models directly. Therefore, a novel Domain Adaptive Deep Recurrent Network (DADRN) is proposed for multivariate time series prediction with insufficient data, which transferring the knowledge of the target-related time series (source domain) to the target time series (target domain) by minimizing distribution mismatch in the feature sharing space. The DADRN automatically learns the temporal dependence of predictive time series and the dynamic dependencies between multiple time variables through the deep recurrent neural network. Besides, a special transfer learning method, domain adaptation, is embedded in the constructed deep recurrent network to reduce the distribution discrepancy between different domains. The proposed domain independence strategy and domain weighted loss further enhance the DADRN's transfer learning capability by improving the distribution estimation of the target domain and balancing the network's learning on two domains. The reasonable combination of deep recurrent network and domain adaptation endows DADRN with favorable transfer learning capability, and its effectiveness is demonstrated by the experimental results on two real-world datasets. Highlights: A novel domain adaptive deep recurrent network (DADRN) for multivariate time series prediction is proposed. An adaptation layer is embedded into DADRN for learning meaningful domain-invariant representations. The domain independence strategy and domain weighted loss are proposed to enhance transfer learning capability of DADRN. The performance of DADRN is validated on real-world multivariate time series datasets.