Joint mutual information-based input variable selection for multivariate time series modeling. (January 2015)

• Record Type: Journal Article
• Authors: Han, Min; Ren, Weijie; Liu, Xiaoxin
• Is Part Of: Engineering applications of artificial intelligence. Volume 37(2015:Jan.)
• Page Start: 250
• Page End: 257
• Publication Date: 2015-01
• Subjects: Joint mutual information -- Copula entropy -- Input variable selection -- Time series; Engineering -- Data processing -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Ingénierie -- Informatique -- Périodiques; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; Artificial intelligence; Engineering -- Data processing; Expert systems (Computer science); Periodicals; 620.00285
• DOI: 10.1016/j.engappai.2014.08.011
• Languages: English
• ISSNs: 0952-1976

Abstract

Abstract: For modeling of multivariate time series, input variable selection is a key problem. This paper presents the estimation of joint mutual information and its application in input variable selection problems. Mutual information is a commonly used measure for variable selection. To improve the performance of input variable selection, we propose a novel high-dimensional mutual information estimator based on copula entropy, which is estimated by the truncated k -nearest neighbor method. Simulations on high dimensional Gaussian distributions substantiate the effectiveness of the proposed mutual information estimator. A relationship between the joint mutual information and the copula entropy is derived, which is used for joint mutual information estimation. Then the proposed estimator is applied to input variable selection for multivariate time series modeling based on the criterion of max dependency and max–min dependency. A stop criterion is proposed to terminate the selection process automatically. Simulation results show that the input variable selection method works well on both synthetic and real life dataset.