Variable importance analysis: A comprehensive review. (October 2015)

• Record Type: Journal Article
• Authors: Wei, Pengfei; Lu, Zhenzhou; Song, Jingwen
• Is Part Of: Reliability engineering & system safety. Volume 142(2015:Oct.)
• Page Start: 399
• Page End: 432
• Publication Date: 2015-10
• Subjects: Variable importance analysis -- Difference-based -- Regression technique -- Random forest -- Variance-based -- Moment-independent -- Graphic variable importance measures; Reliability (Engineering) -- Periodicals; System safety -- Periodicals; Industrial safety -- Periodicals; Fiabilité -- Périodiques; Sécurité des systèmes -- Périodiques; Sécurité du travail -- Périodiques; 620.00452
• DOI: 10.1016/j.ress.2015.05.018
• Languages: English
• ISSNs: 0951-8320

Abstract

Abstract: Measuring variable importance for computational models or measured data is an important task in many applications. It has drawn our attention that the variable importance analysis (VIA) techniques were developed independently in many disciplines. We are strongly aware of the necessity to aggregate all the good practices in each discipline, and compare the relative merits of each method, so as to instruct the practitioners to choose the optimal methods to meet different analysis purposes, and to guide current research on VIA. To this end, all the good practices, including seven groups of methods, i.e., the difference-based variable importance measures (VIMs), parametric regression and related VIMs, nonparametric regression techniques, hypothesis test techniques, variance-based VIMs, moment-independent VIMs and graphic VIMs, are reviewed and compared with a numerical test example set in two situations (independent and dependent cases). For ease of use, the recommendations are provided for different types of applications, and packages as well as software for implementing these VIA techniques are collected. Prospects for future study of VIA techniques are also proposed. Highlights: All the good practices for variable importance analysis (VIA) are reviewed. These VIA techniques are compared with a numerical example. The relative merit of each technique is analyzed. Recommendations are provided for different types of applications. Packages and software for performing these techniques are collected and summarized.