Validation metric based on Mahalanobis distance for models with multiple correlated responses. (March 2017)

• Record Type: Journal Article
• Authors: Zhao, Lufeng; Lu, Zhenzhou; Yun, Wanying; Wang, Wenjin
• Is Part Of: Reliability engineering & system safety. Volume 159(2017)
• Page Start: 80
• Page End: 89
• Publication Date: 2017-03
• Subjects: Model validation -- Mahalanobis distance -- Multiple responses -- Uncertainty -- Correlation -- Area metric; Reliability (Engineering) -- Periodicals; System safety -- Periodicals; Industrial safety -- Periodicals; Fiabilité -- Périodiques; Sécurité des systèmes -- Périodiques; Sécurité du travail -- Périodiques; 620.00452
• DOI: 10.1016/j.ress.2016.10.016
• Languages: English
• ISSNs: 0951-8320

Abstract

Abstract: In the probabilistic context, validation metric for models with multiple responses is essentially used to measure the difference between joint statistical distributions resulting from simulation predictions and experimental observations respectively. Considering both uncertainty and correlation, existing validation metrics either ignore correlations among responses or have a relatively huge computational cost. In this paper, by extending the concept of "area metric" and "u-pooling method" developed for validating a scalar response, two new metrics are proposed to validate models with multiple correlated responses using Mahalanobis distance (MD). One new metric is the MD area metric for validating multi-responses at a single validation site. The other is the MD-pooling metric, and it allows for pooling the evidence from all relevant data of multi-response over the intended validation domain into a scalar measure to assess the global predictive capability of computational models. The proposed metrics are applicable to validation for models with multiple correlated responses. Their several favorable properties include objectiveness, affordability, unboundedness, and determinacy of the results. Compared with the existing validation metrics, the feasibility, effectiveness and efficiency of our proposed two metrics are illustrated by a numerical test example and an engineering example. Highlights: Mahalanobis distance (MD) has an advantage to transforma multivariate analysis into a univariate analysis. The MD area metric for validating multi-responses at a single validation site is proposed. The MD-pooling metric for validating multi-responses over an intended validation domain is proposed. The MD area metric and the MD-pooling metric significantly reduce the computational cost compared to the existing PIT area metric and the t-pooling transformation.