An overview of large‐dimensional covariance and precision matrix estimators with applications in chemometrics. (3rd April 2017)

• Record Type: Journal Article
• Authors: Engel, Jasper; Buydens, Lutgarde; Blanchet, Lionel
• Other Names: Kalivas John H. guestEditor.
• Is Part Of: Journal of chemometrics. Volume 31:Number 4(2017)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2017-04-03
• Subjects: eigenvalue shrinkage -- metabolomics -- ridge‐type estimation -- sparse covariance matrix -- sparse precision matrix; Chemistry -- Mathematics -- Periodicals; Chemistry -- Statistical methods -- Periodicals; 542.85
• DOI: 10.1002/cem.2880
• Languages: English
• ISSNs: 0886-9383

Abstract

Abstract : The covariance matrix (or its inverse, the precision matrix) is central to many chemometric techniques. Traditional sample estimators perform poorly for high‐dimensional data such as metabolomics data. Because of this, many traditional inference techniques break down or produce unreliable results. In this paper, we selectively review several modern estimators of the covariance and precision matrix that improve upon the traditional sample estimator. We focus on 3 general techniques: eigenvalue‐shrinkage estimation, ridge‐type estimation, and structured estimation. These methods rely on different assumptions regarding the structure of the covariance or precision matrix. Various examples, in particular using metabolomics data, are used to compare these techniques and to demonstrate that in concert with, eg, principal component analysis, multivariate analysis of variance, and Gaussian graphical models, better results are obtained. Abstract : We selectively review modern estimators of the covariance and precision matrix focusing on 3 general techniques, namely, eigenvalue‐shrinkage estimation, ridge‐type estimation, and structured estimation. These methods rely on different structural assumptions of the covariance or precision matrix. Various examples, in particular using metabolomics data, are used to compare these techniques and to demonstrate that in concert with, eg, principal component analysis, multivariate analysis of variance, and Gaussian graphical models, better results are obtained.