A Doubly Enhanced EM Algorithm for Model-Based Tensor Clustering. Issue 540 (2nd October 2022)

• Record Type: Journal Article
• Authors: Mai, Qing; Zhang, Xin; Pan, Yuqing; Deng, Kai
• Is Part Of: Journal of the American Statistical Association. Volume 117:Issue 540(2022)
• Page Start: 2120
• Page End: 2134
• Publication Date: 2022-10-02
• Subjects: Clustering -- the EM algorithm -- Gaussian mixture models -- Kronecker product covariance -- Minimax -- Tensor; Statistics -- Periodicals; Statistics -- Periodicals; Statistiques -- Périodiques; États-Unis -- Statistiques -- Périodiques; 519.5
• DOI: 10.1080/01621459.2021.1904959
• Languages: English
• ISSNs: 0162-1459

Abstract

Abstract: Modern scientific studies often collect datasets in the form of tensors. These datasets call for innovative statistical analysis methods. In particular, there is a pressing need for tensor clustering methods to understand the heterogeneity in the data. We propose a tensor normal mixture model approach to enable probabilistic interpretation and computational tractability. Our statistical model leverages the tensor covariance structure to reduce the number of parameters for parsimonious modeling, and at the same time explicitly exploits the correlations for better variable selection and clustering. We propose a doubly enhanced expectation–maximization (DEEM) algorithm to perform clustering under this model. Both the expectation-step and the maximization-step are carefully tailored for tensor data in order to maximize statistical accuracy and minimize computational costs in high dimensions. Theoretical studies confirm that DEEM achieves consistent clustering even when the dimension of each mode of the tensors grows at an exponential rate of the sample size. Numerical studies demonstrate favorable performance of DEEM in comparison to existing methods.