Monte Carlo Simulation on the Stiefel Manifold via Polar Expansion. Issue 3 (16th September 2021)

• Record Type: Journal Article
• Authors: Jauch, Michael; Hoff, Peter D.; Dunson, David B.
• Is Part Of: Journal of computational and graphical statistics. Volume 30:Issue 3(2021)
• Page Start: 622
• Page End: 631
• Publication Date: 2021-09-16
• Subjects: Bayesian inference -- Markov chain Monte Carlo -- Multivariate data -- Orthogonal matrix -- Parameter expansion -- Polar decomposition; Mathematical statistics -- Data processing -- Periodicals; Mathematical statistics -- Graphic methods -- Periodicals; 519.50285
• DOI: 10.1080/10618600.2020.1859382
• Languages: English
• ISSNs: 1061-8600

Abstract

Abstract: Motivated by applications to Bayesian inference for statistical models with orthogonal matrix parameters, we present polar expansion, a general approach to Monte Carlo simulation from probability distributions on the Stiefel manifold. To bypass many of the well-established challenges of simulating from the distribution of a random orthogonal matrix Q, we construct a distribution for an unconstrained random matrix X such that Q X, the orthogonal component of the polar decomposition of X, is equal in distribution to Q . The distribution of X is amenable to Markov chain Monte Carlo (MCMC) simulation using standard methods, and an approximation to the distribution of Q can be recovered from a Markov chain on the unconstrained space. When combined with modern MCMC software, polar expansion allows for routine and flexible posterior inference in models with orthogonal matrix parameters. We find that polar expansion with adaptive Hamiltonian Monte Carlo is an order of magnitude more efficient than competing MCMC approaches in a benchmark protein interaction network application. We also propose a new approach to Bayesian functional principal component analysis which we illustrate in a meteorological time series application. Supplementary materials for this article are available online.