Generalized infinite factorization models. (19th January 2022)

• Record Type: Journal Article
• Authors: Schiavon, L; Canale, A; Dunson, D B
• Is Part Of: Biometrika. Volume 109:Number 3(2022)
• Page Start: 817
• Page End: 835
• Publication Date: 2022-01-19
• Subjects: Adaptive Gibbs sampling -- Bird species -- Ecology -- Factor analysis -- High-dimensional data -- Increasing shrinkage -- Structured shrinkage; Biometry -- Periodicals; 570.1519505
• DOI: 10.1093/biomet/asab056
• Languages: English
• ISSNs: 0006-3444

Abstract

Summary: Factorization models express a statistical object of interest in terms of a collection of simpler objects. For example, a matrix or tensor can be expressed as a sum of rank-one components. In practice, however, it can be challenging to infer the number of components and the relative impact of the different components. A popular idea is to include infinitely many components whose impact decreases with the component index. This article is motivated by two limitations of such existing methods: (i) lack of careful consideration of the within-component sparsity structure; and (ii) not accommodating grouped variables and other nonexchangeable structures. We propose a general class of infinite factorization models that address these limitations. Theoretical support is provided, practical gains are demonstrated in simulation studies, and an ecology application focusing on modelling bird species occurrence is discussed.