A conditional density estimation partition model using logistic Gaussian processes. (5th December 2019)

• Record Type: Journal Article
• Authors: Payne, R D; Guha, N; Ding, Y; Mallick, B K
• Is Part Of: Biometrika. Volume 107:Number 1(2020:Mar.)
• Page Start: 173
• Page End: 190
• Publication Date: 2019-12-05
• Subjects: Bayesian conditional density estimation -- Laplace approximation -- Logistic Gaussian process -- Partition model -- Reversible jump Markov chain Monte Carlo; Biometry -- Periodicals; 570.1519505
• DOI: 10.1093/biomet/asz064
• Languages: English
• ISSNs: 0006-3444

Abstract

Summary: Conditional density estimation seeks to model the distribution of a response variable conditional on covariates. We propose a Bayesian partition model using logistic Gaussian processes to perform conditional density estimation. The partition takes the form of a Voronoi tessellation and is learned from the data using a reversible jump Markov chain Monte Carlo algorithm. The methodology models data in which the density changes sharply throughout the covariate space, and can be used to determine where important changes in the density occur. The Markov chain Monte Carlo algorithm involves a Laplace approximation on the latent variables of the logistic Gaussian process model which marginalizes the parameters in each partition element, allowing an efficient search of the approximate posterior distribution of the tessellation. The method is consistent when the density is piecewise constant in the covariate space or when the density is Lipschitz continuous with respect to the covariates. In simulation and application to wind turbine data, the model successfully estimates the partition structure and conditional distribution.