An Objective Bayesian Criterion to Determine Model Prior Probabilities. (9th April 2015)

• Record Type: Journal Article
• Authors: Villa, Cristiano; Walker, Stephen
• Is Part Of: Scandinavian journal of statistics. Volume 42:Number 4(2015:Dec.)
• Page Start: 947
• Page End: 966
• Publication Date: 2015-04-09
• Subjects: Bayesian model selection -- Kullback–Leibler divergence -- objective Bayes -- self‐information loss; Statistics -- Periodicals; 310
• DOI: 10.1111/sjos.12145
• Languages: English
• ISSNs: 0303-6898

Abstract

Abstract: We discuss the problem of selecting among alternative parametric models within the Bayesian framework. For model selection problems, which involve non‐nested models, the common objective choice of a prior on the model space is the uniform distribution. The same applies to situations where the models are nested. It is our contention that assigning equal prior probability to each model is over simplistic. Consequently, we introduce a novel approach to objectively determine model prior probabilities, conditionally, on the choice of priors for the parameters of the models. The idea is based on the notion of the worth of having each model within the selection process. At the heart of the procedure is the measure of this worth using the Kullback–Leibler divergence between densities from different models.