Bayesian model selection using the median probability model. (31st March 2015)

• Record Type: Journal Article
• Authors: Ghosh, Joyee
• Is Part Of: Wiley interdisciplinary reviews. Volume 7:Number 3(2015)
• Page Start: 185
• Page End: 193
• Publication Date: 2015-03-31
• Subjects: Mathematical statistics -- Data processing -- Periodicals; Science -- Data processing -- Periodicals; Social sciences -- Data processing -- Periodicals; Mathematical statistics -- Periodicals; 519.50285
• DOI: 10.1002/wics.1352
• Languages: English
• ISSNs: 1939-5108

Abstract

<abstract abstract-type="main" id="wics1352-abs-0001"> <title> <x xml:space="preserve">Abstract</x> </title> <p id="wics1352-para-0001">In the Bayesian approach to model selection, models and model specific parameters are treated as unknown quantities and uncertainty about them are expressed through prior distributions. Given the observed data, updating of the prior distribution to the posterior distribution occurs via Bayes' theorem. The posterior probability of a given model may be interpreted as the support it gets based on the observed data. The highest probability model (HPM) that receives the maximum support from the data is a possible choice for model selection. For large model spaces, Markov chain Monte Carlo (MCMC) algorithms are commonly used to estimate the posterior distribution over models. However, estimates of posterior probabilities of individual models based on MCMC output are not reliable because the number of MCMC samples is typically far smaller than the size of the model space. Thus, the HPM is difficult to estimate and for large model spaces it often has a very small posterior probability. An alternative to the HPM is the median probability model (MPM) of Barbieri and Berger, which has been shown to be the optimal model for prediction using a squared error loss function, under certain conditions. In this article we review some of the conditions for which the MPM is optimal, and provide real data examples to evaluate the performance of the MPM under small and large model spaces. We also discuss the behavior of the MPM under collinearity. <italic>WIREs Comput Stat</italic> 2015, 7:185–193. doi: 10.1002/wics.1352</p> <p>For further resources related to this article, please visit the <ext-link ext-link-type="uri" xlink:href="http://wires.wiley.com/remdoi.cgi?doi=10.1002/wics.1352" xlink:type="simple" xmlns:xlink="http://www.w3.org/1999/xlink">WIREs website</ext-link>.</p> <p>Conflict of interest: The author has declared no conflicts of interest for this article.</p> </abstract>