Belief propagation: accurate marginals or accurate partition function—where is the difference?. (15th December 2020)

• Record Type: Journal Article
• Authors: Knoll, Christian; Pernkopf, Franz
• Is Part Of: Journal of statistical mechanics. (2020:Dec.)
• Publication Date: 2020-12-15
• Subjects: machine learning; Statistical mechanics -- Periodicals; Mechanics -- Statistical methods -- Periodicals; 530.1305
• DOI: 10.1088/1742-5468/abcaef
• Languages: English
• ISSNs: 1742-5468

Abstract

Abstract: We analyze belief propagation on patch potential models—attractive models with varying local potentials—obtain all of the potentially many fixed points, and gather novel insights into belief propagation properties. In particular, we observe and theoretically explain several regions in the parameter space that behave fundamentally differently. We specify and elaborate on one specific region that, despite the existence of multiple fixed points, is relatively well behaved and provides insights into the relationship between the accuracy of the marginals and the partition function. We demonstrate the inexistence of a principal relationship between both quantities and provide sufficient conditions for a fixed point to be optimal with respect to approximating both the marginals and the partition function.