The Weight-Shape decomposition of density estimates: A framework for clustering and image analysis algorithms. (September 2018)

• Record Type: Journal Article
• Authors: Deutsch, Lior; Horn, David
• Is Part Of: Pattern recognition. Volume 81(2018:Sep.)
• Page Start: 190
• Page End: 199
• Publication Date: 2018-09
• Subjects: Density estimate -- Quantum clustering -- Mean-shift clustering -- Maximum entropy -- Image contour extraction; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2018.03.034
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Every Parzen estimate of a probability distribution can be decomposed into Weight and Shape components in a unique fashion. This decomposition allows for a fresh classification of clustering algorithms, based on Probability (mean-shift), on Shape (quantum clustering), or on Weight (entropy maximization). These concepts can be applied to image analysis, with Shape providing novel aspects of generalized edge detection. Abstract: We propose an analysis scheme which addresses the Parzen-window and mixture model methods for estimating the probability density function of data points in feature space. Both methods construct the estimate as a sum of kernel functions (usually Gaussians). By adding an entropy-like function we prove that the probability distribution is a product of a weight function and a shape distribution. This Weight-Shape decomposition leads to new interpretations of established clustering algorithms. Furthermore, it suggests the construction of three different clustering schemes, which are based on gradient-ascent flow of replica points in feature space. Two of these are Quantum Clustering and the Mean-Shift algorithm. The third algorithm is based on maximal-entropy. In our terminology they become Maximal Shape Clustering, Maximal Probability Clustering and Maximal Weight Clustering, correspondingly. We demonstrate the different methods and compare them to each other on one artificial example and two natural data sets. We also apply the Weight-Shape decomposition to image analysis. The shape distribution acts as an edge detector. It serves to generate contours, as demonstrated on face images. Furthermore, it allows for defining a convolutional Shape Filter.