A hierarchical Dirichlet process mixture of generalized Dirichlet distributions for feature selection. (April 2015)

• Record Type: Journal Article
• Authors: Fan, Wentao; Sallay, Hassen; Bouguila, Nizar; Bourouis, Sami
• Is Part Of: Computers & electrical engineering. Volume 43(2015)
• Page Start: 48
• Page End: 65
• Publication Date: 2015-04
• Subjects: Clustering -- Hierarchical Dirichlet process -- Variational learning -- Face detection -- Facial expression recognition -- Human gesture recognition; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2015.03.018
• Languages: English
• ISSNs: 0045-7906

Abstract

Graphical abstract: Highlights: A statistical framework based on hierarchical Dirichlet processes and generalized Dirichlet distribution is developed. The framework simultaneously performs model parameters estimations as well as model complexity determination. The learning of the model is done via variational Bayes inference. The efficiency of the proposed algorithm is validated via challenging applications. Abstract: This paper addresses the problem of identifying meaningful patterns and trends in data via clustering (i.e. automatically dividing a data set into meaningful homogenous sub-groups such that the data within the same sub-group are very similar, and data in different sub-groups are very different). The clustering framework that we propose is based on the generalized Dirichlet distribution, which is widely accepted as a flexible modeling approach, and a hierarchical Dirichlet process mixture prior. A main advantage of the adopted hierarchical Dirichlet process is that it provides a principled elegant nonparametric Bayesian approach to model selection by supposing that the number of mixture components can go to infinity. In addition to capturing the structure of the data, the combination of hierarchical Dirichlet process and generalized Dirichlet distribution is shown to offer a natural efficient solution to the feature selection problem when dealing with high-dimensional data. We develop two variational learning approaches (i.e. batch and incremental) for learning the parameters of the proposed model. The batch algorithm examines the entire data set at once while the incremental one learns the model one step at a time (i.e. update the model's parameters each time new data are introduced). The utility of the proposed approach is demonstrated on real applications namely face detection, facial expression recognition, human gesture recognition, and off-line writer identification. The obtained results show clearly the merits of our statistical framework.