Gamma-Poisson Distribution Model for Text Categorization. (4th April 2013)

• Record Type: Journal Article
• Authors: Ogura, Hiroshi; Amano, Hiromi; Kondo, Masato
• Other Names: Chau K. W. Academic Editor.; Chen C. Academic Editor.; Foresti G. L. Academic Editor.; Loog M. Academic Editor.
• Is Part Of: ISRN artificial intelligence. Volume 2013(2013)
• Publication Date: 2013-04-04
• Subjects: Artificial intelligence -- Periodicals; Artificial intelligence; Periodicals; 006.3
• DOI: 10.1155/2013/829630
• Languages: English
• ISSNs: 2090-7435

Abstract

Abstract : We introduce a new model for describing word frequency distributions in documents for automatic text classification tasks. In the model, the gamma-Poisson probability distribution is used to achieve better text modeling. The framework of the modeling and its application to text categorization are demonstrated with practical techniques for parameter estimation and vector normalization. To investigate the efficiency of our model, text categorization experiments were performed on 20 Newsgroups, Reuters-21578, Industry Sector, and TechTC-100 datasets. The results show that the model allows performance comparable to that of the support vector machine and clearly exceeding that of the multinomial model and the Dirichlet-multinomial model. The time complexity of the proposed classifier and its advantage in practical applications are also discussed.