An enhanced high-order Boltzmann machine for feature engineering. (February 2019)

• Record Type: Journal Article
• Authors: Bi, Xiaojun; Wang, Haibo
• Is Part Of: Engineering applications of artificial intelligence. Volume 78(2019)
• Page Start: 37
• Page End: 52
• Publication Date: 2019-02
• Subjects: Deep learning -- High-order Boltzmann machine -- Feature selection -- Feature extraction; Engineering -- Data processing -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Ingénierie -- Informatique -- Périodiques; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; Artificial intelligence; Engineering -- Data processing; Expert systems (Computer science); Periodicals; 620.00285
• DOI: 10.1016/j.engappai.2018.10.011
• Languages: English
• ISSNs: 0952-1976

Abstract

Abstract: Recently, automatic feature extraction and selection from unlabeled images that contain irrelevant patterns have been a proceeding interest. In this paper, an enhanced high-order Boltzmann machine is designed to promote the capacity of feature extraction and selection in a unified context. First, gating mechanism is employed for feature selection in comparison with conventional approaches. Then, two sets of hidden variables that the one set is real-valued latent variables and the other is spike latent variables are introduced to model the covariance structure of local patches, which can boost the abilities of feature learning and feature selection in turn. Simultaneously, the proposed model can infer in parallel via easy block Gibbs sampling without much training difficulty. Last, several extensions of the proposed model are developed to cope with different scenes. The massive performances obtained from various visual tasks have demonstrated that the proposed model can reach the highly improved performances over several currently excellent methods.