Conditional classifiers and boosted conditional Gaussian mixture model for novelty detection. (September 2018)

• Record Type: Journal Article
• Authors: Mohammadi-Ghazi, Reza; Marzouk, Youssef M.; Büyüköztürk, Oral
• Is Part Of: Pattern recognition. Volume 81(2018:Sep.)
• Page Start: 601
• Page End: 614
• Publication Date: 2018-09
• Subjects: Novelty detection -- Mixture models -- Graphical models -- Conditional dependence -- Conditional density -- Additive modeling -- Boosting -- False positive; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2018.03.022
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: A new novelty detection classifier is proposed. The proposed method is capable of considering the dependencies of relevant random variables. No simplifying assumption is made for encoding such dependencies. Combining additive modeling and boosting method to learn conditional densities. 12%–24% false positive reduction compared to one-class SVM and two other methods. Abstract: Novelty detection is an important task in a variety of applications such as object recognition, defect localization, medical diagnostics, and event detection. The objective of novelty detection is to distinguish one class, for which data are available, from all other possible classes when there is insufficient information to build an explicit model for the latter. The data from the observed class are usually represented in terms of certain features which can be modeled as random variables (RV). An important challenge for novelty detection in multivariate problems is characterizing the statistical dependencies among these RVs. Failure to consider these dependencies may lead to inaccurate predictions, usually in the form of high false positive rates. In this study, we propose conditional classifiers as a new approach for novelty detection that is capable of accounting for statistical dependencies of the relevant RVs without simplifying assumptions. To implement the proposed idea, we use Gaussian mixture models (GMM) along with forward stage-wise additive modeling and boosting methods to learn the conditional densities of RVs that represent our observed data. The resulting model, which is called a boosted conditional GMM, is then used as a basis for classification. To test the performance of the proposed method, we apply it to a realistic application problem for analyzing sensor networks and compare the results with those of alternative schemes.