Cost-sensitive classifier chains: Selecting low-cost features in multi-label classification. (February 2019)

• Record Type: Journal Article
• Authors: Teisseyre, Paweł; Zufferey, Damien; Słomka, Marta
• Is Part Of: Pattern recognition. Volume 86(2019:Feb.)
• Page Start: 290
• Page End: 319
• Publication Date: 2019-02
• Subjects: Multi-label classification -- Cost-sensitive feature selection -- Classifier chains -- Logistic regression -- Stability -- Generalization error bounds; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2018.09.012
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Novel method which incorporates the feature cost information into the learning process is proposed. The proposed method (CSCC) combines classifier chains and penalized logistic regression with a modified elastic-net penalty which takes into account costs of the features. We also propose an adaptive version (A-CSCC) in which penalty factors are changing during fitting the consecutive models in the chain. We prove the stability and provide a bound on generalization error of our algorithm. The method is successfully applied on real medical datasets for which cost information is provided by experts. We propose an experimental framework in which features are observed with measurement errors and the costs depend on the quality of the features. Abstract: Feature selection is one of the trending challenges in multi-label classification. In recent years a lot of methods have been proposed. However the existing approaches assume that all the features have the same cost. This assumption may be inappropriate when the acquisition of the feature values is costly. For example in medical diagnosis each diagnostic value extracted by a clinical test is associated with its own cost. In such cases it may be better to choose a model with an acceptable classification performance but a much lower cost. We propose a novel method which incorporates the feature cost information into the learning process. The method, named Cost-Sensitive Classifier Chains, combines classifier chains and penalized logistic regression with a modified elastic-net penalty which takes into account costs of the features. We prove the stability and provide a bound on generalization error of our algorithm. We also propose the adaptive version in which penalty factors are changing during fitting the consecutive models in the chain. The methods are applied on real datasets: MIMIC-II and Hepatitis for which the cost information is provided by experts. Moreover, we propose an experimental framework in which the features are observed with measurement errors and the costs depend on the quality of the features. The framework allows to compare the cost-sensitive methods on benchmark datasets for which the cost information is not provided. The proposed method can be recommended in a situation when one wants to balance low costs and high prediction performance.