An empirical study of feature selection for classification using genetic algorithm. (2018)

• Record Type: Journal Article
• Authors: Goswami, Saptarsi; Chakrabarti, Amlan; Chakraborty, Basabi
• Is Part Of: International journal of advanced intelligence paradigms. Volume 10:Number 3(2018)
• Page Start: 305
• Page End: 326
• Publication Date: 2018
• Subjects: feature selection -- classification -- genetic algorithm -- GA -- multi-objective -- filter; Artificial intelligence -- Periodicals; Machine theory -- Periodicals; Fuzzy logic -- Periodicals; 006.305
• Languages: English
• ISSNs: 1755-0386

Abstract

Feature selection is one of the most important pre-processing steps for a data mining, pattern recognition or machine learning problem. Features get eliminated because either they are irrelevant, or they are redundant. As per literature study, most of the approaches combine the above objectives in a single numeric measure. In this paper, in contrast the problem of finding optimal feature subset has been formulated as a multi objective problem. The concept of redundancy is further refined with a concept of threshold value. Additionally, an objective of maximising entropy has been added. An extensive empirical study has been setup which uses 33 publicly available dataset. A 12% improvement in classification accuracy is reported in a multi objective setup. Other suggested refinements have shown to improve the performance measure. The performance improvement is statistical significant as found by pair wise t-test and Friedman's test.