A comprehensive empirical comparison of modern supervised classification and feature selection methods for text categorization. (1st March 2014)

• Record Type: Journal Article
• Authors: Aphinyanaphongs, Yindalon; Fu, Lawrence D.; Li, Zhiguo; Peskin, Eric R.; Efstathiadis, Efstratios; Aliferis, Constantin F.; Statnikov, Alexander
• Is Part Of: Journal of the Association for Information Science and Technology. Volume 65:Number 10(2014:Oct.)
• Page Start: 1964
• Page End: 1987
• Publication Date: 2014-03-01
• Subjects: Information science -- Periodicals; Information technology -- Periodicals; 020.5
• DOI: 10.1002/asi.23110
• Languages: English
• ISSNs: 2330-1635

Abstract

<abstract abstract-type="main"> <title> <x xml:space="preserve">Abstract</x> </title> <p>An important aspect to performing text categorization is selecting appropriate supervised classification and feature selection methods. A comprehensive benchmark is needed to inform best practices in this broad application field. Previous benchmarks have evaluated performance for a few supervised classification and feature selection methods and limited ways to optimize them. The present work updates prior benchmarks by increasing the number of classifiers and feature selection methods order of magnitude, including adding recently developed, state‐of‐the‐art methods. Specifically, this study used 229 text categorization data sets/tasks, and evaluated 28 classification methods (both well‐established and proprietary/commercial) and 19 feature selection methods according to 4 classification performance metrics. We report several key findings that will be helpful in establishing best methodological practices for text categorization.</p> </abstract>