Improving the performance of inductive learning classifiers through the presentation order of the training patterns. (1st October 2016)

• Record Type: Journal Article
• Authors: Ruz, Gonzalo A.
• Is Part Of: Expert systems with applications. Volume 58(2016)
• Page Start: 1
• Page End: 9
• Publication Date: 2016-10-01
• Subjects: Inductive learning -- Rules family -- Clustering -- Classification; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2016.04.003
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: Presentation order of the training patterns affects inductive learning classifiers. An intelligent presentation order method is proposed. Random presentation order generates a variation in the classification of about 7%. The proposed method obtained on average better classifications than random orders. Abstract: Although the development of new supervised learning algorithms for machine learning techniques are mostly oriented to improve the predictive power or classification accuracy, the capacity to understand how the classification process is carried out is of great interest for many applications in business and industry. Inductive learning algorithms, like the Rules family, induce semantically interpretable classification rules in the form of if-then rules. Although the effectiveness of the Rules family has been studied thoroughly and new and improved versions are constantly been developed, one important drawback is the effect of the presentation order of the training patterns which has not been studied in depth previously. In this paper this issue is addressed, first by studying empirically the effect of random presentation orders in the number of rules and the generalization power of the resulting classifier. Then a presentation order method for the training examples is proposed which combines a clustering stage with a new density measure developed specifically for this problem. The results using benchmark datasets and a real application of wood defect classification show the effectiveness of the proposed method. Also, since the presentation order method is employed as a preprocessing stage, the simplicity of the Rules family is not affected but instead it enables the generation of fewer and more accurate rules, which can have a direct impact in the performance and usefulness of the Rules family in an expert system context.