Evaluating learning algorithms and classifiers. (20th April 2007)

• Record Type: Journal Article
• Authors: Lavesson, Niklas; Davidsson, Paul
• Is Part Of: International journal of intelligent information and database systems. Volume 1:Number 1(2007)
• Page Start: 37
• Page End: 52
• Publication Date: 2007-04-20
• Subjects: classification -- evaluation methods -- taxonomy -- supervised learning -- learning algorithms -- classifiers; Database management -- Computer programs -- Periodicals; Information retrieval -- Computer programs -- Periodicals; Information storage and retrieval systems -- Computer programs -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Intelligent agents (Computer software) -- Periodicals; 006.33
• Languages: English
• ISSNs: 1751-5858

Abstract

We analyse 18 evaluation methods for learning algorithms and classifiers, and show how to categorise these methods with the help of an evaluation method taxonomy based on several criteria. We also define a formal framework that make it possible to describe all methods using the same terminology, and apply it in a review of the state-of-the-art in learning algorithm and classifier evaluation. The framework enables comparison and deeper understanding of evaluation methods from different fields of research. Moreover, we argue that the framework and taxonomy support the process of finding candidate evaluation methods for a particular problem.