A comprehensive survey of error measures for evaluating binary decision making in data science. (8th February 2019)

• Record Type: Journal Article
• Authors: Emmert‐Streib, Frank; Moutari, Salisou; Dehmer, Matthias
• Is Part Of: Wiley interdisciplinary reviews. Volume 9:Number 5(2019)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2019-02-08
• Subjects: classification -- data science -- decision making -- error measures -- machine learning -- statistics; Data mining -- Periodicals; 006.31205
• DOI: 10.1002/widm.1303
• Languages: English
• ISSNs: 1942-4787

Abstract

Abstract : Binary decision making is a topic of great interest for many fields, including biomedical science, economics, management, politics, medicine, natural science and social science, and much effort has been spent for developing novel computational methods to address problems arising in the aforementioned fields. However, in order to evaluate the effectiveness of any prediction method for binary decision making, the choice of the most appropriate error measures is of paramount importance. Due to the variety of error measures available, the evaluation process of binary decision making can be a complex task. The main objective of this study is to provide a comprehensive survey of error measures for evaluating the outcome of binary decision making applicable to many data‐driven fields. This article is categorized under: Fundamental Concepts of Data and Knowledge > Key Design Issues in Data Mining Technologies > Prediction Algorithmic Development > Statistics Abstract : Surveying the evaluation of binary decision making with the contingency table and the four fundamental errors forming the base for deriving a multitude of error measures.