An adaptive machine learning algorithm for the resource-constrained classification problem. (March 2023)

• Record Type: Journal Article
• Authors: Shifman, Danit Abukasis; Cohen, Izack; Huang, Kejun; Xian, Xiaochen; Singer, Gonen
• Is Part Of: Engineering applications of artificial intelligence. Volume 119(2023)
• Publication Date: 2023-03
• Subjects: Classification -- Resource constraints -- Resource allocation -- Cost-sensitive learning -- Adaptive learning; Engineering -- Data processing -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Ingénierie -- Informatique -- Périodiques; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; Artificial intelligence; Engineering -- Data processing; Expert systems (Computer science); Periodicals; 620.00285
• DOI: 10.1016/j.engappai.2022.105741
• Languages: English
• ISSNs: 0952-1976

Abstract

Abstract: Resource-constrained classification tasks are common in real-world applications such as allocating tests for disease diagnosis, hiring decisions when filling a limited number of positions, and defect detection in manufacturing settings under a limited inspection budget. Typical classification algorithms treat the learning process and the resource constraints as two separate and sequential tasks. We develop an adaptive learning approach that considers resource constraints and learning jointly by iteratively fine-tuning misclassification costs. Via a structured experimental study using a publicly available data set, we evaluate a decision tree classifier that utilizes the proposed approach. The adaptive learning approach performs significantly better than alternative approaches, especially for difficult classification problems in which the performance of common approaches may be unsatisfactory. The suggested approach reaches similar classification decisions for different costs, thus it may be useful when misclassification costs are not known precisely or are costly to achieve. We envision the suggested learning approach as an important addition to the repertoire of techniques for handling resource-constrained classification problems.