Comparison of machine learning classifiers: A case study of temperature alarms in a pharmaceutical supply chain. Issue 100 (September 2021)

• Record Type: Journal Article
• Authors: Konovalenko, Iurii; Ludwig, André
• Is Part Of: Information systems. Issue 100(2021)
• Publication Date: 2021-09
• Subjects: Cold supply chain -- Pharmaceutical -- Temperature alarm -- Rule-based monitoring -- Machine learning -- Prediction; Database management -- Periodicals; Electronic data processing -- Periodicals; Bases de données -- Gestion -- Périodiques; Informatique -- Périodiques; Database management; Electronic data processing; Periodicals; 005.7
• DOI: 10.1016/j.is.2021.101759
• Languages: English
• ISSNs: 0306-4379

Abstract

Abstract: Temperature deviations are critical in a pharmaceutical supply chain (SC) due to quality deterioration concerns and resulting health risks. The current solutions ensuring temperature maintenance are either labor-intensive or prone to triggering alarms that require no corrective measures, which, in turn, increase the alarm investigation costs. Machine learning (ML) methods have fared well both in the areas characterized by the execution of repetitive tasks and in the identification of false alarms; however, they have not been applied in the context of temperature monitoring in a pharmaceutical SC. In this paper, we used the real-world data of a large international logistics service provider for the period of 2013–2018 and compared the optimized performance of 10 ML classification methods in the task of false temperature alarm identification. Such additional features as temperature in the location of possible physical handling and average temperature deviation were either externally collected or estimated to enrich the models. In general, gradient boosting achieved the best performance in our evaluations, with an accuracy of 95.9% in comparison with the value of 16.6% demonstrated by the current legacy rule-based system. The feature ranking and sensitivity tests pointed to the strength of the features indicating an absolute temperature deviation and the location of cargo along the SC. The tests simulating model applications on new dissimilar observations showed various performance losses across classifiers, with the best stability retained for a new customer scenario and largest performance decreases for a new temperature range scenario. Highlights: The false temperature alarm problem typical of rule-based systems is addressed. 10 machine learning methods are compared against the legacy system Gradient boosting achieved the accuracy of 95.9% (vs 16.6% by the legacy system). Strong features were represented by the temperature deviation and cargo location. Built models retain the best prediction stability when used on the new customers.