Reinforcement learning-based expanded personalized diabetes treatment recommendation using South Korean electronic health records. (15th November 2022)

• Record Type: Journal Article
• Authors: Oh, Sang Ho; Park, Jongyoul; Lee, Su Jin; Kang, Seungyeon; Mo, Jeonghoon
• Is Part Of: Expert systems with applications. Volume 206(2022)
• Publication Date: 2022-11-15
• Subjects: Reinforcement learning -- Precision medicine -- Decision making -- Data-driven optimization -- Electronic health records; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2022.117932
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: Expanded treatment recommendation model addresses challenges in healthcare domain. Contextual bandits model could be applied to treatment recommendation. Proposed model helped diabetes patients to enhance health conditions. Proposed model over-performed compare to existing reinforcement learning models. Proposed model could be used to assist doctors to prescribe diabetes medications. Abstract: Currently, electronic medical records are becoming more accessible to a growing number of researchers seeking to develop personalized healthcare recommendations to aid physicians in making better clinical decisions and treating patients. As a result, clinical decision research has become more focused on data-driven optimization. In this study, we analyze Korean patients' electronic health records—including medical history, medications, laboratory tests, and more information—shared by the national health insurance system. We aim to develop a reinforcement learning-based expanded treatment recommendation model using the health records of South Korean citizens to assist physicians. This study is significant in that expert and intelligent systems harmoniously solve the problem that directly addresses many clinical challenges in prescribing proper diabetes medication when assessing the physical state of diabetes patients. Reinforcement learning is a mechanism for determining how agents should behave in a given environment to maximize a cumulative reward. The basic model for a reinforcement learning design environment is the Markov decision process (MDP) model. Although it is effective and easy to use, the MDP model is limited by dimensionality, i.e., many details about the patients cannot be considered when building the model. To address this issue, we applied a contextual bandits approach to create a more practical model that can expand states and actions by considering several details that are crucial for patients with diabetes. Finally, we validated the performance of the proposed contextual bandits model by comparing it with existing reinforcement-learning algorithms.