Reinforcement learning-based control of tumor growth under anti-angiogenic therapy. (May 2019)

• Record Type: Journal Article
• Authors: Yazdjerdi, Parisa; Meskin, Nader; Al-Naemi, Mohammad; Al Moustafa, Ala-Eddin; Kovács, Levente
• Is Part Of: Computer methods and programs in biomedicine. Volume 173(2019)
• Page Start: 15
• Page End: 26
• Publication Date: 2019-05
• Subjects: Anti-angiogenic therapy -- Angiogenesis -- Drug administration control -- Reinforcement learning; Medicine -- Computer programs -- Periodicals; Biology -- Computer programs -- Periodicals; Computers -- Periodicals; Medicine -- Periodicals; Médecine -- Logiciels -- Périodiques; Biologie -- Logiciels -- Périodiques; Biology -- Computer programs; Medicine -- Computer programs; Periodicals; Electronic journals; 610.28
• DOI: 10.1016/j.cmpb.2019.03.004
• Languages: English
• ISSNs: 0169-2607

Abstract

Highlights: Reinforcement learning based closed-loop controller is developed for injection of angiogenic inhibitor in cancer therapy. The proposed approach does not require the mathematical model of the system, and it only needs discrete-time measurement of tumor volume. We present simulation results with different parameters to show that the proposed RLbased controller can achieve robustness to system parameter uncertainties. Abstract: Background and objectives: In recent decades, cancer has become one of the most fatal and destructive diseases which is threatening humans life. Accordingly, different types of cancer treatment are studied with the main aim to have the best treatment with minimum side effects. Anti-angiogenic is a molecular targeted therapy which can be coupled with chemotherapy and radiotherapy. Although this method does not eliminate the whole tumor, but it can keep the tumor size in a given state by preventing the formation of new blood vessels. In this paper, a novel model-free method based on reinforcement learning (RL) framework is used to design a closed-loop control of anti-angiogenic drug dosing administration. Methods: A Q-learning algorithm is developed for the drug dosing closed-loop control. This controller is designed using two different values of the maximum drug dosage to reduce the tumor volume up to a desired value. The mathematical model of tumor growth under anti-angiogenic inhibitor is used to simulate a real patient. Results: The effectiveness of the proposed method is shown through in silico simulation and its robustness to patient parameters variation is demonstrated. It is demonstrated that the tumor reaches its minimal volume in 84 days with maximum drug inlet of 30 mg/kg/day. Also, it is shown that the designed controller is robust with respect to ± 20% of tumor growth parameters changes. Conclusion: The proposed closed-loop reinforcement learning-based controller for cancer treatment using anti-angiogenic inhibitor provides an effective and novel result such that with a clinically valid and safe dosage of drug, the volume reduces up to 1mm 3 in a reasonable short period compared to the literature.