Optimal learning control of oxygen saturation using a policy iteration algorithm and a proof-of-concept in an interconnecting three-tank system. (February 2017)

• Record Type: Journal Article
• Authors: Pomprapa, Anake; Leonhardt, Steffen; Misgeld, Berno J.E.
• Is Part Of: Control engineering practice. Volume 59(2017)
• Page Start: 194
• Page End: 203
• Publication Date: 2017-02
• Subjects: Policy iteration algorithm -- Optimal control -- Reinforcement learning -- Control of oxygen saturation -- Biomedical control system -- Closed-loop ventilation; Automatic control -- Periodicals; 629.89
• DOI: 10.1016/j.conengprac.2016.07.014
• Languages: English
• ISSNs: 0967-0661

Abstract

Abstract: In this work, "policy iteration algorithm" (PIA) is applied for controlling arterial oxygen saturation that does not require mathematical models of the plant. This technique is based on nonlinear optimal control to solve the Hamilton–Jacobi–Bellman equation. The controller is synthesized using a state feedback configuration based on an unidentified model of complex pathophysiology of pulmonary system in order to control gas exchange in ventilated patients, as under some circumstances (like emergency situations), there may not be a proper and individualized model for designing and tuning controllers available in time. The simulation results demonstrate the optimal control of oxygenation based on the proposed PIA by iteratively evaluating the Hamiltonian cost functions and synthesizing the control actions until achieving the converged optimal criteria. Furthermore, as a practical example, we examined the performance of this control strategy using an interconnecting three-tank system as a real nonlinear system.