An iterative Q‐learning scheme for the global stabilization of discrete‐time linear systems subject to actuator saturation. (1st March 2019)

• Record Type: Journal Article
• Authors: Rizvi, Syed Ali Asad; Lin, Zongli
• Is Part Of: International journal of robust and nonlinear control. Volume 29:Number 9(2019)
• Page Start: 2660
• Page End: 2672
• Publication Date: 2019-03-01
• Subjects: actuator saturation -- constrained control -- Q‐learning -- reinforcement learning -- Riccati equation; Automatic control -- Periodicals; Control theory -- Periodicals; Nonlinear systems -- Periodicals; 629.836
• DOI: 10.1002/rnc.4514
• Languages: English
• ISSNs: 1049-8923

Abstract

Summary: In this paper, we propose a model‐free algorithm for global stabilization of linear systems subject to actuator saturation. The idea of gain‐scheduled low gain feedback is applied to develop control laws that avoid saturation and achieve global stabilization. To design these control laws, we employ the framework of parameterized algebraic Riccati equations (AREs). Reinforcement learning techniques are developed to find the solution of the parameterized ARE without requiring any knowledge of the system dynamics. In particular, we present an iterative Q‐learning scheme that searches for a low gain parameter and iteratively solves the parameterized ARE using the Bellman equation. Both state feedback and output feedback algorithms are developed. It is shown that the proposed scheme achieves model‐free global stabilization under bounded controls and convergence to the optimal solution of the ARE is achieved. Simulation results are presented that confirm the effectiveness of the proposed method.