A novel optimal control design for unknown nonlinear systems based on adaptive dynamic programming and nonlinear model predictive control. Issue 4 (6th May 2021)

• Record Type: Journal Article
• Authors: Hu, Wei; Zhang, Guoshan; Zheng, Yuqing
• Is Part Of: Asian journal of control. Volume 24:Issue 4(2022)
• Page Start: 1638
• Page End: 1649
• Publication Date: 2021-05-06
• Subjects: adaptive control -- adaptive dynamic programming -- neural networks -- nonlinear model predictive control -- optimal control; Automatic control -- Periodicals; Control theory -- Periodicals; 629.805
• DOI: 10.1002/asjc.2552
• Languages: English
• ISSNs: 1561-8625

Abstract

Abstract: This paper presents a novel adaptive optimal control algorithm by combining adaptive dynamic programming with nonlinear model predictive control for unknown continuous‐time affine nonlinear systems. The adaptive optimal control design is realized by the model‐critic‐actor architecture. Model neural network, critic neural network and actor neural network are constructed to approximate the system dynamics, the cost function and the optimal control law respectively. The random initialization of neural networks usually influences the control performance, so three neural networks are initialized properly to obtain the suitable initial values so that the control performance is improved. Especially, actor neural network is initialized to approximate the near‐optimal control law which is obtained from nonlinear model predictive control. The convergence of the proposed algorithm is proved by the Lyapunov theory. Finally, simulation results are provided to illustrate the effectiveness of the proposed algorithm.