Approximate neural optimal control with reinforcement learning for a torsional pendulum device. (September 2019)

• Record Type: Journal Article
• Authors: Wang, Ding; Qiao, Junfei
• Is Part Of: Neural networks. Volume 117(2019)
• Page Start: 1
• Page End: 7
• Publication Date: 2019-09
• Subjects: Adaptive critic -- Neural optimal control -- Nonaffine nonlinearity -- Reinforcement learning -- Torsional pendulum; Neural computers -- Periodicals; Neural networks (Computer science) -- Periodicals; Neural networks (Neurobiology) -- Periodicals; Nervous System -- Periodicals; Ordinateurs neuronaux -- Périodiques; Réseaux neuronaux (Informatique) -- Périodiques; Réseaux neuronaux (Neurobiologie) -- Périodiques; Neural computers; Neural networks (Computer science); Neural networks (Neurobiology); Periodicals; 006.32
• DOI: 10.1016/j.neunet.2019.04.026
• Languages: English
• ISSNs: 0893-6080

Abstract

Abstract: A torsional pendulum device containing hyperbolic tangent input nonlinearities can be formulated as a nonaffine system. Unlike basic affine systems, the optimal feedback control of complex nonaffine plants is difficult but quite important. In this paper, the approximate optimal control design of continuous-time nonaffine nonlinear systems is investigated with the help of reinforcement learning. For addressing the learning algorithm conveniently, an effective pre-compensation technique is adopted to perform proper system transformation. Then, the integral policy iteration strategy is incorporated to relieve the demand of system dynamics. Moreover, the actor–critic structure is implemented by virtue of neural network approximators. Finally, the experimental verification for the proposed torsional pendulum plant is conducted after a learning process of 20 iterations and the stability performance with basic robustness guarantee can be observed during two case studies.