Nonintrusive parameter adaptation of chemical process models with reinforcement learning. (March 2023)

• Record Type: Journal Article
• Authors: Alhazmi, Khalid; Sarathy, S. Mani
• Is Part Of: Journal of process control. Volume 123(2023)
• Page Start: 87
• Page End: 95
• Publication Date: 2023-03
• Subjects: Nonlinear system identification -- Parameter estimation -- Reinforcement learning; Process control -- Periodicals; Fabrication -- Contrôle -- Périodiques; Process control; Periodicals; Electronic journals; 660.281
• DOI: 10.1016/j.jprocont.2023.02.001
• Languages: English
• ISSNs: 0959-1524

Abstract

Abstract: Model-based control is one of the most prevalent techniques for designing and controlling engineering systems. However, many of these systems are complex and characterized by changing dynamics. Hence, online system identification is required to achieve optimum adaptive control performance for such complex systems. This work proposes an algorithm for nonintrusive, online, nonlinear parameter estimation of physical models using deep reinforcement learning (RL). The problem of training a neural network for parameter estimation is formulated as a reinforcement learning problem. The RL-based parameter estimation policy is tested on a simulation of the selective hydrogenation of acetylene, which is a highly nonlinear system. The learned model estimation policy is able to correctly predict the states of the system with a prediction error of less than 1% in various conditions, such as in the presence of measurement noise and structural differences in models. Highlights: An algorithm for parameter estimation of physical models with reinforcement learning. Proposed method do not require perturbing the system while being controlled. Application of the proposed scheme to the selective hydrogenation of acetylene. Learned estimation policy correctly predicts system states in various conditions.