A multiple neural network and reinforcement learning-based strategy for process control. (January 2023)

• Record Type: Journal Article
• Authors: Dutta, Debaprasad; Upreti, Simant R.
• Is Part Of: Journal of process control. Volume 121(2023)
• Page Start: 103
• Page End: 118
• Publication Date: 2023-01
• Subjects: Artificial neural network -- Multiple neural network -- Reinforcement learning -- Deep deterministic policy gradient -- Process control; Process control -- Periodicals; Fabrication -- Contrôle -- Périodiques; Process control; Periodicals; Electronic journals; 660.281
• DOI: 10.1016/j.jprocont.2022.12.004
• Languages: English
• ISSNs: 0959-1524

Abstract

Abstract: In this study, we propose a novel process control strategy by assimilating multiple neural network (MNN) and reinforcement learning (RL) to generate an MNNRL controller. The artificial neural networks (ANNs) constituting the MNN are trained using repositories of optimal control and state data to predict control actions to attain or stay at a set-point. This ability is significantly improved by developing an RL component for the MNNRL controller to provide enhanced set-point tracking, robustness against disturbances, and real-time learning to successfully adapt in the presence of persistent parameter upsets. The controller performance is examined in three different case studies utilizing the simulation of continuous processes with varying degrees of nonlinearity. Relative to both MNN and nonlinear model predictive control (NMPC), the MNNRL controller is found to provide better performance with about 32% less lower integral absolute error (IAE), and 50% reduced settling time with suppressed over-/under-shoots in controlled variables. Further, it is observed that the controller is fairly robust against disturbances, and can adapt via real-time learning to altered process dynamics caused by any persistent process upsets. The controller computation time is observed to be about an order of magnitude less in comparison to NMPC. Highlights: Multiple neural network, and reinforcement learning are combined for process control The first component provides baseline control, which is improved by the second one The resulting controller has superior performance in three different case studies