Benchmark study of reinforcement learning in controlling and optimizing batch processes. Issue 2 (28th February 2022)

• Record Type: Journal Article
• Authors: Zhu, Wenbo; Castillo, Ivan; Wang, Zhenyu; Rendall, Ricardo; Chiang, Leo H.; Hayot, Philippe; Romagnoli, Jose A.
• Is Part Of: Journal of advanced manufacturing and processing. Volume 4:Issue 2(2022)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2022-02-28
• Subjects: artificial intelligence -- automation and control -- batch optimization -- machine learning; Chemical engineering -- Periodicals; Manufacturing processes -- Technological innovations -- Periodicals; Manufacturing processes; Electronic journals; Periodicals; 660
• DOI: 10.1002/amp2.10113
• Languages: English
• ISSNs: 2637-403X

Abstract

Abstract: In this article, multiple reinforcement learning (RL) methods such as value‐based, policy‐based, and actor‐critic algorithms are investigated for typical control tasks found in the chemical industries. Through a critical assessment of these novel techniques, their main advantages are highlighted, but also the challenges that still need to be resolved are discussed. Two batch control tasks are used as benchmarks, namely, production maximization, and setpoint control. Using these testing environments, a direct comparison of different RL approaches is presented, which could guide the algorithm selection in future RL applications for batch process control. Furthermore, the results obtained with a traditional control method, model predictive control (MPC), are shown to provide a baseline for comparison with RL algorithms. The results show that RL has significant applicability in various control tasks and has comparable control performance to traditional methods but with a lower online computational cost. A batch bioreactor simulation and a simulation of an industrial polyol process are used for illustration purposes. Abstract : In this article, multiple reinforcement learning (RL) methods such as value‐based, policy‐based, and actor‐critic algorithms are investigated for typical control tasks found in the chemical industries. Through a critical assessment of these novel techniques, their main advantages are highlighted, but also the challenges that still need to be resolved are discussed. A batch bioreactor simulation and a simulation of an industrial polyol process are used for illustration purposes.