A Light Attention-Mixed-Base Deep Learning Architecture toward Process Multivariable Modeling and Knowledge Discovery. (June 2023)

• Record Type: Journal Article
• Authors: Li, Yue; Hu, Lijuan; Li, Ning; Shen, Weifeng
• Is Part Of: Computers & chemical engineering. Volume 174(2023)
• Publication Date: 2023-06
• Subjects: Process Knowledge Discovery -- Multivariable Modeling -- Light Attention Mechanism -- Mixed-Base Architecture -- Multi-task Learning -- Interpretable Deep Learning; Chemical engineering -- Data processing -- Periodicals; 660.0285
• DOI: 10.1016/j.compchemeng.2023.108259
• Languages: English
• ISSNs: 0098-1354

Abstract

Highlights: An architecture for process knowledge discovery and multivariable modeling is built. A light attention mechanism is embedded to further improve the modeling performance. Knowledges learnt by the architecture help the development of advanced process tasks. The expandable architecture contributes to the modeling of complex chemical process. Abstract: A Light Attention-Mixed-Base Deep Learning Architecture (LAMBDA) is developed to simultaneously achieve process knowledge discovery and high-accuracy multivariable modeling. By organizing multiple network bases and a novel light attention mechanism in a special way, the proposed LAMBDA is capable to learn different factors affecting the chemical process outputs, i.e. the basic dynamic characteristics, transient disturbances and other unknown factors. Besides, a development procedure embedding a hyperparameter optimization framework—Optuna is performed to optimize the network architecture. Compared with baselines including FNN, CNN, LSTM and Attention-LSTM, the new architecture displays an outstanding fitting capacity on the discharge flowrates modeling of an actual deethanization process. The process knowledges extracted from the LAMBDA model parameters are also illustrated, which are valuable in the development of advanced process tasks. The proposed LAMDBA can fit any number of outputs without degrading the knowledge discovery ability, making itself potential in the modeling of complex chemical processes.