Monitoring multimode processes: A modified PCA algorithm with continual learning ability. (July 2021)
- Record Type:
- Journal Article
- Title:
- Monitoring multimode processes: A modified PCA algorithm with continual learning ability. (July 2021)
- Main Title:
- Monitoring multimode processes: A modified PCA algorithm with continual learning ability
- Authors:
- Zhang, Jingxin
Zhou, Donghua
Chen, Maoyin - Abstract:
- Abstract: For multimode processes, one generally establishes local monitoring models corresponding to local modes. However, the significant features of previous modes may be catastrophically forgotten when a monitoring model for the current mode is built. It would result in an abrupt performance decrease. It could be an effective manner to make local monitoring model remember the features of previous modes. Choosing the principal component analysis (PCA) as a basic monitoring model, we try to resolve this problem. A modified PCA algorithm is built with continual learning ability for monitoring multimode processes, which adopts elastic weight consolidation (EWC) to overcome catastrophic forgetting of PCA for successive modes. It is called PCA–EWC, where the significant features of previous modes are preserved when a PCA model is established for the current mode. The optimal parameters are acquired by difference of convex functions. Moreover, the proposed PCA–EWC is extended to general multimode processes and the procedure is presented. The computational complexity and key parameters are discussed to further understand the relationship between PCA and the proposed algorithm. Potential limitations and relevant solutions are pointed to understand the algorithm further. A numerical case study and a practical industrial system in China are employed to illustrate the effectiveness of the proposed algorithm. Highlights: A novel PCA–EWC framework is proposed for monitoring multimodeAbstract: For multimode processes, one generally establishes local monitoring models corresponding to local modes. However, the significant features of previous modes may be catastrophically forgotten when a monitoring model for the current mode is built. It would result in an abrupt performance decrease. It could be an effective manner to make local monitoring model remember the features of previous modes. Choosing the principal component analysis (PCA) as a basic monitoring model, we try to resolve this problem. A modified PCA algorithm is built with continual learning ability for monitoring multimode processes, which adopts elastic weight consolidation (EWC) to overcome catastrophic forgetting of PCA for successive modes. It is called PCA–EWC, where the significant features of previous modes are preserved when a PCA model is established for the current mode. The optimal parameters are acquired by difference of convex functions. Moreover, the proposed PCA–EWC is extended to general multimode processes and the procedure is presented. The computational complexity and key parameters are discussed to further understand the relationship between PCA and the proposed algorithm. Potential limitations and relevant solutions are pointed to understand the algorithm further. A numerical case study and a practical industrial system in China are employed to illustrate the effectiveness of the proposed algorithm. Highlights: A novel PCA–EWC framework is proposed for monitoring multimode processes. It builds one model with continual learning ability, without retraining from scratch. The model is updated continually based on the learned knowledge and current mode data. It is not required that data from all modes are available in advance. … (more)
- Is Part Of:
- Journal of process control. Volume 103(2021)
- Journal:
- Journal of process control
- Issue:
- Volume 103(2021)
- Issue Display:
- Volume 103, Issue 2021 (2021)
- Year:
- 2021
- Volume:
- 103
- Issue:
- 2021
- Issue Sort Value:
- 2021-0103-2021-0000
- Page Start:
- 76
- Page End:
- 86
- Publication Date:
- 2021-07
- Subjects:
- Continual learning -- Multimode process monitoring -- Elastic weight consolidation -- Principal component analysis -- Catastrophic forgetting
Process control -- Periodicals
Fabrication -- Contrôle -- Périodiques
Process control
Periodicals
Electronic journals
660.281 - Journal URLs:
- http://www.sciencedirect.com/science/journal/09591524 ↗
http://www.elsevier.com/journals ↗ - DOI:
- 10.1016/j.jprocont.2021.05.007 ↗
- Languages:
- English
- ISSNs:
- 0959-1524
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 5042.645000
British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 17218.xml