Majorities help minorities: Hierarchical structure guided transfer learning for few-shot fault recognition. (March 2022)
- Record Type:
- Journal Article
- Title:
- Majorities help minorities: Hierarchical structure guided transfer learning for few-shot fault recognition. (March 2022)
- Main Title:
- Majorities help minorities: Hierarchical structure guided transfer learning for few-shot fault recognition
- Authors:
- Chen, Hao
Liu, Ruonan
Xie, Zongxia
Hu, Qinghua
Dai, Jianhua
Zhai, Junhai - Abstract:
- Highlights: A hierarchy guided transfer learning framework for few-shot fault recognition. A hierarchical structure of classes can be learned by multi-granularity clustering. Filtering out irrelevant categories can overcome the problem of negative transfer. Fault feature information can be shared between similar fault categories. Abstract: To ensure the operational safety and reliability, fault recognition of complex systems is becoming an essential process in industrial systems. However, the existing recognition methods mainly focus on common faults with enough data, which ignore that many faults are lack of samples in engineering practice. Transfer learning can be helpful, but irrelevant knowledge transfer can cause performance degradation, especially in complex systems. To address the above problem, a hierarchy guided transfer learning framework (HGTL) is proposed in this paper for fault recognition with few-shot samples. Firstly, we fuse domain knowledge, label semantics and inter-class distance to calculate the affinity between categories, based on which a category hierarchical tree is constructed by hierarchical clustering. Then, guided by the hierarchical structure, the samples in most similar majority classes are selected from the source domain to pre-train the hierarchical feature learning network (HFN) and extract the transferable fault information. For the fault knowledge extracted from the child nodes of one parent node are similar and can be transferred withHighlights: A hierarchy guided transfer learning framework for few-shot fault recognition. A hierarchical structure of classes can be learned by multi-granularity clustering. Filtering out irrelevant categories can overcome the problem of negative transfer. Fault feature information can be shared between similar fault categories. Abstract: To ensure the operational safety and reliability, fault recognition of complex systems is becoming an essential process in industrial systems. However, the existing recognition methods mainly focus on common faults with enough data, which ignore that many faults are lack of samples in engineering practice. Transfer learning can be helpful, but irrelevant knowledge transfer can cause performance degradation, especially in complex systems. To address the above problem, a hierarchy guided transfer learning framework (HGTL) is proposed in this paper for fault recognition with few-shot samples. Firstly, we fuse domain knowledge, label semantics and inter-class distance to calculate the affinity between categories, based on which a category hierarchical tree is constructed by hierarchical clustering. Then, guided by the hierarchical structure, the samples in most similar majority classes are selected from the source domain to pre-train the hierarchical feature learning network (HFN) and extract the transferable fault information. For the fault knowledge extracted from the child nodes of one parent node are similar and can be transferred with each other, so the trained HFN can extract better features of few samples classes with the help of the information from similar faults, and used to address few-shot fault recognition problems. Finally, a dataset of a nuclear power system with 65 categories and the widely used Tennessee Eastman dataset are analyzed respectively via the proposed method, as well as state-of-the-art recognition methods for comparison. The experimental results demonstrate the effectiveness and superiority of the proposed method in fault recognition with few-shot problem. … (more)
- Is Part Of:
- Pattern recognition. Volume 123(2022)
- Journal:
- Pattern recognition
- Issue:
- Volume 123(2022)
- Issue Display:
- Volume 123, Issue 2022 (2022)
- Year:
- 2022
- Volume:
- 123
- Issue:
- 2022
- Issue Sort Value:
- 2022-0123-2022-0000
- Page Start:
- Page End:
- Publication Date:
- 2022-03
- Subjects:
- Transfer learning -- Fault recognition -- Few-shot problem -- Hierarchical category structure -- Complex systems
Pattern perception -- Periodicals
Perception des structures -- Périodiques
Patroonherkenning
006.4 - Journal URLs:
- http://www.sciencedirect.com/science/journal/00313203 ↗
http://www.sciencedirect.com/ ↗ - DOI:
- 10.1016/j.patcog.2021.108383 ↗
- Languages:
- English
- ISSNs:
- 0031-3203
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 20078.xml