You can get smaller: A lightweight self-activation convolution unit modified by transformer for fault diagnosis. (January 2023)

• Record Type: Journal Article
• Authors: Fang, HaiRui; Deng, Jin; Chen, DongSheng; Jiang, WenJuan; Shao, SiYu; Tang, MingCong; Liu, JingJing
• Is Part Of: Advanced engineering informatics. Volume 55(2023)
• Publication Date: 2023-01
• Subjects: Fault diagnosis -- Lightweight -- Anti-noise -- Limited sample -- Self-activation function; Computer-aided engineering -- Periodicals; Engineering -- Data processing -- Periodicals; 620.00285
• DOI: 10.1016/j.aei.2023.101890
• Languages: English
• ISSNs: 1474-0346

Abstract

Abstract: The fault diagnosis methods based on convolutional neural network (CNN) have achieved many excellent results. However, owing to the deployment cost, numerous CNNs with large parameters are difficult to be directly applied to industrial practice. Therefore, this work aims to use lower parameters (order of magnitude is thousand) to complete the task of bearing fault diagnosis on the premise that the model has high-accuracy. To achieve this goal, a convolution unit modified by transformer was proposed, who is based upon the self-activation function, which makes the transformer and CNN organically integrated into a whole. Then, based on this unit, a series of novel lightweight diagnosis frameworks were proposed, named SANet. Finally, it was demonstrated that the proposed SANet can complete the high-accuracy diagnosis task with less than three thousand parameters and has strong robustness to noise (Average accuracy in various noise environments: 84.55%), and that SANet can achieve satisfactory results when there are few training samples (The number of samples of each category is 3 × 4), through four research cases. To sum up, based on this novel unit, we provide a series of lightweight frameworks with high-accuracy, strong robustness, and low sample demand, which is expected to promote the process of fault diagnosis technology from theoretical research to industrial practice. Highlights: A vibration signal mapping module(VFE), more suitable for CNN input, is proposed. A novel strategy of organic combination of Transformer and CNN is proposed. A series of lightweight diagnosis frameworks with strong robustness are proposed. The proposed approach can remain effective under the condition of limited samples. A new dataset of bearing fault based on vibration signal is opened.