A new intelligent fault diagnosis framework for rotating machinery based on deep transfer reinforcement learning. (May 2023)

• Record Type: Journal Article
• Authors: Yang, Daoguang; Karimi, Hamid Reza; Pawelczyk, Marek
• Is Part Of: Control engineering practice. Volume 134(2023)
• Publication Date: 2023-05
• Subjects: Deep reinforcement learning -- Convolutional auto-encoder -- Fault diagnosis -- Double deep Q network -- Transfer learning; Automatic control -- Periodicals; 629.89
• DOI: 10.1016/j.conengprac.2023.105475
• Languages: English
• ISSNs: 0967-0661

Abstract

Abstract: The advancement of artificial intelligence algorithms has gained growing interest in identifying the fault types in rotary machines, which is a high-efficiency but not a human-like module. Hence, in order to build a human-like fault identification module that could learn knowledge from the environment, in this paper, a deep reinforcement learning framework is proposed to provide an end-to-end training mode and a human-like learning process based on an improved Double Deep Q Network. In addition, to improve the convergence properties of the Deep Reinforcement Learning algorithm, the parameters of the former layers of the convolutional neural networks are transferred from a convolutional auto-encoder under an unsupervised learning process. The experiment results show that the proposed framework could efficiently extract the fault features from raw time-domain data and have higher accuracy than other deep learning models with balanced samples and better performance with imbalanced samples.