Visual inspection of steel surface defects based on domain adaptation and adaptive convolutional neural network. (15th May 2021)

• Record Type: Journal Article
• Authors: Zhang, Siyu; Zhang, Qiuju; Gu, Jiefei; Su, Lei; Li, Ke; Pecht, Michael
• Is Part Of: Mechanical systems and signal processing. Volume 153(2021)
• Publication Date: 2021-05-15
• Subjects: Steel surface defect detection -- Domain adaptation -- Adaptive learning rate -- Adaptive convolutional neural network; Structural dynamics -- Periodicals; Vibration -- Periodicals; Constructions -- Dynamique -- Périodiques; Vibration -- Périodiques; Structural dynamics; Vibration; Periodicals; 621
• DOI: 10.1016/j.ymssp.2020.107541
• Languages: English
• ISSNs: 0888-3270

Abstract

Highlights: A new steel surface defect detection framework, exploiting the idea of domain adaptation learning, is proposed. A domain classifier is added to realize the cross-domain recognition. A constraint on label probability distribution is applied to realize the cross-task recognition. The normal distribution and the quadratic function are used to optimize the loss. The adaptive learning rates are proposed based the loss and the weight. Abstract: Automatic inspection methods based on machine vision have been widely employed for steel surface defect detection. The central purpose of these methods is to extract features to represent different defects. However, current methods depend on machine learning that demands handcrafted features and overlooks the domain shift. In this paper, we propose a new method combining domain adaptation (DA) and adaptive convolutional neural network (ACNN), called DA-ACNN, to achieve steel surface defect detection. The convolutional neural network (CNN) is used as the backbone. To account for the lack of labels in a new domain, we introduce an additional domain classifier and a constraint on label probability distribution to achieve the cross-domain and cross-task recognition. The normal distribution and the quadratic function are used to optimize the loss to improve the network performance. Adaptive learning rates based on the loss and the weight, respectively, are proposed to minimize the losses of DA and classification. We conducted experiments on steel surface defect datasets to validate the effectiveness of DA-ACNN. Compared with the classical CNN and other approaches, the results demonstrate the superiority of the proposed method.