Semi-supervised anomaly detection for visual quality inspection. (30th November 2021)

• Record Type: Journal Article
• Authors: Napoletano, Paolo; Piccoli, Flavio; Schettini, Raimondo
• Is Part Of: Expert systems with applications. Volume 183(2021)
• Publication Date: 2021-11-30
• Subjects: Quality control -- Visual quality inspection -- Anomaly detection -- Computer vision -- Convolutional neural networks -- CNNs; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2021.115275
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: A pre-trained neural network is blended with a statistical-based transformation. The blended network is able to remove any anomalies from the input image. The method requires few samples for training even though is based on deep learning. Very fast domain adaptation based only on anomaly-free samples. Abstract: In this paper a semi-supervised method for the detection of anomalies in both texture- and object-based product images is presented. The method exploits a pre-trained Convolutional Neural Network (CNN) autoencoder that is blended with a statistical-based transformation of the neural network embedding layer in order to remove anomalies from the input image. The "cleaned" version of the input image is then compared with the input image itself in order to spatially localize the anomalies. The method does not require a specific training of the CNN to be applied to a new class of product, but it requires a very fast domain adaptation based on only "anomaly-free" examples. Experiments conducted on a publicly available dataset made of fifteen texture- and object-based classes show that overall performance is better than the state of the art of about 4%. In the case of texture-based classes the proposed method outperforms the state of the art of about 13%. In the case of object-based classes, the proposed method reaches overall the same performance of the state of the art. In this case, apart from 3 cases, that is "bottle", "transistor" and "metal nut", the proposed method performs better than the state of the art in 7 object classes out of 10.