Automatic detection of multi-type defects on potatoes using multispectral imaging combined with a deep learning model. (January 2023)

• Record Type: Journal Article
• Authors: Yang, Yu; Liu, Zhenfang; Huang, Min; Zhu, Qibing; Zhao, Xin
• Is Part Of: Journal of food engineering. Volume 336(2022)
• Publication Date: 2023-01
• Subjects: Potato -- Defect detection -- Multispectral image -- Multi-type defects detection network; Food industry and trade -- Periodicals; Food -- Analysis -- Periodicals; Aliments -- Industrie et commerce -- Périodiques; Aliments -- Analyse -- Périodiques; Aliments -- Recherche -- Périodiques; 664.005
• DOI: 10.1016/j.jfoodeng.2022.111213
• Languages: English
• ISSNs: 0260-8774

Abstract

Abstract: Automatic detection of potato multi-type defects remains a challenge because of the diversification in defect size and visual similarity among multi-type defects. In this study, an accurate and fast detection method based on a multispectral (MS) image combined with an improved YOLOv3-tiny model was developed to automatically detect and classify multi-type defects on potatoes. A multispectral imaging system (MSI), covering 25 wavebands with a spatial resolution of 409 × 216 pixels, was used to collect MS images of 428 potato samples, which consisted of defect-free potatoes and defective potatoes (including five types of defects, i.e. germination, common scab, bug-eye, dry-rot, and bruise). By introducing the Res2Net modules into the YOLO v3-tiny network, a detection model called multi-type defects detection network (MDDNet) was developed for detecting multi-type defects on potatoes. Three deep learning models, YOLO-v5x, YOLOv3-tiny, and DY2TNet models were compared with the MDDNet model on 128 testing potato MS images. Experimental results showed that the proposed model achieved the highest mean average precision of 90.26% for potato defects among the four models, with about 75 ms detecting time for each MS image. This research demonstrated that the MDDNet model combined with MSI can be useful for the detection of potato multi-type defects. Highlights: MSI was employed for the detection of the five-types defect in potatoes. A MDDNet model was proposed to classify and locate defects. The MDDNet model was more promising than three popular deep learning-based detectors. Effective detection of potato defects by applying the MDDNet model combined with MSI.