Symmetric Binary Tree Based Co-occurrence Texture Pattern Mining for Fine-grained Plant Leaf Image Retrieval. (September 2022)

• Record Type: Journal Article
• Authors: Chen, Xin; Wang, Bin; Gao, Yongsheng
• Is Part Of: Pattern recognition. Volume 129(2022)
• Publication Date: 2022-09
• Subjects: Leaf image pattern -- Species recognition -- Fine-grained image recognition -- Feature fusion -- Image retrieval; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2022.108769
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: This work focuses on leaf image retrieval in cultivar level known as a very fine-grained image recognition problem. Symmetric binary tree (SBT) is designed for mining co-occurrence texture patterns. A novel feature fusion scheme, named K-NN Based Handcrafted and Deep Features Fusion, is proposed. The effectiveness of the proposed method has been validated on the soybean cultivar leaf dataset and peanut cultivar leaf dataset. Abstract: Leaf image patterns have been actively researched for plant species recognition. However, as a very challenging fine-grained pattern identification issue, cultivar recognition in which the leaf image patterns usually have very subtle difference among cultivars has not yet received considerable attention in computer vision and pattern recognition community. In this paper, a novel symmetric geometric configuration, named Symmetric Binary Tree (SBT) which has multiple symmetric branch pairs and can change in size, is designed to mine the multiple scale co-occurrence texture patterns. The resulting SBT descriptors encode both shape and texture features which make them more informative than the existing individual descriptors and co-occurrence features. A novel feature fusion scheme, named K-NN Based Handcrafted and Deep Features Fusion (KNN-HDFF) that encodes the neighbouring information of distance measure, is proposed for further boosting the retrieval performance. Extensive experiments conducted on the challenging soybean cultivar leaf image dataset and peanut cultivar leaf image dataset consistently indicate the superiority of the proposed method over the state-of-the-art methods on fine-grained leaf image retrieval. We also conduct extensive experiments of feature fusions using the proposed KNN-HDFF on the benchmark datasets and the experimental results prove its potential for improving the performance of cultivar identification which also indicates that fusing handcrafted and deep features may be the direction to address the challenging fine-grained image recognition problem.