Behavior regularized prototypical networks for semi-supervised few-shot image classification. (April 2021)

• Record Type: Journal Article
• Authors: Huang, Shixin; Zeng, Xiangping; Wu, Si; Yu, Zhiwen; Azzam, Mohamed; Wong, Hau-San
• Is Part Of: Pattern recognition. Volume 112(2021)
• Publication Date: 2021-04
• Subjects: Few-shot learning -- Semi-supervised learning -- Image classification -- Prototypical networks; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2020.107765
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We propose a Behavior Regularized Prototypical Network (BR-ProtoNet) for few-shot image classification in semi-supervised scenarios. BR-ProtoNet enables metric learning to benefit from readily-available unlabeled data. We construct complementary constraints to regularize the model's behavior over the neighborhoods of training instances and along the interpolation paths among them. The constructed regularization encourages the learnt embedding space to possess the property of proximity preservation. Abstract: We propose a Behavior Regularized Prototypical Network (BR-ProtoNet) for few-shot image classification in semi-supervised scenarios. To learn a generalizable metric, we exploit readily-available unlabeled data and construct complementary constraints to regularize the model's behavior. Specifically, we match the label spaces between each episode and the whole training set. The predictions on the unlabeled data over different episodes can be aggregated to capture more reliable category information. We further construct new instances via adversarial perturbation and interpolation. These instances regularize the model's behavior over the neighborhoods of the original ones and along the interpolation paths among them. In addition, they ensure the learnt embedding space possesses the property of proximity preservation. The regularization of these aspects is incorporated into the optimization process of BR-ProtoNet on partially labeled data. We have conducted thorough experiments on multiple challenging benchmarks. The results suggest that the metric learning can significantly benefit from the proposed regularization, and thus leading to the state-of-the-art performance in semi-supervised few-shot image classification.