Transfer learning-based discriminative correlation filter for visual tracking. (April 2020)

• Record Type: Journal Article
• Authors: Huang, Bo; Xu, Tingfa; Li, Jianan; Shen, Ziyi; Chen, Yiwen
• Is Part Of: Pattern recognition. Volume 100(2020:Apr.)
• Publication Date: 2020-04
• Subjects: Visual tracking -- Discriminative correlation filter -- Instance-Transfer -- Probability-Transfer; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2019.107157
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We propose a novel Transfer Learning-based Discriminative Correlation Filter (TLDCF) to avoid the corruption of the updated filters and enhance the distinguishing ability of the model. We encode the spatio-temporal relationship between frames as Gaussian prior knowledge, which provides reliable cues for tracking and suppresses the significant location drift. We develop an efficient ADMM-based algorithm to calculate filters in the frequency domain in real time. Abstract: Most Correlation Filter (CF)-based tracking methods can hardly handle occlusion or severe deformation, due to the lack of effective utilization of previous target information. To overcome this, we propose a novel Transfer Learning-based Discriminative Correlation Filter (TLDCF), which extracts knowledge from multiple previous tracking tasks and applies the knowledge for a new tracking task through Instance-Transfer Learning (ITL) and Probability-Transfer Learning (PTL). ITL applies knowledge of Gaussian Mixture Modelling (GMM) target representations and multi-channel filters learned in previous frames to directly train a new correlation filter. This improves the robustness of tracker for heavy occlusion and large appearance variations. Meanwhile, PTL encodes the spatio-temporal relationship predicted by Kalman Filter (KF) into a shared Gaussian prior to suppress huge location drift caused by similar targets. For optimization, we develop an efficient Alternating Direction Method of Multipliers (ADMM) based algorithm to calculate CFs on each independent channel in real time. Extensive experiments on OTB-2013 and OTB-2015 datasets well demonstrate the effectiveness of the proposed method. In particular, our method improves AUC score of the two datasets by 5.5% and 3.9% respectively compared to baseline, and achieves competitive performance against recent state-of-the-art deep trackers.