Person re-identification by unsupervised video matching. (May 2017)

• Record Type: Journal Article
• Authors: Ma, Xiaolong; Zhu, Xiatian; Gong, Shaogang; Xie, Xudong; Hu, Jianming; Lam, Kin-Man; Zhong, Yisheng
• Is Part Of: Pattern recognition. Volume 65(2017:May)
• Page Start: 197
• Page End: 210
• Publication Date: 2017-05
• Subjects: Person re-identification -- Action recognition -- Gait recognition -- Video matching -- Temporal sequence matching -- Spatio-temporal pyramids -- Time shift; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2016.11.018
• Languages: English
• ISSNs: 0031-3203

Abstract

Abstract: Most existing person re-identification (ReID) methods rely only on the spatial appearance information from either one or multiple person images, whilst ignore the space-time cues readily available in video or image-sequence data. Moreover, they often assume the availability of exhaustively labelled cross-view pairwise data for every camera pair, making them non-scalable to ReID applications in real-world large scale camera networks. In this work, we introduce a novel video based person ReID method capable of accurately matching people across views from arbitrary unaligned image-sequences without any labelled pairwise data. Specifically, we introduce a new space-time person representation by encoding multiple granularities of spatio-temporal dynamics in form of time series. Moreover, a Time Shift Dynamic Time Warping (TS-DTW) model is derived for performing automatically alignment whilst achieving data selection and matching between inherently inaccurate and incomplete sequences in a unified way. We further extend the TS-DTW model for accommodating multiple feature-sequences of an image-sequence in order to fuse information from different descriptions. Crucially, this model does not require pairwise labelled training data (i.e. unsupervised) therefore readily scalable to large scale camera networks of arbitrary camera pairs without the need for exhaustive data annotation for every camera pair. We show the effectiveness and advantages of the proposed method by extensive comparisons with related state-of-the-art approaches using two benchmarking ReID datasets, PRID2011 and iLIDS-VID. Abstract : Highlights: We propose an unsupervised approach to person re-identification based on typical surveillance image-sequences. We present a new video representation particularly tailored for person ReID. Specifically, this representation is built up on existing action space-time features. We introduce an effective video matching algorithm, Time Shift Dynamic Time Warping (TS-DTW) and its Multi-Dimension variant MDTS-DTW, for data selective based sequence matching.