Accurate object detection using memory-based models in surveillance scenes. (July 2017)

• Record Type: Journal Article
• Authors: Li, Xudong; Ye, Mao; Liu, Yiguang; Zhang, Feng; Liu, Dan; Tang, Song
• Is Part Of: Pattern recognition. Volume 67(2017:Jul.)
• Page Start: 73
• Page End: 84
• Publication Date: 2017-07
• Subjects: Convolutional neural network -- Long short-term memory -- Object detection; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2017.01.030
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: A memory-based method is proposed for accurate object detection in surveillance scenes. Two models imitate the mechanism of memory and prediction in our brain respectively. Feature learning and sequence learning are integrated in a memory-based classification model. A memory-based prediction model is specially designed to output the mask indicating the potential object locations. Abstract: Object detection is a significant step of intelligent surveillance. The existing methods achieve the goals by technically designing or learning special features and detection models. Conversely, we propose an effective method for accurate object detection, which is inspired by the mechanism of memory and prediction in our brain. Firstly, a fix-sized window is slid on a static image to generate an image sequence. Then, a convolutional neural network extracts a feature sequence from the image sequence. Finally, a long short-term memory receives these sequential features in proper order to memorize and recognize the sequential patterns. Our contributions are 1) a memory-based classification model in which both of feature learning and sequence learning are integrated subtly, and 2) a memory-based prediction model which is specially designed to predict potential object locations in the surveillance scenes. Compared with some state-of-the-art methods, our method obtains the best performance in term of accuracy on three surveillance datasets. Our method may give some new insights on object detection researches.