Temporal feature enhancement network with external memory for live-stream video object detection. (November 2022)

• Record Type: Journal Article
• Authors: Fujitake, Masato; Sugimoto, Akihiro
• Is Part Of: Pattern recognition. Volume 131(2022)
• Publication Date: 2022-11
• Subjects: Video object detection -- Video analysis -- Object detection; 68T10; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2022.108847
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Aggregating features from only the past few frames can improve detection accuracy. Aggregation by the attention mechanism performs better than similarity- based methods. Aggregating coarse features can improve accuracy while keeping real-time performance. Abstract: This paper proposes a method exploiting temporal context with an attention mechanism for detecting objects in real-time in a live streaming video. Video object detection is challenging and essential in practical applications such as robotics, smartphones, and surveillance cameras. Although methods have been proposed to improve the accuracy or run-time speed by exploiting temporal information, the trade-off between them tends to be ignored. We thus focus on the trade-off between accuracy and speed, and propose a method to improve the accuracy by aggregating the past information from a lightweight feature extractor with an attention mechanism. Evaluations on the UA-DETRAC and ImageNet VID datasets demonstrate our model's superior performance to state-of-the-art methods on live streaming real-time object detection.