Abnormal event detection by a weakly supervised temporal attention network. Issue 3 (1st December 2021)

• Record Type: Journal Article
• Authors: Zheng, Xiangtao; Zhang, Yichao; Zheng, Yunpeng; Luo, Fulin; Lu, Xiaoqiang
• Is Part Of: CAAI transactions on intelligence technology. Volume 7:Issue 3(2022)
• Page Start: 419
• Page End: 431
• Publication Date: 2021-12-01
• Subjects: human detection -- video analysis; Artificial intelligence -- Periodicals; Computer science -- Periodicals; Artificial intelligence; Computer science; Electronic journals; Periodicals; 006.305
• DOI: 10.1049/cit2.12068
• Languages: English
• ISSNs: 2468-6557

Abstract

Abstract: Abnormal event detection aims to automatically identify unusual events that do not comply with expectation. Recently, many methods have been proposed to obtain the temporal locations of abnormal events under various determined thresholds. However, the specific categories of abnormal events are mostly neglect, which are important to help in monitoring agents to make decisions. In this study, a Temporal Attention Network (TANet) is proposed to capture both the specific categories and temporal locations of abnormal events in a weakly supervised manner. The TANet learns the anomaly score and specific category for each video segment with only video‐level abnormal event labels. An event recognition module is exploited to predict the event scores for each video segment while a temporal attention module is proposed to learn a temporal attention value. Finally, to learn anomaly scores and specific categories, three constraints are considered: event category constraint, event separation constraint and temporal smoothness constraint. Experiments on the University of Central Florida Crime dataset demonstrate the effectiveness of the proposed method.