Improving handgun detection through a combination of visual features and body pose-based data. (April 2023)

• Record Type: Journal Article
• Authors: Ruiz-Santaquiteria, Jesus; Velasco-Mata, Alberto; Vallez, Noelia; Deniz, Oscar; Bueno, Gloria
• Is Part Of: Pattern recognition. Volume 136(2023)
• Publication Date: 2023-04
• Subjects: Handgun detection -- Human pose estimation -- CCTV Surveillance -- Transformers -- False positive filtering; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2022.109252
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Handguns can be detected automatically through analysis of surveillance images. Novel framework based on both combined weapon appearance and body pose is proposed. Recent transformer-based architectures are used for visual feature extraction. A false positive filtering model is included to remove incorrectly detected handguns. Proposed method has been tested in different brightness and weapon size conditions. Abstract: Early detection of the presence of dangerous objects such as handguns in Closed-Circuit Television (CCTV) images is vital to reduce the potential damage. In this work, a novel method for automatic detection of handguns in CCTV-like images based on a combination architecture which leverages body pose estimation is proposed. Weapon appearance features along with body pose features are combined to perform robust detection in typical surveillance environments where appearance features alone are not sufficient (e.g., because the handgun may appear too small or dark). Both CNN and recent transformer-based architectures are applied for visual feature extraction. Experiments on multiple datasets show that this approach improves state-of-the-art pose-based handgun detectors. An ablation study is also performed to verify the contribution of the pose processing branch and the false positive filter.