Anomalous object detection by active search with PTZ cameras. (1st November 2021)

• Record Type: Journal Article
• Authors: López-Rubio, Ezequiel; Molina-Cabello, Miguel A.; Castro, Francisco M.; Luque-Baena, Rafael M.; Marín-Jiménez, Manuel J.; Guil, Nicolás
• Is Part Of: Expert systems with applications. Volume 181(2021)
• Publication Date: 2021-11-01
• Subjects: Pan-tilt-zoom cameras -- Camera control -- Anomaly detection -- Mixtures of Dirichlet distributions; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2021.115150
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: Pan-Tilt-Zoom cameras allow viewing larger scene instead of using several fixed ones. Automatically anomalous object detection is needed due to the large amount of videos. Objects which are in the scene are detected by using a deep neural networks. A Dirichlet-distribution algorithm determines which object is likely to be anomalous. Most likely to be anomalous object is automatically tracked by PTZ camera controller. Abstract: Due to the large amount of visual information generated daily, proposals that automatically analyze and process data are becoming increasingly necessary. This work focuses on the detection of anomalous objects in video sequences captured by PTZ (pan-tilt-zoom) cameras, considering as anomalies the objects which belong to categories that should not appear in a specific scene (e.g. pedestrians on a highway). There is a lack in the previous literature of a principled approach for the control of PTZ cameras that takes advantage of the recent developments in deep learning-based object detection. Our proposal aims to fill this gap by offering a probabilistic framework where the guidance of PTZ cameras is accommodated. The proposed methodology involves three different modules. An object detection stage, where deep learning networks are used to detect the objects that appear in the scene; an anomalous detection module, where a mixture of Dirichlet distributions is considered to detect automatically, and without supervised training, those detected objects which are likely to be anomalous; and finally, a PTZ camera controller which allows to follow and focus on the object considered as the most probably anomalous in the scene. The experimental results show the performance and viability of our proposal, which outperforms several competitors from qualitative and quantitative points of view.