A multimodal framework using audio, visible and infrared imagery for surveillance and security applications. (29th June 2009)

• Record Type: Journal Article
• Authors: Kumar, Praveen; Mittal, Ankush; Kumar, Padam
• Is Part Of: International journal of signal and imaging systems engineering. Volume 1:Number 3/4(2008)
• Page Start: 255
• Page End: 263
• Publication Date: 2009-06-29
• Subjects: video surveillance -- visual object detection -- audio classification -- tracking -- event analysis -- multimodal information -- infrared imagery -- video security -- Kalman filter; Signal processing -- Periodicals; Imaging systems -- Periodicals; Information theory -- Periodicals; 621.3822
• Languages: English
• ISSNs: 1748-0698

Abstract

This paper presents a low-cost framework for combining multimodal information (visible, IR and audio signal) for small area surveillance and security applications. The system uses audio and video information to capture different aspects of the environment and infrared imagery is used for low lighting conditions. The visual processing module of the system uses a motion-based approach for detecting objects, and Kalman filter for tracking. Environmental sound is recognised by extracting Mel-Frequency Cepstral Coefficients (MLCCs) audio features and then classified by Dynamic Time Warping (DTW) technique. Experimental results on some typical sequences show promising results.