Tensor total variation regularised low‐rank approximation framework for video deraining. Issue 14 (4th November 2020)

• Record Type: Journal Article
• Authors: P.S., Baiju; P., Deepak Jayan; George, Sudhish N.
• Is Part Of: IET image processing. Volume 14:Issue 14(2020)
• Page Start: 3602
• Page End: 3612
• Publication Date: 2020-11-04
• Subjects: image motion analysis -- computer vision -- minimisation -- image segmentation -- tensors -- rain -- singular value decomposition -- image representation -- video signal processing -- image sequences; tensor total variation -- low‐rank approximation framework -- video deraining -- outdoor monitoring systems -- normal weather conditions -- inclement conditions -- video footage -- rainy conditions -- computer vision algorithms -- unpleasant rainy effects -- suitable algorithms -- low‐rank tensor recovery -- tensor singular value decomposition -- original rain‐free data -- low rankness -- video frames -- TTV regularisation facilitates -- sparse rain streaks; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/iet-ipr.2019.1409
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract : Outdoor monitoring systems are known to exhibit better performance under normal weather conditions, while it lacks effectiveness under inclement conditions. Often video footage captured by the camera under rainy conditions comprises several visual distortions. It eventually leads to flaws when handled with succeeding computer vision algorithms, namely the object identification and tracking. Additionally, eliminating such unpleasant rainy effects is essential prior to the processing of video footage by suitable algorithms. The present work attempts to formulate a new low‐rank tensor recovery based deraining algorithm that enables to remove the rain streaks from video footage. The proposed method detects the rain streaks by adopting optical flow estimation along with the brightness features inherent with the rain streaks. A unified framework comprised of tensor singular value decomposition (t‐SVD) based weighted nuclear norm minimisation and tensor total variation (TTV) regularisation effectively removes rain streaks and recovers the original rain‐free data from the available rainy data. The use of t‐SVD enforces the concept of low rankness and also exploits the temporal redundancy among the video frames. Furthermore, TTV regularisation facilitates to promote the temporal continuity for discriminating most of the natural image contents from sparse rain streaks by preserving piece‐wise smoothness of video frames. Comprehensive experimental findings based on real and synthetic data with dynamic background show that the rain streaks are more efficaciously eliminated by adopting the proposed method without much loss in the information.