Video retargeting through spatio‐temporal seam carving using Kalman filter. Issue 11 (1st August 2019)

• Record Type: Journal Article
• Authors: Kaur, Harpreet; Kour, Swarnjeet; Sen, Debashis
• Is Part Of: IET image processing. Volume 13:Issue 11(2019)
• Page Start: 1862
• Page End: 1871
• Publication Date: 2019-08-01
• Subjects: Kalman filters -- jitter -- video signal processing; video retargeting -- Kalman filter‐based spatio‐temporal seam determination scheme -- seam carving -- authors -- spatial coherence -- temporal coherence -- video frame -- spatially coherent seam -- seam energy minimisation -- temporally coherent seam -- updation processes -- spatial seams -- temporal seams -- Kalman filter‐based approach; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/iet-ipr.2019.0236
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract : A Kalman filter‐based spatio‐temporal seam determination scheme is proposed in this study for video retargeting through seam carving. In probably a first, the authors' retargeting approach is designed to be hardware friendly, and to achieve spatial and temporal coherence through an optimal solution with explicit mechanisms to reduce jitter and structural distortion. In a video frame, while spatially coherent seam is determined by the popular approach of seam energy minimisation, temporally coherent seam is determined using Kalman prediction and updation processes. Further, these spatial and temporal seams are combined judiciously to obtain the spatio‐temporal seam to be removed/repeated for decreasing/increasing the frame size. The authors show that the proposed Kalman filter‐based approach has less theoretical complexity compared to the existing. Extensive experimental results show that the proposed approach consistently outperforms the state‐of‐the‐art, both qualitatively and quantitatively in performance, and in computational time.