Weighted local intensity fusion method for variational optical flow estimation. (February 2016)

• Record Type: Journal Article
• Authors: Tu, Zhigang; Poppe, Ronald; Veltkamp, Remco C.
• Is Part Of: Pattern recognition. Volume 50(2016:Feb.)
• Page Start: 223
• Page End: 232
• Publication Date: 2016-02
• Subjects: Optical flow -- Weighted local intensity fusion -- Large displacement -- Smoothness parameter estimation -- Corrected weighted median filter; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2015.09.002
• Languages: English
• ISSNs: 0031-3203

Abstract

Abstract: Estimating a dense motion field of successive video frames is a fundamental problem in image processing. The multi-scale variational optical flow method is a critical technique that addresses this issue. Despite the considerable progress over the past decades, there are still some challenges such as dealing with large displacements and estimating the smoothness parameter. We present a local intensity fusion (LIF) method to tackle these difficulties. By evaluating the local interpolation error in terms of L1 block match on the corresponding set of images, we fuse flow proposals which are obtained from different methods and from different parameter settings integrally under a unified LIF. This approach has two benefits: (1) the incorporated matching information is helpful to recover large displacements; and (2) the obtained optimal fusion solution gives a tradeoff between the data term and the smoothness term. In addition, a selective gradient based weight is introduced to improve the performance of the LIF. Finally, we propose a corrected weighted median filter (CWMF), which applies the motion information to correct errors of the color distance weight to denoise the intermediate flow fields during optimization. Experiments demonstrate the effectiveness of our method. Abstract : Highlights: A LIF is proposed to handle both large and small motion, and to estimate smoothness parameter. A selective gradient is introduced to the LIF to reduce errors that are caused by outliers. A CWMF is designed to overcome the defect of traditional WMF.