A spatiotemporal super-resolution algorithm for a hybrid stereo video system. Issue 3 (March 2016)

• Record Type: Journal Article
• Authors: Ge, Jing; Liu, Ju; Yuan, Hui; Ge, Chuan; Zhang, Boyang
• Is Part Of: Signal, image and video processing. Volume 10:Issue 3(2016)
• Page Start: 559
• Page End: 566
• Publication Date: 2016-03
• Subjects: Hybrid stereo video -- Spatiotemporal -- Super-resolution -- Frame rate up-conversion; Signal processing -- Digital techniques -- Periodicals; Image processing -- Digital techniques -- Periodicals; Digital video -- Periodicals; 621.3822
• DOI: 10.1007/s11760-015-0774-4
• Languages: English
• ISSNs: 1863-1703

Abstract

Abstract This paper presents a spatiotemporal super-resolution method to enhance both the spatial resolution and the frame rate in a hybrid stereo video system. In this system, a scene is captured by two cameras to form two videos, including a low spatial resolution with high-frame-rate video and a high spatial resolution with low-frame-rate video. For the low-spatial-resolution video, the low-resolution frames are spatially super-resolved by the high-resolution video via the stereo matching, the bilateral overlapped block motion estimation, and the adaptive overlapped block motion compensation algorithms, while for the low-frame-rate video, those missed frames are interpolated using the high-resolution frames obtained by fusing the disparity compensation and the motion compensation frame rate up-conversion. Experimental results demonstrate that the proposed mixed spatiotemporal super-resolution method has a more significant contribution to both the subjective and objective qualities than the pure spatial super-resolution or the frame rate up-conversion.