Stable stitching method for stereoscopic panoramic video. Issue 1 (28th March 2018)

• Record Type: Journal Article
• Authors: Tan, Zhuo; Zhang, Shenghao; Wang, Ronggang
• Is Part Of: CAAI transactions on intelligence technology. Volume 3:Issue 1(2018)
• Page Start: 1
• Page End: 7
• Publication Date: 2018-03-28
• Subjects: feature extraction -- image segmentation -- video signal processing -- image sensors -- stereo image processing -- image matching -- virtual reality -- cameras -- image sequences; optical flow field -- previous frame -- generated video -- temporal flicker -- authors -- ODS -- stereoscopic panorama -- eyes -- final panorama -- stable video -- final output videos -- pleasant experience -- impressive stereoscopic viewing experience -- stable stitching method -- stereoscopic panoramic video -- stable method -- omnidirectional stereo format -- traditional image stitching method -- monocular panorama -- left‐eye -- right‐eye panorama; B6135 Optical, image and video signal processing -- C5260B Computer vision and image processing techniques -- C5260D Video signal processing; Artificial intelligence -- Periodicals; Computer science -- Periodicals; Artificial intelligence; Computer science; Electronic journals; Periodicals; 006.305
• DOI: 10.1049/trit.2018.0002
• Languages: English
• ISSNs: 2468-6557

Abstract

Abstract : This paper proposes a stable method of generating a stereoscopic panoramic video with the omnidirectional stereo (ODS) format. Different from the traditional image stitching method which can only be applied to generate a monocular panorama, we adopt an optical flow‐based blending method to create two panoramas for binocular vision. In addition, traditional image stitching methods based on seam‐finding tend to cause the problem of temporal flicker. We address this problem by restricting the optical flow field of the new frame with its previous frame's optical flow field. Thus, the generated video is stable and out of temporal flicker. There are four key operations in our approach. First, we adopt the ODS format which is the basis of stereoscopic panorama. Second, we do effective exposure compensation, making the brightness of the two eyes' panoramas consistent. Third, we employ an optical flow‐based blending method to synthesis the final panorama effectively. Fourth, we take the previous frame's optical flow field as the restriction of the present frame's optical flow field to acquire a stable video. The final output videos can deliver a pleasant and impressive stereoscopic viewing experience to the audience when the audience watches the videos in the virtual reality headset.