An efficient three-dimensional prediction structure for coding light field video content using the MV-HEVC standard. (23rd February 2022)

• Record Type: Journal Article
• Authors: Khoury, Joseph; Mehajabin, Nusrat; Pourazad, Mahsa T.; Nasiopoulos, Panos; Leung, Victor C.M.
• Is Part Of: International journal of multimedia intelligence and security. Volume 4:Number 1(2022)
• Page Start: 47
• Page End: 64
• Publication Date: 2022-02-23
• Subjects: HEVC -- light field -- multi-view video coding -- prediction structure; Security systems -- Periodicals; Data protection -- Periodicals; Computer security -- Periodicals; Biometric identification -- Periodicals; 005.8
• Languages: English
• ISSNs: 2042-3462

Abstract

Light field cameras have emerged in the consumer market as a technology that captures richer visual information than legacy cameras. While traditional photography captures only a 2D projection of the scene, the light field camera collects light intensity and direction. As a result, this technology opens new opportunities for applications such as remote surgery, autonomous driving, augmented reality, and digital health. However, one of the main problems with this technology is the size of the data captured which significantly increases the consumers' bandwidth requirements. Numerous solutions have been proposed that attempt to compress light field efficiently, but none of them fully evaluate the intricacies found in light field content. This paper proposes a three-dimensional prediction structure for compressing light field video content using the multi-view extension of HEVC (MV-HEVC). The inter-view structure exploits the correlations between the views in two directions and the high degree of resemblance between views around the centre of each frame. Experimental results show a BD-rate gain of 50.89% while subjective tests have shown a BD-rate improvement of 65.83% in mean opinion score over the state-of-the-art method. This means more visually appealing quality at a significantly reduced bitrate, thus facilitating practical implementations of the emerging technology.