No‐reference quality assessment of dynamic sports videos based on a spatiotemporal motion model. Issue 3 (30th March 2021)

• Record Type: Journal Article
• Authors: Kim, Hyoung‐Gook; Shin, Seung‐Su; Kim, Sang‐Wook; Lee, Gi Yong
• Is Part Of: ETRI journal. Volume 43:Issue 3(2021)
• Page Start: 538
• Page End: 548
• Publication Date: 2021-03-30
• Subjects: 3D shearlet transform -- conditional constraints -- deep residual bidirectional gated recurrent neural network -- natural scene statistics -- no‐reference video quality assessment; Telecommunication -- Periodicals; Electronics -- Periodicals; Electronics; Telecommunication; Periodicals; Periodicals; 621.38205
• DOI: 10.4218/etrij.2020-0160
• Languages: English
• ISSNs: 1225-6463

Abstract

Abstract : This paper proposes an approach to improve the performance of no‐reference video quality assessment for sports videos with dynamic motion scenes using an efficient spatiotemporal model. In the proposed method, we divide the video sequences into video blocks and apply a 3D shearlet transform that can efficiently extract primary spatiotemporal features to capture dynamic natural motion scene statistics from the incoming video blocks. The concatenation of a deep residual bidirectional gated recurrent neural network and logistic regression is used to learn the spatiotemporal correlation more robustly and predict the perceptual quality score. In addition, conditional video block‐wise constraints are incorporated into the objective function to improve quality estimation performance for the entire video. The experimental results show that the proposed method extracts spatiotemporal motion information more effectively and predicts the video quality with higher accuracy than the conventional no‐reference video quality assessment methods.