Vector ordering and regression learning‐based ranking for dynamic summarisation of user videos. Issue 15 (12th February 2021)

• Record Type: Journal Article
• Authors: K, Vivekraj V; Sen, Debashis; Raman, Balasubramanian
• Is Part Of: IET image processing. Volume 14:Issue 15(2020)
• Page Start: 3941
• Page End: 3956
• Publication Date: 2021-02-12
• Subjects: Gaussian processes -- learning (artificial intelligence) -- video signal processing -- regression analysis; vector ordering -- user videos -- dynamic video summarisation -- video skimming -- shorter video -- video skim -- efficient dynamic summarisation approach -- ranking video units -- unscripted videos -- video frames; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/iet-ipr.2020.0234
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract : Dynamic video summarisation (video skimming) is a process of generating a shorter video (video skim) as a summary of a given video, which helps in its easier and quicker comprehension. In this study, an efficient dynamic summarisation approach for user videos is proposed using vector ordering for ranking video units (frames/shots). User videos are casually shot unscripted videos, where skimming involves the selection of its interesting part(s) ignoring many uninteresting ones. The concept of R‐ordering of vectors is employed to find a representative frame, which is used to perform relative ranking of the video frames. It is theoretically shown that significance is given to each element of a frame's feature vector while computing the importance scores that lead to the frame ranks used for skimming. Furthermore, the allocation of different weights to the features involved is also achieved using linear and Gaussian process regressions. Through extensive experiments considering several standard datasets with human‐labelled ground truth, the proposed approach is demonstrated to be efficient and to perform better than the relevant state‐of‐the‐art.