Video summarization via minimum sparse reconstruction. Issue 2 (February 2015)

• Record Type: Journal Article
• Authors: Mei, Shaohui; Guan, Genliang; Wang, Zhiyong; Wan, Shuai; He, Mingyi; Dagan Feng, David
• Is Part Of: Pattern recognition. Volume 48:Issue 2(2015:Feb.)
• Page Start: 522
• Page End: 533
• Publication Date: 2015-02
• Subjects: Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2014.08.002
• Languages: English
• ISSNs: 0031-3203

Abstract

<abstract abstract-type="author" id="ab0005"> <title id="sect0005">Abstract</title> <sec> <p id="sp0070">The rapid growth of video data demands both effective and efficient video summarization methods so that users are empowered to quickly browse and comprehend a large amount of video content. In this paper, we formulate the video summarization task with a novel minimum sparse reconstruction (MSR) problem. That is, the original video sequence can be best reconstructed with as few selected keyframes as possible. Different from the recently proposed convex relaxation based sparse dictionary selection method, our proposed method utilizes the true sparse constraint <italic>L</italic><sub>0</sub> norm, instead of the relaxed constraint <inline-formula><alternatives><inline-graphic xlink:href="ark:/27927/pgh2pjdgb8x" xlink:type="simple" xmlns:xlink="http://www.w3.org/1999/xlink" /><mml:math altimg="si0023.gif" overflow="scroll" id="d13e1132" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msub><mml:mrow><mml:mi>L</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn><mml:mo>, </mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:math></alternatives></inline-formula> norm, such that keyframes are directly selected as a sparse dictionary that can well reconstruct all the video frames. An on-line version is further developed owing to the real-time efficiency of the proposed MSR principle. In addition, a percentage of reconstruction (POR) criterion is proposed to intuitively guide users in obtaining a summary with an appropriate length. Experimental results on two benchmark datasets with various types of videos demonstrate that the proposed methods outperform the state of the art.</p> </sec> </abstract>