Query-oriented unsupervised multi-document summarization via deep learning model. Issue 21 (30th November 2015)

• Record Type: Journal Article
• Authors: Zhong, Sheng-hua; Liu, Yan; Li, Bin; Long, Jing
• Is Part Of: Expert systems with applications. Volume 42:Issue 21(2015)
• Page Start: 8146
• Page End: 8155
• Publication Date: 2015-11-30
• Subjects: Deep learning -- Query-oriented summarization -- Multi-document -- Neocortex simulation; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2015.05.034
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: First attempt of deep learning for query-oriented multi-document summarization. Novel algorithm pushes out important concepts layer by layer effectively. Confirm excellent extraction ability under unsupervised learning framework. Abstract: Capturing the compositional process from words to documents is a key challenge in natural language processing and information retrieval. Extractive style query-oriented multi-document summarization generates a summary by extracting a proper set of sentences from multiple documents based on pre-given query. This paper proposes a novel document summarization framework based on deep learning model, which has been shown outstanding extraction ability in many real-world applications. The framework consists of three parts: concepts extraction, summary generation, and reconstruction validation. A new query-oriented extraction technique is proposed to extract information distributed in multiple documents. Then, the whole deep architecture is fine-tuned by minimizing the information loss in reconstruction validation. According to the concepts extracted from deep architecture layer by layer, dynamic programming is used to seek most informative set of sentences for the summary. Experiment on three benchmark datasets (DUC 2005, 2006, and 2007) assess and confirm the effectiveness of the proposed framework and algorithms. Experiment results show that the proposed method outperforms state-of-the-art extractive summarization approaches. Moreover, we also provide the statistical analysis of query words based on Amazon's Mechanical Turk (MTurk) crowdsourcing platform. There exists underlying relationships from topic words to the content which can contribute to summarization task.