A novel ILP framework for summarizing content with high lexical variety. (13th September 2018)

• Record Type: Journal Article
• Authors: LUO, WENCAN; LIU, FEI; LIU, ZITAO; LITMAN, DIANE
• Is Part Of: Natural language engineering. Volume 24:Part 6(2018)
• Page Start: 887
• Page End: 920
• Publication Date: 2018-09-13
• Subjects: Natural language processing (Computer science) -- Periodicals; Software engineering -- Periodicals; 006.35
• DOI: 10.1017/S1351324918000323
• Languages: English
• ISSNs: 1351-3249

Abstract

Abstract: Summarizing content contributed by individuals can be challenging, because people make different lexical choices even when describing the same events. However, there remains a significant need to summarize such content. Examples include the student responses to post-class reflective questions, product reviews, and news articles published by different news agencies related to the same events. High lexical diversity of these documents hinders the system's ability to effectively identify salient content and reduce summary redundancy. In this paper, we overcome this issue by introducing an integer linear programming-based summarization framework. It incorporates a low-rank approximation to the sentence-word cooccurrence matrix to intrinsically group semantically similar lexical items. We conduct extensive experiments on datasets of student responses, product reviews, and news documents. Our approach compares favorably to a number of extractive baselines as well as a neural abstractive summarization system. The paper finally sheds light on when and why the proposed framework is effective at summarizing content with high lexical variety.