QBSUM: A large-scale query-based document summarization dataset from real-world applications. (March 2021)

• Record Type: Journal Article
• Authors: Zhao, Mingjun; Yan, Shengli; Liu, Bang; Zhong, Xinwang; Hao, Qian; Chen, Haolan; Niu, Di; Long, Bowei; Guo, Weidong
• Is Part Of: Computer speech & language. Volume 66(2021)
• Publication Date: 2021-03
• Subjects: Query-based summarization -- Natural language generation -- Information retrieval; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2020.101166
• Languages: English
• ISSNs: 0885-2308

Abstract

Highlights: Propose a large-scale query-based document summarization dataset. Three models for solving the problem. Data and experiment analysis; Online large-scale A/B testing in real-world mobile applications. Abstract: Query-based document summarization aims to extract or generate a summary of a document which directly answers or is relevant to the search query. It is an important technique that can be beneficial to a variety of applications such as search engines, document-level machine reading comprehension, and chatbots. Currently, datasets designed for query-based summarization are short in numbers and existing datasets are also limited in both scale and quality. Moreover, to the best of our knowledge, there is no publicly available dataset for Chinese query-based document summarization. In this paper, we present QBSUM, a high-quality large-scale dataset consisting of 49, 000+ data samples for the task of Chinese query-based document summarization. We also propose multiple unsupervised and supervised solutions to the task and demonstrate their high-speed inference and superior performance via both offline experiments and online A/B tests. The QBSUM dataset is released in order to facilitate future advancement of this research field.