Conditional pre‐trained attention based Chinese question generation. (2nd June 2021)

• Record Type: Journal Article
• Authors: Zhang, Liang; Fang, Ligang; Fan, Zheng; Li, Wei; An, Jing
• Is Part Of: Concurrency and computation. Volume 33:Number 20(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-06-02
• Subjects: Chinese question generation -- conditional pre‐trained attention model -- general background knowledge; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.6374
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: Question generation is a promising and important area in natural language processing. According to the information of the given text, the question generation model can automatically generate a variety of questions, which are conducive to processing various subsequent tasks. Chinese question generation is a specific sub‐area of question generation. Due to the characteristics of Chinese question generation tasks, many methods are not suitable for it, and the generated results are either incorrect in word order or invalid expression. In order to address such challenging problem, we propose the conditional pre‐trained attention model termed A Lite BERT Conditional Question Generation (ALBERT‐CQG) for Chinese question generation. Through introducing general background knowledge of the pre‐trained model and conditional information of the given answers, this model has capacity of generating more valid expression. To our knowledge, we are the first to apply the conditional pre‐trained attention model to Chinese question generation tasks. The experimental results on two known benchmark datasets of Chinese question answering show that the ALBERT‐CQG outperforms its recent peers.