Improving sentence simplification model with ordered neurons network. Issue 2 (15th May 2021)

• Record Type: Journal Article
• Authors: Deng, Chunhui; Zhang, Lemin; Deng, Huifang
• Is Part Of: CAAI transactions on intelligence technology. Volume 7:Issue 2(2022)
• Page Start: 268
• Page End: 277
• Publication Date: 2021-05-15
• Subjects: neural nets -- natural language processing; Artificial intelligence -- Periodicals; Computer science -- Periodicals; Artificial intelligence; Computer science; Electronic journals; Periodicals; 006.305
• DOI: 10.1049/cit2.12047
• Languages: English
• ISSNs: 2468-6557

Abstract

Abstract: Sentence simplification is an essential task in natural language processing and aims to simplify complex sentences while retaining their primary meanings. To date, the main research works on sentence simplification models have been based on sequence‐to‐sequence (Seq2Seq) models. However, these Seq2Seq models are incapable of analysing the hierarchical structure of sentences, which is of great significance for sentence simplification. The problem can be addressed with an ON‐MULTI‐STAGE model constructed based on the improved MULTI‐STAGE encoder model. In this model, an ordered neurons network is introduced and can provide sentence‐level structural information for the encoder and decoder. A weak attention connection method is then employed to make the decoder use the sentence‐level structural details. Experimental results on two open data sets demonstrated that the constructed model outperforms the state‐of‐the‐art baseline models in sentence simplification.