A deep neural architecture for sentence semantic matching. (17th April 2020)

• Record Type: Journal Article
• Authors: Zhang, Xu; Lu, Wenpeng; Li, Fangfang; Zhang, Ruoyu; Cheng, Jinyong
• Is Part Of: International journal of computational science and engineering. Volume 21:Number 4(2020)
• Page Start: 574
• Page End: 582
• Publication Date: 2020-04-17
• Subjects: sentence matching -- representation learning -- sentence interaction -- loss function -- deep neural model -- long short-term memory -- LSTM; Computer science -- Mathematics -- Periodicals; Computer simulation -- Mathematical aspects -- Periodicals; Computational intelligence -- Periodicals; 004.015105
• Languages: English
• ISSNs: 1742-7185

Abstract

Sentence semantic matching (SSM) is a fundamental research task in natural language processing. Most existing SSM methods take the advantage of sentence representation learning to generate a single or multi-granularity semantic representation for sentence matching. However, sentence interactions and loss function which are the two key factors for SSM still have not been fully considered. Accordingly, we propose a deep neural network architecture for SSM task with a sentence interactive matching layer and an optimised loss function. Given two input sentences, our model first encodes them to embeddings with an ordinary long short-term memory (LSTM) encoder. Then, the encoded embeddings are handled by an attention layer to find the key and important words in the sentences. Next, sentence interactions are captured with a matching layer to output a matching vector. Finally, based on the matching vector, a fully connected multi-layer perceptron outputs the similarity score. The model also distinguishes the equivocation training instances with an improved optimised loss function. We also systematically evaluate our model on a public Chinese semantic matching corpus, BQ corpus. The results demonstrate that our model outperforms the state-of-the-art methods, i.e., BiMPM, DIIN.