Improving sentiment analysis with multi-task learning of negation. (11th March 2021)

• Record Type: Journal Article
• Authors: Barnes, Jeremy; Velldal, Erik; Øvrelid, Lilja
• Is Part Of: Natural language engineering. Volume 27:Part 2(2021)
• Page Start: 249
• Page End: 269
• Publication Date: 2021-03-11
• Subjects: sentiment analysis, -- negation detection, -- multi-task; Natural language processing (Computer science) -- Periodicals; Software engineering -- Periodicals; 006.35
• DOI: 10.1017/S1351324920000510
• Languages: English
• ISSNs: 1351-3249

Abstract

Abstract: Sentiment analysis is directly affected by compositional phenomena in language that act on the prior polarity of the words and phrases found in the text. Negation is the most prevalent of these phenomena, and in order to correctly predict sentiment, a classifier must be able to identify negation and disentangle the effect that its scope has on the final polarity of a text. This paper proposes a multi-task approach to explicitly incorporate information about negation in sentiment analysis, which we show outperforms learning negation implicitly in an end-to-end manner. We describe our approach, a cascading and hierarchical neural architecture with selective sharing of Long Short-term Memory layers, and show that explicitly training the model with negation as an auxiliary task helps improve the main task of sentiment analysis. The effect is demonstrated across several different standard English-language data sets for both tasks, and we analyze several aspects of our system related to its performance, varying types and amounts of input data and different multi-task setups.