Hierarchical state recurrent neural network for social emotion ranking. (July 2021)

• Record Type: Journal Article
• Authors: Zhou, Deyu; Zhang, Meng; Yang, Yang; He, Yulan
• Is Part Of: Computer speech & language. Volume 68(2021)
• Publication Date: 2021-07
• Subjects: Sentiment analysis -- Social emotion ranking -- Attention mechanism; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2020.101177
• Languages: English
• ISSNs: 0885-2308

Abstract

Highlights: In this paper, a novel hierarchical state recurrent neural network (HSRNN) is proposed. It incorporates hierarchical state recurrent neural network to capture long-range dependencies and the key semantic hierarchical information of a document. Moreover, instead of incrementally reading a sequence of words or sentences as in traditional recurrent neural networks, the proposed approach encodes the hidden states of all words or sentences simultaneously at each recurrent step to capture long-range dependencies precisely. Experimental results show that the proposed approach performs remarkably better than the state-of-the-art emotion ranking approaches. What's more, the visualization results indicate that the important words/sentences highlighted by HSRNN indeed represent the evoked emotions in documents. Abstract: Text generation with auxiliary attributes, such as topics or sentiments, has made remarkable progress. However, high-quality labeled data is difficult to obtain for the large-scale corpus. Therefore, this paper focuses on social emotion ranking aiming to identify social emotions with different intensities evoked by online documents, which could be potentially beneficial for further controlled text generation. Existing studies often consider each document as an entirety that fail to capture the inner relationship between sentences in a document. In this paper, we propose a novel hierarchical state recurrent neural network for social emotion ranking. A hierarchy mechanism is employed to capture the key hierarchical semantic structure in a document. Moreover, instead of incrementally reading a sequence of words or sentences as in traditional recurrent neural networks, the proposed approach encodes the hidden states of all words or sentences simultaneously at each recurrent step to capture long-range dependencies precisely. Experimental results show that the proposed approach performs remarkably better than the state-of-the-art social emotion ranking approaches and is useful for controlled text generation.