Application of BERT+Attention Model in Emotion Recognition of Metizens during Epidemic Period. Issue 1 (July 2021)

• Record Type: Journal Article
• Authors: Wang, Xuyang; Tong, Yixuan
• Is Part Of: Journal of physics. Volume 1982:Issue 1(2021)
• Publication Date: 2021-07
• Subjects: Deep learning -- Natural language processing -- Text emotion classification -- BERT pre-training model -- Attention mechanism; Physics -- Congresses; 530.5
• DOI: 10.1088/1742-6596/1982/1/012102
• Languages: English
• ISSNs: 1742-6588

Abstract

Abstract: In 2020, SARS-CoV-2 will affect the hearts of people all over the country, and Weibo will become the representative of people expressing their feelings on the Internet. Traditional emotion dictionary and machine learning methods have poor text emotion recognition effect, while BERT pre-training model is based on bidirectional Transformer model, which can better obtain the emotion expressed by the text and effectively improve the accuracy of the model. On the basis of improving BERT pre-training model, attention mechanism is introduced, and the key features are weighted to make emotion classification more accurate. According to the analysis of emotions expressed by netizens on Weibo during the epidemic, compared with textCNN model, BILSTM model and BILSTM+Attention model, the accuracy rate has increased by 6.25%, 4.69% and 2.67% respectively. The overall performance of this model is the best, and it can effectively recognize text emotion.