Sentiment classification of microblog: A framework based on BERT and CNN with attention mechanism. (July 2022)

• Record Type: Journal Article
• Authors: Jia, Keliang
• Is Part Of: Computers & electrical engineering. Volume 101(2022)
• Publication Date: 2022-07
• Subjects: Microblog -- Sentiment classification -- BERT -- CNN -- Attention mechanism -- Feature fusion; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2022.108032
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: BERT, a boon to natural language understanding, extracts the context information of words and forms the basis of the newly-designed sentiment classification framework for Chinese microblogs. Coupled with a CNN and an attention mechanism, the BERT model takes Chinese characters as inputs for vectorization and outputs two kinds of vectors: character-level vectors and sentence-level vectors. The character-level vectors are input into the CNN, and both top-K-average pooling and attention pooling are used to mine emotions from the microblogs. The attention mechanism is used to fuse various features to the microblog vectors. The final classification results are derived via a softmax function over the microblog vectors. The results show an outstanding improvement over benchmark methods on the two classification tasks. Graphical abstract: Highlights: Put forward the BT-CNN-ATT emotion classification model. Two pooling mechanisms are highlighted, top-K-average pooling and attention pooling. An attention mechanism is introduced to fuse the extracted emotion characteristics.