Multi‐representational convolutional neural networks for text classification. (18th June 2019)

• Record Type: Journal Article
• Authors: Jin, Rize; Lu, Liangfu; Lee, Joomin; Usman, Anwar
• Other Names: Pang Shaoning guestEditor.; Zhang Xuyun guestEditor.; Ikeda Kazushi guestEditor.; Puthal Deepak guestEditor.; Li Jianxin guestEditor.; Sarrafzahed Abdolhossein guestEditor.
• Is Part Of: Computational intelligence. Volume 35:Number 3(2019)
• Page Start: 599
• Page End: 609
• Publication Date: 2019-06-18
• Subjects: convolutional neural networks -- multi‐representational architecture -- text classification; Artificial intelligence -- Periodicals; Computational linguistics -- Periodicals; 006.3
• DOI: 10.1111/coin.12225
• Languages: English
• ISSNs: 0824-7935

Abstract

Abstract: Various studies have demonstrated that convolutional neural networks (CNNs) can be directly applied to different levels of text embedding, such as character‐, word‐, or document‐levels. However, the effectiveness of different embeddings is limited in the reported result and there is a lack of clear guidance on some aspects of their use, including choosing the proper level of embedding and switching word semantics from one domain to another when appropriate. In this paper, we propose a new architecture of CNN based on multiple representations for text classification, by constructing multiple planes so that more information can be dumped into the networks, such as different parts of text obtained through named entity recognizer or part‐of‐speech tagging tools, different levels of text embedding, or contextual sentences. Various large‐scale, domain‐specific datasets are used to validate the proposed architecture. Tasks analyzed include ontology document classification, biomedical event categorization, and sentiment analysis, showing that multi‐representational CNNs, which learns to focus attention to specific representations of text, can obtain further gains in performance over state‐of‐the‐art deep neural network models.