D‐BERT: Incorporating dependency‐based attention into BERT for relation extraction. Issue 4 (26th March 2021)

• Record Type: Journal Article
• Authors: Huang, Yuan; Li, Zhixing; Deng, Wei; Wang, Guoyin; Lin, Zhimin
• Is Part Of: CAAI transactions on intelligence technology. Volume 6:Issue 4(2021)
• Page Start: 417
• Page End: 425
• Publication Date: 2021-03-26
• Subjects: Artificial intelligence -- Periodicals; Computer science -- Periodicals; Artificial intelligence; Computer science; Electronic journals; Periodicals; 006.305
• DOI: 10.1049/cit2.12033
• Languages: English
• ISSNs: 2468-6557

Abstract

Abstract: Relation extraction between entity pairs is an increasingly critical area in natural language processing. Recently, the pre‐trained bidirectional encoder representation from transformer (BERT) performs excellently on the text classification or sequence labelling tasks. Here, the high‐level syntactic features that consider the dependency between each word and the target entities into the pre‐trained language models are incorporated. Our model also utilizes the intermediate layers of BERT to acquire different levels of semantic information and designs multi‐granularity features for final relation classification. Our model offers a momentous improvement over the published methods for the relation extraction on the widely used data sets.