Towards structured NLP interpretation via graph explainers. Issue 4 (27th December 2021)

• Record Type: Journal Article
• Authors: Yuan, Hao; Yang, Fan; Du, Mengnan; Ji, Shuiwang; Hu, Xia
• Other Names: Gunning Dave guestEditor.; Vorm Eric guestEditor.; Wang Jennifer Yunyan guestEditor.; Turek Matt guestEditor.
• Is Part Of: Applied AI Letters. Volume 2:Issue 4(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-12-27
• Subjects: graph neural network -- natural language processing -- structured interpretation; 006.3
• DOI: 10.1002/ail2.58
• Languages: English
• ISSNs: 2689-5595

Abstract

Abstract: Natural language processing (NLP) models have been increasingly deployed in real‐world applications, and interpretation for textual data has also attracted dramatic attention recently. Most existing methods generate feature importance interpretation, which indicate the contribution of each word towards a specific model prediction. Text data typically possess highly structured characteristics and feature importance explanation cannot fully reveal the rich information contained in text. To bridge this gap, we propose to generate structured interpretations for textual data. Specifically, we pre‐process the original text using dependency parsing, which could transform the text from sequences into graphs. Then graph neural networks (GNNs) are utilized to classify the transformed graphs. In particular, we explore two kinds of structured interpretation for pre‐trained GNNs: edge‐level interpretation and subgraph‐level interpretation. Experimental results over three text datasets demonstrate that the structured interpretation can better reveal the structured knowledge encoded in the text. The experimental analysis further indicates that the proposed interpretations can faithfully reflect the decision‐making process of the GNN model. Abstract : In this paper we propose two kinds of structured interpretation for pre‐trained GNNs for NLP applications: edge‐level interpretation and subgraph‐level interpretation.