Associative knowledge feature vector inferred on external knowledge base for dialog state tracking. (March 2019)

• Record Type: Journal Article
• Authors: Murase, Yukitoshi; Koichiro, Yoshino; Nakamura, Satoshi
• Is Part Of: Computer speech & language. Volume 54(2019)
• Page Start: 1
• Page End: 16
• Publication Date: 2019-03
• Subjects: Dialog state tracking -- Knowledge base -- Knowledge graph -- Associative knowledge inference; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2018.08.003
• Languages: English
• ISSNs: 0885-2308

Abstract

Highlights: We proposed an inferring method of the associative knowledge features on external knowledge graph. The knowledge base is converted into a subgraph that covers the corresponding entities to the data set. We applied graph inference method on the created graph to produce a feature vector that contains the associative knowledge information. The created feature vectors are used as the inputs of neural based dialog state tracker to improve the accuracy. Ensemble model of the tracker with proposed feature vectors and the tracker based on state of the art CNN based model achieved the best result of dialog state tracking with neural network. Abstract: The dialog state tracker is one of the most important modules on task-oriented dialog systems, its accuracy strongly affects the quality of the system response. The architecture of the tracker has been changed from pipeline processing to an end-to-end approach that directly estimates a user's intention from each current utterance and a dialog history because of the growth in the use of the neural-network-based classifier. However, tracking appropriate slot-value pairs of dialog states that are not explicitly mentioned in user utterances is still a difficult problem. In this research, we propose creating feature vectors by using inference results on an external knowledge base. This inference process predicts associative entities in the knowledge base, which contribute to the dialog state tracker for unseen entities of utterances. We extracted a part of a graph structure from an external knowledge base (Wikidata). Label propagation was used for inferring associative nodes (entities) on the graph structure to produce feature vectors. We used the vectors for the input of a fully connected neural network (FCNN) based tracker. We also introduce a convolutional neural network (CNN) tracker as a state-of-the-art tracker and ensemble models of FCNN and CNN trackers. We used a common test bed, Dialog State Tracking Challenge 4 for experiments. We confirmed the effectiveness of the associative knowledge feature vector, and one ensemble model outperformed other models.