Visual exploration and comparison of word embeddings. (October 2018)

• Record Type: Journal Article
• Authors: Chen, Juntian; Tao, Yubo; Lin, Hai
• Is Part Of: Journal of visual languages & computing. Volume 48(2018)
• Page Start: 178
• Page End: 186
• Publication Date: 2018-10
• Subjects: Visual comparison -- Word embeddings; Visual programming languages (Computer science) -- Periodicals; Visual programming (Computer science) -- Periodicals; Programming languages (Electronic computers) -- Semantics -- Periodicals; Langages de programmation visuelle -- Périodiques; Programmation visuelle -- Périodiques; Langages de programmation -- Sémantique -- Périodiques; Programming languages (Electronic computers) -- Semantics; Visual programming (Computer science); Visual programming languages (Computer science); Periodicals; Electronic journals; 005
• DOI: 10.1016/j.jvlc.2018.08.008
• Languages: English
• ISSNs: 1045-926X

Abstract

Abstract: Word embeddings are distributed representations for natural language words, and have been wildly used in many natural language processing tasks. The word embedding space contains local clusters with semantically similar words and meaningful directions, such as the analogy. However, there are different training algorithms and text corpora, which both have a different impact on the generated word embeddings. In this paper, we propose a visual analytics system to visually explore and compare word embeddings trained by different algorithms and corpora. The word embedding spaces are compared from three aspects, i.e., local clusters, semantic directions and diachronic changes, to understand the similarity and differences between word embeddings.