Automatic tagging with existing and novel tags. (21st April 2017)

• Record Type: Journal Article
• Authors: Wang, Junhui; Shen, Xiaotong; Sun, Yiwen; Qu, Annie
• Is Part Of: Biometrika. Volume 104:Number 2(2017)
• Page Start: 273
• Page End: 290
• Publication Date: 2017-04-21
• Subjects: Alternating direction method of multipliers -- Large margin -- Multi-label classification -- Scalability -- Social bookmarking system -- Text mining; Biometry -- Periodicals; 570.1519505
• DOI: 10.1093/biomet/asx016
• Languages: English
• ISSNs: 0006-3444

Abstract

Summary : Automatic tagging by key words and phrases is important in multi-label classification of a document. In this paper, we first introduce a tagging loss to measure the discrepancy between predicted and actual tag sets, which is expressed in terms of a sum of weighted pairwise margins between two tags by their degree of similarity. We then construct a regularized empirical loss to incorporate linguistic knowledge, and identify a tagger maximizing the separations between the pairwise margins. One salient feature of the proposed method is its capability to identify novel tags absent from a training sample by using their similarity to existing tags. Computationally, the proposed method is implemented by an alternating direction method of multipliers, integrated with a difference convex algorithm. This permits scalable computation. We show that the method achieves accurate tagging, and that it compares favourably with existing methods. Finally, we apply the proposed method to tagging a Reuters news dataset.