Learning Word Sense Disambiguation in biomedical text with difference between training and test distributions. (27th July 2012)

• Record Type: Journal Article
• Authors: Son, Jeong-Woo; Park, Seong-Bae
• Is Part Of: International journal of data mining and bioinformatics. Volume 6:Number 2(2012)
• Page Start: 216
• Page End: 237
• Publication Date: 2012-07-27
• Subjects: distribution difference -- SVM -- support vector machine -- covariate shift -- WSD -- word sense disambiguation -- robustness -- data mining -- bioinformatics; Data mining -- Periodicals; Bioinformatics -- Periodicals; 006.312
• Languages: English
• ISSNs: 1748-5673

Abstract

Word Sense Disambiguation methods based on machine learning techniques with lexical features suffer from the discordance between distributions of the training and test documents, due to the diversity of lexical space. To tackle this problem, this paper proposes Support Vector Machines with Example-wise Weights. In this method, the training distribution is matched with the test distribution by weighting training examples according to their similarity to all test data. The experimental results show the distribution change between the training and test data is actually recognised and the proposed method which considers this change in its training phase outperforms ordinary SVMs.