Improved concept-based query expansion using Wikipedia. (1st January 2013)

• Record Type: Journal Article
• Authors: Yuvarani, M.; Iyengar, N.Ch.S.N.; Kannan, A.
• Is Part Of: International journal of communication networks and distributed systems. Volume 11:Number 1(2013)
• Page Start: 26
• Page End: 41
• Publication Date: 2013-01-01
• Subjects: index terms -- crowdsourcing -- query expansion -- direction finder -- web search -- query formulation -- Wikipedia; Computer networks -- Periodicals; Telecommunication systems -- Periodicals; Electronic data processing -- Distributed processing -- Periodicals; 004.6
• Languages: English
• ISSNs: 1754-3916

Abstract

The query formulation has always been a challenge for the users. In this paper, we propose a novel interactive query expansion methodology that identifies and presents the potential directions (generalised concepts) for the given query enabling the user to explore the interested topic further. The methodology proposed is concept-based direction (CoD) finder which relies on the external knowledge repository for finding the directions. Wikipedia, the most important non-profit crowdsourcing project, is considered as the external knowledge repository for CoD finder methodology. CoD finder identifies the concepts for the given query and derives the generalised direction for each of the concepts, based on the content of the Wikipedia article and the categories it belongs to. The CoD finder methodology has been evaluated in the crowdsourcing marketplace – Amazon's Mechanical Turk for measuring the quality of the identified potential directions. The evaluation result shows that the potential directions identified by the CoD finder methodology produces better precision and recall for the given queries.