Query classification using Wikipedia. (10th March 2011)

• Record Type: Journal Article
• Authors: Khoury, Richard
• Is Part Of: International journal of intelligent information and database systems. Volume 5:Number 2(2011)
• Page Start: 143
• Page End: 163
• Publication Date: 2011-03-10
• Subjects: natural language processing -- NLP -- query classification -- database systems -- information retrieval -- intelligent information systems -- knowledge-based systems -- web-based information systems -- Wikipedia; Database management -- Computer programs -- Periodicals; Information retrieval -- Computer programs -- Periodicals; Information storage and retrieval systems -- Computer programs -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Intelligent agents (Computer software) -- Periodicals; 006.33
• Languages: English
• ISSNs: 1751-5858

Abstract

Identifying the intended topic that underlies a user's query can benefit a large range of applications, from search engines to question-answering systems. However, query classification remains a difficult challenge due to the variety of queries a user can ask, the wide range of topics users can ask about, and the limited amount of information that can be mined from the query. In this paper, we develop a new query classification system that accounts for these three challenges. Our system relies on the freely-available online encyclopedia Wikipedia as a natural-language knowledge-based, and exploits Wikipedia's structure to infer the correct classification of any given query. We will present two variants of this query classification system in this paper, and demonstrate their reliability compared to each other and to the literature benchmarks using the query sets from the KDD CUP 2005 and TREC 2007 competitions.