Web toolkit: an agent based scalable search engine using cellular automata based classification for duly ranked retrieved data. (10th March 2011)

• Record Type: Journal Article
• Authors: Kundu, Anirban; Mukhopadhyay, Debajyoti
• Is Part Of: International journal of intelligent information and database systems. Volume 5:Number 2(2011)
• Page Start: 177
• Page End: 199
• Publication Date: 2011-03-10
• Subjects: cellular automata -- Galois field -- hierarchical crawlers -- page ranking -- single cycle multiple attractor cellular automata -- SMACA -- agent-based systems -- search engines -- multi-agent systems -- web page classification -- web documents -- indexing -- information retrieval -- web pages; Database management -- Computer programs -- Periodicals; Information retrieval -- Computer programs -- Periodicals; Information storage and retrieval systems -- Computer programs -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Intelligent agents (Computer software) -- Periodicals; 006.33
• Languages: English
• ISSNs: 1751-5858

Abstract

Web page classification is a major issue for categorising web documents to facilitate indexing, search and retrieval of web pages for search engine. Different crawling techniques have been utilised to accumulate web pages of different domains under separate databases depending on practical scenario. Downloaded web pages are being parsed for further processing. A classifier is designed dynamically using single cycle multiple attractor cellular automata for mapping downloaded web pages of different domains into specific structure. This paper proposes alternate technique for automatic categorisation of web pages into different domains. Retrieved web pages have been ranked automatically at the time of classifier formation. Typically, our system consists of crawling, ranking and storage parts created in a different way. Hierarchical concept has been used over parallel crawler. GF(2P) concept is introduced in ranking. The concept of SMACA has been utilised in indexing storage. Overall, a search engine module has been created using agent-based method.