A distributed maximal frequent itemset mining with multi agents system on bitmap join indexes selection. (1st January 2015)

• Record Type: Journal Article
• Authors: Necir, Hamid; Drias, Habiba
• Is Part Of: International journal of information technology and management. Volume 14:Number 2/3(2015)
• Page Start: 201
• Page End: 214
• Publication Date: 2015-01-01
• Subjects: bitmap join indices -- BJIs -- data mining -- data warehouse -- multi–agent systems -- MAS -- agent–based systems -- distributed itemsets -- maximal frequent itemset mining -- OLAP queries -- disk space constraints; Management information systems -- Periodicals; Information technology -- Periodicals; Management -- Data processing -- Periodicals; 658.403805
• DOI: 10.1504/IJITM.2015.068470
• Languages: English
• ISSNs: 1461-4111

Abstract

The amount of information in a data warehouse tends to be extremely large and queries may involve several complex join and aggregate operations at the same time. By using the right indices, the database administrator can speed up these OLAP queries and dramatically shorten processing times. However, selection of an optimal set of indices is a very hard task because of the exponential number of attribute candidates that can be used in the selection process. Addressing this problem, we propose a new approach with two main phases. The first involves pruning the search space to reduce the number of indices candidates. To that end, we use a distributed maximal itemsets mining approach based on a multi agent system that can significantly reduce the complexity of the selection process. We also incorporate a convertible anti–monotone constraint that contains information on the profit of index. The second phase uses also a multi agent's architecture to select final indices using a subset of attribute candidates. This final configuration will provide benefit to OLAP queries, but will also respect the disk space constraint. We validate our proposed approach using an experimental evaluation.