Performance improvement of join queries through algebraic signatures. (12th July 2010)

• Record Type: Journal Article
• Authors: Mokadem, Riad; Hameurlain, Abdelkader; Morvan, Franck
• Is Part Of: International journal of intelligent information and database systems. Volume 4:Number 3(2010)
• Page Start: 282
• Page End: 306
• Publication Date: 2010-07-12
• Subjects: database systems -- hash join algorithms -- semi-join based join technique -- algebraic signatures -- multi-join query processing -- performance evaluation -- distributed join queries; Database management -- Computer programs -- Periodicals; Information retrieval -- Computer programs -- Periodicals; Information storage and retrieval systems -- Computer programs -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Intelligent agents (Computer software) -- Periodicals; 006.33
• Languages: English
• ISSNs: 1751-5858

Abstract

Evaluation of distributed join queries in large scale environments often deals with large data volumes, network with low bandwidth and high number of data sources. Several techniques were proposed to improve join query performances. We propose to combine algebraic signatures with known hash join techniques. Algebraic signatures combined to a semi join based join technique are also very useful for reducing the volume of inter-site transmitted data. We discuss impacts of CPU, I/O and communication costs reductions on the total multi-join query performance improvements. The performance study of our technique shows the reduction of both memory requirements and processing costs especially when the join attribute is a long string. Performances of the semi join based join technique are also significantly improved. We experiment with simple, medium and complex queries in both centralised and distributed environments. Algebraic signatures provide improved performances to reduce significantly communication costs, often the dominant factor in distributed environments.