MIND: An approach to optimize communication time via middleware tuning. (May 2019)

• Record Type: Journal Article
• Authors: Belghoul, Abdeslem; Baïou, Mourad; Toumani, Farouk
• Is Part Of: Information systems. Volume 82(2019)
• Page Start: 17
• Page End: 32
• Publication Date: 2019-05
• Subjects: Data access middleware -- Distributed query optimization -- Communication cost model -- Automatic tuning; Database management -- Periodicals; Electronic data processing -- Periodicals; Bases de données -- Gestion -- Périodiques; Informatique -- Périodiques; Database management; Electronic data processing; Periodicals; 005.7
• DOI: 10.1016/j.is.2018.12.005
• Languages: English
• ISSNs: 0306-4379

Abstract

Abstract: Minimizing the communication time due to the transfer over a network of the intermediary results produced during the execution of a distributed query is a fundamental problem in distributed database management systems. We take a new look at this problem by investigating the relationship between the communication time and a remote data access middleware. We focus on two middleware parameters that are manually tuned by database administrators or programmers: the fetch size (i.e., the number of tuples that are communicated at once) and the message size (i.e., the size of the buffer at the middleware level). We present an experimental study which shows that these parameters have a crucial impact on the communication time. Then, we propose theMIND framework, which tunes the aforementioned middleware parameters, while adapting to different queries (that may vary in terms of selectivity) and networks (that may vary in terms of bandwidth). The main technical contributions ofMIND are (i) a communication time estimation function that takes into account the middleware parameters, the size of the query result and the network environment, and (ii) an iterative optimization algorithm to find the fetch size and the message size that allow a good trade-off between low resource consumption and low communication time. We conclude with an experimental study that emphasizes the effectiveness of theMIND framework.