A deep reinforcement learning model with plan value network for join order selection. (17th March 2022)

• Record Type: Journal Article
• Authors: Qiao, Yifan; Wei, Shengjie; Gao, Ruiwei; Han, Nan; Qiao, Shaojie; Song, Haiquan
• Is Part Of: International journal of wireless and mobile computing. Volume 21:Number 4(2021)
• Page Start: 365
• Page End: 374
• Publication Date: 2022-03-17
• Subjects: query optimisation -- join order selection -- database management system -- cardinality estimation -- deep reinforcement learning -- cost estimation -- query optimiser -- query plan -- join plan -- join optimisation; Mobile computing -- Periodicals; Wireless communication systems -- Periodicals; 004.6
• Languages: English
• ISSNs: 1741-1084

Abstract

The existing optimisers and dynamic programming methods rely on the cardinality estimation and the cost model of the local database. The resulting join plan does not reflect the execution time, and the errors of cardinality estimation will also lead to the join plans with poor quality. We propose a new learning optimiser, called DVJ (Deep reinforcement learning with plan Value networks for Join order selection). Compared with the existing deep reinforcement learning method, DVJ has two improvements: (1) the plan value network is designed to improve the reward mechanism in the existing deep reinforcement learning method, and the join plan generated by DVJ can reflect the latency; (2) applying Deep Q-Network to reduce the optimisation time and increase the chance of finding the best connection plan. Extensive experiments are conducted and the experimental results demonstrate that DVJ outperforms traditional optimisers and the existing deep reinforcement learning methods.