A new path plan method based on hybrid algorithm of reinforcement learning and particle swarm optimization. Issue 3 (27th July 2021)

• Record Type: Journal Article
• Authors: Liu, Xiaohuan; Zhang, Degan; Zhang, Ting; Zhang, Jie; Wang, Jiaxu
• Is Part Of: Engineering computations. Volume 39:Issue 3(2022)
• Page Start: 993
• Page End: 1019
• Publication Date: 2021-07-27
• Subjects: Reinforcement learning -- Path planning -- Intelligent driving -- Shortest path algorithm; Computer-aided engineering -- Periodicals; Computer graphics -- Periodicals; 620.00285
• DOI: 10.1108/EC-09-2020-0500
• Languages: English
• ISSNs: 0264-4401

Abstract

Abstract : Purpose: To solve the path planning problem of the intelligent driving vehicular, this paper designs a hybrid path planning algorithm based on optimized reinforcement learning (RL) and improved particle swarm optimization (PSO). Design/methodology/approach: First, the authors optimized the hyper-parameters of RL to make it converge quickly and learn more efficiently. Then the authors designed a pre-set operation for PSO to reduce the calculation of invalid particles. Finally, the authors proposed a correction variable that can be obtained from the cumulative reward of RL; this revises the fitness of the individual optimal particle and global optimal position of PSO to achieve an efficient path planning result. The authors also designed a selection parameter system to help to select the optimal path. Findings: Simulation analysis and experimental test results proved that the proposed algorithm has advantages in terms of practicability and efficiency. This research also foreshadows the research prospects of RL in path planning, which is also the authors' next research direction. Originality/value: The authors designed a pre-set operation to reduce the participation of invalid particles in the calculation in PSO. And then, the authors designed a method to optimize hyper-parameters to improve learning efficiency of RL. And then they used RL trained PSO to plan path. The authors also proposed an optimal path evaluation system. This research also foreshadows the research prospects of RL in path planning, which is also the authors' next research direction.