A Dynamic Adjusting Reward Function Method for Deep Reinforcement Learning with Adjustable Parameters. (23rd November 2019)

• Record Type: Journal Article
• Authors: Hu, Zijian; Wan, Kaifang; Gao, Xiaoguang; Zhai, Yiwei
• Other Names: Rubio Jose de Jesus Academic Editor.
• Is Part Of: Mathematical problems in engineering. Volume 2019(2019)
• Publication Date: 2019-11-23
• Subjects: Engineering mathematics -- Periodicals; 510.2462
• DOI: 10.1155/2019/7619483
• Languages: English
• ISSNs: 1024-123X

Abstract

Abstract : In deep reinforcement learning, network convergence speed is often slow and easily converges to local optimal solutions. For an environment with reward saltation, we propose a magnify saltatory reward (MSR) algorithm with variable parameters from the perspective of sample usage. MSR dynamically adjusts the rewards for experience with reward saltation in the experience pool, thereby increasing an agent's utilization of these experiences. We conducted experiments in a simulated obstacle avoidance search environment of an unmanned aerial vehicle and compared the experimental results of deep Q-network (DQN), double DQN, and dueling DQN after adding MSR. The experimental results demonstrate that, after adding MSR, the algorithms exhibit a faster network convergence and can obtain the global optimal solution easily.