A reinforcement learning-based energy management strategy for fuel cell hybrid vehicle considering real-time velocity prediction. (15th December 2022)

• Record Type: Journal Article
• Authors: Yang, Duo; Wang, Li; Yu, Kunjie; Liang, Jing
• Is Part Of: Energy conversion and management. Volume 274(2022)
• Publication Date: 2022-12-15
• Subjects: Fuel cell -- Hybrid dynamic system -- Energy management strategy -- Reinforcement learning -- Velocity prediction; Direct energy conversion -- Periodicals; Energy storage -- Periodicals; Energy transfer -- Periodicals; Énergie -- Conversion directe -- Périodiques; Direct energy conversion; Periodicals; 621.3105
• DOI: 10.1016/j.enconman.2022.116453
• Languages: English
• ISSNs: 0196-8904

Abstract

Highlights: The electrical model of fuel cell/battery hybrid system is built. A driving pattern classifier is built based on statistical analysis and PNN. Multi-step Markov velocity predictors are designed under different pattern. A double Q-learning strategy is proposed for the power distribution. Different comparative experiments verify the reliability of the proposed method. Abstract: The fuel cell vehicle is an ideal new energy vehicle development direction, and its energy management strategy is one of the core technologies to ensure the safe and efficient operation of the vehicle. We proposed a novel reinforcement learning-based energy management method for the fuel cell/lithium battery hybrid system in this paper. In order to improve the reliability of the EMS, the real-time driving profile classification and velocity prediction method based on data driven and statistical analysis is proposed to forecast vehicle velocity in the near future. Then a reinforcement learning method is designed to realize the real-time power allocation. The reward value function which comprehensively considers the system safety, economics and fuel cell durability is creatively put forward. The double Q-learning strategy is applied to update the Q value function. In addition, the real-time reference path of power allocation is designed by taking battery state-of-charge as an indicator. A new dynamic test profile is conducted to verify the proposed method. The multiple groups of comparative simulation experiments show that the proposed EMS can effectively reduce the life decay rate of fuel cell, but also improves fuel economics by up to 6% compared with other commonly used methods.