A Double‐Deep Q‐Network‐Based Energy Management Strategy for Hybrid Electric Vehicles under Variable Driving Cycles. Issue 2 (6th January 2021)

• Record Type: Journal Article
• Authors: Zhang, Jiaqi; Jiao, Xiaohong; Yang, Chao
• Is Part Of: Energy technology. Volume 9:Issue 2(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-01-06
• Subjects: adaptabilities -- double-deep Q-networks -- energy management strategies -- hybrid electric vehicles -- variable driving cycles; Energy development -- Periodicals; Power resources -- Periodicals; 333.79
• DOI: 10.1002/ente.202000770
• Languages: English
• ISSNs: 2194-4288

Abstract

Abstract : As a core part of hybrid electric vehicles (HEVs), energy management strategy (EMS) directly affects the vehicle fuel‐saving performance by regulating energy flow between engine and battery. Currently, most studies on EMS are focused on buses or commuter private cars, whose driving cycles are relatively fixed. However, there is also a great demand for the EMS that adapts to variable driving cycles. The rise of machine learning, especially deep learning and reinforcement learning, provides a new opportunity for the design of EMS for HEVs. Motivated by this issue, herein, a double‐deep Q‐network (DDQN)‐based EMS for HEVs under variable driving cycles is proposed. The distance traveled of the driving cycle is creatively introduced as states into the DDQN‐based EMS of HEV. The relevant problem of "curse of dimensionality" caused by choosing too many states in the process of training is solved via the good generalization of deep neural network. For the problem of overestimation in model training, two different neural networks are designed for action selection and target value calculation, respectively. The effectiveness and adaptability to variable driving cycles of the proposed DDQN‐based EMS are verified by simulation comparison with Q‐learning‐based EMS and rule‐based EMS for improving fuel economy. Abstract : Herein, a double‐deep Q‐networks‐based energy management strategy for hybrid electric vehicles is proposed. The distance traveled of driving cycle is introduced as states to enhance the adaptability of the algorithm. Two different neural networks are designed for action selection and target value calculation respectively to avoid overestimation in the process of model training.