Hierarchical Energy Management Strategy Based On M-DQN for Fuel Cell Hybrid Electric Vehicle
DOI:
https://doi.org/10.54097/9hyjxy41Keywords:
Deep reinforcement learning , FCHEV , Energy management strategy.Abstract
For fuel cell hybrid electric vehicles equipped with a fuel cell (FC), battery (BAT), and supercapacitor (UC), this paper proposes a hierarchical energy management strategy (EMS) based on the improved M-DQN algorithm to reduce hydrogen consumption, enhance the efficiency of the FC, and maintain the state of charge (SoC) of the BAT. Firstly, an adaptive fuzzy low-pass filter is employed to achieve the frequency decoupling of power demand, enabling the UC to provide/absorb the peak power demand. Secondly, an energy management framework based on M-DQN is designed, and the concept of an equivalent consumption minimization strategy is applied to construct the reward function, which includes penalty factors related to the efficiency of the FC and SoC deviation of the BAT, aiming at optimizing the power allocation between the FC and BAT. Simulations and platform tests were conducted under various typical driving cycles. The results indicate that, compared with the traditional M-DQN-based EMS, the proposed EMS can significantly maintain the SoC of the BAT, improve the efficiency of the FC, reduce hydrogen consumption, and even achieve an average improvement of 5.2% in fuel economy.
Downloads
References
Ferrara A, Jakubek S, Hametner C. Energy management of heavy-duty fuel cell vehicles in real-world driving scenarios: Robust design of strategies to maximize the hydrogen economy and system lifetime[J]. Energy Conversion and Management, 2021, 232: 113795.
Kasimalla V K R, Velisala V. A review on energy allocation of fuel cell/battery/ultracapacitor for hybrid electric vehicles[J]. International Journal of Energy Research, 2018, 42(14): 4263-4283.
Y. Hames, K. Kaya, E. Baltacioglu, A. Turksoy, Analysis of the control strategies for fuel saving in the hydrogen fuel cell vehicles[J]. International Journal of Hydrogen Energy, 2018, 43: 10810–10821.
Tran D D, Vafaeipour M, El Baghdadi M, et al. Thorough state-of-the-art analysis of electric and hybrid vehicle powertrains: Topologies and integrated energy management strategies[J]. Renewable and Sustainable Energy Reviews, 2020, 119: 109596.
Zou Y, Liu T, Liu D, et al. Reinforcement learning-based real-time energy management for a hybrid tracked vehicle[J]. Applied energy, 2016, 171: 372-382.
Sun H, Fu Z, Tao F, et al. Data-driven reinforcement-learning-based hierarchical energy management strategy for fuel cell/battery/ultracapacitor hybrid electric vehicles[J]. Journal of Power Sources, 2020, 455: 227964.
Ganesh A H, Xu B. A review of reinforcement learning based energy management systems for electrified powertrains: Progress, challenge, and potential solution[J]. Renewable and Sustainable Energy Reviews, 2022, 154.
Liu T, Zou Y, Liu D, et al. Reinforcement learning of adaptive energy management with transition probability for a hybrid electric tracked vehicle[J]. IEEE Transactions on Industrial Electronics, 2015, 62(12): 7837-7846.
Ganesh A H, Xu B. A review of reinforcement learning based energy management systems for electrified powertrains: Progress, challenge, and potential solution[J]. Renewable and Sustainable Energy Reviews, 2022, 154: 111833.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Academic Journal of Science and Technology

This work is licensed under a Creative Commons Attribution 4.0 International License.








