Quantile forecast of renewable energy generation based on Indicator Gradient Descent and deep residual BiLSTM. (September 2021)

• Record Type: Journal Article
• Authors: Hu, Tianyu; Li, Kang; Ma, Huimin; Sun, Hongbin; Liu, Kailong
• Is Part Of: Control engineering practice. Volume 114(2021)
• Publication Date: 2021-09
• Subjects: Energy generation -- Quantile forecasting -- Renewable energy -- Deep learning -- Indicator gradient decent -- BiLSTM; Automatic control -- Periodicals; 629.89
• DOI: 10.1016/j.conengprac.2021.104863
• Languages: English
• ISSNs: 0967-0661

Abstract

Abstract: Accurate generation forecasting can effectively accelerate the use of renewable energy in hybrid energy systems, contributing significantly to the delivery of the net-zero emission target. Recently, neural-network-based quantile forecast models have shown superior performance on renewable energy generation forecasting, partially because they have subtly embedded quantile forecast evaluation metrics into their loss functions. However, the non-differentiability of involved metrics has rendered their metric-embedded loss functions not everywhere-derivable, resulting in inapplicability of gradient-based training approaches. Instead, they have resorted to heuristic searches for Neural Network (NN) training, bringing low training efficiency and a rigid restriction on the size of the resultant NN. In this paper, the Indicator Gradient Descent (IGD) is proposed to overcome the non-differentiability of involved metrics, and several metric-embedded loss functions are innovatively customized combining IGD, enabling NNs to be trained efficiently in a 'gradient-descent-like' manner. Moreover, the deep Bidirectional Long Short-Term Memory (BiLSTM) is adopted to capture the periodicity of renewable generation (diurnal and seasonal patterns), and the residual technique is used to improve the training efficiency of the deep BiLSTM. Finally, a Deep Quantile Forecast Network (DQFN) based on IGD and deep residual BiLSTM is developed for wind and solar power quantile forecasting. Practical experiments in four cases have verified the effectiveness and efficiency of DQFN and IGD, where DQFN has achieved the lowest average proportion deviations (all below 1.7%) and the highest skill scores. Highlights: First study on the differentiability of quantile forecast evaluation metrics. The obstacles of applying deep learning to quantile forecast are revealed. IGD is proposed to overcome the nondifferentiability of quantile evaluation metrics. The IGD is GPU-compatible and time-efficient. A deep-learning-based non-parametric quantile forecast model is developed.