Multiple-Load Forecasting for Integrated Energy System Based on Copula-DBiLSTM
Abstract
:1. Introduction
2. Copula Theory Analysis
3. Deep Bidirectional Long and Short-Term Memory Neural Network Model
3.1. Long and Short-Term Memory Neural Network
- Forgetting gate:
- Input gate:
- Output gate:
3.2. Deep Bidirectional Long and Short-Term Memory Neural Network
4. Construction of Copula-DBiLSTM Model
4.1. Model Input and Output Settings
4.2. Copula-DBiLSTM Forecasting Model Framework
5. Case Analysis
5.1. Experimental Data Introduction
5.2. Copula Correlation Analysis Results
5.3. Model Parameter Setting
5.4. Analysis of Copula-DBiLSTM Forecasting Results
5.5. Comparative Analysis of Different Models
- GPR was only applicable to small-scale data and required relatively high regularity of data, so the forecasting effect was the worst;
- Although the forecasting result of BP-NN was better than that of GPR, the performance of the model was also poor due to the inability to remember the information of long time-series and the tendency of gradient disappearance or gradient explosion;
- In the Copula-LSTM model, LSTM neural network could improve the problems of the traditional neural networks, such as gradient disappearance, and its internal structure had a memory unit, which was very suitable for learning long time series. Therefore, compared with the above two models, the forecasting accuracy was greatly improved. However, LSTM neural network only conducted one-way learning on historical data, so it could not effectively learn more information contained in historical data;
- The model proposed in this paper comprehensively considered the impact of weather and calendar rules on the multiple loads. Through Copula correlation analysis, the optimal feature set was selected as the input of the model and combined with the DBiLSTM neural network. It could learn historical data from both forward and backward directions. The model could learn more useful information, and the forecasting accuracy showed a certain improvement compared with the above model.
5.6. Comparison of Different Neural Network Structures
5.7. Comparison of Single Load Forecasting and Multiple Load Forecasting
6. Conclusions
- The Copula correlation analysis method was used to screen out the influencing factors with greater correlation with the multiple loads as the input feature set of the model, which could construct a suitable input feature set, eliminate the influence of interference factors, and improve the forecasting accuracy of the model;
- The DBiLSTM neural network was suitable for long-term sequence forecasting, and due to its unique bidirectional learning advantage of historical data; it could learn the useful information contained in historical data more comprehensively;
- Due to the close coupling of multiple loads in the IES system, the multiple load forecasting model considered the influence of the other two loads compared with the single-load forecasting model so that the model could learn more useful information. Moreover, the time-costs of a multiple-load forecasting model were lower than that of a single-load forecasting model because there was no need to forecast all kinds of loads independently. Hence, it had many advantages.
- Due to the close coupling of multiple energy sources within IES, the system was affected by real-time electricity prices, gas prices and other factors during optimized operation. At the same time, these price factors will also affect users’ energy consumption habits. Therefore, price factors could be considered in the input feature set to construct a more suitable input feature set;
- Since the selection of the number of hidden layers and neurons of the neural network was determined based on several experiments, the subsequent research could find some methods to optimize these parameters.
- Since the intelligent terminal equipment may produce abnormal data or missing data in the process of data collection, the identification of abnormal data and the supplement of missing data before model training is also a direction worthy of further research.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Chaaraoui, S.; Bebber, M.; Meilinger, S.; Rummeny, S.; Schneiders, T.; Sawadogo, W.; Kunstmann, H. Day-Ahead Electric Load Forecast for a Ghanaian Health Facility Using Different Algorithms. Energies 2021, 14, 409. [Google Scholar] [CrossRef]
- Chen, W.N.; Hu, Z.J.; Yue, J.P.; Du, Y.X.; Qi, Q. Short-term load prediction based on combined model of long short-term memory network and light gradient boosting machine. Autom. Electr. Power Syst. 2021, 45, 91–97. [Google Scholar]
- Sun, Q.K.; Wang, X.J.; Zhang, Y.Z.; Zhang, F.; Zhang, P.; Gao, W.Z. Multiple load prediction of integrated energy system based on LSTM-MTL. Autom. Electr. Power Syst. 2021, in press. [Google Scholar]
- Ma, H.; Chen, Q.; Hu, B.; Sun, Q.; Li, T.; Wang, S. A compact model to coordinate flexibility and efficiency for decomposed scheduling of integrated energy system. Appl. Energy 2021, 285, 116474. [Google Scholar] [CrossRef]
- Hwang, J.S.; Fitri, I.R.; Kim, J.-S.; Song, H. Optimal ESS Scheduling for Peak Shaving of Building Energy Using Accuracy-Enhanced Load Forecast. Energies 2020, 13, 5633. [Google Scholar] [CrossRef]
- Zheng, Z.; Chen, H.; Luo, X. A Kalman filter-based bottom-up approach for household short-term load forecast. Appl. Energy 2019, 250, 882–894. [Google Scholar] [CrossRef]
- Lopez, J.C.; Rider, M.J.; Wu, Q. Parsimonious Short-Term Load Forecasting for Optimal Operation Planning of Electrical Distribution Systems. IEEE Trans. Power Syst. 2019, 34, 1427–1437. [Google Scholar] [CrossRef] [Green Version]
- Aprillia, H.; Yang, H.-T.; Huang, C.-M. Optimal Decomposition and Reconstruction of Discrete Wavelet Transformation for Short-Term Load Forecasting. Energies 2019, 12, 4654. [Google Scholar] [CrossRef] [Green Version]
- Li, Y.; Che, J.; Yang, Y. Subsampled support vector regression ensemble for short term electric load forecasting. Energy 2018, 164, 160–170. [Google Scholar] [CrossRef]
- Mayur, B.; Nalin, B.D.C. Season specific approach for short-term load forecasting based on hybrid FA-SVM and similarity concept. Energy 2019, 174, 886–896. [Google Scholar]
- Liu, D.; Sun, K. Random forest solar power forecast based on classification optimization. Energy 2019, 187, 115940. [Google Scholar] [CrossRef]
- Wang, Z.; Hong, T.; Piette, M.A. Building thermal load prediction through shallow machine learning and deep learning. Appl. Energy 2020, 263, 114683. [Google Scholar] [CrossRef] [Green Version]
- Niu, Z.; Yu, Z.; Tang, W.; Wu, Q.; Reformat, M. Wind power forecasting using attention-based gated recurrent unit network. Energy 2020, 196, 117081. [Google Scholar] [CrossRef]
- Zhang, X.; Chan, K.W.; Li, H.; Wang, H.; Qiu, J.; Wang, G. Deep-Learning-Based Probabilistic Forecasting of Electric Vehicle Charging Load With a Novel Queuing Model. IEEE Trans. Cybern. 2020, 99, 1–14. [Google Scholar] [CrossRef]
- Cao, Z.; Wan, C.; Zhang, Z.; Li, F.; Song, Y. Hybrid Ensemble Deep Learning for Deterministic and Probabilistic Low-Voltage Load Forecasting. IEEE Trans. Power Syst. 2020, 35, 1881–1897. [Google Scholar] [CrossRef]
- Li, R.; Sun, F.; Ding, X.; Han, Y.; Liu, Y.P.; Yan, J.R. Ultra short-term load forecasting for user-level integrated energy system considering multi-energy spatio-temporal coupling. Power Syst. Technol. 2020, 44, 4121–4134. [Google Scholar]
- Zhu, R.; Guo, W.; Gong, X. Short-Term Load Forecasting for CCHP Systems Considering the Correlation between Heating, Gas and Electrical Loads Based on Deep Learning. Energies 2019, 12, 3308. [Google Scholar] [CrossRef] [Green Version]
- Yang, X.; Chen, B.C.; Zhu, L.; Fang, C. Short-term public building load probability density prediction based on correlation analysis and long- and short-term memory network quantile regression. Power Syst. Technol. 2019, 43, 3061–3071. [Google Scholar]
- Wan, J.H.; Su, H.; Feng, D.H.; Zhao, Y.; Fan, Y.; Yu, B. Analysis and evaluation of the complementarity characteristics of wind and photovoltaic considering source-load matching. Power Syst. Technol. 2020, 44, 3219–3226. [Google Scholar]
- Chen, J.P.; Hu, Z.J.; Chen, W.N.; Gao, M.X.; Du, Y.X.; Lin, M.R. Load prediction of integrated energy system based on quadratic modal decomposition and DBiLSTM-MLR. Autom. Electr. Power Syst. 2021, in press. [Google Scholar]
- NSRDB Data Viewer. Available online: https://maps.nrel.gov/nsrdb-viewer/ (accessed on 25 November 2020).
- Li, F.; Li, C.Y.; Yang, Y.; Yan, Q.Q.; Zhao, J.B.; Wang, L.J. Short-term photovoltaic power probability forecasting based on OLPP-GPR and modified clearness index. J. Eng. 2017, 1, 1625–1628. [Google Scholar]
Influencing Factors | Electric Load | Cooling Load | Heating Load | Average Correlation Coefficient |
---|---|---|---|---|
Electric load | 1.0000 | 0.3317 | −0.3209 | 0.5509 |
Cooling load | 0.3317 | 1.0000 | −0.7737 | 0.7018 |
Heating load | −0.3209 | −0.7737 | 1.0000 | 0.6982 |
Temperature | 0.2778 | 0.6694 | −0.7114 | 0.5529 |
Wind speed | 0.1239 | 0.0591 | −0.1254 | 0.1028 |
Humidity | −0.2451 | −0.2789 | 0.4180 | 0.3140 |
Direct normal irradiance | 0.3651 | 0.1957 | −0.3521 | 0.3043 |
Global horizontal irradiance | 0.3843 | 0.2528 | −0.4098 | 0.3490 |
Dew point | 0.0800 | 0.3778 | −0.2717 | 0.2432 |
Holidays | −0.0481 | −0.0261 | 0.0299 | 0.0347 |
Months | 0.1714 | 0.3348 | −0.2447 | 0.2503 |
Weeks | −0.2113 | −0.0295 | 0.0004 | 0.0804 |
Days | 0.0164 | 0.0303 | −0.0296 | 0.0254 |
Hours | 0.2823 | 0.1365 | −0.1237 | 0.1808 |
Model | EMAPE | ERMSE | EMAE | EMSE | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Electric (%) | Cooling (%) | Heating (%) | Electric (MW) | Cooling (kTon) | Heating (mmBTU) | Electric (MW) | Cooling (kTon) | Heating (mmBTU) | Electric (MW2) | Cooling (kTon2) | Heating (mmBTU2) | |
Model 1 | 0.89 | 1.40 | 1.06 | 0.179 | 0.193 | 0.274 | 0.142 | 0.141 | 0.226 | 0.032 | 0.037 | 0.075 |
Model 2 | 1.25 | 1.95 | 1.59 | 0.238 | 0.253 | 0.423 | 0.194 | 0.191 | 0.349 | 0.057 | 0.064 | 0.179 |
Model | EMAPE | ERMSE | EMAE | EMSE | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Electric (%) | Cooling (%) | Heating (%) | Electric (MW) | Cooling (kTon) | Heating (mmBTU) | Electric (MW) | Cooling (kTon) | Heating (mmBTU) | Electric (MW2) | Cooling (kTon2) | Heating (mmBTU2) | |
Copula-DBiLSTM | 0.89 | 1.40 | 1.06 | 0.179 | 0.193 | 0.274 | 0.142 | 0.141 | 0.226 | 0.032 | 0.037 | 0.075 |
GPR | 1.78 | 3.16 | 4.55 | 0.417 | 0.366 | 1.157 | 0.310 | 0.301 | 1.016 | 0.174 | 0.134 | 1.338 |
BP-NN | 1.64 | 3.59 | 3.69 | 0.353 | 0.409 | 1.087 | 0.283 | 0.363 | 0.893 | 0.124 | 0.167 | 1.181 |
Copula-LSTM | 1.24 | 2.08 | 1.86 | 0.233 | 0.255 | 0.476 | 0.190 | 0.210 | 0.426 | 0.054 | 0.065 | 0.227 |
Number of Hidden Layers | EMAPE | Training Time (s) | ||
---|---|---|---|---|
Electric (%) | Cooling (%) | Heating (%) | ||
1 | 1.91 | 2.35 | 2.34 | 536.49 |
2 | 0.89 | 1.40 | 1.06 | 706.12 |
3 | 1.20 | 2.05 | 4.49 | 994.98 |
4 | 1.68 | 3.62 | 3.42 | 1487.32 |
Number of Hidden Layers | EMAPE | Training Time (s) | ||
---|---|---|---|---|
Electric (%) | Cooling (%) | Heating (%) | ||
32/64 | 1.64 | 2.17 | 2.37 | 565.38 |
50/100 | 0.89 | 1.40 | 1.06 | 706.12 |
64/128 | 1.54 | 1.89 | 1.99 | 892.67 |
100/200 | 1.79 | 2.07 | 2.57 | 1200.98 |
Model | EMAPE | Time | |||
---|---|---|---|---|---|
Electric (%) | Cooling (%) | Heating (%) | Training (s) | Forecast (s) | |
Single-load forecasting | 1.14 | 1.96 | 2.04 | 2105.08 | 26.67 |
Multiple-load forecasting | 0.89 | 1.40 | 1.06 | 706.12 | 9.24 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Zheng, J.; Zhang, L.; Chen, J.; Wu, G.; Ni, S.; Hu, Z.; Weng, C.; Chen, Z. Multiple-Load Forecasting for Integrated Energy System Based on Copula-DBiLSTM. Energies 2021, 14, 2188. https://doi.org/10.3390/en14082188
Zheng J, Zhang L, Chen J, Wu G, Ni S, Hu Z, Weng C, Chen Z. Multiple-Load Forecasting for Integrated Energy System Based on Copula-DBiLSTM. Energies. 2021; 14(8):2188. https://doi.org/10.3390/en14082188
Chicago/Turabian StyleZheng, Jieyun, Linyao Zhang, Jinpeng Chen, Guilian Wu, Shiyuan Ni, Zhijian Hu, Changhong Weng, and Zhi Chen. 2021. "Multiple-Load Forecasting for Integrated Energy System Based on Copula-DBiLSTM" Energies 14, no. 8: 2188. https://doi.org/10.3390/en14082188
APA StyleZheng, J., Zhang, L., Chen, J., Wu, G., Ni, S., Hu, Z., Weng, C., & Chen, Z. (2021). Multiple-Load Forecasting for Integrated Energy System Based on Copula-DBiLSTM. Energies, 14(8), 2188. https://doi.org/10.3390/en14082188