Wind Power Group Prediction Model Based on Multi-Task Learning
Abstract
:1. Introduction
- (1)
- The dimensionality of WS, WD, temperature, humidity, and pressure data of each WF is reduced based on the principal component analysis algorithm, and the input feature set of the WPP model is formed together with the original meteorological attributes.
- (2)
- A Bi_GRU network is built as the base learner and a multi-task learning mechanism is designed based on the MMoE algorithm to train the power of multiple WFs in space at the same time to improve modeling efficiency.
- (3)
- Simulation experiments were conducted on the data provided by eight WFs in Jilin Province, China, and RMSE and MAE indexes were used to evaluate the prediction performance.
2. Materials and Methods
2.1. Power Group Prediction of Wind Power Cluster
2.2. The MMoe Multi-Task Learning Framework
2.3. Bidirectional Gated Recurrent Unit
3. Technical Route
- (1)
- The WS, WD, temperature, humidity, pressure, and other attributes of different WFs are collected to form a spatial feature matrix, which is used as the original input of the model. Based on the above features, the principal component analysis algorithm is used to reduce the dimensionality of each attribute, and the combination of the original feature matrix and the space matrix after dimensionality reduction is taken as the input.
- (2)
- A multi-output model based on the MMoE framework is designed, in which Bi_GRU is used as the base learner.
- (3)
- The dataset is divided into the training set, verification set, and test set. The wind power group prediction model is trained on the training set, the network parameters are fine−tuned by the validation set, and the performance of the model is tested on the test set.
4. Experimental Analysis
4.1. Dataset and Network Parameters
4.2. Error Evaluation Index
4.3. Experimental Results
5. Conclusions
- •
- The principal component analysis algorithm is used to extract features from meteorological data of multiple wind farms, and the dimensionality of the data is reduced from 48 to 8 dimensions by screening the principal component components, which reduces the complexity of the model.
- •
- The STWPP of the wind power cluster is designed based on multi-task learning, and the power prediction sequence of all wind farms in the output region is synchronized, which simplifies the modeling complexity.
- •
- The average RMSE of the MMoE−PCA−Bi_GRU model for eight wind farms is 0.1754; compared with the model predicted by each wind farm separately, the prediction precision has been significantly improved.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- International Energy Agency. Renewables 2019. Available online: https://www.iea.org/reports/renewables-2019 (accessed on 15 July 2023).
- Yang, M.; Shi, C.; Liu, H. Day-ahead wind power forecasting based on the clustering of equivalent power curves. Energy 2021, 218, 119515. [Google Scholar] [CrossRef]
- Lu, P.; Ye, L.; Zhao, Y. Review of meta-heuristic algorithms for wind power prediction: Methodologies, applications and challenges. Appl. Energy 2021, 301, 117446. [Google Scholar] [CrossRef]
- Ma, Z.; Mei, G. A hybrid attention-based deep learning approach for wind power prediction. Appl. Energy 2022, 323, 119608. [Google Scholar] [CrossRef]
- Alkesaiberi, A.; Harrou, F.; Sun, Y. Efficient wind power prediction using machine learning methods: A comparative study. Energies 2022, 15, 2327. [Google Scholar] [CrossRef]
- Potter, C.W.; Negnevitsky, M. Very short-term wind forecasting for Tasmanian power generation. IEEE Trans. Power Syst. 2006, 21, 965–972. [Google Scholar] [CrossRef]
- Tawn, R.; Browell, J. A review of very short-term wind and solar power forecasting. Renew. Sustain. Energy Rev. 2022, 153, 111758. [Google Scholar] [CrossRef]
- Xue, Y.; Lei, X.; Xue, F. A Review on Impacts of Wind Power Uncertainties on Power Systems. Proc. CSEE 2014, 34, 5029–5040. [Google Scholar]
- Rajagopalan, S.; Santoso, S. Wind power forecasting and error analysis using the autoregressive moving average modeling. In Proceedings of the 2009 IEEE Power & Energy Society General Meeting, Calgary, AB, Canada, 26–30 July 2009; pp. 1–6. [Google Scholar]
- Billinton, R.; Chen, H.; Ghajar, R. A sequential simulation technique for adequacy evaluation of generating systems including wind energy. IEEE Trans. Energy Convers. 1996, 11, 728–734. [Google Scholar] [CrossRef]
- Foley, A.M.; Leahy, P.G.; Marvuglia, A. Current methods and advances in forecasting of wind power generation. Renew. Energy 2012, 37, 1–8. [Google Scholar] [CrossRef]
- Hanifi, S.; Liu, X.; Lin, Z. A critical review of wind power forecasting methods—Past, present and future. Energies 2020, 13, 3764. [Google Scholar] [CrossRef]
- Wang, Y.; Zou, R.; Liu, F. A review of wind speed and wind power forecasting with deep neural networks. Appl. Energy 2021, 304, 117766. [Google Scholar] [CrossRef]
- Rayi, V.K.; Mishra, S.P.; Naik, J. Adaptive VMD based optimized deep learning mixed kernel ELM autoencoder for single and multistep wind power forecasting. Energy 2022, 244, 122585. [Google Scholar] [CrossRef]
- Xing, Z.; Qu, B.; Liu, Y. Comparative study of reformed neural network based short-term wind power forecasting models. IET Renew. Power Gener. 2022, 16, 885–899. [Google Scholar] [CrossRef]
- Du, P.; Wang, J.; Yang, W. A novel hybrid model for short-term wind power forecasting. Appl. Soft Comput. 2019, 80, 93–106. [Google Scholar] [CrossRef]
- Duan, J.; Wang, P.; Ma, W. Short-term wind power forecasting using the hybrid model of improved variational mode decomposition and Correntropy Long Short -term memory neural network. Energy 2021, 214, 118980. [Google Scholar] [CrossRef]
- Zhang, Y.; Li, Y.; Zhang, G. Short-term wind power forecasting approach based on Seq2Seq model using NWP data. Energy 2020, 213, 118371. [Google Scholar] [CrossRef]
- Ding, M.; Zhou, H.; Xie, H. A gated recurrent unit neural networks based wind speed error correction model for short-term wind power forecasting. Neurocomputing 2019, 365, 54–61. [Google Scholar] [CrossRef]
- Ko, M.; Lee, K.; Kim, J.K. Deep Concatenated Residual Network with Bidirectional LSTM for One-Hour-Ahead Wind Power Forecasting. IEEE Trans. Sustain. Energy 2020, 12, 1321–1335. [Google Scholar] [CrossRef]
- Mei, Y.; Zhuo, Z.; Xlac, D. Superposition Graph Neural Network for offshore wind power prediction. Future Gener. Comput. Syst. 2020, 113, 145–157. [Google Scholar]
- Yang, M.; Wang, D.; Zhang, W. A short-term wind power prediction method based on dynamic and static feature fusion mining. Energy 2023, 280, 128226. [Google Scholar] [CrossRef]
- Yang, M.; Wang, D.; Xu, C. Power transfer characteristics in fluctuation partition algorithm for wind speed and its application to wind power forecasting. Renew. Energy 2023, 211, 582–594. [Google Scholar] [CrossRef]
- Kumari, R.; Ashok, N.; Ghosal, T. Misinformation detection using multitask learning with mutual learning for novelty detection and emotion recognition. Inf. Process. Manag. 2021, 58, 102631. [Google Scholar] [CrossRef]
- Ma, J.; Zhao, Z.; Yi, X. Modeling task relationships in multi-task learning with multi-gate mixture-of-experts. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK, 19–23 August 2018; pp. 1930–1939. [Google Scholar]
- Liu, H.; Han, H.; Sun, Y. Short-term wind power interval prediction method using VMD-RFG and Att-GRU. Energy 2022, 251, 123807. [Google Scholar] [CrossRef]
- Liu, X.; Yang, L.; Zhang, Z. Short-term multi-step ahead wind power predictions based on a novel deep convolutional recurrent network method. IEEE Trans. Sustain. Energy 2021, 12, 1820–1833. [Google Scholar] [CrossRef]
Name of Parameter | Parameter Values | |||
---|---|---|---|---|
Network structure | Multi-task layer | MMoE | Number of neurons | 32 |
Number of experts | 4 | |||
Number of tasks | 8 | |||
Subtask layer | Bi_GRU | Number of neurons | 16 | |
Dropout | Ratio | 0.2 | ||
Bi_GRU | Number of neurons | 32 | ||
Dropout | Ratio | 0.2 | ||
Bi_GRU | Number of neurons | 16 | ||
Dense | Number of neurons | 1 | ||
Network parameter | Activation function | Relu | ||
Last layer activation function | Linear | |||
Multi-task loss function weights | Average | |||
optimizer | Adam | |||
Number of iterations | 5000 | |||
Loss function | mse |
I | Degree of Correlation |
---|---|
<0.3 | Weak correlation |
[0.3, 0.5) | Low correlation |
[0.5, 0.8) | Significant correlation |
[0.8, 1] | Strong correlation |
Farm/Cluster | RMSE | MAE | MEP(%) | |||
---|---|---|---|---|---|---|
November | December | November | December | November | December | |
Farm 1 | 0.1769 | 0.1959 | 0.1404 | 0.1476 | 21.22 | 23.32 |
Farm 2 | 0.1763 | 0.1939 | 0.1361 | 0.1441 | 20.83 | 22.18 |
Farm 3 | 0.1575 | 0.1417 | 0.1165 | 0.1021 | 18.69 | 16.84 |
Farm 4 | 0.1872 | 0.1461 | 0.1399 | 0.1146 | 19.17 | 16.03 |
Farm 5 | 0.1970 | 0.1554 | 0.1553 | 0.1211 | 27.71 | 16.98 |
Farm 6 | 0.1595 | 0.1536 | 0.1274 | 0.1159 | 18.46 | 16.34 |
Farm 7 | 0.1739 | 0.2214 | 0.1338 | 0.1731 | 18.04 | 18.56 |
Farm 8 | 0.1793 | 0.1822 | 0.1445 | 0.1415 | 18.41 | 18.97 |
Average | 0.1760 | 0.1738 | 0.1367 | 0.1325 | 20.32 | 18.65 |
Cluster | 0.1394 | 0.1302 | 0.1114 | 0.1023 | 16.43 | 16.02 |
Farm/Cluster | RMSE | MAE | MEP | |||
---|---|---|---|---|---|---|
November | December | November | December | November | December | |
Farm 1 | 0.2077 | 0.1889 | 0.1655 | 0.1442 | 22.56 | 20.88 |
Farm 2 | 0.1818 | 0.1875 | 0.1384 | 0.1375 | 18.59 | 19.03 |
Farm 3 | 0.1549 | 0.1377 | 0.1238 | 0.1068 | 16.54 | 15.58 |
Farm 4 | 0.2008 | 0.1509 | 0.1542 | 0.1156 | 20.35 | 16.87 |
Farm 5 | 0.2184 | 0.1618 | 0.1690 | 0.1256 | 20.79 | 17.89 |
Farm 6 | 0.1672 | 0.1542 | 0.1308 | 0.1128 | 17.03 | 17.25 |
Farm 7 | 0.1927 | 0.2396 | 0.1497 | 0.1868 | 21.22 | 29.38 |
Farm 8 | 0.1837 | 0.1871 | 0.1461 | 0.1424 | 21.32 | 20.16 |
Average | 0.1837 | 0.1760 | 0.1472 | 0.1340 | 19.80 | 19.63 |
Cluster | 0.1547 | 0.1406 | 0.1220 | 0.1078 | 0.1673 | 0.1639 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Wang, D.; Yang, M.; Zhang, W. Wind Power Group Prediction Model Based on Multi-Task Learning. Electronics 2023, 12, 3683. https://doi.org/10.3390/electronics12173683
Wang D, Yang M, Zhang W. Wind Power Group Prediction Model Based on Multi-Task Learning. Electronics. 2023; 12(17):3683. https://doi.org/10.3390/electronics12173683
Chicago/Turabian StyleWang, Da, Mao Yang, and Wei Zhang. 2023. "Wind Power Group Prediction Model Based on Multi-Task Learning" Electronics 12, no. 17: 3683. https://doi.org/10.3390/electronics12173683
APA StyleWang, D., Yang, M., & Zhang, W. (2023). Wind Power Group Prediction Model Based on Multi-Task Learning. Electronics, 12(17), 3683. https://doi.org/10.3390/electronics12173683