Next Article in Journal
GRACE Downscaler: A Framework to Develop and Evaluate Downscaling Models for GRACE
Previous Article in Journal
Eddy Detection in the Marginal Ice Zone with Sentinel-1 Data Using YOLOv5
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Technical Note

Assessment of a New Solar Radiation Nowcasting Method Based on FY-4A Satellite Imagery, the McClear Model and SHapley Additive exPlanations (SHAP)

1
College of Urban Environment, Lanzhou City University, Lanzhou 730070, China
2
Key Laboratory of Land Surface Process and Climate Change in Cold and Arid Regions/Northwest Institute of Eco-Environment and Resources, Chinese Academy of Sciences, Lanzhou 730000, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2023, 15(9), 2245; https://doi.org/10.3390/rs15092245
Submission received: 8 March 2023 / Revised: 19 April 2023 / Accepted: 22 April 2023 / Published: 24 April 2023

Abstract

:
The global warming effect has been accelerating rapidly and poses a threat to human survival and health. The top priority to solve this problem is to provide reliable renewable energy. To achieve this goal, it is important to provide fast and accurate solar radiation predictions based on limited observation data. In this study, a fast and accurate solar radiation nowcasting method is proposed by combining FY-4A satellite data and the McClear clear sky model under the condition of only radiation observation. The results show that the random forest (RF) performed better than the support vector regression (SVR) model and the reference model (Clim-Pers), with the smallest normalized root mean square error (nRMSE) values (between 13.90% and 33.80%), smallest normalized mean absolute error (nMAE) values (between 7.50% and 24.77%), smallest normalized mean bias error (nMBE) values (between −1.17% and 0.7%) and highest R2 values (between 0.76 and 0.95) under different time horizons. In addition, it can be summarized that remote sensing data can significantly improve the radiation forecasting performance and can effectively guarantee the stability of radiation predictions when the time horizon exceeds 60 min. Furthermore, to obtain the optimal operation efficiency, the prediction results were interpreted by introducing the latest SHapley Additive exPlanation (SHAP) method. From the interpretation results, we selected the three key channels of an FY-4A and then made the model lightweight. Compared with the original input model, the new one predicted the results more rapidly. For instance, the lightweight parameter input model needed only 0.3084 s (compared to 0.5591 s for full parameter input) per single data point on average for the 10 min global solar radiation forecast in Yuzhong. Meanwhile, the prediction effect also remained stable and reliable. Overall, the new method showed its advantages in radiation prediction under the condition that only solar radiation observations were available. This is very important for radiation prediction in cities with scarce meteorological observation, and it can provide a reference for the location planning of photovoltaic power stations.

1. Introduction

In recent decades, with the continuous growth of the global population and excessive carbon emissions, the global greenhouse effect have been accelerating rapidly. These factors pose a threat to human survival and health [1]. The United Nations Environment Program claimed that the emission reduction target of each country is far from the 1.5 °C target [2]. More and more countries are reducing the emissions gap by participating in climate actions, such as carbon neutrality. To achieve the goal of carbon neutrality and meet industrial and living requirements in the foreseeable future, it is necessary to replace traditional energy with renewable energy. Because of its outstanding performance in noise, carbon emissions and operations, solar energy has an obvious advantage over other renewable energies [3].
As one of the largest carbon emitters, most of China’s electricity is still supplied by fossil fuels. However, the widespread use of traditional energy emits large amounts of greenhouse gases (such as CH4, SO2 and CO), which is not conducive to meeting China’s commitment to achieve carbon neutrality by 2060 [1,4]. Therefore, the extensive use of solar energy is one of the important ways to achieve this goal. However, contrary to traditional power, solar electricity generation is impacted by transient clouds, aerosols and weather and is, thus, highly intermittent. This affects the layout and development of the photovoltaic industry [5,6,7]. The maintenance cost of PV can be controlled and predicted through the prior knowledge of the expected power output. Accurate predictions of solar radiation are the premise for realizing photovoltaic power generation, and they are one of the most important bases for establishing photovoltaic electric fields.
By summarizing previous studies, solar forecasting methods can be simply classified into four groups by data type and method [8]: (1) data-driven methods (e.g., [9,10]), (2) camera-based methods (e.g., [11,12]), (3) satellite-based methods (e.g., [13,14]) and (4) numerical weather predictions (NWP) (e.g., [15]). The data-driven method is applicable to all forecast horizons, but it is usually applied to 1-h ahead forecasting. While camera-based and satellite-based methods generally forecast based on continuous images, the forecasting time of the camera-based method is usually within 1 h, and the forecasting time of the satellite-based method can be extended from 0.5 h to 6 h. In terms of estimation algorithms, the existing universally applicable methods are relatively high on a large scale, but their calculation speed is greatly reduced when the number of input parameters is large. Consequently, current methods cannot easily meet the needs of real-time observation and cannot cope with massive satellite data. In addition, under the premise of ensuring inversion accuracy, attention should be given to the efficiency of the data and the improvement of inversion efficiency in the future, such as through the efficient combination of look-up table (LUT) methods and deep learning and other artificial intelligence methods to promote the development of high-precision solar radiation products [11,12,13,14]. At the same time, the data-driven prediction method requires multiple data inputs from a first-class (meteorological) station, which are rarely available due to potential calibration problems [16]. Therefore, how to provide solar forecasts with high spatial and temporal resolutions at a low cost has become an essential research topic. For radiation forecasts, the choice of research methods is also crucial. Most of the existing methods cannot solve the complex nonlinear relationships in a noisy environment [17]. Therefore, an increasing number of researchers have chosen to apply machine learning methods to solar radiation prediction with the development of artificial intelligence. The research shows that the artificial neural network can complete radiation prediction tasks well. Deo et al. [18] developed a support vector machine-wavelet-coupled model (WSVM). By inputting meteorological observation parameters, the model can output reliable daily forecast horizons. Yagli et al. [19] combined this system with a machine learning method to correct the bias. The research results show that the bias-corrected satellite-derived data can generate prediction products with the same prediction accuracy as the observation data.
The above research proves the feasibility of using machine learning in radiation prediction. However, most of the regions in China where large-scale PV power generation is planned lack the support of meteorological or other observation data. Therefore, how to use the limited radiation observation data to obtain high spatial and temporal resolution radiation predictions is worthy of in-depth study. By analyzing the main solar radiation-influencing factors, this study selected McClear (a clear sky model) and FY-4A data, which are easy to obtain, and developed a fast and accurate solar radiation nowcasting method based on machine learning. Based on the SHAP interpretation results, we selected three key channels on the FY-4A to improve the calculation speed of the model, and the role of remote sensing data in radiation prediction is also discussed. The new method can reduce the dependence of radiation predictions on other meteorological observation data and can be used to optimize the selection of geographical locations for photovoltaic power stations.

2. Data and Methodology

2.1. Introduction of the Research Process

In this study, FY-4A satellite imagery, solar radiation observations and a McClear-based machine learning regression model were developed to obtain the accurate global solar radiation forecasting. We compared two machine learning models that predict global solar radiation in Yuzhong, Minqin and Dunhuang. The datasets of the three urban indicators related to solar radiation were collected from July 2019 to June 2020. The operation steps of the method are briefly shown in in Figure 1. First, the data underwent quality control and a pretreatment. The radiation observation data at the current time, remote sensing data (different band combinations) and McClear data were used as the input parameters for machine learning, and the radiation observation data corresponding to the predicted time step were used as the output parameters. Data were randomly grouped into training and testing datasets at proportions of 70% and 30%, respectively. Next, the RF and SVR algorithms were introduced for model building. In order to find the optimal parameters, the grid search method was adopted to derive the hyperparameters. Furthermore, performance evaluations were performed based on the statistical indicators. Related indicators, such as nMAE, nMBE, nRMSE, Skillscore and R, were utilized to quantify the evaluation results. Then the optimal machine learning method was selected based on the comprehensive performance. Finally, in the interpretation and lightweight process, the lightweight parameter input model (based on the SHAP results) was established, and a comparison with the initial model in the same field was also made.

2.2. Data

2.2.1. FY-4A Satellite

The FY-4A used the SAST5000 platform and had a hexagonal cylinder structure, which had the advantages of a large surface area and a low centroid. The FY-4A satellite was equipped with advanced observation instruments, including an advanced interferometric atmospheric vertical detector, a space environment-monitoring instrument, a geostationary orbit radiation imager and a lightning imager.
The cloud image data of the Fengyun-4A satellite came from the National Meteorological Science Data Center (http://satellite.nsmc.org.cn/, accessed on 1 December 2016). The FY-4A carried a variety of payloads, including an advanced geosynchronous radiation imager (AGRI) (14 channels between 0.47 and 13.5 µm, with a spatial resolution of 0.5–4 km), an interferometric atmospheric vertical detector (GIIRS), a lightning imager (LMI) and a space environment-monitoring instrument (SEP). The spatial resolution of satellite images used in this study was 2 km × 2 km, and seven channels (0.45~4.00 μm; three channels for visible light, three channels for short-wave infrared and one channel for medium-wave infrared) were selected. First, we deleted the satellite images whose solar altitude angle was less than 10 degrees (the observation error was large due to the weak light). Secondly, geometric calibration and radiometric calibration were carried out for the cloud image. The cropped area of the cloud image was 32 km × 32 km, and the pixels in the inversion area were in the middle. Finally, the missing cloud images were interpolated using linear interpolation, and the regional average of the albedo of the 7 channels with a 10 min time resolution (matching the resolution of observation data) was obtained.

2.2.2. McClear Data

The McClear is a fully physical model parameterized by A, z and several parameters describing the optical state of the atmosphere. For clear-sky conditions, an irradiation time series is provided for any location in the world using information on aerosol, ozone and water vapor from the CAMS global forecasting system. Other properties, such as the ground albedo and ground elevation, are also considered. Similar time series are available for cloudy conditions, but since the high-resolution cloud information is directly inferred from satellite observations, these are currently only available inside the field-of-view of the Meteosat Second Generation (MSG) satellite, which is roughly over Europe, Africa, the Atlantic Ocean and the Middle East. Input quality control, regular quarterly benchmarking against ground stations and regular monitoring of the consistency and detecting of possible trends are performed.
In recent years, many studies have proved the reliability of McClear (including in China) [20,21]. Among them, global, direct and diffuse horizontal irradiations, as well as the beam normal irradiations of 1 min, 15 min, 1 h, daily and monthly time scales can be obtained directly by inputting longitude, latitude, altitude and output format (https://www.soda-pro.com/web-services/radiation/cams-mcclear, accessed on 1 January 2004). The global solar radiation of Yuzhong, Minqin and Dunhuang from June 2019 to July 2020 were downloaded with 1 min temporal resolution as one of the machine learning input parameters.

2.2.3. Observation

Ground solar radiation data were obtained from three meteorological observation stations in the Northwestern China, namely Yuzhong, Minqin and Dunhuang (Figure 2). Northwestern China accounts for 60% of the total installed capacity and grid of connected power in China due to its simple vegetation types, sparse population and arid climate. According to the standards of ISO 9060:1990 and WMO, all instruments were calibrated and maintained in time. The dataset used was from July 2019 to June 2020, and the temporal resolution was 1 min. These stations provided data of short-wave downward global radiations in W/m2, which were measured using the FS-S6 solar radiation sensor. The observation data in the input data were real-time matched with the remote sensing data, while the radiation data in output data were delayed matched based on the predicted time step. The geographic statistics of the 3 training and testing study sites are also listed in Table 1.

2.3. Methods

2.3.1. Machine Learning

According to previous research [3], SVR and RF are the best two models for estimating and predicting solar radiation in China’s regions. Therefore, this study used the following two methods to construct radiation prediction models and then selected the optimal model from them.
  • SVR model
The SVR model can be simply understood as creating a “gap zone” on both sides of the linear function, and the distance of this “gap zone” is ϵ (this value is often given according to experience). The optimized model is obtained by minimizing the total loss and maximizing the gap. Nonlinear models such as SVR can be spatially mapped by using kernel functions, and then the predicted values can be obtained by regression [22].
The prediction of x by the SVR method is given in the following formula:
y ˆ = i = 1 n α i k r b f ( x i , x ) + b
Parameter b can be calculated from specific conditions, and α i can be calculated by the difference between two Lagrange multipliers.
2.
RF model
The RF (random forest) method is an improved bagging regression tree. Because of its wide range of applications, high precision, difficulty in over-fitting and ability to process nonlinear data, the random forest method has been widely used in predictions and classifications in different fields [23]. RF theory was introduced in detail in Yu’s research [24].
Super-parameters were set in advance before training. In the study, the grid search was selected to optimize the super-parameters. For the SVR method, the hyperparametric optimization was mainly aimed at the type of kernel function (radial basis function, RBF, or linear kernel) and the penalty coefficient C. For RF, the hyperparametric optimization was mainly aimed at the following six super-parameters: the number of decision trees (n_estimators), the maximum depth of decision trees (max_depth), the minimum number of separated samples (min_samples_split), the minimum number of leaf node samples (min_samples_leaf), the maximum number of separated features (max_features) and whether to conduct random sampling (bootstrap).
3.
Reference model (Clim-Pers, combination of climatology and persistence model)
In order to ensure the comparability of the prediction models, this study introduced the reference method proposed by Yang for comparison. Yang effectively combines classic climatology and persistence methods by calculating lag autocorrelation [25]. The core parameters of the reference method are as follows.
The combination of climatology and the persistence model is chosen as the reference forecasts, namely,
y i = α x i h + ( 1 α ) μ
where α represents the weight on the persistence model, and 1 α is the weight on the climatology model and y i denotes the forecast value, respectively. For a variable of interest, x, the RMSE of the internal single-valued climatology is given by R M S E c . The RMSE of the climatology-persistence combination is thus given by R M S E c p .
R M S E c = 1 n i = 1 n ( μ x i ) 2 = σ
R M S E c p = 1 n i = 1 n [ α x i h + ( 1 α ) μ x i ] 2 = α 2 σ 2 + σ 2 2 α cov ( x i h , x i )
α = cov ( x i h , x i ) σ 2 = γ ( h )
where x i h denotes the lag-h autocorrelation (assuming the end effect is negligible), μ and σ denote the sample mean and standard deviation (assuming n is large).

2.3.2. Performance Evaluation

In order to evaluate the performance of the models, the Pearson correlation coefficient (R), the normalized mean absolute error (nMAE), the normalized root mean square error (nRMSE) and the normalized mean bias error (nMBE) were selected, as follows:
M A E = 1 N × i = 1 N | y i x i | n M A E = M A E x ¯ × 100 %
M B E = 1 N × i = 1 N ( y i x i ) n M B E = M B E x ¯ × 100 %
R M S E = 1 N × i = 1 N ( y i x i ) 2 n R M S E = R M S E x ¯ × 100 %
R = i = 1 N ( x i x ¯ ) ( y i y ¯ ) i = 1 N ( x i x ¯ ) i = 1 N ( y i y ¯ )
where x i and y i represent the measurements and predictions, respectively.
Although RMSEs are commonly used in radiation forecasting, in order to better reflect the accuracy of the prediction model, the continuous ranked probability score (skill score) was chosen in the probabilistic solar forecasting [26]:
s RMSE = 1 RMSE m o d e l RMSE c p

3. Results and Discussion

To avoid the impact of sample differences during the machine learning model training and testing processes, 70% of the data were randomly selected as the training data (the remaining 30% were selected as testing data) by using the random module in Python. These randomized data included the radiation observation data at the current time series, the McClear data and the regional average of cloud image albedos in different channels. It can be seen in Figure 3 that when the total amount of learning data was limited (the total amount of data used in this manuscript was from 1 year), the advantage of using random functions to select learning arrays was that they could contain various change rules to the greatest extent.

3.1. Assessing the Applicability of Machine Learning Methods

In order to accurately evaluate the solar radiation forecasting performances of different machine learning models, according to previous research [18], the two most effective machine learning models were selected (RF and SVR). At the same time, the effect of the outputting test data was also more reliable. The performance characteristics of the models were evaluated by utilizing the nRMSE, nMAE, nMBE and R.
The scatter diagrams of the measured and predicted values (RF and SVR) are presented for Yuzhong, Minqin and Dunhuang (Figure 4). The red and dark blue dots represent the high-density and low-density samples, respectively. This figure also presents the values of nMAE, nMBE, nRMSE, N (the number of samples) and the correlation coefficient (R), in addition to the 1:1 line (y = x).
The results showed that the overall RF and SVR prediction effects in each region were similar. In all study areas, the global solar radiation predictions utilizing RF were better than those utilizing SVR. According to the nMBE values in the figure, it can be clearly seen that using SVRs to predict the values may have a greater probability of positive deviations. Among them, the normalized mean bias error (nMBE) values of the global solar radiation predicted by the RF method in Minqin were the smallest (−0.0003%). The normalized root mean square error (nRMSE) values of global solar radiation utilizing RF in the Dunhuang area were the smallest (20.6963%). At the same time, the Pearson correlation coefficient (R) values were also the largest (0.8739) in Dunhuang (utilizing RF).

3.2. Comparison of the Accuracy Achieved by the RF, SVR and Reference Models

To analyze the rule of the forecast effect with the time horizons, the forecasting performances of 10, 20, 30, 40, 50, 60, 90, 120, 150 and 180 min are shown in Figure 5. The nRMSE, nMAE, nMBE and R2 metrics for the three methods are also shown in Figure 5.
The RF forecasts had a time-horizon averaged nRMSE of 16.36% at 10 min, and it increased steadily with the forecast time to 30.36% at 180 min. The nMAE values had a similar trend, which was 7.50% at 10 min and increased to 21.98% at 180 min (time horizon averaged). The R value was 0.95 at 10 min and decreased rapidly to 0.78 at 180 min (time horizon averaged). Unlike the other metrics, the values of nMBE fluctuated around 0. The nRMSE improvements of RF (and SVR) compared to Clim-Pers were 16.35 (15.00) percent points at 10 min and 35.84 (22.54) percent points at 180 min. Compared with the Clim-Pers reference model, the longer the time horizon was, the more obvious the improvement of the prediction effect.
The small nMAE and nMBE values of the Clim-Pers method are understandable, as the starting point was the observed irradiance. Unlike the forecast results, the Clim-Pers method underestimated the value of most in situ irradiance for all forecast times (based on the nMBE), especially in Dunhunag. The Clim-Pers had larger nRMSE and nMAE values than RF and SVR at all sites, but the R2 values of the Clim-Pers results were smaller. The main difference between Clim-Pers, RF and SVR may be due to cloud information, because remote cloud field development-sensing information was successfully added to RF and SVR. For the Clim-Pers model, the better accuracy at the start of the forecast was rapidly lost, resulting in higher nRMSE values after 60 min of forecast time at each site.
In general, compared with the reference model (Clim-Pers) and SVR, RF performed the best, with the time horizon averaging the smallest nRMSE values (between 13.90% and 33.80%), smallest nMAE values (between 7.50% and 24.77%), smallest nMBE values (between −1.17% and 0.7%) and highest R2 values (between 0.76 and 0.95).
Based on the reference model, we analyzed two machine learning methods in depth. A skill score comparison for Yuzhong, Minqin and Dunhuang is shown in Figure 6. In this case, RF was found to perform better at all three sites, especially when the time horizon was longer than 30 min. In the solar radiation forecasts of the three sites, the difference range of the SVR and RF skill scores changed from 0.0025–0.016 (0–30 min) to 0.012–0.140 (40–180 min). Among them, the maximum values of the skill score differences of the three sites all occurred at 180 min, with a range of 0.12–0.14.
In summary, there are few differences between the two radiation prediction machine learning models within 30 min, but RF showed better stability with increasing time horizons. Therefore, RF is a better machine learning method for building a solar radiation forecast model based on global solar radiation observations using McClear and satellite data in northwestern China. Compared with the research results of Ravinesh et al. [27], both methods can provide radiation predictions within an acceptable range. However, our method can provide more stable radiation prediction results as the time step increases, and it requires fewer operational and input parameters.

3.3. Importance Analysis and Lightweight Model Discussion

This research shows that the model’s running time is closely related to the number of input variables. A long running time and high-level computing requirements are not conducive to the future deployment of the model in the photovoltaic industry. Therefore, under the condition of maintaining the prediction accuracy, selecting input parameters that are highly related to the prediction results becomes increasingly important. To analyze the influence of the different input variables on the radiation prediction results at different time horizons in RF, the data of 10, 60, 120 and 180 min were interpreted by SHAP (SHapley Additive exPlanations).
The SHAP values of each feature are shown in the SHAP summary plot (Figure 7). The relationship between the size of the feature values and the predicted impacts can be seen through the color, and the distributions of the feature values are also displayed. On the X-axis, the output of the model is listed. On the Y-axis, features sorted according to their contributions are represented. This can clearly show the contribution of each feature to the overall forecasting. Therefore, the larger the average SHAP value is, the more important the feature is. Based on the SHAP results, the top five input variables with the highest impact on the model output were Observation, McClear, Channel 7, Channel 2 and Channel 1. In addition, Observation made the most important contribution to the model output, especially for ultrashort-term radiation forecasts within 60 min. The observation and forecast data show an obvious positive correlation, regardless of the time horizon. However, Channels 1 and 2 showed opposite correlations with the forecasts, and Channel 7 and McClear showed a positive correlation with the radiation forecasts within 60 min. It is worth noting that the correlation is not obvious over the range of 90 to 180 min.
In summary, among the input parameters, Observation, McClear and Channels 1, 2 and 7 had greater contributions to the global solar radiation forecast results. The impact of adding remote sensing data on the effectiveness of radiation predictions will be discussed in detail in the next section.
Table 2 shows that adding satellite data to the input data can significantly improve the radiation predictions. It is worth noting that the prediction effect without adding remote sensing data decreased rapidly after the time horizon exceeded 60 min. The specific details are that the values of the nRMSE and the nMAE continued to increase, and the prediction accuracy decreased rapidly. Among them, the range of nRMSE differences (excluding remote sensing data minus including remote sensing data) changed from 3.8777~6.044% with a time horizon of 60 min to 10.0181~13.8113% with a time horizon of 180 min; R2 changed from 0.6166 with a time horizon of 60 min to 0.1795 with a time horizon of 180 min. Therefore, it can be concluded that remote sensing data can improve radiation predictions and effectively guarantee the stability of radiation predictions when the time horizon exceeds 60 min.
In addition, the selection of remote sensing data channels can improve the operational efficiency of radiation predictions. By comparing the relevant data presented in Table 2, the variation ranges of the model running time differences between the full-channel and the three-channel models were from 585.9727 s to 1025.7605 s. At the same time, it is notable that the lightweight parameter input model had similar relevant performances to the all-parameters input model at any time horizon and that they had most of the same R2, nMAE, nRMSE and nMBE values.
In summary, adding remote sensing data to input variables can significantly improve radiation predictions under different time steps. Full-channel input of remote sensing data can provide better prediction results, but if time and calculation cost are considered, the optimal three-channel model is a better choice.

3.4. Discussion

In addition to the method’s accuracy, computational speed also plays a significant role in solar energy forecasts and, thus, should be considered here. The lightweight parameter input model computes the results more rapidly than the all-parameter input model. For instance, the lightweight parameter input model needed only 0.3084 s (compared to 0.5591 s for full-parameter input) per single data point on average for the 10 min global solar radiation forecast in Yuzhong when running on a computer with an i7-10700 CPU operating at 2.90 GHz and having 16 GB of RAM. As shown in Table 2, a similar conclusion can be drawn that models with lightweight input parameters had faster running speeds at different time horizons, and the time differences did not show a linear relationship with the time series. It is worth noting that the running speed of the model in the study is based on its implementation in Python language, while the running speed in other languages may be different.
It is worth noting that the running time of the models used in this study included the process of model establishment, super-parameter optimization and prediction. However, in the actual prediction process, the time proportion of model establishment and the super-parameter optimization were very high. Taking the 10 min radiation prediction in the Dunhuang area as an example, the running time of this part accounted for 99.9%. Therefore, if it is necessary to establish a prediction model in practical applications, the optimal channels (Channels 1, 2 and 7) can be selected for rapid radiation prediction. In contrast, if there is an established radiation prediction model, more accurate predictions can be quickly with the full channel model.

4. Conclusions

Simple and accurate prediction methods are usually the first choice of users. In this regard, it is now clear that if the dependence on high spatial and temporal resolution observation data could be reduced as much as possible, this radiation prediction method might be used more widely. This paper addresses the following question: How can limited observation data be effectively used to obtain fast and accurate solar forecasting? To the best of our knowledge, there are few studies using radiation observations combined with satellite remote sensing data and McClear-based machine learning in northwestern China. Different from the previous research on the improvement of model and forecast effects, this study focuses on the influence of feature contributions on prediction effects and operation speeds.
A common problem in machine learning is how to allocate training and test data reasonably. To avoid the impact of sample differences on the prediction effect of the model, 70% of the data were randomly selected as the training data of the model by using the random module in Python. The results showed that it is reasonable and effective to divide the learning and prediction data in this way.
In addition, machine learning methods have once again proven to be an important means to provide reliable solar radiation prediction results. The results showed good behavior, especially regarding the general use of RF. For the overall prediction effect, the prediction effect of global solar radiation utilizing RF was better than that utilizing SVR. At the same time, according to the nMBE values, it can be clearly seen that using SVR to predict the value would have a greater probability of a positive deviation. For the radiation predictions in different time horizons, compared with the reference model (Clim-Pers) and SVR, RF performed the best, with its time horizon averages having the smallest nRMSE values (between 13.90% and 33.80%), smallest nMAE values (between 7.50% and 24.77%), smallest nMBE values (between −1.17% and 0.7%) and highest R2 values (between 0.76 and 0.95).
More importantly, the study revealed the importance of using remote sensing data for adding radiation prediction results when only radiation observations are available. It is worth noting that the prediction effect without adding remote sensing data decreased rapidly after the time horizon exceeded 60 min. Based on the SHAP interpretation results, we selected three key channels (1, 2 and 7) on the FY-4A to improve the calculation speed of the model. The prediction results show that the differences in the predictions between the full-channel input and the three-channel input results did not change significantly with the time horizon. Therefore, on the premise of ensuring the computing ability, the full-channel input can provide more accurate prediction results. However, three-channel input can provide faster, accurate and reliable prediction results under the same conditions. The prediction time of 10 min per single data point on average in Yuzhong can be reduced from 0.5591 s to 0.3084 s.

Author Contributions

D.J.: conceptualization, writing—original draft, writing—review and editing, funding acquisition; L.Y.: data curation, software; X.G.: supervision, funding acquisition; K.L.: data curation. All authors have read and agreed to the published version of the manuscript.

Funding

This study was jointly supported by the Science and Technology Project of Gansu Province (No. 21JR7RA546) and Gansu Provincial Department of Education: University Teacher Innovation Fund Project (No. 2023B-151).

Acknowledgments

The authors would like to thank Chunxia Yuan, for the opportunity to work together with and for the help provided throughout this project.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chen, H.; Qi, S.; Tan, X. Decomposition and prediction of China’s carbon emission intensity towards carbon neutrality: From perspectives of national, regional and sectoral level. Sci. Total Environ. 2022, 825, 153839. [Google Scholar] [CrossRef] [PubMed]
  2. UNEP. The Emissions Gap Report 2019 [R/OL]. Available online: https://wedocs.unep.org/bitstream/handle/20.500.11822/30797/EGR2019.pdf?sequence=1&isAllowed=y (accessed on 26 November 2019).
  3. Jia, D.; Yang, L.; Lv, T.; Liu, W.; Gao, X.; Zhou, J. Evaluation of machine learning models for predicting daily global and diffuse solar radiation under different weather/pollution conditions. Renew. Energy 2022, 187, 896–906. [Google Scholar] [CrossRef]
  4. Zhang, Y.X.; Luo, H.L.; Can, W. Progress and trends of global carbon neutrality pledges. Clim. Chang. Res. 2021, 17, 88–97. [Google Scholar]
  5. Rodríguez-Benítez, F.J.; López-Cuesta, M.; Arbizu-Barrena, C.; Fernández-León, M.M.; Pamos-Ureña, M.Á.; Tovar-Pescador, J.; Santos-Alamillos, F.J.; Pozo-Vázquez, D. Assessment of new solar radiation nowcasting methods based on sky-camera and satellite imagery. Appl. Energy 2021, 292, 116838. [Google Scholar] [CrossRef]
  6. Brouwer, A.S.; Van Den Broek, M.; Seebregts, A.; Faaij, A. Impacts of large-scale intermittent renewable energy sources on electricity systems, and how these can be modeled. Renew. Sustain. Energy Rev. 2014, 33, 443–466. [Google Scholar] [CrossRef]
  7. Ela, E.; Tuohy, A.; Entriken, R.; Lannoye, E.; Philbrick, R. Using probabilistic renewable forecasts to determine reserve requirements. In Proceedings of the 7th Solar Integration Workshop. International Workshop on Integration of Solar Power into Power Systems, EPRI, Berlin, Germany, 24–25 October 2017; EPRI, Electric Power Research Institute: Singapore, 2017. [Google Scholar]
  8. Yang, D.; Kleissl, J.; Gueymard, C.A.; Pedro, H.T.; Coimbra, C.F. History and trends in solar irradiance and PV power forecasting: A preliminary assessment and review using text mining. Sol. Energy 2018, 168, 60–101. [Google Scholar] [CrossRef]
  9. Yagli, G.M.; Yang, D.; Srinivasan, D. Automatic hourly solar forecasting using machine learning models. Renew. Sustain. Energy Rev. 2019, 105, 487–498. [Google Scholar] [CrossRef]
  10. Yang, D. Ultra-fast preselection in lasso-type spatio-temporal solar forecasting problems. Sol. Energy 2018, 176, 788–796. [Google Scholar] [CrossRef]
  11. Mejia, F.A.; Kurtz, B.; Levis, A.; de la Parra, Í.; Kleissl, J. Cloud tomography applied to sky images: A virtual testbed. Sol. Energy 2018, 176, 287–300. [Google Scholar] [CrossRef]
  12. Kuhn, P.; Wilbert, S.; Prahl, C.; Schüler, D.; Haase, T.; Hirsch, T.; Wittmann, M.; Ramirez, L.; Zarzalejo, L.; Meyer, A.; et al. Shadow camera system for the generation of solar irradiance maps. Sol. Energy 2017, 157, 157–170. [Google Scholar] [CrossRef]
  13. André, M.; Perez, R.; Soubdhan, T.; Schlemmer, J.; Calif, R.; Monjoly, S. Preliminary assessment of two spatio-temporal forecasting technics for hourly satellite-derived irradiance in a complex meteorological context. Sol. Energy 2019, 177, 703–712. [Google Scholar] [CrossRef]
  14. Harty, T.M.; Holmgren, W.F.; Lorenzo, A.T.; Morzfeld, M. Intra-hour cloud index forecasting with data assimilation. Sol. Energy 2019, 185, 270–282. [Google Scholar] [CrossRef] [Green Version]
  15. Wu, E.; Clemesha, R.E.; Kleissl, J. Coastal stratocumulus cloud edge forecasts. Sol. Energy 2018, 164, 355–369. [Google Scholar] [CrossRef]
  16. Marion, B.; Smith, B. Photovoltaic system derived data for determining the solar resource and for modeling the performance of other photovoltaic systems. Sol. Energy 2017, 147, 349–357. [Google Scholar] [CrossRef] [Green Version]
  17. Kisi, O.; Parmar, K.S. Application of least square support vector machine and multivariate adaptive regression spline models in long term prediction of river water pollution. J. Hydrol. 2016, 534, 104–112. [Google Scholar] [CrossRef]
  18. Deo, R.C.; Wen, X.; Qi, F. A wavelet-coupled support vector machine model for forecasting global incident solar radiation using limited meteorological dataset. Appl. Energy 2016, 168, 568–593. [Google Scholar] [CrossRef]
  19. Yagli, G.M.; Yang, D.; Gandhi, O.; Srinivasan, D. Can we justify producing univariate machine-learning forecasts with satellite-derived solar irradiance? Appl. Energy 2020, 259, 114122. [Google Scholar] [CrossRef]
  20. Yang, D. Choice of clear-sky model in solar forecasting. J. Renew. Sustain. Energy 2020, 12, 026101. [Google Scholar] [CrossRef]
  21. Jia, D.; Hua, J.; Wang, L.; Guo, Y.; Guo, H.; Wu, P.; Liu, M.; Yang, L. Estimations of Global Horizontal Irradiance and Direct Normal Irradiance by Using Fengyun-4A Satellite Data in Northern China. Remote Sens. 2021, 13, 790. [Google Scholar] [CrossRef]
  22. Voyant, C.; Notton, G.; Kalogirou, S.; Nivet, M.-L.; Paoli, C.; Motte, F.; Fouilloy, A. Machine learning methods for solar radiation forecasting: A review. Renew. Energy 2017, 105, 569–582. [Google Scholar] [CrossRef]
  23. Breiman, L. Bagging_Predictors. Mach. Learn. 1996, 24, 123–140. [Google Scholar] [CrossRef] [Green Version]
  24. Feng, Y.; Gong, D.; Zhang, Q.; Jiang, S.; Zhao, L.; Cui, N. Evaluation of temperature-based machine learning and empirical models for predicting daily global solar radiation. Energy Convers. Manag. 2019, 198, 111780. [Google Scholar] [CrossRef]
  25. Yang, D. Making reference solar forecasts with climatology, persistence, and their optimal convex combination. Sol. Energy 2019, 193, 981–985. [Google Scholar] [CrossRef]
  26. Yang, D. A universal benchmarking method for probabilistic solar irradiance forecasting. Sol. Energy 2019, 184, 410–416. [Google Scholar] [CrossRef]
  27. Deo, R.C.; Şahin, M.; Adamowski, J.F.; Mi, J. Universally deployable extreme learning machines integrated with remotely sensed MODIS satellite predictors over Australia to forecast global solar radiation: A new approach. Renew. Sustain. Energy Rev. 2019, 104, 235–261. [Google Scholar] [CrossRef]
Figure 1. Research flowchart.
Figure 1. Research flowchart.
Remotesensing 15 02245 g001
Figure 2. Spatial distribution of the radiation observation sites (red marks).
Figure 2. Spatial distribution of the radiation observation sites (red marks).
Remotesensing 15 02245 g002
Figure 3. Random distribution of machine learning input and testing parameters (for instance, location: Yuzhong, time horizon: 10 min, train set (N) = 13,290, test set (N) = 5696).
Figure 3. Random distribution of machine learning input and testing parameters (for instance, location: Yuzhong, time horizon: 10 min, train set (N) = 13,290, test set (N) = 5696).
Remotesensing 15 02245 g003
Figure 4. Scatter diagrams of the measurements (horizontal axis) and forecasts (vertical axis) of the GHI for Yuzhong, Minqin and Dunhuang. (The first row and the second row represent the overall forecast performance of RF and SVR, respectively, on the GHI with different prediction durations.) The color represents the frequency of each pair: R, the Pearson correlation coefficient, and RMSE, the root mean square error.
Figure 4. Scatter diagrams of the measurements (horizontal axis) and forecasts (vertical axis) of the GHI for Yuzhong, Minqin and Dunhuang. (The first row and the second row represent the overall forecast performance of RF and SVR, respectively, on the GHI with different prediction durations.) The color represents the frequency of each pair: R, the Pearson correlation coefficient, and RMSE, the root mean square error.
Remotesensing 15 02245 g004
Figure 5. Site-specific nRMSE, nMAE, nMBE and R2 values by forecast time for the three compared methods.
Figure 5. Site-specific nRMSE, nMAE, nMBE and R2 values by forecast time for the three compared methods.
Remotesensing 15 02245 g005
Figure 6. RF and SVR forecast skills by forecast time against the Clim-Pers method.
Figure 6. RF and SVR forecast skills by forecast time against the Clim-Pers method.
Remotesensing 15 02245 g006
Figure 7. SHAP summary plots of the three observation sites in typical time horizons (red is the high value and blue is the low value).
Figure 7. SHAP summary plots of the three observation sites in typical time horizons (red is the high value and blue is the low value).
Remotesensing 15 02245 g007
Table 1. Geographic statistics of the 3 training and testing study sites.
Table 1. Geographic statistics of the 3 training and testing study sites.
Station NameLatitude (°)Longitude (°)Elevation (m)Mean GHI (W/m2)Max GHI (W/m2)Data Size
Yuzhong35.87104.151874.4460.36130719,525
Minqin38.63103.091367.5520.22128918,840
Dunhuang40.1594.681139.0548.17121918,024
GHI: Global Horizontal Irradiance.
Table 2. Comparison of the mean radiation prediction effect under different time horizons.
Table 2. Comparison of the mean radiation prediction effect under different time horizons.
Time HorizonInput Data
(McClear and Radiation Observations Are Not Listed)
nRMSE/%nMAE/%nMBE/%R2T/s
10 minFY-4A (Best 3 Channels)16.57939.38440.00790.90112328.9037
FY-4A (All 7 Channels)16.34209.09370.00570.90352914.8764
Without FY-4A18.422110.7338−0.01310.8768956.7337
20 minFY-4A (Best 3 Channels)18.978711.7958−0.06510.86691894.0174
FY-4A (All 7 Channels)18.348311.110−0.09050.87562896.0017
Without FY-4A21.588914.2191−0.01530.8273957.5262
30 minFY-4A (Best 3 Channels)20.867113.7970−0.28420.83351703.3047
FY-4A (All 7 Channels)19.753812.6537−0.14260.85102604.9350
Without FY-4A23.850516.9326−0.15410.78211103.7431
40 minFY-4A (Best 3 Channels)22.574115.3859−0.00800.79561957.5106
FY-4A (All 7 Channels)21.189314.06150.06190.82042860.9892
Without FY-4A26.253419.2950−0.08140.7244995.3814
50 minFY-4A (Best 3 Channels)24.141916.87390.00460.76251870.1118
FY-4A (All 7 Channels)22.573715.47200.07630.79342895.8723
Without FY-4A28.319321.48590.15870.6745992.8946
60 minFY-4A (Best 3 Channels)26.016118.5139−0.03450.73411757.2776
FY-4A (All 7 Channels)23.849816.66960.02620.76692733.2219
Without FY-4A29.893822.9646−0.02860.6166959.7182
90 minFY-4A (Best 3 Channels)29.937521.6341−0.76240.61001641.0330
FY-4A (All 7 Channels)27.110519.4680−0.58650.68132641.0437
Without FY-4A35.577628.0763−0.83420.4482882.1576
120 minFY-4A (Best 3 Channels)32.733023.7999−0.33250.53511521.5579
FY-4A (All 7 Channels)29.759821.2222−0.24480.61652517.6641
Without FY-4A39.632331.7468−0.36850.3163872.8807
150 minFY-4A (Best 3 Channels)34.013824.9394−0.32650.50481430.8113
FY-4A (All 7 Channels)30.546921.9532−0.44970.59942170.4864
Without FY-4A42.360734.5322−0.35140.2275825.2293
180 minFY-4A (Best 3 Channels)34.160225.2437−0.32880.51451266.1396
FY-4A (All 7 Channels)30.367021.9811−0.31590.61421985.8447
Without FY-4A44.178336.4969−0.75040.1795740.1289
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Jia, D.; Yang, L.; Gao, X.; Li, K. Assessment of a New Solar Radiation Nowcasting Method Based on FY-4A Satellite Imagery, the McClear Model and SHapley Additive exPlanations (SHAP). Remote Sens. 2023, 15, 2245. https://doi.org/10.3390/rs15092245

AMA Style

Jia D, Yang L, Gao X, Li K. Assessment of a New Solar Radiation Nowcasting Method Based on FY-4A Satellite Imagery, the McClear Model and SHapley Additive exPlanations (SHAP). Remote Sensing. 2023; 15(9):2245. https://doi.org/10.3390/rs15092245

Chicago/Turabian Style

Jia, Dongyu, Liwei Yang, Xiaoqing Gao, and Kaiming Li. 2023. "Assessment of a New Solar Radiation Nowcasting Method Based on FY-4A Satellite Imagery, the McClear Model and SHapley Additive exPlanations (SHAP)" Remote Sensing 15, no. 9: 2245. https://doi.org/10.3390/rs15092245

APA Style

Jia, D., Yang, L., Gao, X., & Li, K. (2023). Assessment of a New Solar Radiation Nowcasting Method Based on FY-4A Satellite Imagery, the McClear Model and SHapley Additive exPlanations (SHAP). Remote Sensing, 15(9), 2245. https://doi.org/10.3390/rs15092245

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop