1. Introduction
Satellite observations have been widely used during recent decades for several meteorological, hydrological and climatological applications incorporating precipitation data worldwide [
1,
2,
3,
4,
5,
6]. In order to fill in where ground observations are absent or sparse, satellite estimations have been evolving using sophisticated algorithms that can identify rainfall, snow and/or other hydrometeors [
7,
8,
9,
10,
11]. However, although Satellite Precipitation (SP) products are able to, overall, capture the variability and magnitude of rainfall, still they cannot accurately estimate the localized rainfall variations. Thus, validation of satellite precipitation products is often needed against ground-based measurements.
The Tropical Rainfall Measuring Mission (TRMM) platform placed in orbit during the 1997–2015 period, provided reliable data of high spatial (≈25 km) and temporal resolution (3 h), at a geographical coverage between 50°N and 50°S [
12,
13,
14,
15,
16,
17]. TRMM’s successor, namely, the Global Precipitation Mission (GPM) has been in orbit since 2014, giving estimates at even higher resolutions (≈10 km; 30 min) and geographical coverage from 60°S to 60°N, making it available for a variety of applications, including the assimilation of GPM data in numerical weather prediction models to improve model forecasting skill [
15,
16], the monitoring of severe weather events [
13,
15,
16,
17], hydrological hazards [
18,
19], etc.
Several studies attempted to demonstrate the accuracy of TRMM and GPM IMERG (Integrated Multi-satellitE Retrievals) estimates in various geographical areas. In their study over mainland China, Wu et al. [
20] found that both SP products overestimate light rainfall. This is attributed to the fact that hydrometeors detected by infrared and microwave sensors as well as precipitation radars may partially or even totally evaporate before they are registered by the rain gauges. Furthermore, these authors found an underestimation of moderate and heavy rainfall by both products. A slightly better performance by GPM-IMERG, according to these authors, is attributed to the satellite overpasses and sensor capabilities.
In a similar study over Pakistan, Anjum et al. [
21] found a slight dominance of IMERG; however, both products correlate well with the in situ measurements at a monthly scale, adequately following the temporal pattern. Again, underestimation of moderate and heavy rainfall and overestimation of light events was reported.
In their study regarding the area of Singapore, Tan and Duan [
22] presented similar results, showing good correlation on a monthly scale, with rain gauges for both products and moderate correlation for daily values. The authors underlined that the better performance of IMERG was not that notable and that the main advantage of the new product was mostly its finer resolution.
In a study over the Tibetan plateau (Hexi region), Wang et al. [
23] found a better correlation for IMERG, ascribed mostly to the ability to detect better moderate and heavy rainfall; however, they concluded that the improvement was not significant.
In their study (China, 2015–2017), Chen et al. [
24] evaluated the performance of IMERG (v5) and TRMM 3B42 (v7) and found that, at monthly and annual scale, both datasets were highly correlated with rain gauge observations. Considering daily values, satellite estimates overestimate precipitation for intensities within the range 0 to 25 mm/day and underestimate precipitation for light and heavy intensities. Considering various statistical scores, they found that IMERG, in general, performed better in detecting the observed precipitation.
In a similar study (China, March 2014 to February 2017), Wei et al. [
25] found severe underestimation with high negative relative biases for both IMERG (v5) and TRMM products. However, IMERG product performed better than TRMM 3B42 in the detection of precipitation events in terms of specific statistical scores (i.e., probability of detection), over China and across most of the sub-regions.
Sunilkumar et al. [
26] evaluated the GPM-IMERG (v5) final precipitation product against a ground-based gridded data set over Japan, Nepal and the Philippines for two years (2014–2015). Their results showed generally good performance (in terms of statistical scores, like correlation, mean bias, root mean square error) of GPM-IMERG over three regions, although an underestimation was noticed during heavy rainfall events. They also noticed that GPM-IMERG estimates improved its capability in terms of detecting light and heavy precipitation events, although their performance was found to be seasonally dependent.
A few studies with evaluation of satellite precipitation products over Cyprus are reported in the literature. Retalis et al. [
27] performed an analysis of precipitation data from satellite data TRMM 3B43 (versions 7 and 7A) over Cyprus and compared them with the corresponding gauge observations and E-OBS gridded data (i.e., a European daily high-resolution gridded dataset of surface temperature and precipitation to be used for validation of Regional Climate Models and for climate change studies) for a 15-year period (1998–2012). They concluded that correlation between TRMM and E-OBS was higher in summertime (≈0.97), but significantly lower in the winter period (≈0.60–0.74). It was noticed that the annual correlation tends to decrease considerably with time. They also found that the coefficient of determination between TRMM, E-OBS estimates and gauge data were relatively high (0.929 and 0.932, respectively); however, the variations noticed were attributed to the elevation differences.
A study for a 30-year period (1981–2010) for the precipitation database Climate Hazards Group Infrared Precipitation with Station data (CHIRPS) in Cyprus was presented by Katsanos et al. [
28]. The CHIRPS database was evaluated against gauge stations data. Results showed good correlation between monthly CHIRPS values and recorded precipitation with the correlation coefficients found to be around 0.85 and January the month with the highest correlation. The corresponding values for the annual mean ranged between 0.70 and 0.74, with the mountainous stations showing a slightly higher correlation.
In a later study, Katsanos et al. [
29] examined the performance of several climatic indices for the CHIRPS precipitation dataset and rain gauges records on high spatial (0.05°) and temporal (daily) resolution for a period of 30 years (1981–2010). Results indicates quite a promising performance regarding indices related to daily precipitation thresholds, resulting in high correlation scores. However, for indices referring to number of days, results showed medium or no correlation, probably due to the criteria used for the identification of a wet (rainy) day on the CHIRPS dataset.
Furthermore, Retalis et al. [
30], in their study on the accuracy of the GPM IMERG estimates over Cyprus (April 2014 to February 2017), concluded that, overall, a very good agreement (based on the statistical analysis) between monthly IMERG estimates and gauge data was established (coefficient of determination r
2 value ≈ 0.93), presenting a tendency of IMERG for underestimation when higher elevation (>1000 m) was considered. They also examined the daily dependency of IMERG estimates and gauge data, considering a series of extreme precipitation events, and they concluded that this is case dependency, while elevation does not have an apparent effect.
The objective of this study is to evaluate statistically the performance and improvement of the GPM IMERG product compared to TRMM 3B43V7 estimates, thus exploring, the continuity and uniformity between IMERG and TRMM-era data sets over Cyprus so that they can be used in climate studies as a combined and consistent dataset. The present research is a continuation and extension of previous studies by the same authors.
The current research aims at comparing the two products, namely, GPM IMERG and TRMM 3B43, in order to determine and highlight possible differences, advantages and disadvantages of each one of them, based on the performance of several statistical skill scores, along with cross-evaluation against the dense rain gauge dataset over Cyprus during the period from April 2014 to June 2018.
4. Results and Discussion
4.1. Monthly Validation
Mean monthly values for the study period were calculated for both the gauge stations (136 stations) and the two satellite precipitation products (mean values of all available corresponding grid cells within the study area). The results are illustrated in
Figure 3. We notice that, overall, both IMERG and TRMM data follow very well the “climatology” of the stations, although with an underestimation during the rainy period, while IMERG is closer to the gauge values for almost the whole period of study.
In order to highlight the performance of satellite precipitation (SP) products, we estimate their average difference (of their monthly values) from the corresponding gauge stations data (see
Figure 4). We notice that, generally, IMERG monthly values present lower divergence than TRMM.
Next, IMERG and TRMM monthly estimates were compared to the corresponding gauge data based on a grid-level approach. Thus, for each SP product, the mean gauge station value is calculated for the comparison if more than one station was located within each SP grid.
The estimated correlation coefficient values between the monthly values of the gauge stations and the SP data are presented in
Figure 5. Correlation seems slightly better for TRMM 3B43 cells, since there is a lower variation (minimum 0.84–maximum 0.96) than that corresponding to the IMERG cells (minimum 0.78–maximum 0.96), with the average of all cells being 0.92 and 0.91, respectively.
Both IMERG and 3B43 products underestimate precipitation with Bias values of −1.6 mm/month and −3.0 mm/month, respectively. IMERG showed better performance than 3B43 in terms of rBias values (3.6 and −8.7, respectively), while presenting worst performance in terms of RMSE (23.8 mm/month and 20.0 mm/month, respectively) and MAE (15.1 mm/month and 12.9 mm/month, respectively) values, as presented in
Table 2 (minimum and maximum respective values are provided in brackets).
4.2. Seasonal Validation
The results for the seasonal validation are summarized in
Table 3. Both TRMM 3B43 and GPM IMERG estimates presented high R values (0.91 and 0.90, respectively) in winter, which suggests a good agreement with ground-based measurements on a seasonal scale. Similar results were found for autumn (0.84 and 0.83, respectively) and spring (0.81 and 0.80, respectively), while the poorest correlation (0.68 and 0.67, respectively) was established in summer.
The BIAS for TRMM 3B43 and IMERG ranged from −12.6 to 0.9 and from −8.3 to 2.6, respectively, in the four seasons. The 3B43 overestimated precipitation in spring (0.9) and autumn (0.3), while underestimation is noticed in summer (−1.3) and is rather significant in winter (−12.6). Similar is the pattern for IMERG, with overestimation in spring (0.8) and autumn (2.6), while underestimation is noticed in summer (−1.8) and is rather significant in winter (−8.3).
In terms of rBias, 3B43 presented larger values than that of IMERG in spring (15.0 and 17.5, respectively) and autumn (6.4 and 18.4, respectively), while IMERG showed better performance in winter (−1.1 and −9.9, respectively). Both products displayed their worst values in summer (440.7 for 3B43 and 299.8 for IMERG, respectively).
Precipitation products displayed a similar trend for RMSE and MAE with higher values in winter, spring and autumn and lower values in summer. For winter, spring and autumn, TRMM 3B43 had RMSE values of 33.4, 15.2 and 13.9, which were slightly lower than those of IMERG, which were 38.6, 19.1 and 16.7, respectively. In summer, 3B43 had lower RMSE values, 6.3, compared to those of IMERG, 8.7, respectively. Similar results occurred for MAE values between 3B43 and IMERG, with larger values noticed in winter (33.4 and 38.6, respectively) and lower in summer (3.8 and 4.9, respectively). These results may indicate that both SP products exhibit a similar error level, on a seasonal scale.
4.3. Annual Validation
Mean annual values for the study period (see
Figure 6) were calculated for both the set of 136 ground stations and the satellite precipitation products (mean values of the available corresponding grid cells within the study area). It is found that, overall, both SP data exhibit an underestimation, although it is lower for IMERG, with the exception of 2015, when a slight overestimation by the IMERG product was noticed. It should be noted, however, that the available precipitation estimates for 2014 were limited to the period April to December, while for 2018 they were limited to January to June.
Figure 7 displays the variation of overestimation (>100%) or underestimation (<100%) of annual precipitation values at each of the corresponding SP grid cell, between the SP estimated and calculated mean annual gauge station records. We notice that, more or less, the SP estimates have the same behavior regarding the overestimation/ underestimation of annual rainfall. Underestimation is more evident in the central area of Cyprus (greater area of Troodos mountain range), where higher precipitation records are generally noticed, highlighting the known limitations of satellite products regarding heavy rainfall, while the overestimation is noticed in the coastal or rather flat areas, where again the estimation of precipitation still remains a challenge due to the difficulty in distinguishing between rain and non-rain pixels over a complex background [
44]. Furthermore, there are no significant differences between the years, since the cells that generally overestimate/underestimate rainfall have a similar performance regardless of the year.
The performance of the IMERG product was slightly better than 3B43V7 with an R higher value (0.82 and 0.81, respectively), lower Bias values (−17.9 mm/month and −30.5 mm/month, respectively) and rBias values (3.1 and −3.0, respectively), while presenting worst performance in terms of RMSE (108.8 mm/month and 94.7 mm/month, respectively) and MAE (96.1 mm/month and 83.4 mm/month, respectively) values, as presented in
Table 4 (minimum and maximum respective values are provided in brackets).
4.4. Influence of Elevation on Satellite Precipitation Products
To analyze further the influence of elevation and satellite precipitation products, we grouped all the rain gauge stations into three categories according to their elevation (0–300 m, 300–600 m, >600 m), and compared the evaluation metrics across the different elevation ranges. The annual rBias results for the both GPM and TRMM products are presented in
Table 5 and
Table 6, respectively. Minimum and maximum respective values are provided in brackets along with the corresponding number of satellite products cell for each elevation category.
Results as presented in
Table 5 and
Table 6, respectively, portray that, on an annual scale, both of the two SP products overestimate the precipitation below an altitude of 300 m, with IMERG presenting the largest overestimation (mean annual RB values: RBIMERG = 123.8%, RB3B43 = 107.7%). On the contrary, both SP products underestimate precipitation with increasing elevation, with 3B43v7 displaying a more apparent underestimation than IMERG, with RBIMERG = 93.0%, RB3B43 = 78.0% and RBIMERG = 70.3%, RB3B43 = 65.6% for elevation ranges between 300 and 600 m and >600 m, respectively. Regarding the Pearson correlation coefficient, the performance for 3B43 v7 was slightly better than IMERG at all of the categories, with
r values increasing with elevation.
More evaluation metrics (Bias, RMSE, MAE) were used to evaluate the performance of GPM and TRMM monthly data according to elevation (
Table 7). Overall, the performance of both satellite products metrics (Bias, RMSE, MAE) were worst in higher altitude areas than in lower altitude areas. Regarding Bias, findings established that TRMM performed better in the elevation range 0–300 m, while GPM exhibited lower bias values in higher altitudes. TRMM exhibited lower RMSE and MAE values than those of GPM in the elevation ranges 0–300 m and >600 m and higher values in the elevation range 300–600 m.
The monthly and annual spatio-temporal variations of bias for both satellite precipitation products for the study period are presented in
Figure 8 and
Figure 9, respectively, while the corresponding seasonal spatio-temporal variation is presented in
Figure 10. It is clear that both SP products underestimate precipitation in higher elevation areas and overestimate in areas with lower elevation fluctuations. The underestimation is more evident in the winter.
These findings are in agreement with previous studies reported in the literature [
45,
46,
47,
48,
49,
50]. The performance of both SP products could be due to the products themselves and to topography. Both satellite precipitation products combine data from both satellite sensors and ground gauges. Since data from only one gauge station are used in mountainous areas in Cyprus, while three are located in rather flat areas, the accuracy of satellite precipitation products may be affect. Chen and Li [
51] and Tang et al. [
52] also reported that the accuracy of satellite precipitation products in high mountainous areas in west China could be attributed to the sparse gauge network. Moreover, estimated differences could be also attributed to the differences of the rainfall process, which is rather complicated in mountainous areas than in low altitude areas due to the influence of topography.
5. Conclusions
An evaluation of the monthly and annual IMERG and TRMM 3B43 product estimates with corresponding rain-gauges data over Cyprus for the period April 2014 to June 2018 was performed. Based on the analysis presented, it is found that, overall, both monthly satellite product estimates and rain gauge data presented a very good agreement; however, both IMERG and TRMM estimates tend to underestimate precipitation, especially during the rainy season, although, IMERG and rain gauge records seem to exhibit similar temporal patterns. Considering the annual values, we notice that both SP estimates underestimate annual precipitation records, although IMERG estimates are much closer to gauge station records. In terms of statistical scores analysis, it was found that on a monthly and annual basis, a slightly better performance of IMERG for R, Bias and rBias values was noticed, while 3B43 product performed better in terms of RMSE and MAE values. Seasonal analysis showed that both products exhibited a better performance during the rainy (winter) period, followed by autumn and spring seasons, while both products were able to detect the summer-time precipitation, although with high uncertainty in terms of relative bias values.
In summary, we conclude that although satellite products could be considered as quite accurate estimates of precipitation, indeed, their accuracy is not yet profound, and this issue is open to further elaboration. Nonetheless, IMERG estimates, due to their superiority in terms of spatial and temporal resolution, could serve as an alternative precipitation dataset, where in-situ precipitation records are limited.
The influence of elevation of both SP estimates was considered by grouping rain gauge stations in three categories, with respect to their elevation and it was found that both SP estimates underestimate precipitation with increasing elevation and overestimate it at lower elevations. Thus, it is suggested that one possible improvement would be the prospect of blending the SP data with more in situ data from rain gauges that are distributed evenly over the geographical area of Cyprus and especially in mountainous areas. Furthermore, it would be quite challenging to enhance the retrieval algorithms by implementing elevation correction or adjustment.
Although the results derived from this study are site specific for Cyprus, the methodology adopted could be “transferred” to other regions according to our understanding of how satellite-based precipitation estimates perform over different regions. For example, for study areas with characteristics similar to our area of study, in terms of geographic location, with no very complex topography, the methodology could be applied directly. For other areas, with complex topography or with various climatic zones the methodology should further consider these parameters.
The authors aim to expand their research in this field, by considering an evaluation over Cyprus of the newly released version of IMERG data that expands the SP products into a uniformly processed data set embracing the TRMM-era. The establishment of a uniform TRMM and GPM SP record will broaden the scientific challenges for further research in several meteorological and hydrological applications.