3.1. Station Data
Figure 2 shows the annual cycle of monthly mean minimum and maximum temperatures at each station, ordered by decreasing latitude. At the four stations in Niger and Ghana, maximum temperatures are regularly above 30 °C and highest in March to May, with Sadore, Niger having average maximum temperatures above 40 °C in April and May. At Kisumu, Kenya and Dodoma, Tanzania, maximum temperatures are fairly consistent year-round at 30 °C, whereas at the two stations in Zambia there is more seasonality with the highest temperatures in October and November.
Minimum temperatures exceed 20 °C throughout the year at the stations in Niger and Ghana. At Saltpond, the diurnal range is lowest at an average of less than 5 °C in July, whereas it is up to 15 °C at Sadore where minimum temperatures reach lower levels. At Kisumu, minimum temperatures are fairly consistent at around 17 °C. The farther south the stations go, the greater the minimum temperatures decrease in the winter months of July–September, with a slight seasonal variation in Dodoma, and greater temperature decreases at the stations in Zambia where average minimum temperatures are below 10 °C in this period. The proximity to the equator affects the seasonal patterns with stations closer to the equator (Saltpond, Kisumu and Dodoma) having less seasonal variability. The stations farther from the equator exhibit a bimodal temperature pattern. In west Africa, temperatures reduce from June–September, because of the monsoon, and again in the winter months of December and January, with a hot dry season in-between that peaks in April. In Zambia, southern Africa, temperatures are highest in the hot dry season beginning in August, before reducing in October/November at the onset of the rainy season, which is then followed by a cool dry Southern Hemisphere winter. This highlights the diversity in seasonal patterns and temperature ranges of the sites included in this study.
3.2. Daily Comparisons
On a daily basis, the overall correlations between CHIRTS and the station data are high (r ≥ 0.80, not shown) for both minimum and maximum temperatures, and greater than or similar to those for ERA5 and ERA5-Land. However, the overall correlation can be misleading when there is seasonality in the data, as high correlation values could be achieved by values that model the seasonality well, without necessarily strong correlation of values within seasons. Hence, we also examine daily temperature correlations calculated by each month, i.e., 12 correlation values per site, alongside mean monthly rainfall from the station data, as shown in
Figure 3 and
Figure 4.
CHIRTS has higher minimum temperature correlations than ERA5 and ERA5-Land in all or almost all months at each station. CHIRTS and ERA5 both have high correlations for maximum temperatures, with ERA5-Land having similar values for the stations in Kenya, Tanzania and Zambia and lower in those in Niger and Ghana. However, there is variation across the locations with Kisumu, and to a lesser extent Saltpond, having noticeably lower minimum temperature correlations than at the other stations for all three products. These results agree with the findings from the technical validation of CHIRTS in Verdin et al. [
18], where the mean correlation with station data in Africa for the hottest three-month period was 0.81 and 0.67, respectively, for daily maximum and minimum temperatures.
We also note that ERA5-Land does not appear to have substantially higher correlations over ERA5 and actually has lower maximum temperature correlations at some stations. One would expect the improved downscaling to a higher spatial resolution to provide values that are more closely representative of point-based values.
There appears to be a seasonality effect in the daily minimum temperature correlations at some stations for all three products (
Figure 3). At Sadore, Wa and Tamale, the minimum temperature correlations drop between June and September, corresponding to the main rainy season in these locations. Similarly, in the other locations, we generally also see a pattern of reduced correlations in the rainiest months. Temperature variability is also reduced during the rainy seasons, which can affect correlation. However, this does not correspond to higher RMSE, which is fairly consistent across months, as shown in
Figure 5. The lower correlation in these months is therefore likely due to lower variability of minimum temperature in this period since lower variability decreases correlation [
32] and is not an indication of worse performance in terms of deviations in the rainy months as the consistent RMSE shows. For example,
Figure 6 shows clearly that minimum temperatures at Sadore fall in a narrower range from July to September, where correlations are lower, even though the sizes of the differences are not larger than in other months. Hence, performance in estimating absolute values does not appear to be worse in those months. This also highlights the importance of using multiple metrics to assess different aspects of performance.
This effect is also observed to a lesser extent for maximum temperature correlations (
Figure 4), although Dodoma, Tanzania and Saltpond, Ghana do not appear to follow this pattern.
CHIRTS overestimates daily minimum temperatures and by larger amounts on average than ERA5 and ERA5-Land at all stations (
Table 3). The bias is largest at Kisumu (+6.4°). The daily mean bias is also large in Zambia at Mpika (+2.9°) and Livingstone (+3.7°), which has the lowest minimum temperatures of the eight sites. At the other stations, the overestimation is lower and between 0.6° and 2.3°. ERA5 and ERA5-Land also generally overestimate minimum temperatures but by less than CHIRTS at all stations. This is consistent with the RMSE values, which are generally similar or lower for ERA5 and ERA5-Land compared to CHIRTS. Wa is the only station where the minimum temperature is underestimated by CHIRTS for part of the year (November to March). CHIRTS consistently overestimates minimum temperatures in each month at all other stations (not shown); hence, only the overall bias values are reported. The larger bias in CHIRTS minimum temperatures compared to the corresponding bias for maximum temperatures was not observed in Verdin et al. [
18], where mean absolute error over Africa was similar for minimum and maximum temperatures; however, these were only for the hottest three-month period in the year.
Although the CHIRTS minimum temperature biases are generally larger, the errors (differences) are slightly less variable with a lower standard deviation at all stations compared to ERA5 and ERA5-Land (
Table 4). This is consistent with CHIRTS also having comparable or lower RMSE at some stations (
Table 4), despite the higher biases. Therefore, the biases in the CHIRTS minimum temperatures may be largely systematic biases and, hence, could be corrected for. This is also consistent with the Taylor diagram in
Figure 7, which shows smaller centered RMSE for CHIRTS since this considers the centered pattern error after subtracting the means. This result is illustrated in the scatter plots in
Figure 7 of the station vs. the CHIRTS minimum temperatures at Sadore, Niger where the CHIRTS bias is almost double that of ERA5, yet the RMSEs are the same and CHIRTS has higher correlations. The CHIRTS data are more offset from the y = x line of perfect fit than the ERA5 data, but also appear to fit a straight line better; hence, with an offset correction CHIRTS values could be considered to better estimate the station data. From
Figure 7 we also observe that the standard deviations of all products are more often less than that of the station data, although not by large amounts, except at Kisumu. In general, the CHIRTS points are closest to the station point in
Figure 7, showing better overall performance in these metrics.
At all stations, CHIRTS has a lower bias for maximum temperature than it does for minimum temperature (
Table 3). CHIRTS biases in maximum temperatures are consistently between −1.7° and 2° across all stations and months (
Table 3). This range is even narrower if Kisumu is excluded. While CHIRTS consistently overestimates minimum temperatures, there is more of a mixture between under- and overestimation of maximum temperatures (
Figure 8). CHIRTS overestimates in every month at Saltpond, Kisumu, Mpika and Livingstone, whereas it underestimates at Tamale and overestimates around the middle of the year and underestimates otherwise at Sadore and Wa (
Figure 8).
ERA5 and ERA5-Land underestimate maximum temperatures on average and the biases are larger in size than for CHIRTS (
Table 3). CHIRTS also has lower RMSE at all stations (
Table 5). This improved performance of maximum temperature by CHIRTS over ERA5 and ERA5-Land is expected as the CHIRTS algorithm is designed to address the cool biases observed in ERA5 [
33], which are more noticeable in Africa [
18].
Reda, Liu, Tang, and Gebremicael [
34] also showed that CHIRTS exhibits good performance on a daily basis in comparison with records at stations in the complex terrain of the Upper Tekeze River Basin, Ethiopia and performed better than other products. However, it is noticeable that the average daily correlations were lower than observed in this study and the RMSE values were higher at 3.7° and 4° for maximum and minimum temperatures, respectively.
The performance of CHIRTS at Kisumu, Kenya stands out as being the poorest across all measures. This could relate to the complex local climate around Kisumu. It is on the shores of Lake Victoria, 24 km from the equator, and is close to much cooler, higher-altitude and mountainous areas. However, this would need further investigation in a more detailed study focused on this area with more station records. At Saltpond, Ghana, CHIRTS also has a relatively worse performance compared to its closest other stations, and Saltpond also borders a water body close to the equator. However, there were also some large biases and low correlations in some months in the two locations in Zambia, which does not have these features.
Although it was not an objective of the study, it is somewhat surprising that the higher resolution of ERA5-Land compared to ERA5 does not appear to improve performance in comparison to the station data in point-to-pixel comparisons. One would have expected temperature values to be dependent, for example, on the pixel altitude and, hence, a smaller pixel area around the station location may be expected to compare better to the station data. A further study to understand the spatial variability of ERA5 and ERA5-Land over Africa could help to better understand this.