4.5. Isohyetal Map Assessment
In order to assess how the use of stationary and/or non-stationary isohyetal maps could affect the calculation of the areal P
max-24h (P
areal) in a given watershed (W), nine watersheds were selected, three in each of the three homogeneous regions (light-green areas in
Figure 11). W1, W2, and W3 are located in the north, central, and southern areas of the west homogeneous region, respectively. W4, W5, and W6 are within the central region, located in the northern, central, and southern areas, respectively. Finally, W7 (north), W8 (center), and W9 (south) are located within the east region.
Table 9 summarizes the watershed area, the nearest rain gauge, and its distance to each of the watersheds.
P
areal values for all watersheds (return periods of five, 10, 25, 50, and 100 years) for stationary and non-stationary conditions, as well as mixed ones, are shown in
Table 10. Likewise, stationary and non-stationary P
areal values were compared, through their differences (mixed minus the SC and NSC values), with P
areal values of mixed isohyetal maps (
Table 10).
Pareal values of the mixed isohyetals for the five-year return period were in a range of 95.0 mm (W3) to 109.2 mm (W8). For the 10-year return period, the value range was between 107.6 mm (W3) and 126.7 mm (W2). For the 25-year return period, values ranged from 127.3 mm (W3) to 145.5 mm (W2). For the return period of 50 years, the range was between 141.2 mm (W3) and 168.9 mm (W2). For the 100-year return period, values ranged from 153.1 mm (W3) to 179.2 mm (W5).
Pareal values of the stationary isohyetals for the five-year return period were in a range of 100.0 mm (W5) to 109.4 mm (W9). For the 10-year return period, the minimum and maximum values were between 113.0 mm (W3) and 124.2 mm (W2). For the 25-year return period, values ranged from 124.7 mm (W7) to 147.7 mm (W2). For the 50-year return period, the value range was between 135.0 mm (W7) and 160.0 mm (W2). For the 100-year return period, values ranged from 143.1 mm (W8) to 180.0 mm (W2).
Pareal values of the non-stationary isohyetals for the five-year return period were in a range of 94.8 mm (W6) to 117.7 mm (W5). For the 10-year return period, the value range was given between 101.6 mm (W6) and 125.0 mm (W9). For the 25-year return period, values ranged from 115.4 mm (W6) to 145.5 mm (W2). For the 50-year return period, values ranged from 120.1 mm (W6) to 161.7 mm (W5). For the 100-year return period, the values were between 126.8 mm (W6) and 187.0 mm (W2).
The frequency analysis under stationary conditions is most commonly used by hydrologists to estimate the design rainfall for hydraulic structures for stormwater management. Nonetheless, the differences observed in
Table 10 show that the stationary frequency analysis underestimated the values of areal P
max-24h for the study area. This behavior occurred in 60% of the cases evaluated (27 out of 45) throughout the department of Atlántico. This implies that, if a designer decides to use a stationary design rainfall, the subsequent estimation of the design flow for a given hydraulic structure could end up as an underestimated value. It can also be observed that these underestimations reach their most critical values within the central region, where the highest areal P
max-24h differences range from 11.3 to 24.2 mm (both in W5) for return periods of 25, 50, and 100 years (which are the most used in the design of drainage hydraulic structures). The west region exhibited only two cases where the difference in P
areal had values greater than 5 mm (7.7 mm in W1 and 8.9 mm in W2). In the eastern region, underestimations occurred in 60% of cases (six cases out of 10) with values ranging from 6.8 to 11.2 mm (W7 and W8). Like the central region, these values came from return periods of 25, 50, and 100 years. These results also show that, for stationary conditions, the probability of underestimating the values of P
areal is higher in these three return periods, with values of 66%, 88%, and 66%, respectively. Rainfall differences with values less than 5 mm occurred in 57.8% of the cases (26 cases distributed as follows: nine for the west region, nine for the east region, and eight for the central region, where two values of 5.1 mm were given that could be considered within the rank).
For the non-stationary scenario, the tendency to underestimate P
areal occurred in 46.7% of the cases (21 out of 45): seven cases for the west region, nine for the central region, and five for the east region. It was also noted that, for this scenario, more P
areal values with differences less than or equal to 5 mm are estimated, which was observed in 66.7% of the cases (11 for the west region, nine for the central region, and 10 for the eastern region). On the other hand, when each of the regions was analyzed individually, the western region showed a slight tendency to overestimate the P
areal values (eight out of 15, negative values in red in
Table 10). This behavior was more noticeable for the 100-year return period, where the three watersheds evaluated presented values ranging from 2.2 mm (W2) to 13.3 mm (W3). In the central region, underestimated values of P
areal (60% of the cases or nine out of 15) were observed, particularly in the southern part of this region (W6), with values ranging from 11.1 to 26.5 mm for return periods 10, 25, 50, and 100 years. For the eastern region, there was also a tendency to overestimate the P
areal (66.7% of the cases, 10 of 15), with values ranging from 2.1 mm (W9) to 19.5 mm (W8).
Regarding the real values of P
areal (mixed isohyetals), the southern area of the department of Atlántico exhibited the lowest values, specifically in W3 (located in the south of the west region) and W6 (located in the south of the eastern region). This is clearly evident, for example, when comparing the P
areal values for the 100-year return period between W6 and W7 (located northeast). W6, despite having an area three times larger than W7, has a lower P
areal value (153.3 mm versus the 155.0 mm for W7). These results coincide with the findings of IDEAM [
3], who determined that municipalities located in the southeast of the department will likely be the most affected by rainfall decrease.
The isohyetal map (stationary and non-stationary) performance assessment within each of the watersheds was carried out through the relative error percentage (REr). Additionally, the performance of each of the regions was assessed by RSR, PBIAS, and NSE. The results of this statistical analysis are presented in
Table 11.
For the stationary isohyetal maps, REr values ranged from 0.00% (W2) to 9.52% (W3) for the five-year return period, 0.77% (W6) to 6.17% (W4) for the 10-yearperiod, 0.13% (W3) to 8.84% (W5) for the 25-year period, 0.17% (W6) to 9.59% (W5) for the 50-year period, and 0.23% (W9) to 15.64% (W5) for the 100-year period. The highest REr values were observed in two of the return periods (50 and 100 years) most commonly used in the design of hydraulic structures for runoff management (50 and 100 years). No relationship was observed between the watershed area and REr.
For non-stationary isohyetal maps, REr values ranged from 0.00% (W3) to 4.66% (W4) for the five-year return period, 0.00% (W7) to 10.93% (W6) for the 10-year period, 0.23% (W2) to 12.10% (W6) for the 25-year period, 0.93% (W3) to 18.28% (W6) for the 50-year period, and 1.36% (W1) to 20.85% (W6) for the 100-year period. The highest REr values were observed in return periods of 50 and 100 years.
In general, for stationary conditions, there were 14 cases where REr was greater than or equal to 5.00% (gray cells). The maximum value was 15.64%, with only one case where REr was greater than or equal to 10%. For the non-stationary conditions, 10 cases were observed where the REr was greater than or equal to 5.00%. The maximum value was 20.85%, with five cases where REr was greater than or equal to 10%. Furthermore, when the stationary and non-stationary conditions were compared one-to-one, it was observed that, in 57.8% of the cases (26 out of 45), the REr values for the non-stationary conditions were lower than their stationary counterparts. These results suggest that (a) the error might be more frequent when using the stationary condition isohyetal maps, and (b) additional attention should be paid during the design of hydraulic structures under stationary frequency analysis, especially as it was also found that this scenario tends to underestimate the P
areal (
Table 10).
With respect to the overall performance of all regions, the stationary conditions resulted in lower values of RSR (10 in total) than those for the non-stationary conditions (five in total). At first glance, this may indicate less error under stationary conditions (which contradicts the results previously obtained when the REr was analyzed for each watershed). Nonetheless, a closer look at
Table 10 revealed that, despite the fact that each condition had five REr values greater than or equal to 5.00%, the non-stationary condition had REr values of up to 20.85%, which contributed to having an overall larger RSR value. Such large REr values were due to the fact that W6 happened to have a rain gauge (Hda El Rabón) with a time series better suited to a stationary frequency analysis (
Table 8). As for the individual performance of each region, the west region showed 90% (nine out of 10) of the RSR values below one, followed by the east region with three values. The central region had more stationary condition values (in four out of the five return periods) that outperformed the non-stationary ones.
Regarding the P
areal tendency to under- or overestimate, PBIAS values indicate that isohyetal maps under stationary conditions tend to underestimate (black positive values in
Table 11) in the majority of the cases (66.7% or 10 out of 15), which is more evident in the central region. These results corroborate what was previously found in
Table 10. The underestimated results also observed in the central region for the non-stationary conditions (which are opposite to the results of both
Table 10 and REr in
Table 11) were mainly caused by the large P
areal differences found in W6. The non-stationary isohyetal maps tend to underestimate (60% in all regions, or nine out of 15). In the central region, the underestimation occurred in all return periods for both stationary and non-stationary conditions, especially for 50- and 100-year periods, which are two of the return periods most used in the design of hydraulic structures. In the east region, a tendency to overestimate (red values in
Table 11) was detected for non-stationary conditions in four out of five return periods. A different behavior was observed for the stationary conditions within the same region (east) where underestimation prevailed. Overall, the west region showed less bias when compared with the other two regions, with values ranging from 0.61% (underestimation for the 25-year return period for stationary conditions) to −4.21% (overestimation for the five-year return period for non-stationary conditions). Central and east regions showed values oscillating from 0.72% (underestimation for the five-year return period for non-stationary conditions) to 5.80% (underestimation for the 100-year return period for stationary conditions).
With regard to the prediction power of the isohyetal maps under stationary and non-stationary conditions, better NSE results were obtained within the west region in the majority of cases. Both conditions (stationary and non-stationary) had three return periods with NSE values above 0.5 (blue cells in
Table 11). Among the return periods most used for the design of hydraulic structures for stormwater management (25, 50, and 100 years), 25- and 50-year periods showed values close to one (indicator of a good performance), with values above 0.70 for both conditions. For the 100-year period, a value of 0.39 was observed for stationary conditions, denoting good performance as well. However, for non-stationary conditions, a value of 0.09 denotes both that the simulated value is far from the 1:1 line and that the average value of either the simulated or true value better represents the areal rainfall value. For the central and east regions, negative values prevailed in most of the cases for either stationary or non-stationary conditions (only one value was above 0.5). Within the central region for stationary conditions, all return periods had negative values, while, for the non-stationary conditions, this behavior was seen in 80% of the cases. In the east region, four out of five return periods showed negative values for stationary conditions, and three out of five return periods showed negative values for non-stationary conditions. These results indicate that the average of the true value (mixed isohyetal maps) is a better predictor for these two regions.
In general, lower values of REr, RSR, and PBIAS were observed within the west region, especially for stationary conditions, which suggests that a stationary frequency analysis might be used in watersheds within this region. This was also confirmed by the NSE results obtained in four out of five of the return periods. For the central and east regions, the use of a stationary frequency analysis (typically and widely used in hydrology), according to the results obtained, might introduce errors in the calculation of Pareal, which could affect, for instance, the magnitude of the estimated runoff for water balances (for agriculture, livestock, and energy water demand, among other uses), hydraulic structures for stormwater management, flash flood guidance, and flood risk assessment.