Next Article in Journal
Optimization of Irrigation Scheduling for Improved Irrigation Water Management in Bilate Watershed, Rift Valley, Ethiopia
Next Article in Special Issue
Impacts of Precipitation Type Variations on Runoff Changes in the Source Regions of the Yangtze and Yellow River Basins in the Past 40 Years
Previous Article in Journal
Evaluation and Optimization of Hydrological Connectivity Based on Graph Theory: A Case Study in Dongliao River Basin, China
Previous Article in Special Issue
Teaching Floods in the Context of Climate Change with the Use of Official Cartographic Viewers (Spain)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Nonstationary Annual Maximum Flood Frequency Analysis Using a Conceptual Hydrologic Model with Time-Varying Parameters

1
Bureau of Hydrology, Changjiang Water Resources Commission, Wuhan 430010, China
2
China Three Gorges Corporation, Yichang 443133, China
*
Author to whom correspondence should be addressed.
Water 2022, 14(23), 3959; https://doi.org/10.3390/w14233959
Submission received: 28 October 2022 / Revised: 30 November 2022 / Accepted: 1 December 2022 / Published: 5 December 2022
(This article belongs to the Special Issue Impacts of Climate Change on Water Resources and Water Risks)

Abstract

:
Recent evidence of the impact of watershed underlying conditions on hydrological processes have made the assumption of stationarity widely questioned. In this study, the temporal variations of frequency distributions of the annual maximum flood were investigated by continuous hydrological simulation considering nonstationarity for Weihe River Basin (WRB) in northwestern China. To this end, two nonstationary versions of the GR4J model were introduced, where the production storage capacity parameter was regarded as a function of time and watershed conditions (e.g., reservoir storage and soil-water conservation land area), respectively. Then the models were used to generate long-term runoff series to derive flood frequency distributions, with synthetic rainfall series generated by a stochastic rainfall model as input. The results show a better performance of the nonstationary GR4J model in runoff simulation than the stationary version, especially for the annual maximum flow series, with the corresponding NSE metric increasing from 0.721 to 0.808. The application of the nonstationary flood frequency analysis indicates the presence of significant nonstationarity in the flood quantiles and magnitudes, where the flood quantiles for an annual exceedance probability of 0.01 range from 4187 m3/s to 8335 m3/s for the past decades. This study can serve as a reference for flood risk management in WRB and possibly for other basins undergoing drastic changes caused by intense human activities.

1. Introduction

The occurrence of hydrological extremes has always been a challenge for human civilization. In the last decades, the exposure of critical infrastructures to flood has brought the attention of the scientific community on regional and national scales [1,2]. The Sixth Assessment Report of the Intergovernmental Panel on Climate Change (IPCC) highlighted the increase in extreme precipitation and the associated increase in the frequency and magnitude of river floods in many regions, including Asia, central Africa, and western Europe [3]. The change in the magnitude and frequency of these extremes has questioned the assumption of stationarity, on which most flood frequency analysis (FFA) studies were based [4,5]. Failure to account for nonstationarity, especially nowadays when the change of flood regimes due to climate change or/and human activities can no longer be ignored, may lead to underestimation or overestimation of the design flood value.
Design flood value associated with a specific return period (e.g., 100-year that is most commonly used in relevant studies) is traditionally estimated based on flood frequency analysis through statistical approaches [6]. Recently, with the concept that stationarity is dead [4], various methodologies using a probabilistic model of flood frequency considering nonstationarity have been introduced [7,8,9,10,11,12,13,14,15]. Khaliq et al. [16] provide a comprehensive review of these approaches, including the incorporation of trends in distribution parameters, trends in statistical moments, etc. Most studies of FFA considering nonstationarity adopted time-varying models to describe the variation of flood regimes [17,18,19,20]. However, applying a time-dependent model is inadequate because it fails to account for the change caused by climate change and/or human activities, which are usually the fundamental drivers. Thus, recent studies [21,22,23,24,25,26] have investigated the possibility of incorporating external forcings, such as climate factors, into models for FFA, and their work reported a better description of variation in flood regimes. However, it is unclear how these methods can be used to project future conditions since they are not physically based.
An alternative to statistical approaches is to derive flood frequency distribution using hydrological modeling, where design flood value for a specific return period was estimated using simulated runoff series from a hydrological model forced by observed or synthetic rainfall series [27,28,29,30,31,32,33,34]. The simulation can be event-based or continuous, with the latter approach increasing in use for its independence on the assumption about equal return periods for the design rainfall event and resulting design flood. Moreover, it becomes less necessary to account for the initial soil moisture conditions within the catchment when applying continuous simulation. A detailed review of applications of continuous simulation in design flood estimation can be found in the work of Boughton and Droop [35]. Through the continuous simulation approach, the design flood value can be determined by derived flood frequency analysis using long-term simulated flows series [28,29,30,31,32,33]. To this end, long-term continuous rainfall series with a sufficient temporal resolution are required, especially for small catchments. Due to the limitation of the resolution and length of available observed data, some researchers turn to synthetic rainfall series generated by stochastic rainfall models [36,37,38,39,40]. Moreover, recent years have witnessed the increasing availability of satellite-based rainfall products (e.g., GPM) and reanalysis rainfall products (e.g., ERA5 and UERRA), which can serve as a good solution for data-scare areas [41,42].
The potential advantage of deriving flood frequency analysis using a hydrological model over a statistical one is being able to account for the flood-related physical processes explicitly. However, this method may be invalid under changing environments, such as alteration in land use or the construction of new flood protection projects, whose effect cannot be reflected by the observed historical flood records. Thus, some recent studies try to diagnose and interpret hydrological nonstationarity, aiming to improve the structure of hydrological models and corresponding simulation/forecasting performance under such conditions [43,44,45]. The current state of the art is the application of conceptual hydrological models with time-varying parameters, which are usually assumed to represent changing watershed conditions. For example, Wallner and Haberlandt [44] reported a significantly improved streamflow simulation performance of the HBV model when the model parameter was made dependent on the climate indices. Deng et al. [45] linked the parameters of the two-parameter monthly water balance model with catchment properties. Their case study in southern China shows that the incorporation of time-varying parameters can lead to a more reliable prediction of monthly streamflow under changing environments.
However, most recent studies focus on deriving flood frequency analysis using a statistical model with time-varying parameters. Although the method of deriving flood frequency using continuous hydrological simulation and hydrological modeling with time-varying parameters have been validated in previous studies, few studies link them together to derive flood frequency analysis under nonstationary conditions. Thus, this study aims to derive flood frequency using a hydrological model with time-varying parameters under changing watershed conditions. The flood quantiles in different sub-period were derived using continuous simulation results by the stationary and nonstationary GR4J model, with the Weihe River basin (WRB) as the study area. Then the differences in estimated flood quantiles and magnitudes by the stationary and nonstationary models were presented to emphasize the importance of applying nonstationary modeling in flood designing.

2. Study Area and Data

The Weihe River basin (WRB) in northwestern China was chosen as the study area for its high nonstationarity, with runoff series from Huaxian station (near the outlet of the basin) on a declining trend over the past decades [46,47,48,49,50,51,52,53,54,55], mainly due to the intensifying human activities associated with water extraction and diversion [49,50]. The WRB is located between 104°00′ E–110°20′ E and 33°50′ N–37°18′ N, with a length of 818 km and a drainage area of 134,800 km2, as shown in Figure 1. The elevation within WRB ranges from 340 to 3671 m, with a decrease from northwest to east.
The daily runoff series from 1951 to 2011 were obtained from the Huaxian station. The daily rainfall and mean temperature series were obtained from the 21 meteorological stations (see Figure 1) within or around WRB for the same period as the runoff data. The daily potential evaporation of the corresponding period was estimated by the modified Hargreaves equation [56]. To account for the possible impact of human activities on the underlying conditions and flow regimes within WRB, the socio-economic factors, including population (POP), gross domestic product (GDP), irrigated land area (IA), cultivated land area (CA), reservoir storage (RS) and soil-water conservation land area (SWC) were considered as the candidates of external covariates for time-varying parameters. These factors can serve as indicators for the alterations of watershed conditions (e.g., land use and land cover) and have been used to assess the impact of human activities on flow regimes in previous work [57,58]. Considering the majority of cities, population, and farmed land area within WRB located in the Shaanxi Province, the covariates mentioned above for the period of 1951–2011 were represented by data of this province [59,60], as shown in Figure 2.

3. Methodology

3.1. GR4J Model: Stationary and Nonstationary

The hydrological model applied in this study is the lumped conceptual GR4J model [61]. The GR4J model was chosen for its parsimony in model parameters while still maintaining adequate process representation, including fast and slow responses together with a soil moisture component. The GR4J model has 4 parameters that are required to be calibrated, as presented in Table 1.
The stationary and two nonstationary versions of the GR4J model were applied for continuous simulation purposes in the study, i.e., the stationary model (model zero), where parameter values keep constant over time; the time-dependent model (model one), where the parameters vary as a function of time; and the time-varying model (model two), where the parameters vary as a function of covariate related to watershed underlying conditions. For both models one and two, the parameter θ 1 was allowed to vary over time because it stands for the production storage capacity of the watershed and has proved to be the most sensitive parameter of GR4J in previous studies [62,63,64].
For model one, the parameter θ 1 was treated as a liner function of time, as follows
θ 1 1 , t = a + b t
where θ 1 1 , t stands for θ 1 in model one for the year t . The coefficients { a , b } are unknown and are therefore calibrated together with the parameter θ 2 , θ 3 and θ 4 in model one.
To reveal how the parameter θ 1 would vary with the underlying conditions variation caused by human activities, θ 1 in model two was treated as a function of multiple covariates, as follows
θ 1 , t 2 = β 0 + i = 1 m β i h i ( x i , t )
where θ 1 , t 2 represents the value of θ 1 in model two for the year t , x i , t ( i = 1 , 2 , ... , m ) are m explanatory variables for the year t , β i ( i = 0 , 1 , ... , m ) are m + 1 regression coefficients. Note that function h i ( ) stands for the dependence of the parameter θ 1 , t on explanatory variables x i , t , which can be identical, logarithmic, or exponential, so as to represent possible linear or nonlinear relationships of the parameter θ 1 to changing watershed conditions.

3.2. Parameter Estimation and Model Selection

For model two, the selection of proper covariates for the parameter θ 1 from several candidate explanatory variables is essential. In total, 6 covariates (POP, GDP, IA, CA, RS, and SWC) were considered in this study, as mentioned above. In order to investigate the potential for the nonstationary GR4J model in runoff simulation, all combinations of the 6 external covariates (in total 63 covariate combinations, C 6 1 + C 6 2 + C 6 3 + C 6 4 + C 6 5 + C 6 6 = 63 ) were tested, and their corresponding performance was evaluated in terms of the Nash-Sutcliffe efficiency coefficient (NSE) metric. The combination of covariates corresponding to the highest NSE metric was regarded as optimal.
Parameters of all 3 models were calibrated using the SCEM [65] method, which has been widely used for practical assessment of parameter uncertainty in hydrological modeling [65,66,67]. The most likely parameter set in terms of NSE metric can be identified through the SCEM method, as well as their underlying posterior distribution [65,66,67,68,69]. To account for uncertainty in parameters, 1000 parameter sets were then sampled from the posterior probability distribution. Of the 1000 sampled parameter sets, the one corresponding to the highest NSE metric was regarded as the approximation of the global optimum and used for model evaluation and selection. Considering the limitation of model comparison and selection based on a single metric, additional criteria were adopted, including the Kling-Gupta efficiency coefficient (KGE), the relative error (RE) between simulated and observed annual total volume, and the daily-scale flow-duration curves, which enables comparison between the probability distribution of simulated and observed runoff and may contribute to figuring out the potential biases (e.g., possible underestimation of high flows).
The period of 1951–1990 was used for parameter calibration (for all models) and model selection (for model two only). The period of 1991–2011 was used for model validation. In order to reduce the possible impact of initial conditions, a 1-year warm-up period was applied for both the calibration and validation period, and the simulation within the warm-up period was excluded before the model evaluation procedure.
Note that WRB is highly seasonal, typically with low flow during winter. In order to avoid the possible impact of low flow on the analysis, a peak-over-threshold calibration strategy was adopted. This strategy excludes flows below a threshold of 100 m3/s for the model evaluation procedure, thus placing greater emphasis on the simulation performance of high flow [70]. This censoring threshold was chosen because roughly 40% days from 1951 to 2011 witnessed a flow below 100 m3/s for WRB.

3.3. Deriving Flood Frequency Distribution through Monte Carlo Simulation

For flood frequency analysis under the stationarity assumption, the underlying watershed conditions were assumed to be time-invariant; thus, a constant value of design flood for a specific return period could be determined. However, under nonstationary conditions, the design flood value for a certain return period may change over time due to the evolving watershed conditions. In order to achieve flood frequency analysis under nonstationary conditions, the historical period was divided into several sub-period. Based on the parameter from each sub-period, the Monte Carlo simulation method using the GR4J model was adopted to generate long-term runoff series; subsequently, the flood frequency distribution for certain sub-period could be determined.
As for model input for the Monte Carlo simulations, long-term rainfall series were generated by the weather generator BCC/RCG-WG [71], which was developed by Beijing Climate Center of China Meteorological Administration and Regional Climate Group at the University of Gothenburg. The stochastic model generates continuous rainfall series whose arrival time, duration, and intensity are all random, governed by a gamma distribution with parameters assumed to change monthly [72]. The calibration and validation of monthly parameters of the stochastic model have been conducted for 672 meteorological stations all over China in previous works [72,73]. Details on the model and its calibration/validation procedure can be found in the work of Liao et al. [73].
In practice, maximum annual flows are mainly relevant to annual maximum rainfall events and their antecedent rainfalls. In the case of WRB, Xiong, and Jiang [25] reveal a considerable correlation between annual maximum daily runoff and its 15-day antecedent rainfall, which shows a negligible variation. This study assumed that the characteristics of storms (annual maximum rainfall events) were stationary over the study period, thus enabling investigations on how the variation of watershed conditions affects the design flood value. Note that when applied in future scenarios, a perturbation with a climate change signal to the weather generator is necessary to generate rainfall series corresponding to the possible climate scenarios.
The GR4J model and the weather generator were used in the Monte Carlo simulation to generate daily runoff series of 100 years. Ten rainfall realizations generated by the stochastic model were used to consider uncertainty in rainfall (i.e., input for the GR4J model). As mentioned above, a total of 1000 parameter combinations were obtained from the posterior parameter distribution to account for uncertainty in the parameters of GR4J. Thus, in total 10,000 model runs were applied to derive the flood frequency distributions and corresponding uncertainty for certain sub-period.

4. Results

4.1. Simulation Performance of the Stationary and Nonstationary GR4J Models

For model two, 63 covariate combinations were tested, and their corresponding performance was evaluated in terms of the NSE metric. For the sake of brevity, only 4 cases are presented in Table 2 for illustration purposes. Note that for each covariate combination, 1000 parameter sets were obtained from the posterior probability distribution, and only the highest-NSE one was presented here for model selection purposes. Case C0 was designed to represent the stationary GR4J model. Under cases C1–C3, the external covariate RS and SWC were introduced in different schemes to describe the temporal variation of the production storage capacity parameter θ 1 . It can be found that the runoff simulation performance improved when the parameter θ 1 was allowed to change over time. For example, the NSE value is 0.753 under case C1, where only the covariate RS was considered when compared to 0.711 for the stationary GR4J model. The highest NSE value (0.765) was achieved under case C3, where both RS and SWC were incorporated into the time-varying parameter. Thus, the time-varying model under C3 was chosen as the optimal model two. Table 2 also gives the equation for the time-varying parameter θ 1 , t under 4 cases, where R S ¯ and S W C ¯ represent the mean value of covariate RS and SWC for the period from 1951 to 2011.
Table 3 gives a summary of statistics of simulation performance using the stationary GR4J model (model zero) and the modified versions (models one and two). Note that there are numerous versions of model two, and only the highest-NSE one is present here. The NSE, KGE, and RE metrics in Table 3 indicate that all three models achieved acceptable simulation performance for both calibration and validation periods. Model two, which incorporates RS and SWC as external variables, achieved the highest NSE value for both the calibration and validation period, followed by model one and model zero. This indicates that the nonstationary GR4J model can achieve a better simulation performance than the stationary one.
Figure 3 shows the comparison between the observed and simulated flow-duration curves (FDC) from models zero, one, and two with the parameter set corresponding to the highest NSE metric. All models achieved a good simulation performance for flow with an exceedance probability of less than 20%. Model two apparently outperforms model zero and one in terms of high flows. The flow-duration curves were also presented for the autumn season when floods are most likely to occur (Figure 3b). The results indicate good performance for models zero, one, and two in simulating high flows and poor performance in reproducing low flows. This is expected given NSE is the objective function and the peak-over-threshold calibration strategy was applied.
Predictions of the annual maximum flow were obtained from the simulated runoff series using the GR4J models (model zero, one, and two) with the 1000 parameter sets. Figure 4 compares the observed and simulated annual maximum flows for the period of 1951–2011. The observed annual maximum flows are represented by blue dots. The 95% prediction uncertainty bounds associated with the parameter are represented by the dark-shaded area, and the 95% prediction interval related to the model residuals corresponds to the light-shaded area. The NSE metric for the annual maximum flood series is denoted by NSEAMF in Figure 4.
The results from the stationary model with a constant parameter set (model zero) and the nonstationary model assuming temporal dependence only (model one) can adequately describe the variation in maximum annual flows (see Figure 4a,b), with most observed floods lying within the uncertainty bounds. For WRB, model two produced the most reliable estimation of maximum annual flows under nonstationary conditions (NSEAMF = 0.808) when compared to model zero (NSEAMF = 0.721) and model one (NSEAMF = 0.748), together with comparative narrower uncertainty bounds. This also proves the benefit and advantage of incorporating reservoir storage RS and soil-water conservation project SWC that are related to local regulation strategies as covariates.
Note that the incorporation of the time-varying parameter can be regarded as a modification of the model structure since one or more parameters require calibration are incorporated. Thus, whether a significant improvement in simulation performance can be achieved highly depends on the rationality of the modified model structure. For models with time-varying parameters, the selection of appropriate covariate to describe the dynamic of watershed conditions is of great importance. In this study, the combination of covariate RS and SWC leads to the highest NSE metric. Other covariates related to watershed conditions (e.g., vegetation cover) may achieve a more significant improvement in simulation performance. This is an interesting topic that deserves further research.

4.2. Dynamic Variation of Time-Varying Parameter

Figure 5 presents the dynamic variation of the parameter θ 1 for models one and two over the whole period with a 5-year spacing. The production storage capacity determines the catchment responsiveness and the allocation of rainfall input into interception, evapotranspiration, groundwater, and runoff. A larger production storage capacity means stronger resistance effects of rainfall input on runoff generation, i.e., weaker responsiveness of the watershed to rainfall variability.
For both models one and two, the increasing trend in the parameter θ 1 is apparent. This can be partially explained by the aforementioned external variables RS (reservoir storage) and SWC (soil-water conservation land area). The construction of large reservoirs in WRB sprang up in the 1960s and reached an upsurge in the late 1970s, which may lead to a significant shift in flood regime and, therefore, a noticeable change in flood magnitude at the outlet of the basin. The soil-water conservation projects (including the construction of terraces, afforestation, etc.) that started in the late 1950s and still persist today also contributed to larger storage for the rainfall during runoff generation, thus causing a much lower flow given the same rainfall input.

4.3. Performance of the Stochastic Rainfall Model

In order to validate the reliability of the stochastic rainfall model mentioned above, 10 realizations of long-term synthetic rainfall series on a daily basis (each 100-year in length) were generated for 21 meteorological stations within WRB. For brevity, only the result of the meteorological station Tianshui is shown here. Table 4 shows comparisons of the event characteristics of the 61-year observed rainfall series and the synthetic rainfall series generated by the stochastic rainfall model. The statistics of the generated rainfall series show good agreement with those of the observed historical records, with a slight overestimation of the mean volume of a rainfall event. The standard deviation and skewness of event volume were also well reproduced.
A frequency analysis was conducted on the annual maximum rainfall series for both the observed and synthetic rainfall series. Note that rainfall series can be generated for long periods using the stochastic model but only can be compared with the shorter observation statistic. Selected results are presented in Figure 6, where the observed values mainly lie within the boundary of the corresponding synthetic rainfall records. This indicates a good reproduction of rainfall series using the stochastic model, and the synthetic rainfall series is adequate for the purpose of Monte Carlo simulation.

4.4. Flood Frequency Derivation Using the Stationary and Nonstationary Model

Figure 7 and Figure 8 show the comparison of flood quantiles for an exceedance probability of 0.01 using the stationary model (model zero) and nonstationary models (models one and two). The 95% uncertainty bounds were estimated from simulation results from the 10,000 model runs, as mentioned above.
For the stationary model (model zero), the flood quantile for an exceedance probability of 0.01 (i.e., return period of 100-year) was a constant value of 6521 m3/s (see Figure 7). For model one, the corresponding flood magnitudes were continuously on a downward trend. This is expected since the parameter θ 1 of model one was time-dependent only. An FFA of the Huanxian station using model two (see Figure 8) shows that the flood quantiles for an annual exceedance probability of 0.01 range from 4187 m3/s (in 2011) to 8335 m3/s (in 1960). A noticeable decline occurred in the late 1970s when the reservoir storage and soil-water conservation area were undergoing drastic changes, indicating a more reasonable interpretation of the variation of flood magnitudes over time compared to model one. The variation in flood quantiles is in line with the work of Xiong et al. [25] and Hesarkazzazi et al. [74].
The results also stress the problems when assuming stationarity in flood frequency analysis and design. The application of the nonstationary models indicates that flood quantiles and magnitudes for WRB underwent significant variability over the past decades. In such cases, the assumption of stationarity may lead to an apparent misestimate of design flood for the future.

5. Discussion

Applying time-varying parameters in hydrological modeling has proved to be a useful approach to diagnosing hydrological nonstationarity under changing underlying watershed conditions. The key issue remains the selection of proper external covariates that are related to watershed conditions variation. This study chooses six external covariates and searches for the optimal one in a brute-force approach. A more comprehensive approach to identifying the most likely covariate combination requires further investigation.
The introduction of external covariates helps the models grasp the variations in flood frequency during the calibration and validation periods. This is in line with the work of Xiong et al. [25] and Jiang et al. [55]. However, before utilizing such a model as a predictive tool for future scenarios, the predictions of climate and anthropogenic indices are necessary.

6. Conclusions

In this study, flood frequency analysis considering nonstationarity by continuous simulation using the GR4J model with time-varying parameters was conducted for the Weihe River basin, and the main findings are as follows:
  • Improved model performance can be achieved when the parameter θ 1 (representing the production storage capacity) is treated as time-dependent or as a function of external variables that reflect changes in the hydrological responses within WRB;
  • Incorporating the watershed conditions as covariates for the model parameter (model two) can better describe nonstationarity in the flood frequency and magnitude in WRB than the over-simplified time-dependent model (model one);
  • The nonstationary model can achieve a more rational description of variations in the frequency and magnitude of floods over time, which reveals the deficiency when applying a stationary model under changing watershed conditions.

Author Contributions

Conceptualization, L.Z. and H.B.; Data curation, L.Z., X.L. and J.C.; Formal analysis, L.Z.; Funding acquisition, H.B. and S.L.; Investigation, L.Z. and Y.L.; Methodology, L.Z.; Project administration, H.B.; Resources, H.B.; Software, L.Z. and X.L.; Supervision, L.Z.; Validation, L.Z., H.B., Y.L., X.L. and S.L.; Visualization, L.Z.; Writing—original draft, L.Z.; Writing—review and editing, H.B. and Y.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research is supported by the National Natural Science Foundation of China (Grant Nos. U2040218 and 52109024), which are greatly appreciated.

Acknowledgments

Sincere thanks are due to the editor and the anonymous reviewers for all the remarks and suggestions that are very helpful and constructive for improving our manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Stefanidis, S.; Alexandridis, V.; Theodoridou, T. Flood Exposure of Residential Areas and Infrastructure in Greece. Hydrology 2022, 9, 145. [Google Scholar] [CrossRef]
  2. Tate, E.; Rahman, M.A.; Emrich, C.T.; Sampson, C.C. Flood Exposure and Social Vulnerability in the United States. Nat. Hazards 2021, 106, 435–457. [Google Scholar] [CrossRef]
  3. IPCC. Climate Change 2022: Impacts, Adaptation, and Vulnerability. In Contribution of Working Group II to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change; Cambridge University Press: Cambridge, UK, 2021. [Google Scholar]
  4. Milly, P.; Betancourt, J.; Falkenmark, M.; Hirsch, R.M.; Kundzewicz, Z.W.; Lettenmaier, D.P.; Stouffer, R.J. Stationarity id Dead: Whither Water Management. Science 2008, 319, 573–574. [Google Scholar] [CrossRef] [PubMed]
  5. Westra, S.; Sisson, S.A. Detection of non-stationarity in precipitation extremes using a max-stable process model. J. Hydrol. 2011, 406, 119–128. [Google Scholar] [CrossRef] [Green Version]
  6. Biondi, D.; De Luca, D.L. Process-based design flood estimation in ungauged basins by conditioning model parameters on regional hydrological signatures. Nat. Hazards 2015, 79, 1015–1038. [Google Scholar] [CrossRef]
  7. Qu, C.; Li, J.; Yan, L.; Yan, P.; Cheng, F.; Lu, D. Non-Stationary Flood Frequency Analysis Using Cubic B-Spline-Based GAMLSS Model. Water 2020, 12, 1867. [Google Scholar] [CrossRef]
  8. Liu, M.; Ma, X.; Yin, Y.; Zhang, Z.; Yin, J.; Ullah, I.; Arshad, M. Non-stationary Frequency Analysis of Extreme Streamflow Disturbance in a Typical Ecological Function Reserve of China under a Changing Climate. Ecohydrology 2021, 14, e2323. [Google Scholar] [CrossRef]
  9. Su, C.; Chen, X. Assessing the Effects of Reservoirs on Extreme Flows Using Nonstationary Flood Frequency Models with the Modified Reservoir Index as a Covariate. Adv. Water Resour. 2019, 124, 29–40. [Google Scholar] [CrossRef]
  10. Zhou, Y.; Guo, S.; Xu, C.-Y.; Xiong, L.; Chen, H.; Ngongondo, C.; Li, L. Probabilistic Interval Estimation of Design Floods under Non-Stationary Conditions by an Integrated Approach. Hydrol. Res. 2022, 53, 259–278. [Google Scholar] [CrossRef]
  11. Li, S.; Qin, Y. Frequency Analysis of the Nonstationary Annual Runoff Series Using the Mechanism-Based Reconstruction Method. Water 2022, 14, 76. [Google Scholar] [CrossRef]
  12. Sen, S.; He, J.; Kasiviswanathan, K.S. Uncertainty Quantification Using the Particle Filter for Non-Stationary Hydrological Frequency Analysis. J. Hydrol. 2020, 584, 124666. [Google Scholar] [CrossRef]
  13. He, C.; Chen, F.; Wang, Y.; Long, A.; He, X. Flood Frequency Analysis of Manas River Basin in China under Non-stationary Condition. J. Flood Risk Manag. 2021, 14, e12745. [Google Scholar] [CrossRef]
  14. Zhang, T.; Wang, Y.; Wang, B.; Tan, S.; Feng, P. Nonstationary Flood Frequency Analysis Using Univariate and Bivariate Time-Varying Models Based on GAMLSS. Water 2018, 10, 819. [Google Scholar] [CrossRef] [Green Version]
  15. Dong, Q.; Zhang, X.; Lall, U.; Sang, Y.-F.; Xie, P. An Improved Nonstationary Model for Flood Frequency Analysis and Its Implication for the Three Gorges Dam, China. Hydrol. Sci. J. 2019, 64, 845–855. [Google Scholar] [CrossRef]
  16. Khaliq, M.N.; Ouarda, T.; Ondo, J.; Gachon, P.; Bobée, B. Frequency analysis of a sequence of dependent and/or non-stationary hydro-meteorological observations: A review. J. Hydrol. 2006, 329, 534–552. [Google Scholar] [CrossRef]
  17. Olsen, J.R.; Lambert, J.H.; Haimes, Y.Y. Risk of extreme events under nonstationary conditions. Risk Anal. 1998, 18, 497–510. [Google Scholar] [CrossRef]
  18. Renard, B.; Lang, M.; Bois, P. Statistical analysis of extreme events in a non-stationary context via a Bayesian framework: Case study with peak-over-threshold data. Stoch. Environ. Res. Risk Assess. 2006, 21, 97–112. [Google Scholar] [CrossRef] [Green Version]
  19. Leclerc, M.; Ouarda, T.B. Non-stationary regional flood frequency analysis at ungauged sites. J. Hydrol. 2007, 343, 254–265. [Google Scholar] [CrossRef]
  20. Delgado, J.M.; Apel, H.; Merz, B. Flood trends and variability in the Mekong river. Hydrol. Earth Syst. Sci. 2010, 14, 407–418. [Google Scholar] [CrossRef] [Green Version]
  21. Katz, R.W.; Parlange, M.B.; Naveau, P. Statistics of extremes in hydrology. Adv. Water Resour. 2002, 25, 1287–1304. [Google Scholar] [CrossRef]
  22. El Adlouni, S.; Ouarda, T.; Zhang, X.; Roy, R.; Bobée, B. Generalized maximum likelihood estimators for the nonstationary generalized extreme value model. Water Resour. Res. 2007, 43, W03410. [Google Scholar] [CrossRef]
  23. López, J.; Francés, F. Non-stationary flood frequency analysis in continental Spanish rivers, using climate and reservoir indices as external covariates. Hydrol. Earth Syst. Sci. 2013, 17, 3189–3203. [Google Scholar] [CrossRef] [Green Version]
  24. Xiong, L.; Du, T.; Xu, C.; Guo, S.; Jiang, C.; Gippel, C.J. Non-Stationary Annual Maximum Flood Frequency Analysis Using the Norming Constants Method to Consider Non-Stationarity in the Annual Daily Flow Series. Water Resour. Manag. 2015, 29, 3615–3633. [Google Scholar] [CrossRef]
  25. Xiong, L.; Jiang, C. Designing flood hydrograph of the Weihe River considering nonstationarity. J. Water Resour. Res. 2015, 4, 109–119. [Google Scholar] [CrossRef]
  26. Vasiliades, L.; Galiatsatou, P.; Loukas, A. Nonstationary frequency analysis of annual maximum rainfall using climate covariates. Water Resour. Manag. 2015, 29, 339–358. [Google Scholar] [CrossRef]
  27. Haberlandt, U.; Radtke, I. Hydrological model calibration for derived flood frequency analysis using stochastic rainfall and probability distributions of peak flows. Hydrol. Earth Syst. Sci. 2014, 18, 353–365. [Google Scholar] [CrossRef] [Green Version]
  28. Winter, B.; Schneeberger, K.; Dung, N.V.; Huttenlau, M.; Achleitner, S.; Stötter, J.; Merz, B.; Vorogushyn, S. A Continuous Modelling Approach for Design Flood Estimation on Sub-Daily Time Scale. Hydrol. Sci. J. 2019, 64, 539–554. [Google Scholar] [CrossRef] [Green Version]
  29. Grimaldi, S.; Nardi, F.; Piscopia, R.; Petroselli, A.; Apollonio, C. Continuous Hydrologic Modelling for Design Simulation in Small and Ungauged Basins: A Step Forward and Some Tests for Its Practical Use. J. Hydrol. 2021, 595, 125664. [Google Scholar] [CrossRef]
  30. Fleischmann, A.S.; Collischonn, W.; Paiva, R.C.D.D. Estimating Design Hydrographs at the Basin Scale: From Event-Based to Continuous Hydrological Simulation. RBRH 2019, 24, e4. [Google Scholar] [CrossRef] [Green Version]
  31. Rowe, T.; Smithers, J. Review: Continuous Simulation Modelling for Design Flood Estimation—A South African Perspective and Recommendations. Water SA 2018, 44, 691–705. [Google Scholar] [CrossRef]
  32. Huang, X.; Wang, L.; Han, P.; Wang, W. Spatial and Temporal Patterns in Nonstationary Flood Frequency across a Forest Watershed: Linkage with Rainfall and Land Use Types. Forests 2018, 9, 339. [Google Scholar] [CrossRef] [Green Version]
  33. Falter, D.; Schröter, K.; Dung, N.V.; Vorogushyn, S.; Kreibich, H.; Hundecha, Y.; Apel, H.; Merz, B. Spatially Coherent Flood Risk Assessment Based on Long-Term Continuous Simulation with a Coupled Model Chain. J. Hydrol. 2015, 524, 182–193. [Google Scholar] [CrossRef] [Green Version]
  34. Yu, G.; Wright, D.B.; Zhu, Z.; Smith, C.; Holman, K.D. Process-Based Flood Frequency Analysis in an Agricultural Watershed Exhibiting Nonstationary Flood Seasonality. Hydrol. Earth Syst. Sci. 2019, 23, 2225–2243. [Google Scholar] [CrossRef] [Green Version]
  35. Boughton, W.; Droop, O. Continuous simulation for design flood estimation-a review. Environ. Modell. Softw. 2003, 18, 309–318. [Google Scholar] [CrossRef]
  36. Cameron, D.S.; Beven, K.J.; Tawn, J.; Blazkova, S.; Naden, P. Flood frequency estimation by continuous simulation for a gauged upland catchment (with uncertainty). J. Hydrol. 1999, 219, 169–187. [Google Scholar] [CrossRef]
  37. Blazkova, S.; Beven, K. Flood frequency estimation by continuous simulation of subcatchment rainfalls and discharges with the aim of improving dam safety assessment in a large basin in the Czech Republic. J. Hydrol. 2004, 292, 153–172. [Google Scholar] [CrossRef]
  38. Aronica, G.T.; Candela, A. Derivation of flood frequency curves in poorly gauged Mediterranean catchments using a simple stochastic hydrological rainfall-runoff model. J. Hydrol. 2007, 347, 132–142. [Google Scholar] [CrossRef]
  39. Moretti, G.; Montanari, A. Inferring the flood frequency distribution for an ungauged basin using a spatially distributed rainfall-runoff model. Hydrol. Earth Syst. Sci. 2008, 12, 1141–1152. [Google Scholar] [CrossRef] [Green Version]
  40. Haberlandt, U.; Ebner Von Eschenbach, A.; Buchwald, I. A space-time hybrid hourly rainfall model for derived flood frequency analysis. Hydrol. Earth Syst. Sci. 2008, 12, 1353–1367. [Google Scholar] [CrossRef] [Green Version]
  41. Courty, L.G.; Wilby, R.L.; Hillier, J.K.; Slater, L.J. Intensity-duration-frequency curves at the global scale. Environ. Res. Lett. 2019, 14, 084045. [Google Scholar] [CrossRef]
  42. Venkatesh, K.; Maheswaran, R.; Devacharan, J. Framework for Developing IDF Curves Using Satellite Precipitation: A Case Study Using GPM-IMERG V6 Data. Earth Sci. Inform. 2022, 15, 671–687. [Google Scholar] [CrossRef]
  43. Westra, S.; Thyer, M.; Leonard, M.; Kavetski, D.; Lambert, M. A strategy for diagnosing and interpreting hydrological model nonstationarity. Water Resour. Res. 2014, 50, 5090–5113. [Google Scholar] [CrossRef] [Green Version]
  44. Wallner, M.; Haberlandt, U. Non-stationary hydrological model parameters: A framework based on SOM-B. Hydrol. Process. 2015, 29, 3145–3161. [Google Scholar] [CrossRef]
  45. Deng, C.; Liu, P.; Wang, W.; Shao, Q.; Wang, D. Modelling time-variant parameters of a two-parameter monthly water balance model. J. Hydrol. 2019, 573, 918–936. [Google Scholar] [CrossRef]
  46. Song, J.X.; Xu, Z.X.; Liu, C.M.; Li, H.E. Ecological and environmental instream flow requirements for the Wei River-the largest tributary of the Yellow River. Hydrol. Process. 2007, 21, 1066–1073. [Google Scholar] [CrossRef]
  47. Wei, H.; Li, J.; Wang, J.; Tian, P. Analysis on runoff trend and influence factors in Weihe River basin. Bull. Soil Water Conserv. 2008, 28, 76–80. [Google Scholar]
  48. Li, S.; Xiong, L.; Li, H.; Leung, L.R.; Demissie, Y. Attributing runoff changes to climate variability and human activities: Uncertainty analysis using four monthly water balance models. Stoch. Environ. Res. Risk Assess. 2016, 30, 251–269. [Google Scholar] [CrossRef]
  49. Zhao, G.; Mu, X.; Tian, P.; Wang, F.; Gao, P. Climate changes and their impacts on water resources in semiarid regions: A case study of the Wei River basin, China. Hydrol. Process. 2013, 27, 3852–3863. [Google Scholar] [CrossRef]
  50. Gao, Z.; Long, D.; Tang, G.; Zeng, C.; Huang, J.; Hong, Y. Assessing the Potential of Satellite-Based Precipitation Estimates for Flood Frequency Analysis in Ungauged or Poorly Gauged Tributaries of China’s Yangtze River Basin. J. Hydrol. 2017, 550, 478–496. [Google Scholar] [CrossRef]
  51. Gao, P.; Geissen, V.; Ritsema, C.J.; Mu, X.; Wang, F. Impact of climate change and anthropogenic activities on stream flow and sediment discharge in the Wei River basin, China. Hydrol. Earth. Syst. Sci. 2013, 17, 961–972. [Google Scholar] [CrossRef] [Green Version]
  52. Su, X.L.; Kang, S.Z.; Wei, X.M.; Xing, D.W.; Cao, H. Impact of climate change and human activity on the runoff of Wei River basin to the Yellow River. J. Northwest A F Univ. (Nat. Sci. Ed.) 2007, 35, 153–159. [Google Scholar]
  53. Liu, Q.; Li, S.; Zhou, G.; Feng, Z.; Wang, G.; Qiu, Q. Attribution of Nonstationary Changes in the Annual Runoff of the Weihe River Using the De-Nonstationarity Method. Hydrol. Res. 2022, 53, 407–418. [Google Scholar] [CrossRef]
  54. Yan, L.; Xiong, L.; Luan, Q.; Jiang, C.; Yu, K.; Xu, C.-Y. On the Applicability of the Expected Waiting Time Method in Nonstationary Flood Design. Water Resour. Manag. 2020, 34, 2585–2601. [Google Scholar] [CrossRef]
  55. Jiang, C.; Xiong, L.; Wang, D.; Liu, P.; Guo, S.; Xu, C. Separating the impacts of climate change and human activities on runoff using the Budyko-type equations with time-varying parameters. J. Hydrol. 2015, 522, 326–338. [Google Scholar] [CrossRef]
  56. Adam, J.C.; Clark, E.A.; Lettenmaier, D.P.; Wood, E.F. Correction of global precipitation products for orographic effects. J. Clim. 2006, 19, 15–38. [Google Scholar] [CrossRef]
  57. Wang, D.; Hejazi, M. Quantifying the relative contribution of the climate and direct human impacts on mean annual streamflow in the contiguous United States. Water Resour. Res. 2011, 47, W00J12. [Google Scholar] [CrossRef] [Green Version]
  58. Chen, J.; Wu, X.; Finlayson, B.L.; Webber, M.; Wei, T.; Li, M.; Chen, Z. Variability and trend in the hydrology of the Yangtze River, China: Annual precipitation and runoff. J. Hydrol. 2014, 513, 403–412. [Google Scholar] [CrossRef]
  59. Yang, T. Shaanxi Statistical Yearbook; China Statistics Press: Beijing, China, 2009. [Google Scholar]
  60. Shao, H. Simulation of Soil and Water Loss Variation toward Terrace Practice in the Weihe River Basin; Northwest A & F University: Xi’an, China, 2005. [Google Scholar]
  61. Perrin, C.; Michel, C.; Andréassian, V. Improvement of a parsimonious model for streamflow simulation. J. Hydrol. 2003, 279, 275–289. [Google Scholar] [CrossRef]
  62. Kuczera, G.; Kavetski, D.; Franks, S.; Thyer, M. Towards a Bayesian total error analysis of conceptual rainfall-runoff models: Characterising model error using storm-dependent parameters. J. Hydrol. 2006, 331, 161–177. [Google Scholar] [CrossRef]
  63. Renard, B.; Kavetski, D.; Leblois, E.; Thyer, M.; Kuczera, G.; Franks, S.W. Toward a reliable decomposition of predictive uncertainty in hydrological modeling: Characterizing rainfall errors using conditional simulation. Water Resour. Res. 2011, 47, W11516. [Google Scholar] [CrossRef]
  64. Zeng, L.; Xiong, L.; Liu, D.; Chen, J.; Kim, J.S. Improving Parameter Transferability of GR4J Model under Changing Environments Considering Nonstationarity. Water 2019, 11, 2029. [Google Scholar] [CrossRef] [Green Version]
  65. Vrugt, J.A.; Gupta, H.V.; Bouten, W.; Sorooshian, S. A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters. Water Resour. Res. 2003, 39, 1201. [Google Scholar] [CrossRef]
  66. Vrugt, J.A.; Gupta, H.V.; Dekker, S.C.; Sorooshian, S.; Wagener, T.; Bouten, W. Application of stochastic parameter optimization to the Sacramento soil moisture accounting model. J. Hydrol. 2006, 325, 288–307. [Google Scholar] [CrossRef] [Green Version]
  67. Feyen, L.; Vrugt, J.A.; Nualláin, B.Ó.; van der Knijff, J.; De Roo, A. Parameter optimisation and uncertainty assessment for large-scale streamflow simulation with the LISFLOOD model. J. Hydrol. 2007, 332, 276–289. [Google Scholar] [CrossRef] [Green Version]
  68. Ajami, N.K.; Duan, Q.; Sorooshian, S. An integrated hydrologic Bayesian multimodel combination framework: Confronting input, parameter, and model structural uncertainty in hydrologic prediction. Water Resour. Res. 2007, 43, W01403. [Google Scholar] [CrossRef]
  69. Gelman, A.; Rubin, D.B. Inference from iterative simulation using multiple sequences. Stat. Sci. 1992, 7, 457–472. [Google Scholar] [CrossRef]
  70. Smith, T.; Sharma, A.; Marshall, L.; Mehrotra, R.; Sisson, S. Development of a formal likelihood function for improved Bayesian inference of ephemeral catchments. Water Resour. Res. 2010, 46, W12551. [Google Scholar] [CrossRef]
  71. Liao, Y.; Zhang, Q.; Chen, D. Stochastic modeling of daily precipitation in China. J. Geogr. Sci. 2004, 14, 417–426. [Google Scholar]
  72. Knighton, J.O.; Walter, M.T. Critical Rainfall Statistics for Predicting Watershed Flood Responses: Rethinking the Design Storm Concept. Hydrol. Process. 2016, 30, 3788–3803. [Google Scholar] [CrossRef]
  73. Liao, Y.; Chen, D.; Gao, G.; Xie, Y. Impacts of climate changes on parameters of a weather generator for daily precipitation in China. Acta Geogr. Sin. 2009, 7, 871–878. [Google Scholar]
  74. Hesarkazzazi, S.; Arabzadeh, R.; Hajibabaei, M.; Rauch, W.; Kjeldsen, T.R.; Prosdocimi, I.; Castellarin, A.; Sitzenfrei, R. Stationary vs Non-Stationary Modelling of Flood Frequency Distribution across Northwest England. Hydrol. Sci. J. 2021, 66, 729–744. [Google Scholar] [CrossRef]
Figure 1. Location of Weihe River Basin (WRB) in China (a) and stations with hydrological and meteorological measurements (b).
Figure 1. Location of Weihe River Basin (WRB) in China (a) and stations with hydrological and meteorological measurements (b).
Water 14 03959 g001
Figure 2. Annual and the 11-year moving average value of 6 covariates related to human activities. (af) represent population, gross domestic product, cultivated land area, irrigated land area, reservoir storage and soil-water conservation land area, respectively.
Figure 2. Annual and the 11-year moving average value of 6 covariates related to human activities. (af) represent population, gross domestic product, cultivated land area, irrigated land area, reservoir storage and soil-water conservation land area, respectively.
Water 14 03959 g002
Figure 3. Comparison between the observed and simulated flow-duration curves for the whole period (a) and autumn season (b) from model zero, one and two.
Figure 3. Comparison between the observed and simulated flow-duration curves for the whole period (a) and autumn season (b) from model zero, one and two.
Water 14 03959 g003
Figure 4. Comparison of the observed and simulated annual maximum flow. (ac) represent model zero, one and two, respectively.
Figure 4. Comparison of the observed and simulated annual maximum flow. (ac) represent model zero, one and two, respectively.
Water 14 03959 g004
Figure 5. Annual variation of the parameter θ 1 in model one (a) and model two (b).
Figure 5. Annual variation of the parameter θ 1 in model one (a) and model two (b).
Water 14 03959 g005
Figure 6. Comparison of empirical probability distributions of observed and model-generated annual maximum rainfall series for Tianshui station.
Figure 6. Comparison of empirical probability distributions of observed and model-generated annual maximum rainfall series for Tianshui station.
Water 14 03959 g006
Figure 7. Variation of the estimated annual maximum floods for an exceedance probability of 0.01 based on model zero and one.
Figure 7. Variation of the estimated annual maximum floods for an exceedance probability of 0.01 based on model zero and one.
Water 14 03959 g007
Figure 8. Variation of the estimated annual maximum floods for an exceedance probability of 0.01 based on model zero and two.
Figure 8. Variation of the estimated annual maximum floods for an exceedance probability of 0.01 based on model zero and two.
Water 14 03959 g008
Table 1. Description of the parameters within the GR4J model.
Table 1. Description of the parameters within the GR4J model.
ParameterDescriptionUnitFeasible Range
θ 1 production storage capacitymm20–1200
θ 2 groundwater exchange coefficientmm−5–3
θ 3 one day ahead maximum capacity of the routing storemm20–500
θ 4 time base of unit hydrographdays1–5
Table 2. Model evaluation and selection for the nonstationary GR4J model (model 2).
Table 2. Model evaluation and selection for the nonstationary GR4J model (model 2).
CaseCovariateEquation for the Time-Varying Parameter θ 1 , t NSE [-]KGE [-]RE [%]
RSSWC
C0 θ 1 , t = 542.1 0.7110.80111.5
C1 θ 1 , t = 290.3 + 195.6 R S t R S ¯ 0.7530.8458.9
C2 θ 1 , t = 296.8 + 152.4 S W C t S W C ¯ 0.7480.8399.4
C3 θ 1 , t = 304.5 + 102.1 R S t R S ¯ + 69.2 S W C t S W C ¯ 0.7650.8538.5
Table 3. Simulation performances of the stationary and nonstationary GR4J model for WRB.
Table 3. Simulation performances of the stationary and nonstationary GR4J model for WRB.
ModelCovariatesCalibration Period (1951–1990)Validation Period (1991–2011)
NSE
[-]
KGE
[-]
RE
[%]
NSE
[-]
KGE
[-]
RE
[%]
Model zeronone0.7110.80111.50.6920.79113.5
Model onetime0.7430.8329.80.7140.81210.1
Model twoRS, SWC0.7650.8538.50.7160.8189.8
Table 4. Event characteristics of the observed rainfall series (OBS) and the synthetic rainfall series (STOCH) for the meteorological station Tianshui.
Table 4. Event characteristics of the observed rainfall series (OBS) and the synthetic rainfall series (STOCH) for the meteorological station Tianshui.
Event CharacteristicsUnitOBSSTOCH
Number of rainfall events per year-5448
Mean of event volumemm9.5410.08
Standard deviation of event volumemm14.7613.58
Skewness of event volume-3.243.52
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zeng, L.; Bi, H.; Li, Y.; Liu, X.; Li, S.; Chen, J. Nonstationary Annual Maximum Flood Frequency Analysis Using a Conceptual Hydrologic Model with Time-Varying Parameters. Water 2022, 14, 3959. https://doi.org/10.3390/w14233959

AMA Style

Zeng L, Bi H, Li Y, Liu X, Li S, Chen J. Nonstationary Annual Maximum Flood Frequency Analysis Using a Conceptual Hydrologic Model with Time-Varying Parameters. Water. 2022; 14(23):3959. https://doi.org/10.3390/w14233959

Chicago/Turabian Style

Zeng, Ling, Hongwei Bi, Yu Li, Xiulin Liu, Shuai Li, and Jinfeng Chen. 2022. "Nonstationary Annual Maximum Flood Frequency Analysis Using a Conceptual Hydrologic Model with Time-Varying Parameters" Water 14, no. 23: 3959. https://doi.org/10.3390/w14233959

APA Style

Zeng, L., Bi, H., Li, Y., Liu, X., Li, S., & Chen, J. (2022). Nonstationary Annual Maximum Flood Frequency Analysis Using a Conceptual Hydrologic Model with Time-Varying Parameters. Water, 14(23), 3959. https://doi.org/10.3390/w14233959

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop