Next Article in Journal
Modelling Plume Development with Annual Pulses of Contaminants Released from an Airport Runway to a Layered Aquifer, Evaluation of an In Situ Monitoring System
Next Article in Special Issue
Flood Simulations Using a Sensor Network and Support Vector Machine Model
Previous Article in Journal
Chironomid-Based Modern Summer Temperature Data Set and Inference Model for the Northwest European Part of Russia
Previous Article in Special Issue
Methodological Guide to Forensic Hydrology
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Copula Application for Analysis of the Flood Threat at the River Confluences in the Danube River Basin in Slovakia

by
Veronika Bačová Mitková
*,
Dana Halmová
,
Pavla Pekárová
and
Pavol Miklánek
Slovak Academy of Sciences, Institute of Hydrology, Dúbravská Cesta 9, 841 04 Bratislava, Slovakia
*
Author to whom correspondence should be addressed.
Water 2023, 15(5), 984; https://doi.org/10.3390/w15050984
Submission received: 31 January 2023 / Revised: 1 March 2023 / Accepted: 1 March 2023 / Published: 4 March 2023
(This article belongs to the Special Issue Advance in Flood Risk Management and Assessment Research)

Abstract

:
In hydrological practice, individual elements of the hydrological cycle are most often estimated and evaluated separately. Uncertainty in the size estimation of extrema discharges and their return period can affect the statistical assessment of the significance of floods. One example is the simultaneous occurrence and joining of extremes at the confluence of rivers. The paper dealt with the statistical evaluation of the occurrence of two independent variables and their joint probabilities of occurrence. Bivariate joint analysis is a statistical approach for the assessment of flood threats at the confluence of rivers. In our study, the annual maximum discharges monitored on four selected Slovak rivers and their tributaries represent the analyzed variables. The Archimedean class of copula functions was used as a set of mathematical tools for the determination and evaluation of the joint probability of annual maximal discharges at river confluences. The results of such analysis can contribute to a more reliable assessment of flood threats, especially in cases where extreme discharges occur simultaneously, increasing the risk of devastating effects. Finally, the designed discharges of the different return periods calculated by using the univariate approach and the bivariate approach for the gauging station below the confluence of the rivers was evaluated and compared.

1. Introduction

To assess the significance of extreme events, various statistical methods are used. The theory of probability is one of the most widely used mathematical tools in hydrological practice for the evaluation of event extremity. In hydrological practice, individual elements that characterize the hydrological cycle are most often estimated and evaluated separately, which means that univariate statistical analysis is used. This approach gives satisfactory results when applied to simple systems, for example, where the mainstream does not capture major tributaries [1]. A different situation can arise if rivers with similarly significant overflows form a confluence and extreme events meet at the confluence simultaneously, which can increase the significance of the event or cause a catastrophic situation in the area below the confluence. Artificial interventions in river basins affect or disturb their natural water circulation. Regulations or anthropogenic interventions in river basins often cause changes in their runoff conditions or cause changes in the transformation of flow waves in the riverbed. Such interventions can result in the joint occurrence of flood waves at river confluences. In addition, climate changes also affect the behavior of hydrological extremes along rivers and the interdependent structures between hydrological characteristics. In order to obtain this information, multivariate statistical analysis with a combined cumulative distribution function and a probability density function can be used. A Gaussian probability distribution was used as the first joint distribution function, but the marginal probability distributions had to be normally distributed [2,3]. The limitation of this approach in hydrology is that all variables have the same probability distribution, while the analyzed elements have different marginal distributions. Copula functions are mathematical tools that can be used to solve the above-mentioned limitation regarding marginal functions in the two-dimensional analysis of hydrological elements. Copula functions express the structure of dependence between random variables, regardless of their marginal distribution. In the context of mentioned factors (climate change, anthropogenic activities), a multivariate statistical approach seems to be a suitable mathematical tool for analyzing changes in the mutual dependence of the natural variables or joint occurrence of extremes. The joint probability of two random variables in contrast to the conditional probability reflects the probability with which the two random variables occur simultaneously [4]. The monograph on the Danube by [5] dealt with the coincidence between flood waves in the Danube River and its selected tributaries. The bivariate analysis confirmed that flood wave genesis in the Danube River basin is very complex. The coincidence of waves caused a flood with a return period of 100 years in 2000 on the Tisa and the Bodrog Rivers. The coincidence of the individual flood waves in the profiles of the Vltava and the Dyje Rivers (Czech Republic) significantly increased the flow return period in basin areas, causing extreme floods in August 2002 [6]. Espinoza et al. [7] dealt with the bivariate analysis of the great flood that occurred in 2012 in the Amazonas River, which was caused by two large simultaneous flood waves. Li et al. [8] studied the effects of the coinciding flood peaks and the impact of the high precipitation for the Dongting Lake region on flood vulnerability.
The Archimedean class of copula functions is very popular in hydrological applications for studying the relations between the individual elements of a hydrological cycle. This class of copulas is popular in empirical applications due to their flexibility, easy construction, and whole suite of closed-form copulas that cover a wide range of dependency structures including comprehensive and non-comprehensive copulas, radial symmetry and asymmetry, and asymptotic tail dependence and independence. Their applications in flood frequency analyses are very often focused on interdependence analyses between flood characteristics such as peak discharge, volume, and duration. The choice of a specific copula depends on the nature of the dataset. De Michele et al. [9] used the Gumbel–Hougaard copula to model the joint distribution of flood peak and volume to check the adequacy of the dam spillway. Zhang and Singh [10,11] applied the bivariate selected copulas and trivariate Gumbel–Hougaard to obtain conditional return periods of flood peak, volume, and duration. Reddy and Ganguli [12] concluded that the Frank copula better fit the joint and conditional return periods of the mentioned flood characteristics compared to the Ali-Mikhail-Haq, Clayton, Gumbel–Hougaard copulas. The Clayton and Gumel–Hougaard copulas were selected as appropriate tools for bivariate analysis of the flood characteristics at the Bratislava Gauging Station on the Danube River in Slovakia [13]. The Clayton and Student-t copulas were selected as appropriate tools for the bivariate analysis of the flood characteristics at the Litija Gauging Station on the Sava River in Slovenia [14]. The Galambos, Gumbel, and Hüsler–Reiss copulas showed the best performance for synoptic and flash floods, while the Frank copula showed the best performance for snowmelt floods for the bivariate modeling of the relationship between the flood peaks and volumes with a focus on flood generation processes [15]. The bivariate analysis of the peak discharge and volumes with the use of various copula families (11 copula functions) on the Danube River showed that most favored the Frank copula rather than the Clayton and Normal copulas [16]. The study of the bivariate dependences and joint probabilities of various hydrological variables of the Morava River (Slovakia) using Archimedean, extreme value (EV), and Archimax copulas was published in Matúš [17]. The Frank or Gumbel copulas were selected for bivariate drought frequency analysis because these copulas well reproduce the upper tail dependence structure between drought duration and severity [18]. Bezak et al. [19] presented the method of determination of rainfall IDF (intensity–duration–frequency) curves using Frank copula and evaluated the results with empirical rainfall thresholds for selected extreme events that occurred in Slovenia.
Chen et al. [20] applied multidimensional copulas to a flood risk analysis of the corresponding peak discharges at selected river confluences and evaluated the X-Gumbel copula function as an appropriate tool for assessing the joint conditional distribution function and for return periods of joint discharges. Some Archimedean copulas were applied to assess the combined flood occurrence at the confluence of the rivers Rhine and Sieg (Germany) [21]. In Peng et al. [22], the joint probabilities of the annual maximum discharges were investigated using Archimedean and elliptical copulas and compared with the monthly maximum discharges between the mainstream and its tributaries. Fischer et al. [23] determined long synthetic samples of peak–volume pairs using copulas, which were then applied in a multivariate statistical flood frequency analysis considering flood types and impact of the tributary. Joint frequency analysis at the confluences of the Sava River showed the potential risk of underestimating the design discharges estimated by using the traditional one-dimensional analysis of extremes [24]. The analysis of the joint probabilities of flood occurrences at the Danube and Drava confluence showed that the joint probability of an extreme situation is relatively low (0.79%) [25]. The authors of [25] concluded that such a situation occurred in 1966, and it was one of the biggest floods on record.
Therefore, the objective of this study was to apply a bivariate Archimedean copula to analyze the joint probabilities of flood hazard at the Slovak River confluences. The four mainstreams and their tributaries of the Slovak part of the Danube River basin were selected for analysis. Annual maximum discharges from the upper parts of the selected rivers were chosen, and the Gumbel–Hougard copula function was applied to construct the joint distribution. The results of the analysis allow for a comparison and evaluation of the annual maximum discharges with specific return periods T calculated by the univariate flood frequency approach and by the copula approach under the confluences.

2. Materials and Methods

2.1. Materials

Around 96% of the Slovak territory belongs to the Black Sea drainage area. The Black Sea drainage area represents a part of the basin of the European waterway—the Danube—on the territory of Slovakia and its tributaries: Morava, Váh, Hron, and Ipeľ. The basins of Slaná, Bodva, Hornád, and Bodrog belong to the drainage area of Tisa. The Baltic Sea drainage area (4%) represents the basins of the Poprad and Dunajec Rivers. We selected the four mainstreams of the Slovak Danube River basin and their tributaries in the sections with the least anthropogenic influence (the upper sections of the river) for analysis in the present study. The longest possible data series of the annual maximum discharges were analyzed. Table 1 lists the selected mainstreams, tributaries, gauging stations, and monitored periods. The scheme of the selected rivers and their tributaries is illustrated in Figure 1.
The courses of the selected and analyzed maximum annual discharge pairs are presented in Figure 2. In bivariate flood analysis at the river confluences, the data from gauge stations located on the mainstream immediately above and below the confluence and the gauge station located on the tributary above the confluence were used. We investigated the maximum annual discharge pairs Qmaxup–Qmaxtr, where Qmaxup is the maximum annual discharge of the mainstream above the confluence, Qmaxtr is the maximum annual discharge of the tributary above the confluence, and Qmaxdwn represents the maximum annual discharge of the mainstream below the confluence. The Váh River and its tributary, the Belá River, showed the highest differences in the dates when the annual maximum discharges occur (Figure 3a). In addition, the Nitra River and its tributary, the Bebrava River, showed the lowest difference in the dates when the annual maximum discharges occurred (Figure 3b).
The date when the annual maximum discharges between the Váh River and their tributary the Belá River occurs indicates a partly different flood regime between the upper part of the Váh and its tributary, the Belá. Authors of the monograph [26] assumed that the orientations of the various mountains in its path and the depression position of the catchment as well as the different spatial distributions of precipitation might cause the partially different flood regime of the upper part of the Váh and its tributary.

2.2. Method

In our study, we used the Gumbel–Hougaard copula function to perform the statistical bivariate analysis of flood hazards at the selected Slovak River confluences. The Gumbel–Hougaard copula belongs to the Archimedean class of copulas. The relationships between Kendall’s coefficient and the generating function show that only the positive dependence structure of the data can be analyzed (e.g., peak–volume or duration–volume) [27,28,29,30,31,32]. This copula function does not allow for negative dependence and exhibits a strong upper-tail dependence and a relatively weak lower-tail dependence. The Gumbel–Hougard copula may therefore be a suitable choice for dependencies where there is a strong correlation at high values but a weaker correlation at low values. The first step of the bivariate analysis is to identify the marginal distribution. Hydrological variables can have different properties, so it is necessary to scale the data to variables in the interval [0, 1]. Next, we can separate the marginal behavior and the dependence structure. The joint distribution obtained from the marginal distributions of the uniform variables completely describes the dependence structure of the variables. The mathematical description of the Gumbel–Hougaard copula is listed in Table 2. The copula parameter θ was calculated according a mathematical relationship between Kendall’s rank correlation and the generating function φ(t) [33].
The possibilities of statistically testing how well a copula function fits a set of empirical data have been studied in many publications (e.g., [34,35,36,37,38]). Meylan et al. [39] divided the testing into three groups: (1) Based on probability integral transformation; (2) based on the kernel estimation of the copula density; and (3) based on the empirical processes of copulas. There exist several goodness-of-fit tests for comparing the empirical joint probability population and the probability population derived by parametric copulas (e.g., Kolmogorov–Smirnov, Chi-square, Anderson–Darling or Cramér–von Mises). The empirical probability [40,41,42] is represented in Equation (1):
F ( x , y ) = m = 1 i l = 1 i n m l 0.44 N + 0.12
where N is the number of the variables; j and i are ascending ranks of xi and yi; and nml is the number of occurrences of the combinations of xi and yj.
In the hydrological frequency analysis, the return period of the hydrological variable that occurs once in a year can be defined as
T = μ ( 1 F ( x ) )
where T is the return period; F(x) is the marginal cumulative distribution function; and μ is an average arrival interval between events. In the frequency analysis of the annual values, μ = 1.
In bivariate statistical analysis, we can use two formulas to calculate the joint return period, depending on whether only one or both of the monitored values exceed or are equal to a certain threshold value that defines the extremity. The joint return period equations of two variables are defined and described in many publications in the following form [43,44,45]:
T ( x , y ) a n d = μ ( 1 F ( x ) F ( y ) + C ( F ( x ) , F ( y ) ) )
T ( x , y ) o r = μ ( 1 C ( F ( x ) , F ( y ) ) )
T o r ( x , y ) min [ T x , T y ] max [ T x , T y ] T a n d ( x , y )
where C(F(x), F(y)) is the bivariate joint distribution function expressed as a copula function and F(x) and F(y) are the marginal distribution functions of the variable X and Y. The operator of the penetration (X   x and Y   y) is used in Equation (3), and therefore, this formula was used to calculate the joint return period if both investigated quantities exceeded a certain threshold value. Equation (4), on the other hand, works with the operator of the unification (X   x or Y   y). For this reason, it was used to calculate the joint return period if only one of the monitored values exceeded the given threshold value. These relationships indicate that different combinations of the numbers x and y can cover the same return period.
The conditional return period for Y, given X   x, may be expressed as [44]:
T ( y | X x ) = μ ( 1 F ( x ) ) ( 1 F ( y ) F ( x ) + C ( F ( x ) , F ( y ) ) )
The conditional cumulative distribution function of Y, given X   x, can be expressed as
F ( y | X x ) = F ( y ) C ( F ( x ) , F ( y ) ) ( 1 F ( x ) )
where C(F(x), F(y)) is the copula function of the random variables X and Y. An equivalent formula for the conditional return period of Y   y, given X   x, can thus be obtained.
The bivariate return period for variables are illustrated using contour lines called isolines. The isolines of the joint “or” return period are the level curves of the G–H copula of interest, while the isolines of the joint “and” return period are the level curves of the survival copula of interest.

3. Results

3.1. Univariate Statistical Analysis of Flood Hazards

First, the univariate parametric marginal distributions of the annual maximum discharges were identified. In our study, the Johnson SB distribution was evaluated as the most acceptable marginal distribution from the various tested distributions, except for station Nitrianska Streda, where the Weibull probability distribution most acceptable fitted the data. The Johnson SB distribution is a continuous four-parametric distribution defined on a bounded range, and the distribution can be symmetric or asymmetric (Equation (8)). Svanidze and Grigolia [46] recommended this probability distribution as being suitable for annual discharges. This parametric distribution has flexibility in comparison to commonly used distributions such as the Log-normal and the Gamma distributions [47]. The PDF for a variable X that follows an SB PDF can be expressed as [48]:
f ( x ) = δ λ 2 π ( x ξ ) ( ξ + λ x )   e x p ( 1 2 [ λ + δ ln ( x ξ ξ + λ x ) ] 2 )
where ξ < x < ξ + λ, λ, and σ are >0, −∞ < ξ < ∞, and −∞ < γ < ∞, respectively.
The parameter λ gives the rang;, ξ is the location parameter (lower bound); δ and γ are the shape parameters, and γ = 0 indicates symmetry.
The Kolmogorov–Smirnov (K–S) test was used to test the assumption that a theoretical distribution follows the empirical discharge magnitudes. A p-value at a 5% significance level was used as the criterion for the acceptance of the proposed distribution hypothesis. Empiric distributions, evaluated with the Cunnane [41] formula, were fitted with the selected parametrical cumulative distribution function. Based on the goodness-of-fit test, the calculated RMSE, and a graphical comparison between the monitored data and generated data, the selected parametrical distribution functions were used as the marginal distribution functions for bivariate frequency analysis (Figure 4). The annual maximum discharges estimated using a marginal probability distribution for the selected return period T are listed in Table 3. The selected parametrical distribution function was also used as the marginal distribution function in the joint frequency analysis of flood hazards at selected Slovak River confluences using copulas.

3.2. Bivariate Statistical Analysis of Flood Hazards at River Confluences Using Gumbel–Hougaard Copula

The Gumbel–Hougaard copula, which is one of the Archimedean copulas, was used as a mathematical tool to calculate the joint probability of the two hydrologic variables at the river confluences. In Feng et al. [49], the authors used three types of time-varying copula functions to analyze the risk of coinciding, nonstationary floods. The authors of [49] recommended the Gumbel copula rather than the Frank and Clayton copulas.
Correlation analysis showed a strong positive dependence between the monitored annual maximum discharges at the confluences of all rivers. Kendall’s rank correlation coefficient ranged between 0.23 and 0.48 (Figure 5a,b). The correlation of the selected combination of hydrological variables showed a statistically significant correlation. The combination of the variables Qmaxup−Qmaxtr between the Váh River and the Belá River reached the lowest value of the Kendall rank correlation (Figure 5). The created combinations of the hydrological variables were used in the bivariate frequency analysis to investigate how the relationship of the hydrological characteristics may affect the size of extreme hydrological situations.
The Gumbel–Hougaard copula’s parameters are listed in Table 4. The K–S nonparametric goodness-of-fit test was used to assess whether the selected copula function followed the joint empirical distribution. The results show that we cannot reject the hypothesis that the selected copula fits well with the empirical data at a 5% significance level (Table 4). Second, the mean absolute errors (MAE) were used as statistical criteria to determine the level of agreement between the discharges simulated by the copula function and the actual monitored discharges (Table 4). Graphical comparisons of the joint empirical and fitted Gumbel–Hougaard copula of the selected rivers and their tributaries for selected pairs Qmaxup−Qmaxtr are illustrated in Figure 6a–d. According the above-mentioned criteria, the Gumbel–Hougaard copula was deemed to be a suitable statistical tool to calculate the joint probability distribution of the discharges in our study.
Subsequently, the selected copula function was used to generate 9000 pairs of selected combinations of hydrological variables on the monitored river confluences. The generated pairs were used to determine the joint probability distribution using copulas. Subsequently, the joint return periods of the analyzed pairs of the annual maximum discharges Qmaxup−Qmaxtr were estimated. Figure 7 illustrates the scatter plot of the monitored annual maximum discharges and values generated by using the Gumbel–Hougard copula. Figure 7 also illustrates the isolines of the joint return periods “or” and “and”, which are the level curves of the Gumbel–Hougaard copula of interest if the variables exceeded the outward bounds and inward bounds, respectively.
The extreme values of the combined discharges’ joint return periods were calculated, (i.e., the maximum discharge resulting from combinations of discharges of the mainstreams and their tributaries). These extreme values represent the worst case scenario for flood hazards at these confluences. Table 5 presents a comparison of the estimated T-year designed discharges (Q50, Q100, Q200, Q500, and Q1000) based on the univariate approach and the copula approach for gauging stations below the selected mainstream river confluences. For the traditional univariate method, the resulting discharge for the selected return period was calculated as a reciprocal of the probability of exceedance.

4. Discussion

In the submitted study, the long-term annual maximum discharges at four mainstreams in the Slovak part of the Danube River basin (Morava, Váh, Nitra, and Hron) and their tributaries (Morava, Belá, Nitra, and Slatina) were analyzed. The calculated joint probabilities indicate that coincident flood events are more likely to occur for medium-scale or small-scale flood events. The calculated joint probabilities for large flood events was nearly equal to zero. In following, the extreme values of the joint return periods of the combined discharges were calculated (i.e., the maximum discharge resulting from the combinations of the discharges of the mainstreams and their tributaries). These extreme values represent the worst case scenarios for flood hazards at these confluences. The results of the copula application for analysis of the flood threat at the Slovak River confluences showed that the discharges estimated by a copula in the station below the confluence achieved higher values than the discharges estimated by a univariate approach. The results of the analysis also showed that differences between the discharges estimated by a copula and univariate approach below the confluence decreased with an increase in the return period. For the Váh–Belá River confluence, the differences in annual maximum discharges below the confluence calculated by a copula in comparison to the traditional approach ranged from 20% for 50-year return periods to 11% for a 500-year return period. These relatively high differences between discharges estimated using the copula and univariate approach could indicate different hydrological regimes of the Váh and Belá Rivers for floods with high values of the return period. On the other hand, the relatively low differences between the discharges estimated using the univariate and copula approaches indicate a similar hydrological regime in the mainstream and its tributary.
Catastrophic floods have had and continue to have an important impact on the environment and the economy. Identifying flood risk is very important and difficult, and we are still looking for answers on a huge number of key issues. The natural variability in streams and flows is related to natural cycles, but also to anthropogenic activities. For the Central European region, an increase in the frequency, duration, and severity of extreme hydro meteorological phenomena is expected in the future as a direct consequence of climate change. Climate change alters the interdependence structures of the hydrological variables. On the other hand, urbanization, channel regulation, dams, and many other interventions can influence the behavior of the basin during extreme hydrological events or affect the travel times of floods. The monitoring and evaluation of extreme hydrological phenomena using various models and methods is still necessary as a result of anthropogenic activities and climatic changes, which can negatively affect the application of frequency analysis. The statistical approach to hydrological analyses based on variables that occur only once per year represents the most frequently used approach in probabilistic hydrology. This approach has three limitations. The first is the length of the data series, which can frequently be less than 100 years. The second is the non-complete time-series data. Because they are incomplete, they may not provide comprehensive information about the conditions in the basin before the extreme flooding event occurs. The last one is the choice of suitable probability distribution functions, parameter estimation methods, and study period. An important factor in the correct estimation of extremes is the uncertainty of the applied statistical method. The estimation of the uncertainty in the designed discharges was investigated in [50] and [51]. For example, in our analysis, the four parametric JSB distribution fit the empirical data the best and increased the number of model parameters to nine. Stedinger et al. [52] preferred the generalized extreme value (GEV) distribution for estimating hydrological extremes. Millington et al. [53] examined the suitability of several types of probability distributions (GEV, LPIII, and Gumbel) for estimating the T-year discharges. We must not forget the fact that discharges with longer return periods (usually up 200 years) are extrapolated values burdened by systematic estimation errors as well as the choice of statistical methodology. A flood bivariate hydrological analysis of extremes plays an important role in flood risk analysis. Such analyses provide an overview of the flood event as a whole and can enable a more reliable assessment of flood risks and subsequent flood protection. The time variance and asymmetry of copulas make them suitable tools for such analyses. The applications of the copulas in the frequency analysis of the hydrological extremes are very often focused on the interdependence analyses between hydrological variables such as discharge–volume, volume–duration, and discharge–duration. The copula function used as a mathematical tool in the frequency analysis of confluence flood waves was introduced in the work of Wang [54]. He applied four often-used Archimedean copulas to confluence floods and concluded that the Frank copula and the Gumbel–Hougaard copula are suitable statistical tools. The results of the bivariate analysis in Poyang Lake and the Yangtze River also showed that the coincidence probabilities were higher for flood events with shorter return periods [55]. However, the authors of [55] selected the Clayton copula as the better choice. In recent years, the use of the copula functions in the bivariate analysis of the flood risk at the river confluences has been increasing. Various authors (e.g., see [5,56,57,58]) dealt with the effect of synchronous extreme events on the mainstream and its tributaries. As we previously mentioned, the natural transformation of flood waves is also being increasingly affected and disturbs the artificial interventions in river basins and climate change. This can result in the synchronous occurrence of flood waves at the confluence of the rivers.

5. Conclusions

The paper presents an evaluation of the bivariate joint probability approach that may provide a practical method for performing the frequency analysis of floods at river confluences using a copula function. We focused on the statistical bivariate analysis of flood hazards at selected confluences of Slovak rivers.
The presented research showed the following:
-
The copula-based joint probability approach for the confluence flood estimation performed well for the selected river basins;
-
The copula-based joint probability approach provides a way to estimate the confluence flood without the discharge records needed for the mainstream below the confluence and without difficult computations such as flow routing;
-
The copula functions for the multivariate analyses enable the use of various types of marginal distributions and thus release the limitation of the others in the case of multivariate approaches where the margins follow the same type of distributions. In our study, based on the selected criterions and the tests, the same type of probability distribution fit the analyzed data, except for Nitrianska Streda Station, situated below the Nitra–Bebrava confluence;
-
The joint return periods calculated using copulas could be used to determine the severity of floods based on the desired relations between the mainstreams and their tributaries, looking for the exceedance of both variables.
Although this work was carried out in the basins of Slovakia, the methodology, de-spite its limitations, is also applicable for hydrological analyses in other localities. In our work, we used the longest possible series of input data, the availability of which in other (foreign) locations can be problematic. For this reason, we cooperate very closely with the countries of the Danube River region.

Author Contributions

Conceptualization, V.B.M.; Formal analysis, V.B.M.; Investigation, V.B.M., D.H. and P.P.; Writing—original draft, V.B.M.; Writing—review and editing, P.P., D.H. and P.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Data sharing is not applicable.

Acknowledgments

This work was supported by the project VEGA No. 2/0015/23 “Comprehensive analysis of the quantity and quality of water regime development in streams and their mutual dependence in selected Slovak basins”; project APVV-20-0374 “Regional detection, attribution and projection of impacts of climate variability and climate change on runoff regimes in Slovakia”; and project WATSIM “Water temperature simulation during summer low flow conditions in the Danube basin”.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bačová Mitková, V.; Halmová, D. Analysis of the Joint Impact of Synchronous Discharges in Estimating the Flood Risk: Case Study on Hron River. IOP Conf. Ser. Earth Environ. Sci. 2019, 221, 012034. [Google Scholar] [CrossRef]
  2. Hasino, M. Formulation of the joint return period of two hydrologic variates associated with a Poisson process. J. Hydrosci. Hydraul. Engng 1985, 3, 73–84. [Google Scholar]
  3. Correia, F.N. Multivariate partial duration series in flood risk analysis. In Hydrologic Frequency Modelling; Reidel: Dordrecht, The Netherlands, 1987; pp. 541–554. [Google Scholar] [CrossRef]
  4. Bačová Mitková, V. Bivariate joint probability analysis of flood hazard at river confluence. Acta Hydrol. Slovaca 2020, 21, 129–138. [Google Scholar] [CrossRef]
  5. Prohaska, S. Coincidence of flood flow of the Danube River and its tributaries. In A Hydrological Monograph Follow-up Volume 4, 1st ed.; Research Institute of Water Management: Bratislava, Slovakia, 2000; p. 187. ISBN 8096828231. [Google Scholar]
  6. Report of T. G. Assessment of the Catastrophic Floods in August 2002 and Proposal for Adaptation of the Flood Prevention System; Final report on the 2002 project; Masaryk Water Research Institute: Prague, Czech Republic, 2002; p. 174. (In Czech) [Google Scholar]
  7. Espinoza, J.C.; Ronchail, J.; Frappart, F. The Major Floods in the Amazonas River and Tributaries (Western Amazon Basin) during the 1970–2012 Period: A Focus on the 2012 Flood. J. Meteorol. 2013, 14, 1000–1008. [Google Scholar] [CrossRef] [Green Version]
  8. Li, C.H.; Li, N.; Wu, L.C.; Hu, A.J. A relative vulnerability estimation of flood disaster using data envelopment analysis in the Dongting Lake region of Hunan. Nat. Hazards Earth Syst. Sci. 2013, 13, 1723–1734. [Google Scholar] [CrossRef]
  9. De Michele, C.; Salvadori, G.; Canossi, M.; Petaccia, A. and Rosso, R. Bivariate statistical approach to check adequacy of dam spillway. J. Hydrol. Eng. 2005, 10, 50–57. [Google Scholar] [CrossRef]
  10. Zhang, L.; Singh, V.P. Bivariate flood frequency analysis using the copula method. J. Hydrol. Eng. 2006, 11, 150–164. [Google Scholar] [CrossRef]
  11. Zhang, L.; Singh, V.P. Trivariate flood frequency analysis using the Gumbel-Hougaard copula. J. Hydrol. Eng. Special Issue Copulas Hydrol. 2007, 12, 431–439. [Google Scholar] [CrossRef]
  12. Reddy, M.J.; Ganguli, P. Bivariate flood frequency analysis of upper Godavari River flows using archimedean copulas. Water Resour. Manag. 2012, 26, 3995–4018. [Google Scholar] [CrossRef]
  13. Bačová Mitková, V.; Halmová, D. Joint modeling of flood peak discharges, volume and duration: A case study of the Danube River in Bratislava. J. Hydrol. Hydromech. 2014, 62, 186–196. [Google Scholar] [CrossRef] [Green Version]
  14. Šraj, M.; Bezak, N.; Brilly, M. Bivariate flood frequency analysis using the copula function: A case study of the Litija station on the Sava River. Hydrol. Process. 2014, 225–238. [Google Scholar] [CrossRef]
  15. Szolgay, J.; Gaál, L.; Bacigal, T.; Kohnová, S.; Hlavcova, K.; Výleta, R.; Blöschl, G. A regional comparative analysis of empirical and theoretical flood peak-volume relationships. J. Hydrol. Hydromech. 2016, 64, 367–381. [Google Scholar] [CrossRef] [Green Version]
  16. Papaioannou, G.; Kohnova, S.; Bacigal, T.; Szolgay, J.; Hlavcova, K.; Loukas, A. Joint modelling of flood peaks and volumes: A copula application for the Danube River. J. Hydrol. Hydromech. 2016, 64, 382–392. [Google Scholar] [CrossRef] [Green Version]
  17. Matúš, R. The modeling of hydrological joint events on the Morava river using aggregation operators. Slovak J. Civ. Eng. 2009, 3, 9–15. [Google Scholar]
  18. Lee, T.; Modarres, R.; Ouarda, T. Data-based analysis of bivariate copula tail dependence for drought duration and severity. Hydrol. Process. 2013, 27, 1454–1463. [Google Scholar] [CrossRef]
  19. Bezak, N.; Šraj, M.; Mikoš, M. Copula-based IDF curves and empirical rainfall thresholds for flash floods and rainfall-induced landslides. J. Hydrol. 2016, 541, 272–284. [Google Scholar] [CrossRef]
  20. Chen, L.; Singh, V.P.; Guo, S. Flood Coincidence Risk Analysis Using Multivariate Copula Functions. J. Hydrol. Eng. 2012, 17, 742–755. [Google Scholar] [CrossRef]
  21. Bender, J.; Wahl, T.; Müller, A.; Jensen, J. A multivariate design framework for river confluences. Hydrol. Sci. J. 2016, 61, 471–481. [Google Scholar] [CrossRef] [Green Version]
  22. Peng, Y.; Shi, Y.; Yan, H.; Chen, K.; Zhang, J. Coincidence risk analysis of floods using multivariate copulas: Case study of Jinsha River and Min River, China. J. Hydrol. Eng. 2019, 24, 05018030. [Google Scholar] [CrossRef]
  23. Fischer, S.; Schumann, A.H. Multivariate Flood Frequency Analysis in Large River Basins Considering Tributary Impacts and Flood Types. Water Res. Res. 2021, 57, e2020WR029029. [Google Scholar] [CrossRef]
  24. Gilja, G.; Ocvirk, E.; Kuspilić, N. Joint probability analysis of flood hazard at river confluences using bivariate copulas. J. Croat. Assoc. Civ. Eng. 2018, 70, 267–275. [Google Scholar] [CrossRef] [Green Version]
  25. Tadić, L.; Bonacci, O.; Dadić, T. Analysis of the Drava and Danube rivers floods in Osijek (Croatia) and possibility of their coincidence. Environ. Earth Sci. 2016, 75, 12. [Google Scholar] [CrossRef]
  26. Pekárová, P.; Szolgay, J. Scenarios of Changes in Selected Hydrosphere and Biosphere Components in the Hron and Váh Catchment Areas due to Climate Change, 1st ed.; Press Bratislava: Veda, Slovakia, 2005; p. 496. ISBN 80-224-0884-0. (In Slovak) [Google Scholar]
  27. Karmakar, S.; Simonovic, S.P. Flood Frequency Analysis Using Copula with Mixed Distributions; Project Report No. 055; Department of Civil and Environmental Engeenering, The University of Western Ontario: London, ON, Canada, 2007; p. 58. [Google Scholar]
  28. Bender, J.; Wahl, T.; Mudersbach, C.; Jensen, J. Flood Frequency Analysis at River Confluences—Univariate vs. Multivariate Extreme Value Statistics. In Proceedings of the Water & Environmental Dynamics—6th International Conference on Water Resources and Environment Research, Koblenz, Germany, 3–7 June 2013; pp. 316–328. [Google Scholar]
  29. Xu, C.; Yin, J.; Guo, S.; Liu, Z.; Hong, X. Deriving Design Flood Based on Conditional Distribution: A Case Study of Danjiangkou Reservoir in Hanjiang Basin. Math. Probl. Eng. 2016, 11, 1–16. [Google Scholar] [CrossRef] [Green Version]
  30. Li, T.; Guo, S.; Liu, Z.; Xiong, L.; Yin, J. Bivariate design flood quantile selection using copulas. Hydrol. Res. 2017, 48, 997–1103. [Google Scholar] [CrossRef]
  31. Han, C.H.; Liu, S.; Guo, Y.; Lin, H.; Liang, Y.; Zhang, H. Copula-Based Analysis of Flood Peak Level and Duration: Two Case Studies in Taihu Basin, China. J. Hydrol. Eng. 2018, 23. [Google Scholar] [CrossRef]
  32. Lacko, M.; Potočki, K.; Škreb, K.A.; Bezak, N. Joint Modelling of Flood Hydrograph Peak, Volume and Duration Using Copulas—Case Study of Sava and Drava River in Croatia, Europe. Water 2022, 14, 2481. [Google Scholar] [CrossRef]
  33. Nelsen, R.B. An introduction to Copula, 2nd ed.; Springer: New York, NY, USA, 2006. [Google Scholar]
  34. Genest, C.; Rémillard, B.; Beaudoin, D. Goodness-of-fit tests for copulas: A review and a power study. Insur. Math. Econ. 2009, 44, 199–213. [Google Scholar] [CrossRef]
  35. Kojadinovic, I.; Yan, J. A Goodness-of-Fit Test for Multivariate Multiparameter Copulas Based on Multiplier Central Limit Theorems. Stat. Comput. 2011, 21, 17–30. [Google Scholar] [CrossRef]
  36. Karmakar, S.; Simonovic, S.P. Bivariate flood frequency analysis. Part 1: Determination of marginals by parametric and nonparametric techniques. J. Flood Risk Manag. 2009, 1, 190–200. [Google Scholar] [CrossRef]
  37. Shiau, J.T.; Wang, H.Y. and Tsai, Ch. T. Copula-based depth-duration-frequency analysis of thyphoons in Taiwan. Hydrol. Res. 2010, 41, 414–422. [Google Scholar] [CrossRef]
  38. Chowdhary, H.; Escobar, L.A.; Singh, P. Identification of suitable copulas for bivariate frequency analysis of flood peak and flood volume data. Hydrol. Res. 2011, 42, 193–215. [Google Scholar] [CrossRef]
  39. Meylan, P.; Favre, A.C.; Musy, A. Predictive Hydrology: A Frequency Analysis Approach; CRC Press: Boca Raton, FL, USA, 2012; p. 212. [Google Scholar]
  40. Gringorten, I.I. A plotting rule for extreme probability paper. J. Geophys. Res. 1963, 68, 813–814. [Google Scholar] [CrossRef]
  41. Cunnane, C. Methods and merits of regional flood frequency analysis. J. Hydrol. 1988, 100, 269–290. [Google Scholar] [CrossRef]
  42. Yue, S.; Ouarda, T.B.M.J.; Bobée, B.; Legendre, P.; Bruneau, P. The Gumbel mixed model for flood frequency analysis. J. Hydrol. 1999, 226, 88–100. [Google Scholar] [CrossRef]
  43. Shiau, J.T. Return period of bivariate distributed extreme hydrological events. Stoch. Envir. Res. Risk Assess. 2003, 17, 42–57. [Google Scholar] [CrossRef]
  44. Salvadori, G. Bivariate return periods via 2-Copulas. Stat. Methodol. 2004, 1, 129–144. [Google Scholar] [CrossRef]
  45. Salvadori, G.; De Michele, C. Frequency analysis via copulas: Theoretical aspects and applications to hydrological events. Water Resour Res. 2004, 40, W12511. [Google Scholar] [CrossRef]
  46. Svanidze, G.G.; Grigolia, G.L. The use of Johnson distribution in the stream-flow calculations. Vodn. Resur. 1974, 6, 45–59. [Google Scholar]
  47. Markovic, R.D. Probability Functions of Best Fit to Distributions of Annual Precipitation and Runoff. Doctoral Dissertation, Colorado State University, Fort Collins, CO, USA, 1965; p. 30. Available online: https://mountainscholar.org/bitstream/handle/10217/61285/HydrologyPapers_n8.pdf (accessed on 1 August 1965).
  48. Fidalgo Fonseca, T.; Pacheco Marques, C.R.; Parreso, B. Describing Maritime Pine Diameter Distributions with Johnson’s SB Distribution Using a New All-Parameter Recovery Approach. Forest SC 2009, 55, 367–373. [Google Scholar] [CrossRef]
  49. Feng, Y.; Shi, P.; Qu, S.; Mou, S.; Chen, C.; Dong, F. Nonstationary flood coincidence risk analysis using time-varying copula functions. Sci. Rep. 2020, 10, 10. [Google Scholar] [CrossRef] [Green Version]
  50. Lam, D.; Thompson, C.; Croke, J.; Sharma, A.; Macklin, M. Reducing uncertainty with flood frequency analysis: The contribution of paleoflood and historical flood information. Water Resour. Res. 2017, 53, 2312–2327. [Google Scholar] [CrossRef] [Green Version]
  51. Coxon, G.; Freer, J.; Westerberg, I.K.; Wagener, T.; Woods, R.; Smith, P.J. A novel framework for discharge uncertainty quantification applied to 500 UK gauging stations. Water Resour. Res. 2015, 51, 5531–5546. [Google Scholar] [CrossRef] [Green Version]
  52. Stedinger, J.R.; Vogel, R.M.; Foufoula-Georgiou, E. Frequency Analysis of Extreme Events, Handbook of Hydrology; Maidment, D.R., Ed.; chap. 18; McGraw-Hill: New York, NY, USA, 1993. [Google Scholar]
  53. Millington, N.; Das, S.; Simonovic, S.P. The Comparison of GEV, Log-Pearson Type 3 and Gumbel Distributions in the Upper Thames River Watershed under Global Climate Models; Water Resources Research Report; Department of Civil and Environmental Engineering, The University of Western Ontario London: London, ON, Canada, 2011; pp. 1–54. [Google Scholar]
  54. Wang, C. A Joint Probability Approach for the Confluence Flood Frequency Analysis; Iowa State University ProQuest Dissertations Publishing: Ames, IO, USA, 2007; p. 24. [Google Scholar]
  55. Jianping, B.; Pengxin, D.; Xiang, Z.; Sunyun, L.; Marani, M.; Yi, X. Flood coincidence analysis of Poyang Lake and Yangtze River: Risk and influencing factors. Stoch. Environ. Res. Risk Assess. 2018, 32, 879–891. [Google Scholar] [CrossRef]
  56. Le Clerc, S.; Lang, M. Flood frequency analysis downstream confluences. Comparison between bivariate densities and experimental data. In Proceedings of the International Conference on Flood Estimation, Berne, Switzerland, 6–8 March 2002; pp. 295–304. [Google Scholar]
  57. Favre, A.C.; El Adlouni, S.; Perreault, L.; Thiémonge, N.; Bobée, B. Multivariate hydrological frequency analysis using copulas. Water Resour. Res. 2004, 40, 12. [Google Scholar] [CrossRef] [Green Version]
  58. Huang, K.; Chen, L.; Zhou, J.; Zhang, J.; Singh, V.P. Flood hydrograph coincidence analysis for mainstream and its tributaries. J. Hydrol. 2018, 65, 341–353. [Google Scholar] [CrossRef]
Figure 1. Selected river network and gauging stations.
Figure 1. Selected river network and gauging stations.
Water 15 00984 g001
Figure 2. Maximum annual discharges for the mainstreams and their tributaries during the analyzed periods: Morava–Myjava, Váh–Belá, Nitra–Bebrava, Hron–Slatina.
Figure 2. Maximum annual discharges for the mainstreams and their tributaries during the analyzed periods: Morava–Myjava, Váh–Belá, Nitra–Bebrava, Hron–Slatina.
Water 15 00984 g002
Figure 3. Occurrence of the annual maximum discharges in Julian days for (a) Váh: Liptovský Hádok (1950–2011) and Belá: Podbanské (1950–2011); (b) Nitra: Chynorany (1940–2011) and Bebrava: Nadlice (1940–2011).
Figure 3. Occurrence of the annual maximum discharges in Julian days for (a) Váh: Liptovský Hádok (1950–2011) and Belá: Podbanské (1950–2011); (b) Nitra: Chynorany (1940–2011) and Bebrava: Nadlice (1940–2011).
Water 15 00984 g003
Figure 4. Comparison of the empirical exceedance probabilities (points) and the theoretical exceedance probability curves (line) of the maximum annual discharges for the selected mainstreams and tributaries during the analyzed periods.
Figure 4. Comparison of the empirical exceedance probabilities (points) and the theoretical exceedance probability curves (line) of the maximum annual discharges for the selected mainstreams and tributaries during the analyzed periods.
Water 15 00984 g004aWater 15 00984 g004b
Figure 5. (a) Pearson correlation R of the maximum annual discharges and (b) Kendall’s rank correlation τ of the maximum annual discharges.
Figure 5. (a) Pearson correlation R of the maximum annual discharges and (b) Kendall’s rank correlation τ of the maximum annual discharges.
Water 15 00984 g005
Figure 6. The joint empirical probability (points) and Gumbel–Hougaard copula at selected rivers and their tributaries (Qmaxup−Qmaxtr).
Figure 6. The joint empirical probability (points) and Gumbel–Hougaard copula at selected rivers and their tributaries (Qmaxup−Qmaxtr).
Water 15 00984 g006aWater 15 00984 g006b
Figure 7. Scatter plots of 9000 data pairs generated from Gumbel–Hougaard copula and monitored data of the selected pairs Qmaxup−Qmaxtr. The contours in the return periods (a) in the case of “or” (X ≥ x or Y ≥ y, only one investigated variables exceeded a certain threshold value) and (b) in the case of “and” (X ≥ x and Y ≥ y, both investigated variables exceeded a certain threshold value).
Figure 7. Scatter plots of 9000 data pairs generated from Gumbel–Hougaard copula and monitored data of the selected pairs Qmaxup−Qmaxtr. The contours in the return periods (a) in the case of “or” (X ≥ x or Y ≥ y, only one investigated variables exceeded a certain threshold value) and (b) in the case of “and” (X ≥ x and Y ≥ y, both investigated variables exceeded a certain threshold value).
Water 15 00984 g007aWater 15 00984 g007b
Table 1. Selected mainstreams and their tributaries, stations, analyzed periods, annual maximum discharge, river kilometer, and basin area.
Table 1. Selected mainstreams and their tributaries, stations, analyzed periods, annual maximum discharge, river kilometer, and basin area.
RiverGauging Station Period
[Year]
Qmax
[m3 s−1]
River Kilometer
[rkm]
Area
[km2]
MoravaStrážnica (up) 1968–2019901134.39146.92
Moravský Svätý Ján (dwn) 1968–2019140067.1524,129.30
MyjavaŠaštín Stráže (tr)1968–20198215.15644.89
VáhLiptovský Hrádok (up)1950–2019240359.3638.38
Liptovský Mikuláš (dwn)1950–2019540343.61107.21
BeláPodbanské (tr)1950–201917021.3593.49
NitraChynorany (up)1951–20192791061134.28
Nitrianska Streda (dwn)1951–201932491.12093.71
BebravaNadlice (tr)1951–20191286.2598.8
HronBanská Bystrica (up)1972–2019260175.21766.48
Žiar nad Hronom (dwn)1972–2019636131.53310.69
SlatinaZvolen (tr)1972–201922012.1790.16
Table 2. Mathematical description of the applied Gumbel–Hougaard copula.
Table 2. Mathematical description of the applied Gumbel–Hougaard copula.
Copula FunctionC (u, v, θ)Parameter θKendall’s τGenerator φ(t)
Gumbel–Hougaard exp [ ( ( ln u ) θ + ( ln v ) θ ) 1 / θ ] [1, ) θ 1 θ ( ln t ) θ
Table 3. Estimated univariate designed discharge Qmax for various return periods T and p-values of the Kolmogorov–Smirnov test.
Table 3. Estimated univariate designed discharge Qmax for various return periods T and p-values of the Kolmogorov–Smirnov test.
ConfluenceQ
[m3 s−1]
Distr.p ValueEstimated QT
[m3 s−1]
Monitored Qmax
[m3 s−1]
Q50Q100Q200Q500Q1000QmaxT [year]
Morava–MyjavaQmaxupJSB0.93281589296610591127901145
QmaxtrJSB0.81280859095988270
QmaxdwnJSB0.911122113511473162117231400160
Váh–BeláQmaxupJSB0.24200232259290313240160
QmaxtrJSB0.95136160185213234170160
QmaxdwnJSB0.87372435499587652540310
Nitra–BebravaQmaxupJSB0.92225247268295314279220
QmaxtrJSB0.91119125130134137128140
QmaxdwnWeib.0.7632234636838640032460
Hron–SlatinaQmaxupJSB0.9726627728529429926850
QmaxtrJSB0.83206221234247256220100
QmaxdwnJSB0.8659064369275680663690
Table 4. The Gumbel–Hougaard copula parameters for the selected variable combinations, mean absolute errors (MAE) values, and K–S test.
Table 4. The Gumbel–Hougaard copula parameters for the selected variable combinations, mean absolute errors (MAE) values, and K–S test.
ConfluencePairKendall’s τParameter CopulaMAE [%]p-Value
Morava–MyjavaQmaxup–Qmaxtr0.3661.5774.020.73
Váh–BeláQmaxup−Qmaxtr0.2251.2902.270.96
Nitra–BebravaQmaxup−Qmaxtr0.4761.9085.940.052
Hron–SlatinaQmaxup−Qmaxtr0.3661.5674.940.78
Table 5. Comparison of design discharges (Q50, Q100, Q500, Q1000) based on univariate (Uni.) and based on the copula method at the mainstream stations below the confluences Qmaxdwn.
Table 5. Comparison of design discharges (Q50, Q100, Q500, Q1000) based on univariate (Uni.) and based on the copula method at the mainstream stations below the confluences Qmaxdwn.
Confluence
(Station on Mainstream below the Confluence)
Method/DifferencesEstimated QT
[m3 s−1]
Q50Q100Q200Q500Q1000
Morava–Myjava
(Morava: Moravský Sv. Ján)
Uni−SB distr.12211351147316211723
copula G–H13691500162317221878
Difference [%]12111069
Váh–Belá
(Váh: Liptovský Mikuláš)
Uni−JSB distr.372435499587652
copula G–H446508570651712
Difference [%]201714119
Nitra–Bebrava
(Nitra: Nitrianska Streda)
Uni−weib. distr.322346368386400
copula G–H336354369388401
Difference [%]42010
Hron–Slatina
(Hron: Žiar nad Hronom)
Uni−JSB distr.590643692756806
copula G–H649699747808853
Difference [%]109876
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Bačová Mitková, V.; Halmová, D.; Pekárová, P.; Miklánek, P. The Copula Application for Analysis of the Flood Threat at the River Confluences in the Danube River Basin in Slovakia. Water 2023, 15, 984. https://doi.org/10.3390/w15050984

AMA Style

Bačová Mitková V, Halmová D, Pekárová P, Miklánek P. The Copula Application for Analysis of the Flood Threat at the River Confluences in the Danube River Basin in Slovakia. Water. 2023; 15(5):984. https://doi.org/10.3390/w15050984

Chicago/Turabian Style

Bačová Mitková, Veronika, Dana Halmová, Pavla Pekárová, and Pavol Miklánek. 2023. "The Copula Application for Analysis of the Flood Threat at the River Confluences in the Danube River Basin in Slovakia" Water 15, no. 5: 984. https://doi.org/10.3390/w15050984

APA Style

Bačová Mitková, V., Halmová, D., Pekárová, P., & Miklánek, P. (2023). The Copula Application for Analysis of the Flood Threat at the River Confluences in the Danube River Basin in Slovakia. Water, 15(5), 984. https://doi.org/10.3390/w15050984

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop