Next Article in Journal
Acknowledgment to the Reviewers of Hydrology in 2022
Next Article in Special Issue
Revisiting of a Three-Parameter One-Dimensional Vertical Infiltration Equation
Previous Article in Journal
Iron and Manganese Oxidation States, Bonding Environments, and Mobility in the Mining-Impacted Sediments of Coeur d’Alene Lake, Idaho: Core Experiments
Previous Article in Special Issue
Application of GIS Techniques in Identifying Artificial Groundwater Recharging Zones in Arid Regions: A Case Study in Tissamaharama, Sri Lanka
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Comparison of Nonlinear Reservoir and UH Algorithms for the Hydrological Modeling of a Real Urban Catchment with EPASWMM

Dipartimento di Ingegneria Civile e Architettura, Università degli Studi di Pavia, Via Ferrata 3, 27100 Pavia, Italy
*
Author to whom correspondence should be addressed.
Hydrology 2023, 10(1), 24; https://doi.org/10.3390/hydrology10010024
Submission received: 22 December 2022 / Revised: 11 January 2023 / Accepted: 12 January 2023 / Published: 16 January 2023

Abstract

:
This paper presents a comparative analysis of two hydrological models in the Storm Water Management Model (SWMM) software, namely, the non-linear reservoir (N-LR) and the unit hydrograph (UH), on the urban catchment of Cascina Scala, Pavia in Italy. The two models were applied for the simulation of the rainfall-runoff transformation in the 42 sub-catchments in Cascina Scala, while flow routing in the underground channels was simulated by means of the De Saint-Venant equations. A dataset of rainfall and runoff for 14 events from 2000 to 2003 was adopted for the calibration and validation of the models. The calibration was performed on 7 out of the 14 events by maximizing the fit of modeled-to-measured hydrographs in the final channel of the system. Prediction performance was assessed through different indices. Results from both models fit measured data well in terms of the total hydrograph. Whereas the time to peak was reliably predicted by both models, the N-LR was found to slightly outperform the UH in terms of total volume and peak flow prediction, though it requires a more detailed knowledge of the system for its implementation. Accordingly, the UH must be preferred in the case of a scarcity of data.

1. Introduction

The high rate of urbanization and the transformation of vegetated areas into impervious ones have significantly impacted water hydrological processes [1]. An increase in urbanization potentially results in increased runoff volumes, flash floods, and intensive water quality degradation [2,3]. Moreover, climate change consequences are putting more pressure on water network systems through extreme precipitation events [4,5]. Therefore, the analysis and design of urban catchments has become a crucial subject to achieve sustainable water resource management. In this regard, an accurate estimation of rainfall-runoff processes is of crucial importance for proper drainage system analysis and planning, water storage design, and flood mitigation measures. However, rainfall-runoff transformation is a complex hydrological task involving several variables related to rainfall patterns, catchment characteristics, soil type, and physiography [6]. Indeed, several physical processes are present in urban hydrology, such as precipitation and interception, infiltration, water movement through saturated and unsaturated soil and groundwater, evaporation, transpiration, and runoff [7]. The degree of complexity varies with the catchment’s spatial and temporal scales. Rainfall-runoff models can be categorized depending on their spatial representation (lumped or distributed) and/or temporal representation (event-based or continuous time) [8,9]. Lumped models consider space-average values of model parameters to represent the entire catchment [10]. Distributed models consider, instead, space-variable parameters in the rainfall-runoff transformation [11]. Although distributed models are helpful in comprehending the physics of hydrological processes, they need accurate calibration of several parameters, which represents a very challenging task [12]. The rainfall-runoff models can be calibrated using event-based or continuous storm event simulation. Event-based models consider a single rainfall event with a total duration of some hours. Continuous simulation models instead use an extended period made up of rain events and inter-event dry periods, with a total duration ranging from months to years. In general, for the event-based approach, losses include only the infiltration process during the simulation, whereas in continuous modeling, the evapotranspiration process is also taken into account [13]. Several research works have used continuous calibration models [14,15,16,17,18]. Continuous calibration delivers an adequate estimation in terms of total runoff volume [19,20]. Event-based calibration instead provides a better estimation of time to peak, peak flow rate, and overall hydrograph shape, which are critical prerequisites for developing an effective pollutant dynamic modeling.
Distributed models typically use conceptual hydrological modeling to simulate rainfall-runoff transformation outside the channel network. The unit hydrograph (UH) [21] and the non-linear reservoir (N-LR) [22] are two methods often adopted in this hydrological modeling. In the N-LR, the surface runoff is generated by modeling the study catchment area as a nonlinear reservoir. In the UH, the surface runoff is reconstructed with the convolution integral, starting from the response of the catchment to an instantaneous input of rainfall with a unitary depth.
The open-source software Storm Water Management Model, created by the United States Environmental Protection Agency (US EPA-SWMM), [23] is one of the most frequently used software programs to simulate the rainfall-runoff transformation and the related hydrological processes in urban catchments [24]. Either the N-LR or the UH can be used in the US EPA-SWMM to model the formation of runoff over external catchment surfaces. Then, the De Saint-Venant equations are used for modeling the flow routing in underground channels, which are fed by external catchment surfaces. EPA-SWMM can be used to perform event-based or continuous simulations and can be applied to combined sewer systems, sanitary sewer systems, and catchments containing storm drains [23,25]. The accuracy and reliability of rainfall-runoff models are highly dependent on how the parameter values are defined [26,27]. Some of these can be physically measured from the catchment characteristics (e.g., area and slope). Others require parameterization based on high-quality rainfall-runoff measured data. This parameterization consists of finding the set of parameters that maximize the fit of model results to experimental observation. Traditionally, this process is carried out manually by using the trial-and-error method. However, manual parameterization is time consuming and subjective, and it depends on expert judgement. Furthermore, it may fail to reach the global optimal solution [28]. Therefore, automatic calibration methods using computer-based tools have been widely developed and used to obtain a more robust and efficient estimation of the best-fit parameter values [29,30,31]. In general, automatic calibration algorithms can be classified into deterministic and stochastic methods. Deterministic optimization algorithms are developed to locate the optimal parameter set close to a starting solution. Therefore, they are generally fast local optimization methods. To avoid getting trapped in local optima, stochastic optimization methods can be used, though they generally feature a higher computational overhead. The presence of many parameters [25] makes stochastic optimization methods preferable in hydrological models [32,33,34]. The genetic algorithm (GA) [35] is one of the efficient optimization approaches known for its capability of detecting global optimal solutions. It is a population-based heuristic algorithm inspired by the concept of natural selection that drives biological evolution. The GA has been applied successfully to several environmental research problems [36,37,38]. It is also widely used to optimize the parameters of rainfall-runoff transformation [39,40].
This research work attempts to develop an automatic calibration method for the event-based rainfall-runoff transformation in a small urban catchment. The main novelty of the present work consists of the application and comparison of the two rainfall-runoff models N-LR and UH in the framework of the EPA-SWMM software. In fact, to the best of our knowledge, no previous work has ever attempted to compare the performance of these models on a real case study.
The following sections describe the case study, methodology and applications, followed by the discussion and conclusions.

2. Case Study

The selected study area is Cascina Scala, which is located in northern Pavia, Italy [41] (Figure 1). It is an urban catchment hosting 1500 residents. The contribution area is 12.7 ha, where 7.9 ha (62%) is impervious, and 4.8 ha (38%) is pervious.
The impervious area is composed of 2.88 ha (22%) of roofs and 5.02 ha (39.6%) of streets and paved surfaces. The area is quite flat, with an average slope of 0.15% inclined from northwest to southeast and connected to the urban drainage system directly. The catchment can be separated into 42 sub-catchments, with a single pipe drain for each sub-catchment. Table 1 shows the characteristics (area, slope, and impervious area percentage divided into roofs and streets) of each sub-catchment.
After May 2001, a new area (1.33 ha) was connected to the urban drainage system, specifically to sub-catchment number 42. Therefore, the area of sub-catchment 42 was considered to grow from 0.22 to 1.55 ha starting from May 2001 (in Table 1, sub-catchment 42 * is the upgraded version of sub-catchment 42). Two tipping-bucket rain gauges were installed in the catchment area with 0.2 mm accuracy (P1 and P2 in Figure 1) to collect the rainfall data. The two rainfall gauges have a funnel with an area of 1000 cm2. The presence of two gauges with a mutual distance of 310 m ensured that the spatial uniformity of the precipitation was controlled. Furthermore, it provided an accurate assessment of rainfall volume. To measure the runoff at the outlet of the channel network, an ISCO (ISCO, Genova, Italy) 4230 bubbler depth meter was placed upstream from a Venturi flume at the final reach of the channel network in the southeastern corner of the catchment (Figure 1). The system of underground channels in the Cascina Scala catchment is made of 42 concrete pipes. The upstream channels are circular conduits with a diameter ranging between 0.4 m and 0.6 m. The downstream channels are egg-shaped conduits with horizontal and vertical sizes ranging between 0.6–0.9 and 0.7–1.05 m, respectively. The conduit slope ranges between 0.15 and 1.01%, with an average value of 0.42 %. The pipe length ranges between 16 m and 75 m, with a total length of 2045 m. Twenty-three rainfall events were monitored for both rainfall-runoff transformation and water quality in the period between June 2000 and October 2003 (more details about the events can be found in [42]). As for the rainfall-runoff transformation, simultaneous measurements of rainfall intensity at the two rain-gauges and of the flow rate in the final catchment channel were performed. A representative subset was selected for rainfall-runoff simulation, meeting the following requirements:
  • Regular operation of rain gages and flow meter without any instrumentation failures or pressurized flow conditions;
  • Total rainfall depth of at least 5 mm;
  • Maximum rainfall intensity equal to or greater than 0.1 mm/min;
  • Maximum rainfall depth of at least 2 mm over 15 min.
Fourteen events (Nr,tot) were found to fit the requirements (Table 2), having the following characteristics: total rainfall depth (Vtotal) ranging between 7 mm and 39.8 mm, rainfall duration (Ttotal) ranging between 50 and 1133 min, and peak flow rate (QMax) ranging between 0.06 m3/s and 0.55 m3/s.
The events were split into two subsets, i.e., the calibration and validation subsets, which were used for the optimization-based parameterization of the hydrological model and for the testing of the optimal set of parameters, respectively. The splitting was carried out while guaranteeing wide and representative ranges for Vtotal, Ttotal, and QMax in the two subsets.

3. Materials and Methods

In this study, the distributed modeling approach was used for the rainfall-runoff transformation. For each sub-catchment of the Cascina Scala catchment (see previous Section 2), the N-LR and the UH models were constructed to simulate the runoff formation and routing, upstream from the channel network. The following sections describe the N-LR and UH models and their implementation in EPASWMM, followed by the genetic algorithm adopted for their parameterization.

3.1. Non-Linear Reservoir (N-LR)

This method models the generic sub-catchment as a nonlinear reservoir, for which water storage is a function of inflow (precipitation) and outflow (infiltration, evaporation, and runoff), as shown in Figure 2. During the generic rain event, the reservoir storage starts to fill. Runoff starts only after water storage depth overcomes the depression storage depth associated with surface wetting, interception, and ponding.
In this study, the Horton model was used to model infiltration. The required parameters for Horton’s approach include the maximum infiltration rate, the minimum infiltration rate, the decay coefficient, the maximum infiltration volume, and the regeneration coefficient. Evaporation is ignored in this work, since the temporal scale of event-based modeling is small.
As a result of mass conservation, the net change in water depth d (m) in the sub-catchment per unit of time t (s) is the difference between inflow (rainfall) and outflow (infiltration + runoff) according to the following equation:
d t = i f r
where i = rainfall intensity (m/s), f = infiltration rate (m/s), and r = runoff rate per unit of surface area (m/s).
Assuming a uniform flow over the sub-catchment surface, which features a width W (m), a slope S (-), and an area A (m2), r can be computed by Manning’s equation:
r = W ( d d s ) 5 / 3 S 1 / 2 n   A
where ds = depth of depression storage (m), and n = Manning roughness coefficient (s/m1/3), which depends on surface characteristics, being obtained as a function of the roughness of the various pervious and impervious areas present in the sub-catchment.
In the US EPASWMM, the use of the N-LR requires the following set of parameters to be defined for the external sub-catchments:
  • Slope (-);
  • Area (m2);
  • Percentage of impervious and pervious area (-);
  • Manning roughness coefficient for impervious area (roof) (s/m1/3);
  • Manning roughness coefficient for impervious area (street) (s/m1/3);
  • Manning roughness coefficient for the pervious area (s/m1/3);
  • Depth of depression storage on impervious area (mm);
  • Depth of depression storage on pervious area (mm);
  • Maximum infiltration rate (mm/h);
  • Minimum infiltration rate (mm/h);
  • Decay coefficient (1/h);
  • Maximum infiltration volume (mm);
  • Drying time (days);
  • Width coefficient (-).
In the applications of the present work, the optimal set of parameters for the N-LR method was derived as follows. Three parameters (1,2,3) were directly assigned based on the geometrical and land use characteristics of the sub-catchments (e.g., see Table 1 and [41]). After preliminary analyses, not reported in this paper, proving their poor impact on the results, the two parameters of the Horton model (12,13) were set to constant values of 0 mm and 7 days, respectively, according to the values suggested in [23]. The remaining nine parameters (4,5,6,7,8,9,10,11,14) were searched for by the genetic algorithm (see Section 3.3), assumed to be equal for all the sub-catchments. For parameter 14 (width coefficient), it was then multiplied by the length of the pipe in which the single sub-catchment drains the runoff, for calculating the equivalent width of each sub-catchment. Indeed, as indicated in [23], the width is a model parameter assumed to be proportional to the length of the drainage channel. For the channel network, the following set of parameters must be defined:
15.
Manning roughness for conduit (s/m1/3);
16.
Conduit length (m);
17.
Junction elevations (m);
In this case, two parameters (16,17) were directly assigned based on the available information about the sewerage system (see [41]), and the remaining parameter (15) was searched for by the genetic algorithm (see Section 3.3) and assumed to be equal for all the pipes, since they are all made of the same material (concrete).

3.2. Unit Hydrograph (UH)

UH is traditionally used in surface water hydrology to estimate the direct runoff hydrograph resulting from a unit input of rainfall. UH techniques can be adapted to estimate rainfall-dependent infiltration/inflow (RDII) flows into a channel network. One of the widely used and most flexible UH approaches for estimating RDII is the UH-RTK method (the RTK abbreviation comes from the key three parameters that feature the unit hydrographs used by the technique, as shown in Figure 3). Notably:
  • R is the fraction of rainfall entering the channel network, also known as runoff volumetric coefficient (-);
  • T is the time to peak (h);
  • K is the ratio of time to recession to time to peak (-).
The RTK method was developed by [43] and became one of the most commonly used unit hydrograph methods in the storm water management field [44]. This method uses the single triangular unit hydrograph to represent the sub-catchment response to a rainfall event. These unit hydrographs can be employed for any event to generate the corresponding RDII flow rates. Figure 3 shows a single triangular UH assumed to represent the RDII flow induced by one unit of rainfall over a unit of time.
As the integral of the UH is equal to 1, its peak UHpeak at time T is given by the following formula:
U H p e a k = 2 / ( T + K T )
By applying the convolution integral, the runoff r per unit of sub-catchment area at the generic time t can be calculated as:
r ( t ) = 0 t R   i ( τ ) U H ( t τ ) d τ
In the US EPASWMM, the use of the UH requires the following set of parameters to be defined for each external sub-catchment:
  • Area (m2);
  • Parameter R (-);
  • Parameter T (h;
  • Parameter K (-);
In the applications of the present work, the optimal set of parameters for the UH method was derived as follows. One parameter (1) was directly assigned based on the geometrical characteristics of the sub-catchments (e.g., see Table 1), and the remaining three parameters (2, 3, 4) were searched by the genetic algorithm (see Section 3.3) for all the sub-catchments, for a total of (42 × 3 + 3 (for the sub-catchment 42 *)) = 129 variables. For the channel network, the following set of parameters must be defined:
5.
Manning roughness for the conduit (s/m1/3);
6.
Conduit length (m);
7.
Junction elevations (m).
Also in this case, two parameters (6,7) were directly assigned based on the available information about the sewerage system (see [41]), and the remaining parameter (5) was searched by the genetic algorithm (see Section 3.3) and assumed to be equal for all the pipes.

3.3. Genetic Optimization

Inside the GA [35], a population of individuals exists, in which the generic individual is encoded in genes representing the decision variables of the problem. Following an initial random generation, the population evolves thanks to the processes of crossover and mutation, till it converges towards a global optimum in terms of fitness, represented by the objective function (OF) to be optimized.
In the present work, the GA was used to optimize the parameters of the N-LR and UH algorithms for the 42 catchments of the Cascina Scala catchment (see Section 2) to maximize the fit of modeled-to-measured hydrographs in the final channel of the system. The parameters were optimized in a subset of seven rainfall events (calibration set) considering the following OF to be minimized:
O F = i = 1 N r j = 1 N t , i ( Q p , i , j Q m , i , j ) 2
in which Nr and Nt,i are the number of rain events (seven) considered for the optimization (the first seven of Table 2) and the number of time instants in the generic i-th rain event (discretization of measured water-discharge data 1 min), respectively. Qm,i,j (m3/s) and Qp,i,j (m3/s) are the measured and predicted water discharges (in the final channel of the system), respectively, at the j-th time and in the i-th rain event.
Notably, the application of the N-LR requires the calibration of 10 parameters (i.e., nine for the sub-catchments and one for the channels), whereas for the UH, the number of parameters to be calibrated is 130 (i.e., 129 for the sub-catchments and one for the channels).
In this work, the GA toolbox of MATLAB® was linked to the EPA-SWMM dll in order to perform the optimization for both the N-LR and the UH. For each individual of the GA, the sequence of instructions shown in Figure 4 was executed.
First, the parameters of either the N-LR or the UH were defined based on the decision variables encoded in individual genes. Then, the EPA-SWMM dll was run, i.e., the hydrological module first and then the hydraulic module, to estimate the runoff generated in each sub-catchment and to simulate the flow routing in the underground channels. Finally, the hydrograph at the exit of the Cascina Scala catchment was evaluated and compared with the measured one for each event of the calibration set, leading to the evaluation of the objective function OF.

3.4. Goodness-of-Fit Indices

The performance of the calibration (carried out by minimizing Equation (5)) and validation steps was evaluated using goodness-of-fit indices, as suggested in the literature [45,46,47]. Three efficiency criteria were selected, the coefficient of efficiency (CE) (also known as Nash–Sutcliffe efficiency), the coefficient of determination (R2), and the root mean square error (RMSE), the equations of which are:
CE = 1 k = 1 N ( V m , k V p , k ) 2 k = 1 N ( V m , k V m ¯ ) 2
R 2 = k = 1 N ( V p , k V m ¯ ) 2 k = 1 N ( V m , k V m ¯ ) 2  
R M S E = 1 N k = 1 N ( V m , k V p , k ) ²
where V m ¯ is the mean of the measured variable Vm,k, V p ¯ is the mean of the predicted variable Vp,k, N is equal to Nt,i or Nr,tot, depending on whether the generic goodness-of-fit index is calculated on the hydrograph or on one of the global variables Total Volume, peak flow QMax, and time to peak TPeak.

4. Results

The results of the calibration step for the N-LR method are listed in Table 3, in which the range of variation (taken from [23]) and the final calibrated values for the 10 parameters are shown. The results of the calibration step for the UH method are listed in Table 4, in which the range of variation and the final calibrated values for the 129 parameters related to the sub-catchments are shown.
Notably, for the parameter R, since it represents the runoff volumetric coefficient, its range of variation was set equal to ±20% of the ratio between the impervious area and the total area of each sub-catchment. For the parameter T, which represents the time to peak, it was allowed to vary, for all the sub-catchments, between 5 and 20 min, according to the topography and land use of the area. Finally, for the parameter K, according to the characteristics of the analyzed area, the range of variation was allowed to vary from 0.5 to 2 times the time to peak of the hydrograph. For the Manning coefficient of the conduit, the range of variations and the final calibrated value were equal to that of the N-LR model, and specifically n = 0.012 s/m1/3.
Without loss of generality, the hydrographs (with the corresponding hyetographs) for event 23 (from the calibration set) and event 12 (from the validation set), obtained with the N-LR (grey solid line) and the UH (dark-gray dotted line) models, are plotted in Figure 5a,b, respectively. Measured data are shown with star symbols. Results from both models were found to be in good agreement with the measured data, either in the calibration or the validation step, with a slight underestimation of the total runoff and peak flow, and with a very good prediction of the time to peak. Notably, as can be seen from the values of the R2, RMSE, and CE in Figure 5, the N-LR provides, either in calibration and validation, slightly better prediction performance:
-
In calibration, the N-LR method yields R2 = 0.99, RMSE = 0.01 m3/s, and CE = 0.93, whereas the UH method yields R2 = 0.98, RMSE = 0.01 m3/s, and CE = 0.90;
-
In validation, the N-LR method yields R2 = 0.95, RMSE = 0.01 m3/s, and CE = 0.92, whereas the UH method yields R2 = 0.89, RMSE = 0.02 m3/s, and CE = 0.87.
Table 5 reports the values of the three goodness-of-fit indices defined in Section 3.4, for all the events (from both the calibration and validation sets) and for both models, calculated considering measured and predicted water-discharge patterns at the catchment outlet. It is evident that the values of the RMSE are generally small, with the highest values for event 7 (in the calibration set) and event 8 (in the validation set), which are also the shortest rainfall events considered (durations of 50 min and 64 min, respectively). Therefore, both models seem to perform satisfactorily. In more detail:
-
In calibration, looking at all the indices, the N-LR has a better performance in three events (7, 9, and 23); the UH prevails in two events (3 and 5); finally, the performance is similar in the remaining two events (14 and 17).
-
In validation, looking at all the indices, the N-LR is better in four events (8, 11, 12, and 13); the UH prevails in two events (20 and 21); finally, the performance is similar in the remaining event (19).
-
Globally, the N-RL seems to perform slightly better, also exhibiting higher performance in validation.
In Figure 6, Figure 7 and Figure 8, the comparison between the prediction performance of the N-LR (light grey) and UH (dark grey) model, in the calibration (values indicated with solid circle) and validation (values indicated with solid triangle) sets, is shown in terms of total volume (Figure 6), peak flow (Figure 7), and time to peak (Figure 8). The three indices described in Section 3.4 were also applied to the total volume, peak flow, and time to peak considering both models on the whole dataset of fourteen rainfall events.
Notably, in Figure 6, the comparison between the measured and the predicted total volume is shown. The scattered dots along the bisector for both models confirm a good prediction capability either in calibration or validation. From the performance indices, it is clear that the N-LR model outperforms the UH in terms of R2 (0.92 against 0.91), RMSE (183 m3 against 222 m3), and CE (0.91 against 0.86). Overall, both models overestimate the total volume, and only in one case (for the rainfall event with the largest total volume belonging to the validation set), they provide a remarkable underestimation.
Figure 7 shows the comparison between the measured and the predicted peak flow QMax. Also in this case, the scattered dots along the bisector confirm the good agreement of the predicted values with the measured data, either in calibration or validation, with a general slight underestimation of the peak flow, especially for those events featuring higher values of the peak water discharge. From the performance indices, it is clear that the N-LR model generally outperforms the UH in terms of R2 (0.92 against 0.84) and CE (0.84 against 0.82), while showing the same average error RMSE = 0.05 m3/s.
Finally, in Figure 8, the comparison between the measured and the predicted time to peak is shown. From the performance indices and the alignment of the dots along the bisector, it is evident that both models, either in calibration or in validation, provide a very accurate estimation of the time in which the peak flow occurs, with an average error of just a few minutes (RMSE = 2.95 min for N-LR and RMSE = 3.9 min for the UH). The R2 is excellent for both models (R2 = 0.99).

5. Discussion

In the last decades, the Storm Water Management Model (SWMM) software of the EPA has been widely used for modeling the hydrology of urban and rural catchments due to its versatility and flexibility in reproducing the complex hydrological processes in various contexts. Overall, the good performance of this software was fully confirmed in this work on the Cascina Scala catchment. The results obtained considering both the adopted hydrological models, namely, the N-LR and the UH, were found to satisfactorily agree with the measured data in terms of the total hydrograph, total volume, peak flow, and time to peak at the catchment outlet. The N-LR showed a slightly better performance than the UH, at the price of a much more detailed amount of information required on the study area, mainly in terms of geometrical and morphological characteristics of pervious and impervious areas inside each sub-catchment. When this information is unavailable, the UH model can be conveniently adopted, as its parameterization does not require this detailed degree of knowledge. However, the easier applicability of the UH model is paid back by a larger parametrization burden (number of parameters equal to 10 and 130 for the N-LR and UH models, respectively). More specifically, both models provide a slight underestimation of the peak flow, especially for those events that feature the highest values of the peak water discharge and the shortest durations (see Figure 7 and Table 2). This could be because for modeling the catchment, a uniform spatial distribution of rainfall was assumed, and it is plausible that short and intense rainfall events are not uniformly distributed over the catchment. Furthermore, it must be highlighted that the results of the parameterization may be affected by the objective function adopted, as it was pointed out in [48], in which the authors investigated the influence of objective functions on the rainfall-runoff models’ performance. In fact, the analysis of Table 5 points out that the best performance, considering the three goodness-of-fit indices altogether, is obtained for the longest rainfall events, namely, 14, 17, and 23, for which Ttotal = 380, 964, and 1133 min, respectively. This can be explained by the structure of the objective function used for the optimization (Equation (5)). Indeed, it minimizes the sum of the squared difference between the measured and predicted water discharges for each time instant of each event. Accordingly, this could drive the optimizer to favor parameter sets that fit better to longer rainfall events, which obviously feature a higher number of time instants and a larger number of terms to be summed as a result. By considering the events in the calibration step all together, the optimizer attempts to find a good compromise but implicitly gives a higher weight to longer events. Indeed, thanks to the multi-objective approach, the adoption of other objective functions considering various variables of interest, such as the total volume and peak flow, is expected to yield different sets of optimal parameters in comparison with those obtained in the present work. It is worth highlighting that this aspect is easily implementable in the proposed procedure, and therefore, this issue will be the topic of future investigations.

Author Contributions

Conceptualization, S.T. and E.C.; methodology, C.G., M.N.A. and E.C.; investigation, M.N.A.; writing—original draft preparation, C.G., M.N.A. and E.C.; writing—review and editing, S.T. and E.C.; data resources, S.T. funding acquisition, E.C. and S.T. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by the Italian Ministry for Research within the national project ‘PRIN 2020—URCA!’.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Acknowledgments

Support from the Italian MIUR and the University of Pavia is acknowledged within the program Dipartimenti di Eccellenza 2023–2027.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhu, Z.; Morales, V.; Garcia, M.H. Impact of combined sewer overflow on urban river hydrodynamic modelling: A case study of the Chicago waterway. Urban Water J. 2017, 14, 984–989. [Google Scholar] [CrossRef]
  2. Quijano, J.C.; Zhu, Z.; Morales, V.; Landry, B.J.; Garcia, M.H. Three-dimensional model to capture the fate and transport of combined sewer overflow discharges: A case study in the Chicago Area Waterway System. Sci. Total. Environ. 2017, 576, 362–373. [Google Scholar] [CrossRef] [PubMed]
  3. Todeschini, S. Hydrologic and environmental impacts of imperviousness in an industrial catchment of northern Italy. J. Hydrol. Eng. 2016, 21, 05016013. [Google Scholar] [CrossRef]
  4. Kourtis, I.M.; Tsihrintzis, V.A. Adaptation of urban drainage networks to climate change: A review. Sci. Total. Environ. 2021, 771, 145431. [Google Scholar] [CrossRef]
  5. Todeschini, S. Trends in long daily rainfall series of Lombardia (northern Italy) affecting urban storm water control. Int. J. Climatol. 2012, 32, 900–919. [Google Scholar] [CrossRef]
  6. Caviedes-Voullième, D.; Ahmadinia, E.; Hinz, C. Interactions of Microtopography, Slope and Infiltration Cause Complex Rainfall-Runoff Behavior at the Hillslope Scale for Single Rainfall Events. Water Resour. Res. 2021, 57, e2020WR028127. [Google Scholar] [CrossRef]
  7. Mohammadi, B. A review on the applications of machine learning for runoff modeling. Sustain. Water Resour. Manag. 2021, 7, 1–11. [Google Scholar] [CrossRef]
  8. Brocca, L.; Melone, F.; Moramarco, T. Distributed rainfall-runoff modelling for flood frequency estimation and flood fore-casting. Hydrol. Process. 2011, 25, 2801–2813. [Google Scholar] [CrossRef]
  9. Daniel, E.B.; Camp, J.V.; LeBoeuf, E.J.; Penrod, J.R.; Dobbins, J.P.; Abkowitz, M.D. Watershed modeling and its applications: A state-of-the-art review. Open Hydrol. J. 2011, 5, 27. [Google Scholar] [CrossRef] [Green Version]
  10. Peel, M.C.; McMahon, T.A. Historical development of rainfall-runoff modeling. WIREs Water 2020, 7, 1471. [Google Scholar] [CrossRef]
  11. Shin, M.J.; Guillaume, J.H.; Croke, B.F.; Jakeman, A.J. A review of foundational methods for checking the structural identi-fiability of models: Results for rainfall-runoff. J. Hydrol. 2015, 520, 1–16. [Google Scholar] [CrossRef]
  12. Javadinejad, S.; Dara, R.; Jafary, F. Difference of rainfall-runoff models and effect on flood forecasting: A brief review. Resour. Environ. Inf. Eng. 2022, 4, 184–199. [Google Scholar] [CrossRef]
  13. Kaffas, K.; Hrissanthou, V. Application of a continuous rainfall-runoff model to the basin of Kosynthos river using the hydrologic software HEC-HMS. Glob. NEST J. 2014, 16, 188–203. [Google Scholar]
  14. Yang, J.; Castelli, F.; Chen, Y. Multiobjective sensitivity analysis and optimization of distributed hydrologic model MOBIDIC. Hydrol. Earth Syst. Sci. 2014, 18, 4101–4112. [Google Scholar] [CrossRef] [Green Version]
  15. Khazaei, M.R.; Zahabiyoun, B.; Saghafian, B.; Ahmadi, S. Development of an Automatic Calibration Tool Using Genetic Algorithm for the ARNO Conceptual Rainfall-Runoff Model. Arab. J. Sci. Eng. 2013, 39, 2535–2549. [Google Scholar] [CrossRef]
  16. Paquet, E.; Garavaglia, F.; Garçon, R.; Gailhard, J. The SCHADEX method: A semi-continuous rainfall–runoff simulation for extreme flood estimation. J. Hydrol. 2013, 495, 23–37. [Google Scholar] [CrossRef]
  17. Gamage, S.; Hewa, G.; Beecham, S. Modelling hydrological losses for varying rainfall and moisture conditions in South Australian catchments. J. Hydrol. Reg. Stud. 2015, 4, 1–21. [Google Scholar] [CrossRef] [Green Version]
  18. Pinheiro, V.B.; Naghettini, M. Calibration of the Parameters of a Rainfall-Runoff Model in Ungauged Basins Using Synthetic Flow Duration Curves as Estimated by Regional Analysis. J. Hydrol. Eng. 2013, 18, 1617–1626. [Google Scholar] [CrossRef]
  19. Tan, S.B.; Chua, L.H.; Shuy, E.B.; Lo, E.Y.-M.; Lim, L.W. Performances of Rainfall-Runoff Models Calibrated over Single and Continuous Storm Flow Events. J. Hydrol. Eng. 2008, 13, 597–607. [Google Scholar] [CrossRef]
  20. Hossain, S.; Hewa, G.A.; Wella-Hewage, S. A Comparison of Continuous and Event-Based Rainfall–Runoff (RR) Modelling Using EPA-SWMM. Water 2019, 11, 611. [Google Scholar] [CrossRef] [Green Version]
  21. Nash, J.E. The form of the instantaneous unit hydrograph. Comptes Rendus Et Rapp. Assem. Gen. De Tor. 1957, 3, 114–121. [Google Scholar]
  22. Chen, C.W.; Shubinski, R.P. Computer Simulation of Urban Storm Water Runoff. J. Hydraul. Div. 1971, 97, 289–301. [Google Scholar] [CrossRef]
  23. Rossman, L.A. Storm Water Management Model User’s Manual, Version 5.0; National Risk Management Research Laboratory, Office of Research and Development, US Environmental Protection Agency: Cincinnati, OH, USA, 2010.
  24. Niazi, M.; Nietch, C.; Maghrebi, M.; Jackson, N.; Bennett, B.R.; Tryby, M.; Massoudieh, A. Storm Water Management Model: Performance Review and Gap Analysis. J. Sustain. Water Built Environ. 2017, 3, 04017002. [Google Scholar] [CrossRef] [Green Version]
  25. Rossman, L.; Huber, W. Storm Water Management Model Reference Manual; EPA/600/R-15/162A; U.S. EPA Office of Research and Development: Washington, DC, USA, 2015; Volume 1.
  26. Wang, W.-C.; Cheng, C.-T.; Chau, K.-W.; Xu, D.-M. Calibration of Xinanjiang model parameters using hybrid genetic algorithm based fuzzy optimal model. J. Hydroinform. 2011, 14, 784–799. [Google Scholar] [CrossRef] [Green Version]
  27. Sarkar, A.; Kumar, R. Artificial Neural Networks for Event Based Rainfall-Runoff Modeling. J. Water Resour. Prot. 2012, 04, 891–897. [Google Scholar] [CrossRef] [Green Version]
  28. Shamsi, U.M.S.; Koran, J. Continuous calibration. J. Water Manag. Model. 2017, 25, C414. [Google Scholar] [CrossRef] [Green Version]
  29. Alamdari, N. Development of a robust automated tool for calibrating a SWMM watershed model. World Environ. Water Resour. Congr. 2016, 221–228. [Google Scholar] [CrossRef]
  30. Behrouz, M.S.; Zhu, Z.; Matott, L.S.; Rabideau, A.J. A new tool for automatic calibration of the Storm Water Management Model (SWMM). J. Hydrol. 2019, 581, 124436. [Google Scholar] [CrossRef]
  31. Barco, J.; Wong, K.M.; Stenstrom, M.K. Automatic Calibration of the U.S. EPA SWMM Model for a Large Urban Catchment. J. Hydraul. Eng. 2008, 134, 466–474. [Google Scholar] [CrossRef]
  32. Chow, M.F.; Yusop, Z.; Toriman, M.E. Modelling runoff quantity and quality in tropical urban catchments using Storm Water Management Model. Int. J. Environ. Sci. Technol. 2012, 9, 737–748. [Google Scholar] [CrossRef] [Green Version]
  33. Xing, W.; Li, P.; Cao, S.-B.; Gan, L.-L.; Liu, F.-L.; Zuo, J.-E. Layout effects and optimization of runoff storage and filtration facilities based on SWMM simulation in a demonstration area. Water Sci. Eng. 2016, 9, 115–124. [Google Scholar] [CrossRef] [Green Version]
  34. Masseroni, D.; Cislaghi, A. Green roof benefits for reducing flood risk at the catchment scale. Environ. Earth Sci. 2016, 75, 1–11. [Google Scholar] [CrossRef]
  35. Holland, J.H. Genetic Algorithms and the Optimal Allocation of Trials. SIAM J. Comput. 1973, 2, 88–105. [Google Scholar] [CrossRef]
  36. Huang, J.J.; Xiao, M.; Li, Y.; Yan, R.; Zhang, Q.; Sun, Y.; Zhao, T. The optimization of Low Impact Development placement considering life cycle cost using Genetic Algorithm. J. Environ. Manag. 2022, 309, 114700. [Google Scholar] [CrossRef] [PubMed]
  37. Tetzlaff, D.; Soulsby, C.; Waldron, S.; Malcolm, I.A.; Bacon, P.J.; Dunn, S.M.; Lilly, A.; Youngson, A.F. Conceptualization of runoff processes using a geographical information system and tracers in a nested mesoscale catchment. Hydrol. Process. 2006, 21, 1289–1307. [Google Scholar] [CrossRef]
  38. Gupta, A.K.; Shrivastava, R.K. Optimal design of water treatment plant under uncertainty using genetic algorithm. Environ. Prog. 2008, 27, 91–97. [Google Scholar] [CrossRef]
  39. Chlumecký, M.; Buchtele, J.; Richta, K. Application of random number generators in genetic algorithms to improve rain-fall-runoff modelling. J. Hydrol. 2017, 553, 350–355. [Google Scholar] [CrossRef]
  40. Lopes, M.D.; da Silva, G.B.L. An efficient simulation-optimization approach based on genetic algorithms and hydrologic modeling to assist in identifying optimal low impact development designs. Landsc. Urban Plan. 2021, 216, 104251. [Google Scholar] [CrossRef]
  41. Papiri, S.; Ciaponi, C.; Todeschini, S. Il bacino urbano sperimentale di Cascina Scala (Pavia). Aracne Via Raffaele Garofalo. 2008, 217, 133. [Google Scholar]
  42. Barco, J.; Papiri, S.; Stenstrom, M.K. First flush in a combined sewer system. Chemosphere 2008, 71, 827–833. [Google Scholar] [CrossRef] [PubMed]
  43. Giguere, P.R.; Riek, G.C. Infiltration/Inflow Modeling for the East Bay (Oakland-Berkeley Area) I/I Study. In Proceedings of the 1983 International Symposium on Urban Hydrology, Hydraulics and Sediment Control, Lexington, KY, USA, 25–28 July 1983. [Google Scholar]
  44. Vallabhaneni, S.; Chan, C.; Burgess, E.H. Computer Tools for Sanitary Sewer System Capacity Analysis and Planning; US Environmental Protection Agency, Office of Research Development: Washington, DC, USA, 2007.
  45. Moriasi, D.N.; Arnold, J.G.; Van Liew, M.W.; Bingner, R.L.; Harmel, R.D.; Veith, T.L. Model evaluation guidelines for sys-tematic quantification of accuracy in watershed simulations. Trans. ASABE 2007, 50, 885–900. [Google Scholar] [CrossRef]
  46. Krebs, G.; Kokkonen, T.; Valtanen, M.; Koivusalo, H.; Setälä, H. A high resolution application of a stormwater management model (SWMM) using genetic parameter optimization. Urban Water J. 2013, 10, 394–410. [Google Scholar] [CrossRef]
  47. Zakizadeh, F.; Nia, A.M.; Salajegheh, A.; Sañudo-Fontaneda, L.A.; Alamdari, N. Efficient Urban Runoff Quantity and Quality Modelling Using SWMM Model and Field Data in an Urban Watershed of Tehran Metropolis. Sustainability 2022, 14, 1086. [Google Scholar] [CrossRef]
  48. Fowler, K.; Peel, M.; Western, A.; Zhang, L. Improved rainfall-runoff calibration for drying climate: Choice of objective function. Water Resour. Res. 2018, 54, 3392–3408. [Google Scholar] [CrossRef]
Figure 1. Cascina Scala experimental catchment, Pavia, Italy.
Figure 1. Cascina Scala experimental catchment, Pavia, Italy.
Hydrology 10 00024 g001
Figure 2. Nonlinear reservoir model of a sub-catchment [23].
Figure 2. Nonlinear reservoir model of a sub-catchment [23].
Hydrology 10 00024 g002
Figure 3. Example of a triangular unit hydrograph.
Figure 3. Example of a triangular unit hydrograph.
Hydrology 10 00024 g003
Figure 4. Flowchart of GA.
Figure 4. Flowchart of GA.
Hydrology 10 00024 g004
Figure 5. Hyetographs (top) and comparison of the hydrographs (bottom) for N-LR (gray solid line) and UH (dark-gray dotted line) models with measured data (star symbol) for: (a) event 23 (from calibration set); and (b) event 12 (from validation set).
Figure 5. Hyetographs (top) and comparison of the hydrographs (bottom) for N-LR (gray solid line) and UH (dark-gray dotted line) models with measured data (star symbol) for: (a) event 23 (from calibration set); and (b) event 12 (from validation set).
Hydrology 10 00024 g005
Figure 6. Comparison plot between measured and predicted total volume, for N-LR (light grey) and UH (dark grey) model in either calibration (solid circle) or validation (solid triangle) step.
Figure 6. Comparison plot between measured and predicted total volume, for N-LR (light grey) and UH (dark grey) model in either calibration (solid circle) or validation (solid triangle) step.
Hydrology 10 00024 g006
Figure 7. Comparison plot between measured and predicted peak flow QMax, for N-LR (light grey) and UH (dark grey) model in either calibration (solid circle) or validation (solid triangle) step.
Figure 7. Comparison plot between measured and predicted peak flow QMax, for N-LR (light grey) and UH (dark grey) model in either calibration (solid circle) or validation (solid triangle) step.
Hydrology 10 00024 g007
Figure 8. Comparison plot between measured and predicted time to peak Tpeak, for N-LR (light grey) and UH (dark grey) model in either calibration (solid circle) or validation (solid triangle) step.
Figure 8. Comparison plot between measured and predicted time to peak Tpeak, for N-LR (light grey) and UH (dark grey) model in either calibration (solid circle) or validation (solid triangle) step.
Hydrology 10 00024 g008
Table 1. Cascina Scala sub-catchment characteristics. See footnote for description of the symbols.
Table 1. Cascina Scala sub-catchment characteristics. See footnote for description of the symbols.
IDA (ha)S (%)IAIDA (ha)S (%)IA
R (%)S&S (%)R (%)S&S (%)
10.270.5029.2220.500.520.456.3
20.200.221.254.8230.130.1085.9
30.390.123.140.7240.810.123.547.8
40.280.132.854.4250.410.224.231.9
50.070.10100260.130.10100
60.490.132.540270.390.122.126
70.090.10100280.210.137.99
80.160.132.433.2290.200.1077.9
90.070.124.543.2300.060.1075.4
100.570.15.135.6310.100.1080.8
110.120.112.462.7320.500.137.621.9
120.360.330.830.5330.050.219.580.5
130.200.331.346.8340.330.123.140.2
140.160.120.353350.420.13241.5
151.350.126.325.6360.270.11640.7
160.210.129.337.1370.240.116.365.7
170.110.123.943.4380.160.214.451.9
180.060.30100390.050.1048
190.050.130.654.3400.190.629.643.9
200.170.126.242410.120.325.249.6
210.470.126.529.3420.220.326.857.3
42 *1.550.325.121.1
Footnote: For the 42 sub-catchments, ID: identifier of sub-catchments, A: area, S: slope, IA: impervious area, R: roof, S&S: streets and squares; 42 * indicates the modified catchment 42 after May 2001.
Table 2. Main characteristic of the selected rainfall events. The first seven events are for calibration. The following seven events are for validation.
Table 2. Main characteristic of the selected rainfall events. The first seven events are for calibration. The following seven events are for validation.
EventTotal Rainfall Depth Vtotal (mm)Rainfall Duration Ttotal (min)Peak Flow Rate QMax (m3/s)
311.81970.255
516.41080.551
77500.326
910.62150.19
1415.83800.257
1723.49640.139
2339.811330.149
811640.376
1126.24780.281
1218.64430.263
138.41110.157
1912.62480.234
2016.22310.245
2172860.06
Table 3. The calibrated parameters of the N-LR method.
Table 3. The calibrated parameters of the N-LR method.
ParameterRange of Variation Calibrated Value
Manning coefficient for roof (s/m1/3)0.014–0.0300.014
Manning coefficient for street (s/m1/3)0.010–0.0550.011
Manning coefficient for pervious area (s/m1/3)0.10–0.350.321
Depression storage on impervious area (mm)1.27–2.541.27
Depression storage on pervious area (mm)2.54–5.083.08
Maximum infiltration rate (mm/h) 58–170118
Minimum infiltration rate (mm/h) 1–5750
Decay coefficient (1/h) 2–74.3
Width coefficient (-)1–21.99
Manning coefficient for conduit (s/m1/3)0.012–0.020.012
Table 4. The calibrated parameters of the UH method. (42 *) indicates the modified catchment 42 after May 2001.
Table 4. The calibrated parameters of the UH method. (42 *) indicates the modified catchment 42 after May 2001.
N R
(-)
T
(h)
K
(-)
Range of
Variation
Calibrated
Value
Range of
Variation
Calibrated
Value
Range of
Variation
Calibrated
Value
10.23–0.350.240.08–0.330.330.5–21.99
20.61–0.910.630.08–0.330.320.5–21.46
30.51–0.770.510.08–0.330.080.5–20.57
40.7–10.730.08–0.330.090.5–20.53
50.8–10.80.08–0.330.330.5–22
60.58–0.870.580.08–0.330.330.5–21.88
70.8–10.80.08–0.330.170.5–20.62
80.52–0.790.530.08–0.330.10.5–20.69
90.54–0.810.610.08–0.330.090.5–20.52
100.33–0.490.370.08–0.330.330.5–22
110.6–0.90.670.08–0.330.080.5–20.57
120.49–0.740.550.08–0.330.080.5–20.56
130.62–0.940.640.08–0.330.330.5–21.97
140.59–0.880.590.08–0.330.080.5–20.56
150.42–0.620.530.08–0.330.090.5–20.55
160.53–0.80.690.08–0.330.080.5–20.52
170.54–0.810.570.08–0.330.090.5–20.56
180.8–10.910.08–0.330.080.5–21.5
190.68–110.08–0.330.080.5–20.5
200.55–0.820.820.08–0.330.090.5–20.5
210.45–0.670.480.08–0.330.270.5–21.91
220.61–0.920.620.08–0.330.330.5–21.68
230.69–10.720.08–0.330.090.5–21.37
240.57–0.860.620.08–0.330.080.5–20.5
250.45–0.670.580.08–0.330.080.5–20.5
260.8–10.940.08–0.330.080.5–20.5
270.38–0.580.580.08–0.330.30.5–21.2
280.38–0.560.440.08–0.330.080.5–20.89
290.62–0.930.630.08–0.330.330.5–21.86
300.6–0.90.720.08–0.330.10.5–20.52
310.65–0.970.70.08–0.330.330.5–21.7
320.48–0.710.480.08–0.330.080.5–21.16
330.8–10.970.08–0.330.080.5–20.52
340.51–0.760.70.08–0.330.080.5–20.51
350.59–0.880.590.08–0.330.10.5–20.79
360.45–0.680.670.08–0.330.080.5–20.58
370.66–0.980.980.08–0.330.080.5–20.59
380.53–0.80.590.08–0.330.080.5–20.59
390.38–0.580.40.08–0.330.160.5–20.5
400.59–0.880.880.08–0.330.090.5–20.6
410.6–0.90.90.08–0.330.080.5–20.83
420.37–0.550.550.08–0.330.210.5–21.5
42 *0.67–10.990.08–0.330.090.5–20.6
Table 5. Simulation results. The yellow color is used to highlight the performance of the better model.
Table 5. Simulation results. The yellow color is used to highlight the performance of the better model.
EventR2
(-)
RSME
(m3/s)
CE
(-)
N-LRUHN-LRUHN-LRUH
Calibration30.780.870.030.020.770.85
50.920.960.030.030.910.94
70.510.420.070.080.500.30
90.900.860.020.020.690.58
140.940.940.020.020.880.86
170.910.910.010.010.720.74
230.990.980.010.010.930.90
Validation80.810.680.040.060.810.57
110.980.960.010.010.950.95
120.950.890.010.020.920.87
130.940.820.020.020.850.78
190.970.970.020.020.910.92
200.690.750.030.030.510.58
210.850.880.010.010.490.44
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Giudicianni, C.; Assaf, M.N.; Todeschini, S.; Creaco, E. Comparison of Nonlinear Reservoir and UH Algorithms for the Hydrological Modeling of a Real Urban Catchment with EPASWMM. Hydrology 2023, 10, 24. https://doi.org/10.3390/hydrology10010024

AMA Style

Giudicianni C, Assaf MN, Todeschini S, Creaco E. Comparison of Nonlinear Reservoir and UH Algorithms for the Hydrological Modeling of a Real Urban Catchment with EPASWMM. Hydrology. 2023; 10(1):24. https://doi.org/10.3390/hydrology10010024

Chicago/Turabian Style

Giudicianni, Carlo, Mohammed N. Assaf, Sara Todeschini, and Enrico Creaco. 2023. "Comparison of Nonlinear Reservoir and UH Algorithms for the Hydrological Modeling of a Real Urban Catchment with EPASWMM" Hydrology 10, no. 1: 24. https://doi.org/10.3390/hydrology10010024

APA Style

Giudicianni, C., Assaf, M. N., Todeschini, S., & Creaco, E. (2023). Comparison of Nonlinear Reservoir and UH Algorithms for the Hydrological Modeling of a Real Urban Catchment with EPASWMM. Hydrology, 10(1), 24. https://doi.org/10.3390/hydrology10010024

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop