1. Introduction
Sensitivity analysis serves as a fundamental instrument for importance ranking and the dimension reduction of input parameters [
1], and its applications are spreading across diverse topics in civil engineering, such as strength analysis [
2], failure analysis [
3], rock mechanics [
4], slope stability analysis [
5], and structural reliability analysis [
6].
Sensitivity analysis examines how the output, or model’s response, is affected by the inputs and therefore calculates their corresponding importance. Compared to qualitative or subjective sensitivity measures [
7,
8], quantitative sensitivity measures have been demonstrated to be much more trustworthy [
9,
10,
11]. Quantitative sensitivity measures can be roughly classified into local sensitivity measures and global sensitivity measures [
12].
The local sensitivity measures, also referred to as the elementary effect, assess how the input factor locally affects the model output by varying the input of interest while keeping the rest of the inputs constant, which is the one factor of a time method [
13]. The main drawback of local sensitivity measures is that they are fixed to the corresponding nominal points in the input space, which means they cannot provide information on the inputs’ total effects or detect interactions among inputs. In contrast to local sensitivity measures, global sensitivity measures evaluate the inputs’ overall effects on the model output, which can also account for interactions between inputs. Obviously, global sensitivity measures offer a more comprehensive sensitivity analysis and are thus more widely accepted in practical engineering. Invented in the 1970s, the Fourier amplitude sensitivity test [
14] is one of the quickest global sensitivity measures. It is, however, merely a first-order measure and can be insufficient if higher-order terms dominate the model output [
9]. Another widely adopted global sensitivity measure is the variance-based global sensitivity measure, which was first proposed by Sobol and further developed by Saltelli and his colleagues [
1,
11]. The variance-based global sensitivity measure calculates the model output’s variances of different subsets of input variables, which usually requires a large number of model evaluations in order to achieve a reasonable convergence and then becomes computationally unaffordable. To this end, a number of alternative global sensitivity measures have been recently proposed, one of which is the Morris measure [
7,
15]. The Morris measure relies on averaging the absolute values of local sensitivity measures, which is considerably cheaper in terms of computation than the variance-based global sensitivity measure. Nevertheless, the Morris method uses local sensitivity measures of random points on a fixed grid for averaging, which cannot correctly reflect effects if the model’s characteristic dimensions are smaller than the grid size [
16]. To solve this issue, the derivative-based global sensitivity measure was recently proposed by employing local sensitivity measures of randomly distributed points rather than a fixed grid to estimate the integral representing the global effects [
17]. The derivative-based global sensitivity measure has been demonstrated to be good at quickly identifying unimportant input factors, while the variance-based global sensitivity measure is more comprehensive but also more computationally expensive. Another advantage of the variance-based global sensitivity measure over the derivative-based global sensitivity measure is that the variance-based global sensitivity measure provides absolute values for the sensitivity measures, while the derivative-based global sensitivity measure only provides relative values for sensitivity measures. In other words, in using a derivative-based global sensitivity measure for the sensitivity analysis, one has to compute the derivative-based global sensitivity measure of each input before determining their sensitivities or importance. Recently, a variety of innovative sensitivity measures have been proposed for various application scopes. A novel global sensitivity measure, called PAWN, was proposed to efficiently compute density-based sensitivity indices [
18]. As for structural engineering, a novel vine copula-based approach for analyzing the variance-based global sensitivity measure is proposed [
19]. In reliability engineering, a new reliability-oriented global sensitivity measure, which is obtained by replacing the variance with entropy, was proposed [
20]. Connections between entropy and variance in reliability engineering have also been recently explored [
21].
It should also be pointed out that the computational efficiency of global sensitivity measures heavily depends on different sampling methods [
12,
22,
23]. Although recently developed meta-models appear to be more efficient in terms of sampling [
24,
25,
26], the traditional quasi-Monte Carlo or Monte Carlo methods remain the primary sampling methods for practical sensitivity analysis. It is well known that quasi-Monte Carlo sampling should outperform Monte Carlo sampling in a sensitivity analysis for a sufficiently large sample size [
23,
27]. A board comparison including other popular sampling methods, such as Latin hypercube sampling, stratified sampling, and Latinized stratified sampling, has not been conducted yet. In addition, the impact of nonlinear dependency among random variables is also important in sensitivity analysis, which can be investigated through the copula theory [
28].
Sensitivity measures that combine the advantages of both the variance-based global sensitivity measures and derivative-based global sensitivity measures would provide better tools for sensitivity analysis. In light of such an idea, a new global sensitivity measure based on derivative-integral and variance decomposition was recently proposed; however, this measure is too complicated for many engineering applications [
29], and a simpler derivate-variance hybrid sensitivity analysis is needed. Therefore, this research presents a simple derivative-variance hybrid sensitivity measure, which we named the derivative-variance hybrid global sensitivity measure. The proposed derivative-variance hybrid global sensitivity measure is as computationally efficient as the derivative-based global sensitivity measure, which can also serve as a conservative approximation of the corresponding variance-based global sensitivity measure. Furthermore, in seeking the optimal sampling method, we investigated the performances of six frequently used sampling methods, namely Monte Carlo samplings, Latin hypercube samplings, stratified samplings, Latinized stratified samplings, and two quasi-Monte Carlo samplings using the Sobol sequence and the Halton sequence.
The rest of this paper is organized as follows:
Section 2 reviews the necessary backgrounds of sensitivity measures;
Section 3 proposes the derivative-variance hybrid global sensitivity measure;
Section 4 determines the optimal sampling method via an investigation of the performances of six widely used sampling methods; and
Section 5 validates the proposed sensitivity measure through its application to the sensitivity analysis of a rural bridge.
3. The Derivative-Variance Hybrid Global Sensitivity Measure
In this section, the derivative-variance hybrid global sensitivity measure is proposed, which is as computationally efficient as the derivative-based global sensitivity measure while providing as much meaningful absolute value for sensitivity analysis as the variance-based global sensitivity measure.
Section 3.1 proposes the sensitivity measure;
Section 3.2 presents a method for computing the proposed sensitivity measure;
Section 3.3 compares the derivative-variance hybrid global sensitivity measure with the derivative-based global sensitivity measure and the variance-based global sensitivity measure using three benchmark examples; and
Section 3.4 discusses the advantages and limitations of the proposed sensitivity measure.
3.1. Presentation of the Sensitivity Measure
The derivative-based global sensitivity measure and the variance-based global sensitivity measure can be linked using [
17]:
where
is the variance-based global sensitivity measure computed via Equation (14),
V is the total variance computed via Equation (23), and
vi is the derivative-based global sensitivity measure computed via Equation (2).
On the basis of Equation (25), the following sensitivity measure, referred to as the derivative-variance hybrid global sensitivity measure, is proposed:
Evidently, the derivative-variance hybrid global sensitivity measure ϒi is obtained by dividing the derivative-based global sensitivity measure vi by π2V, so they should share a similar computational cost that is much lower than that of the variance-based global sensitivity measure. Derivative-variance hybrid global sensitivity measures can be treated as reduced derivative-based global sensitivity measures in which the reduction allows the value of the derivative-variance hybrid global sensitivity measure to serve as a conservative approximation of the corresponding variance-based global sensitivity measure.
3.2. Computational Method
As shown in
Figure 1, the derivative-variance hybrid global sensitivity measure can be computed using the following steps: (1) sample the input matrix
x; (2) compute the total variance
V using Equations (23) and (24); (3) enumerate each input
xi with Steps 4 and 5; (4) compute the derivative-based global sensitivity measure
vi using Equation (2); and (5) compute the derivative-variance hybrid global sensitivity measure
ϒi using Equation (26).
3.3. Comparison with Other Global Sensitivity Measures
In this subsection, the performances of the derivative-variance hybrid global sensitivity measure, the derivative-based global sensitivity measure, and the variance-based global sensitivity measure using three benchmark examples are compared and analyzed, and the corresponding results are obtained through Monte Carlo simulations, in which the sample size is 108.
Example 1. The analysis of variance decomposition is provided below [33]:where 0 < xi < 1, c1 = 10, c2 = 1, c3 = 0.1, and c12 = 10. In this example, x1 is the most sensitive input, x3 is trivial, the importance of x2 is in-between, and the sensitivity of a highly non-linear term is controlled by c12. The corresponding results are shown in Table 1, from which it is seen that: (1) the derivative-based global sensitivity measures cannot directly indicate sensitivities of the corresponding inputs, while the variance-based global sensitivity measure and the derivative-variance hybrid global sensitivity measure can; (2) the derivative-variance hybrid global sensitivity measure can serve as a conservative estimation of the corresponding variance-based global sensitivity measure since the value of the derivative-variance hybrid global sensitivity measure is slightly larger than that of the corresponding variance-based global sensitivity measure; the value of derivative-variance hybrid global sensitivity measure can be greater than 1. Example 2. The g-function is provided below [33]:where 0 < xi < 1, n = 3, a1 = 1, a2 = 10, and a3 = 100. In this example, a larger value of ai corresponds to a smaller importance of xi. The corresponding results are shown in Table 2. It is seen from Table 2 that the derivative-variance hybrid global sensitivity measure can still effectively identify insensitive input x3; however, the ratio between the derivative-variance hybrid global sensitivity measure and the corresponding variance-based global sensitivity measure can be significantly greater than 1. Example 3. The Ishigami function is provided below [34]: where 0 < xi < 1, i = 1, 2, or 3, and a and b in the following examples were set to 7 and 0.1, respectively. The corresponding results are shown in Table 3, from which it is seen that the derivative-variance hybrid global sensitivity measure may not be efficient with regard to the ranking of inputs of significant sensitivities. 3.4. Advantages and Limitations
Since the derivative-variance hybrid global sensitivity measure is the conservative approximation of the corresponding variance-based global sensitivity measure, the values of the variance-based global sensitivity measures can directly reflect the inputs’ sensitivities, which provides a solid argument for identifying insensitive inputs. For instance, if it is found that ϒi is negligibly small, then xi can be safely reduced without further analyzing the rest of the inputs. For the identification of insensitive inputs using the derivative-based global sensitivity measures, one has to exhaust each input and rank their derivative-based global sensitivity measures in ascending order. On the other hand, the computational cost of the derivative-variance hybrid global sensitivity measure is similar to that of the derivative-based global sensitivity measure, which is considerably lower than that of the variance-based global sensitivity measure. At this point, we list the advantages of the proposed derivative-variance hybrid global sensitivity measure as follows: (1) inputs with a small derivative-variance hybrid global sensitivity measure can be labeled as unimportant without investigating the rest of the inputs; (2) the computational cost of the derivative-variance hybrid global sensitivity measure is comparable to that of the derivative-based global sensitivity measure, which only requires the additional computation of the total variance V; (3) since the derivative-variance hybrid global sensitivity measure is the upper bound for the corresponding variance-based global sensitivity measure, the derivative-based global sensitivity measures can serve as a conservative approximation of the variance-based global sensitivity measure. Thus, the derivative-variance hybrid global sensitivity measure is recommended to replace derivative-based global sensitivity measure or the variance-based global sensitivity measure for sensitivity analysis.
On the other hand, since the computation of the derivative-variance hybrid global sensitivity measure requires the value of the corresponding derivative-based global sensitivity measure, it shares the same limitations as the derivative-based global sensitivity measure, such as: (1) it requires the output function to be continuous so that the corresponding derivatives are available; (2) its applications on highly nonlinear output functions may result in considerable errors; and (3) it cannot detect the interactive effect between different inputs.
4. Selection of the Optimal Sampling Method
In this section, six frequently used sampling methods are evaluated in terms of their performances of sensitivity analysis using the derivative-variance hybrid global sensitivity measure, namely: Monte Carlo sampling [
23]; Latin hypercube sampling [
12]; stratified sampling [
22]; Latinized stratified sampling [
22]; and two quasi-Monte Carlo samplings using the Sobol sequence and Halton sequence [
23].
Figure 2 presents one realization of random points in domain
I2 that are generated from the above six sampling methods. It is noted that, when the simple size
N equals
kn and
k is a positive integer, stratified sampling and Latinized stratified sampling can guarantee that there is exactly one point contained in each stratum (a hypercube with a length of 1/
k defined by a corresponding grid).
The performances of the derivative-variance hybrid global sensitivity measure of the aforementioned six sampling methods were investigated using the aforementioned three examples described by Equations (27)–(29). Since all these sampling methods produce unbiased estimations for random integrals, only the stochastic errors were studied, and we chose the standard deviation of the relative error as the index for the stochastic errors. At this point, the relative error of variable
χ is defined as:
, where
is one realization of
χ and
is the corresponding analytical solution.
Figure 3 shows the standard deviations (STD) of the relative errors for the derivative-variance hybrid global sensitivity measure
ϒi as functions of sample size
N, in which
N equals 10
3, 25
3, and 50
3. In the calculation, 10
7 sample points were divided into the corresponding number of sample sets according to a different sample size
N, and each sample set yields one group of relative errors. As can be seen from
Figure 3, Monte Carlo sampling and Latin hypercube sampling always have the largest stochastic errors among these six sampling methods, suggesting a ban of these two sampling methods on sensitivity analysis.
Figure 3 presents the stochastic errors for derivative-variance hybrid global sensitivity measure evaluations. It is noted that, due to the derivative of
x3 of Example 1 being a constant, the errors’ STDs obtained using different sampling methods are equal to zero. In
Figure 3, it can be seen that the Latinized stratified sampling and the two quasi-Monte Carlo samplings produce the lowest stochastic error, and their relative performances may vary for different cases. In this instance, the two quasi-Monte Carlo samplings outperform the Latinized stratified sampling in the evaluations of
ϒ1 and
ϒ3, while the Latinized stratified sampling provides the lowest stochastic error for the evaluations of
ϒ2. Thus, Latinized stratified sampling and quasi-Monte Carlo sampling are recommended.
An explanation for the above phenomenon can involve the sample’s stochasticity and uniformity. On the one hand, a random integral requires the sample to have good uniformity to cover sudden changes in small areas. On the other hand, reasonable stochasticity is also necessary to avoid periodic related issues. Nevertheless, the dilemma is that high uniformity and high stochasticity cannot be achieved simultaneously since the uniformity decreases as the stochasticity increases. Monte Carlo sampling and Latin hypercube sampling have poor uniformity, resulting in undesirable performances. In contrast, quasi-Monte Carlo samplings and Latinized stratified sampling have the right balance between uniformity and stochasticity, which contributes to their satisfactory accuracy and convergence rate in sensitivity analysis.
5. Numerical Application and Validation
In order to demonstrate its validity and practicability, the proposed sensitivity measure is applied to the sensitivity analysis of a rural bridge. The bridge, located in the Xinzhou district (Wuhan city, Hubei Province, China), is a solid plate bridge with a span-combination of 4 × 6 m, whose width equals 10 m (shown in
Figure 4). Each span consists of 10 solid plates of 0.99 m wide.
The performance function [
35] of the weakest plate is chosen as the model output, which can be expressed as
in which the specific parameters of the bridge are obtained from in situ investigations and reasonable error analysis (shown in
Table 4).
Firstly, the derivative-variance hybrid global sensitivity measure is applied to the sensitivity analysis of the rural bridge. In the analysis, the sampling method used was quasi-Monte Carlo sampling with Sobol sequence, and the convergence threshold in terms of absolute error was set to 0.01. The values of the derivative-based global sensitivity measures obtained from 10
8 samples are considered the target for error computation. As shown in
Table 5, it was found that 1000 samples can already guarantee the above criterion of convergence, and such a good convergence using merely 1000 samples indicates the convergence rate of derivative-variance hybrid global sensitivity measure using quasi-Monte Carlo sampling is sufficiently high. In addition, it is seen from
Table 5 that the six insensitive inputs, namely
l,
b,
,
,
, and
, are found (highlighted in gray), and their derivative-variance hybrid global sensitivity measures are less than the corresponding sensitivity threshold of 1.5%. At this juncture, it is noted that the relative errors for the different inputs’ derivative-variance hybrid global sensitivity measures are surprisingly close to each other, and the reason for this remains to be further studied.
On the other hand, in order to compare the derivative-variance hybrid global sensitivity measure and the variance-based global sensitivity measure in terms of computational efficiency, the variance-based global sensitivity measure was also imposed on the sensitivity analysis of the above example, and the identical convergence threshold of 0.01 was adopted. The target variance-based global sensitivity measure values for error computation were obtained from 10
8 samples. It is found that, if the sample size equals 240,000, the above criterion for convergence was just met, and the corresponding result is shown in
Table 6. By comparing
Table 5 and
Table 6, it is evident that the computational efficiency of the derivative-variance hybrid global sensitivity measure is much higher than that of the variance-based global sensitivity measure, and the required sample sizes for the derivative-variance hybrid global sensitivity measure and the variance-based global sensitivity measure to meet the convergence threshold of 0.01 are 1000 and 240000, respectively.
Lastly, in order to demonstrate that the derivative-variance hybrid global sensitivity measures can serve as good approximations for the corresponding variance-based global sensitivity measures, the derivative-variance hybrid global sensitivity measures, the derivative-based global sensitivity measures, and the variance-based global sensitivity measures for the above example are computed and compared, and the sample sizes for computing the variance-based global sensitivity measures, the derivative-based global sensitivity measures, and the derivative-variance hybrid global sensitivity measures are 240,000, 1000, and 1000, respectively.
Table 7 shows the comparison among the derivative-based global sensitivity measures, the variance-based global sensitivity measures, and derivative-variance hybrid global sensitivity measures. From
Table 7, it is seen that: (1) the absolute values of the derivative-based global sensitivity measures are meaningless, so one must compute all the inputs’ derivative-based global sensitivity measures and rank them before determining their sensitivities, while the values of the derivative-variance hybrid global sensitivity measures and the variance-based global sensitivity measures directly reflect the sensitivity of the corresponding inputs; (2) for sensitive inputs, the derivative-variance hybrid global sensitivity measure is consistently greater than the corresponding variance-based global sensitivity measure; and (3) for sensitive inputs, the relative errors between the derivative-based global sensitivity measures and the corresponding variance-based global sensitivity measures are all less than 26%. Therefore, it is demonstrated that derivative-variance hybrid global sensitivity measures are good and conservative approximations for the variance-based global sensitivity measures.
6. Conclusions
This research proposes a new sensitivity measure for sensitivity analysis, which is referred to as the derivative-variance hybrid global sensitivity measure. Optimal sampling methods for computing the derivative-variance hybrid global sensitivity measure are investigated by evaluating the corresponding performances of six frequently used sampling methods. To demonstrate its validity and practicality, the proposed sensitivity measure is applied to the sensitivity analysis of a rural bridge, which is further compared to the derivative-based global sensitivity measure and the variance-based global sensitivity measure. We found that the derivative-variance hybrid global sensitivity measure can directly measure the sensitivities of the corresponding inputs of the variance-based global sensitivity measure, while the derivative-based global sensitivity measures cannot directly reflect the inputs’ sensitivities, and the computational efficiency of the derivative-variance hybrid global sensitivity measure is much higher than that of the variance-based global sensitivity measure. Thus, the derivative-variance hybrid global sensitivity measure has promising sensitivity analysis applications in a variety of engineering fields, such as strength analysis, failure analysis, rock mechanics, slope stability analysis, and structural reliability analysis. In addition, the following conclusions are drawn:
The derivative-variance hybrid global sensitivity measure and the derivative-based global sensitivity measure share similar computational costs, but the values of the derivative-variance hybrid global sensitivity measures directly imply the sensitivities of the corresponding inputs, while the values of the derivative-based global sensitivity measures are meaningless.
The derivative-variance hybrid global sensitivity measure can serve as a good and conservative approximation for the corresponding variance-based global sensitivity measure, while the computational cost of the derivative-variance hybrid global sensitivity measure is much lower than that of the variance-based global sensitivity measure.
Latinized stratified sampling and quasi-Monte Carlo sampling are recommended for computing the derivative-variance hybrid global sensitivity measure.