1. Introduction
In recent years, unconventional emergencies occur frequently and this phenomenon causes great loss to people’s life, the safety of their property, and also affects the development of society. The ability of pre-disaster prediction and prevention, emergency rescue in disasters, and post-disaster disposal plays an important role in reducing loss [
1]. Emergency logistics as a response to emergencies is particularly important, which is related to whether the lives and properties of the victims can be saved. If the role of emergency logistics cannot be effectively played, it may seriously affect the “golden 72-hour” life-saving work and worsen disaster consequences.
Despite the rapid economic and technological development of the world, countries or regions around the world remain vulnerable to a number of emergencies such as natural disasters, accidents, and public health emergencies. As is known to all, the frequent occurrence of emergencies has caused huge loss of life and property all over the world. Disastrous events during the past two decades include the Iraq war (2003), SARS in China (2003), the tsunami in Indonesia regions (2004), Hurricane Katrina in America (2005), the Bangladesh cyclone Sidr (2007), the Wenchuan earthquake in China (2008), etc. All of these emergencies have caused massive disruption to people’s lives, requiring the delivery and distribution of large quantities of relief supplies in a short period of time. When unexpected disasters crop up, relief operations are carried out in the initial response phase, and logistics support operations need to last longer to meet the basic living needs of survivors in the affected areas. Therefore, the performance of emergency logistics plays a vital role in disaster mitigation, it is very necessary to make a reasonable evaluation of the corresponding logistics.
The multi-criteria decision making (MCDM) method has been widely used in the area of logistics [
2,
3], and while there are few studies on emergency decision-making [
4], previous emergency logistics evaluation research has tended to focus on emergency logistic planning or emergency logistic management [
5,
6]. To the authors’ best knowledge, performance evaluations of emergency logistics are rare. In addition, when evaluating emergency logistics, researchers usually take into account the logistics center capabilities, the logistics system path planning, the material supplier selection [
7,
8], and provide some suggestions for improving actual emergency logistics problems [
9]. However, emergency logistics is a complex system, which needs to take into account the supply capacity and coordination capacity of human, material, capital, transportation from a system perspective. Therefore, the basic idea of this paper is to consider the whole components of emergency logistics to carry out performance evaluation.
Because unconventional emergencies is an unstructured or semi-structured problem, most of the studies are conducted considering the internal branches of the emergency logistics system, for example, Sahu (2016) and Hu (2019) studied the selection of suppliers for disaster relief supplies [
7,
10]. Bozorgi-Amiri (2016) studied the location and route selection of disaster relief logistics [
11]. Liu (2017) evaluated the integrity of emergency supplies distribution [
12]. Some researchers tried to establish an indicators system for the evaluation of the whole emergency logistics system, for example, Gong (2012) evaluated the emergency logistics system reliability and analyzed the hypothetical examples [
13]. Guan (2017) proposed an evaluation model for earthquake relief emergency logistics capacity [
14]. However, the indicators system of these researches mainly focuses on the emergency response stage and rarely considers the pre-disaster prediction and post-disaster reconstruction. To solve this problem, the indicators system established in this study considers the entire disaster cycle, which covers emergency preparation, response, and recovery.
In recent decades, there have been a lot of evaluation methods for emergency logistics performance evaluation [
15], in which the MCDM method has been broadly employed [
16,
17], it refers to selecting the optimal scheme or sorting under consideration of multiple criteria. As an MCDM method, TOPSIS symmetrical technique has been extensively used in scheme selection and performance evaluation [
18,
19]. The optimal scheme selected by the TOPSIS method is based on minimizing the distance from the positive ideal point and maximizing the distance from the negative ideal point, so it is very suitable for study with both benefit indicators and cost indicators. In addition, the TOPSIS method can be operated easily when there are many criteria and alternatives [
20,
21,
22]. Moreover, the advantage of the TOPSIS method is that it can be used to deal with different indicators with different dimensions. In the proposed evaluation indicator system of the emergency logistics performance, many kinds of indicators with different dimensions are considered. Furthermore, the relative closeness calculation of the TOPSIS method depends on the range of available alternatives. Emergencies are abrupt and uncertain, and their destructiveness is also caused by the complexity of their influencing factors. As a result, the public is unable to obtain the optimal results when faced with the losses caused by huge disasters. Therefore, the TOPSIS method is applicable to the evaluation of emergencies, ranking the performance of emergency logistics in various regions, based on which some suggestions can be put forward for improving the ability to respond to emergencies. In addition, in the TOPSIS method, the determination of indicator weights is the most critical part. Experts’ preferences are difficult to measure using determined values, the hesitant fuzzy linguistic set, closer to human cognition expressions [
23,
24,
25], is used in this paper to describe the experts’ judgments on the importance of the indicators. Moreover, maximum group consensus and minimum hesitant degree [
26,
27], which can obtain group consistency and improve decision credibility [
18], are considered to get the experts’ weights. Based on this, the weighted average operator is used for obtaining the indicator weight. However, due to its inherent subjectivity and ambiguity, the application of this method has some limitations. The entropy weight (EW) method can fully mine the information contained in the original data, the smaller the entropy value, the smaller the degree of disorder in the system, and the higher the weight. Therefore, the objective weights of the EW method can be used to adjust the subjective weights to get more practical results [
2]. Furthermore, there exist some indicators in the system that are difficult to quantify, the multi-granularity linguistic assessment (MGLA) approach, which can enhance the elasticity and dependability of processing multifarious linguistic expressions [
28,
29,
30,
31], is applied to express qualitative information as linguistic variables in the processing of some indicators hard to quantify. In this case, a fuzzy TOPSIS-EW method with MGLA information is put forward in this paper for performance evaluation of emergency logistics.
Table 1 summarizes the main facing challenges and the solving strategies adopted in this study.
The remainder of this paper is structured in the following way. The key problem statement is stated in
Section 2.
Section 3 introduces the comprehensive evaluation methodology, which includes the overall framework, the indicators description, the main steps of the MGLA method, the weights determination method, and the TOPSIS method. In
Section 4, the proposed method is employed to evaluate the emergency logistics performance level of several worst-hit districts in Wenchuan earthquake in China, in which a comparison analysis with the TOPSIS method with equal expert weights and the TOPSIS-EW method is conducted along with a sensitivity analysis demonstrating the influence of decision-making strategy. Moreover, the deficiencies in some emergency logistics systems are pointed out and the directions for improvement are presented in this section.
Section 5 presents the conclusions with a summary and gives the future research direction.
3. Evaluation Methodology
3.1. Overall Framework
The overall framework is presented below. There are
u evaluators,
is the
mth evaluator;
p indicators,
is the
hth indicator; and
q regions to be evaluated,
is
ith region. This study describes the experts’ judgments on the importance degrees of indicators by employing hesitant fuzzy linguistic sets and then both group consensus maximization and hesitant degree minimization are considered to determine the experts’ weights. The weighted average operator [
18] is combined with the EW method to obtain the indicator weights. Moreover, the MGLA method is utilized to solve the quantification problem of some indicators. After collecting the data of all indicators, the TOPSIS method is utilized to sort and obtain the final ranking of the regions (i.e., alternatives). The overall framework of the evaluation method is shown in
Figure 3.
3.2. Indicators Description
The indicators of emergency logistics performance evaluation can be divided into 4 subsystems: information processing (denoted as ), logistics operation (denoted as ), organization and coordination (denoted as ), and post-disaster response (denoted as ).
3.2.1. Information Processing
This paper mainly considers information processing from three aspects: information collection and analysis (denoted as
), natural disaster prediction (denoted as
), and comprehensive database (denoted as
) [
35]. The detailed description is as follows.
The real-time disaster information (denoted as
) is used to reflect whether the local government department can get the disaster situation in time after the disaster occurs in the disaster area [
36]. Therefore, the time required to initiate an emergency response is used to measure this indicator.
where
is the time of the earthquake eruption,
is the time required to initiate an emergency response.
To provide more reliable and accurate real-time information of the demand for emergency supplies in disaster areas, to predict and calculate the material demand (denoted as ), to facilitate decision-makers to conduct scientific and reasonable emergency supplies scheduling. In this paper, the demand for tents after the disaster is used to measure this indicator.
Whether decision makers can timely grasp real-time road conditions has an important impact on the path selection and transportation of emergency supplies, as well as personnel scheduling. Live traffic (denoted as ) affects the path selection. If accurate information cannot be mastered, the subsequent path selection may no longer be optimized, and path adjustment is required.
The timeliness of disaster prediction (denoted as
) mainly refers to the timely acquisition of data and early warning of disasters to facilitate the prediction and prevention of disasters. Control in the initial stage of a disaster can minimize the damage. The immediacy of disaster prediction can be reflected by the time between the earthquake eruption and the government getting initial information about the disaster.
where
is the time of the government to get initial information about the disaster.
The accuracy of disaster prediction (denoted as ) is mainly influenced by the accuracy of information prediction and the accurate judgment of information by professionals.
A well-developed emergency database can provide policymakers with information to make more accurate decisions about disasters. The database is the collection and integration of historical data to provide reference data for disaster prevention and prediction. Therefore, the integrity of the emergency database (denoted as
) can greatly improve the ability to cope with disasters [
37]. The number of disaster information collected within 24 h is used to measure this indicator.
3.2.2. Logistics Operation
Emergency logistics operation can ensure survivors of disaster-stricken regions with relief materials (such as medical supplies, water, food), provide the necessary financial support in need and contribute to post-disaster reconstruction and rehabilitation activities. In general, the emergency logistics system consists mainly of elements such as the acquisition, storage, and transportation and allocation of emergency supplies [
38,
39]. The goal of emergency logistics operation is to integrate and make the best of emergency supplies, to pursue the fastest time efficiency within the acceptable range of economic input, deliver the materials to the designated place as soon as possible, and reduce the consequences of disasters.
In this paper, the quantity of materials (denoted as ) is the standard to measure whether the emergency resources in the disaster area can reach the balance between supply and demand. This indicator is based on the number of relief living tents delivered to the disaster area on 25 May 2008.
Reasonable emergency supplies reserve is a powerful guarantee to cope with unexpected disasters. Therefore, it is of great importance to reserve emergency supplies and analyze the reasonable demand for emergency supplies in case of emergencies. The emergency supplies storage plan should be of operability ad rationality, paying attention to the sustainability, economy, and balance in the material storage process [
40].
By controlling the storage cost of emergency supplies [
41], emergency funds can be allocated more effectively. The cost of storing a single tent is about 10 percent of the market price, so the storage cost is 40 yuan for each tent. Then the storage cost (denoted as
) can be defined as
Transportation and allocation are the core links of emergency logistics operations to convey relief supplies and rescue staff to disaster areas. In emergency situations, the quantity of emergency relief supplies is relatively limited, which requires decision-makers to formulate the optimal route for the transportation of relief supplies with maximum social value.
The path selection (denoted as ) directly affects the fastest time for the delivery of relief supplies to the disaster-affected areas, and sometimes it is necessary to open a green channel to save transportation time. In this paper, the road damage rate of the most influential path choice is used to measure this indicator.
Even if the path selection above is optimal, the transportation process will still be affected by the real-time road conditions and other conditions to reach the destination time. Let
denote the on-time delivery times, and
denotes the total number of deliveries, the basic form for punctuality rate (denoted as
) can be expressed as follows:
Emergency relief material delivery from local distribution centers to disaster-affected beneficiaries measure the last kilometer of material delivery [
42] with quickness (denoted as
) and accuracy (denoted as
).
3.2.3. Organization and Coordination
When an emergency occurs, a number of social groups or organizations organized by the government participate in the emergency relief work, bringing more relief resources to the affected areas and people. To ensure the efficient and orderly participation of the emergency rescue work, the central and local governments should coordinate all aspects of the work, such as the establishment of emergency funds and emergency departments.
The level of inter-departmental collaboration (denoted as ) reflects the decision-making ability and management ability of the government. Good inter-organizational coordination can make efficient use of human and material resources and save rescue time. Therefore, it is necessary to set up corresponding working groups, such as the emergency rescue team, the medical rescue team, the communication support team, etc. This paper is represented by the number of working response groups established after the earthquake.
The emergency drill level (denoted as
) is the response to the emergency situation shown by the simulation training in different situations. Practice has proven that regular emergency drills can reduce personnel casualties and property losses and restore normal conditions for the disaster-hit areas as soon as possible [
43].
where
is the time of government to get initial information about the damage.
Emergency fund (denoted as ) is the important foundation for the rescue activities, there should be enough funds and reasonable allocation of use, so the speed of fundraising (denoted as ) should be as fast as possible.
After the disaster, all the departments, military, medical, social volunteers, and other supporting forces are mobilized to help the disaster regions. Consequently, the number of mobilization (denoted as ) to reflect the situation of mobilization after the disaster. The number of armed police officers and soldiers supporting the disaster areas within three days after the earthquake to represent the mobilization force.
3.2.4. Post-Disaster Response
As most emergencies will have serious consequences, such as damaging infrastructure and buildings in the affected areas, post-disaster reconstruction is a difficult and long-term work.
This paper considers using the number of injuries and deaths (denoted as ) to assess the severity of the disaster.
Two indicators are used to evaluate the relief effect in the disaster area. First, Life-saving ratio (denoted as
) is defined as
where
is the number of rescued,
is the total number of victims.
And the cost of property damaged (denoted as ) reflect the damage in the affected areas.
The people in the disaster-hit areas suffer heavy losses after the major disaster and must speed up reconstruction to restore normal life in the disaster-hit areas. The economic recovery efficiency (denoted as ) reflects the rate of economic recovery, and on the other hand, the basic life rebuilding speed (denoted as ) is measured by the time the graduating students return to class.
3.3. MGLA Approach
Due to the uncertainty and complexity of earthquake occurrence, direct data cannot be obtained for some indicators in real life, Therefore, it is necessary to conduct an expert evaluation on these indicators, this paper uses the MGLA approach to solve the quantification of these indicators [
28,
29].
Step 1. At times, the experts employ multi-granularity linguistic term sets to express their own judgment information. In this case, let be the th pre-established confined and completely ordered linguistic term set, where is called the granularity of , denotes the yth linguistic term of set . The judgment of each individual expert can be fully expressed by the utilization of the linguistic label set of granularity.
Step 2. Considering these original linguistic terms are obtained from different experts with different linguistic granularities, they should be unified first. This study utilizes some transformation functions to unify the derived multi-granularity linguistic labels into a consistent linguistic term set. With regard to any two linguistic term sets
and
, the transformation functions between them are presented below [
44]:
Using Equations (
7)–(
10), the linguistic term sets in
and
can be made consistent without loss of decision information. It is noteworthy that the selection of any given linguistic term sets does not change the end results, therefore the above method can be employed to transform and unify the multi-granularity linguistic comparison matrices based on the information given by the experts.
Step 3. Conducting improved standard and mean deviations method [
44]. Let
be two linguistic variables, the deviation between
and
is expressed as
. To expert
and indicator
, the standard deviation between region
and others is as follows [
45]:
where
where
denotes the judgement information given by expert
about
jth indicator of
region, then
denotes the mean value of indicator
given by expert
.
represents the deviation of the mean value
to the attribute value
of the region
for the indicator
of the expert
. Then
denotes the standard deviation for the indicator
of expert
. The mean deviation can be expressed as
where
where
denotes the mean value of the indicator
given by expert
.
denotes the deviation of the mean value
to the attribute value
of region
for indicator
of the expert
. Then
denotes the mean deviation for indicator
of expert
.
Step 4. Based on the above analysis, maximizing the total mean and standard deviation of all the evaluation indicators to determine the weighting vector
w. The objective function is established below:
where
and
denote the preferences of the experts,
denotes the experts take into account the standard deviation while not the mean deviation,
denotes the experts take into account the mean deviation while not the standard deviation, then
denotes the experts take into account both the mean and standard deviations. Therefore the following model is determined when taking into account both the mean and standard deviations:
This model could achieve the
:
The normalization of
is expressed in the following:
Step 5. The
kth expert’s decision matrix is
where, for benefit indicators
, it gives
for cost indicators
, it gives
Then the calculated indicator weight vector is used to calculate the normalized decision matrix
:
Then the average matrix of the group decision matrix (denoted as ) is the final result of the indicators.
3.4. Weights Determination
As different indicators in the evaluation system may have different impacts on the performance of emergency logistics, it is necessary to lay different importance degrees on various indicators. In this section, an aggregated method with hesitation fuzzy linguistic judgments (i.e., subjective method) and EW (i.e., objective method) is used to obtain the final indicator weights.
3.4.1. Hesitant Fuzzy Linguistic Judgment Description
When determining the weights of indicators, experts should be invited first to make linguistic judgments on the importance degree of each indicator. However, each expert has different working experience and knowledge, this difference directly affects their understanding and evaluation of the importance degrees of various indicators [
46]. Experts use different linguistic terms when judging the indicators. For example, when experts are confident, they use a single linguistic term to give a clear and definitive assessment, such as “the natural disaster prediction is of the highest importance”. However, when they are low in cognition or confident, they would give continuous interval-valued judgments, such as “the material reserve is between medium and important”. Some experts give an open range such as “the material transport is more than slightly important”, and other experts may offer more flexible judgments such as “the emergency fund reserve is between medium and extremely important, but are most likely to be very important”. There is no need to force experts to make crisp/single linguistic/random judgments when they are particularly unfamiliar with certain indicators. Conversely, scoring in this situation may lead to an incorrect result.
Traditional linguistic evaluation approaches that use single linguistic terms are unable to express the hesitations of experts. Therefore, this study applies the method of hesitant fuzzy linguistic term sets [
47] to express the expert judgments on the importance degrees of different indicators, as this method is more flexible, accurate, and in line with human habits of information expression [
48].
Let
be a symmetrical linguistic term set, a 9-scale linguistic term set can be expressed in the following:
The linguistic variable
is denoted as a fuzzy restriction label, and each linguistic value corresponds to a real number in [0, 1] [
49]. In this paper, a 9-scaled symmetrical linguistic term set is applied for the evaluation [
50]: {0.0, 0.125, 0.25, 0.375, 0.5, 0.625, 0.75, 0.875, 1.0}. For instance, when evaluating the “material transport route selection”, the linguistic information given by hesitant fuzzy linguistic terms might be
= very good,
= between slightly good and very good,
= between poor and fair, probably slight poor
= The performance is no more than slight poor,
= Better than the fair. The real numbers in the interval [0, 1] are divided into 9 scales, which can be expressed as
,
,
,
,
, as shown in
Figure 4.
The number of various elements in
can be different, and to compare distances, we must extend the shorter elements until all elements have the same length [
23]. The extension value is
, where
is the parameter obtained by the experts’ preferences,
and
are the maximal and minimal values in
, respectively. The extension element value
is used when experts are neutral on elements, which indicates
. The extension example of hesitant fuzzy linguistic terms set can be seen in
Table 2. In addition, when the length of an expert’s judgment is 0, the evaluation value given by other experts is used to supplement it. For example, if the element for
is blank,
is supplemented with all the values given by all the other experts, namely
.
3.4.2. Expert Weights Determination
In the MCDM problems, it is difficult to determine the weight of the expert because each expert has different levels of knowledge, experience, and preferences. Previous studies are more inclined to give equal or fuzzy weights to experts [
51,
52], while the determination of appropriate expert weights is helpful to improve the reliability of evaluation results [
53]. Therefore, a small hesitant degree and a high group consensus are critical to the effectiveness and reliability of the results [
18,
54]. Therefore, this paper establishes a model of both minimizing degree of hesitation and maximizing group consistency to determine the weight of each expert. Euclidian distance is used to express the divergence between two expert judgments, and the ambiguity of experts in judging the importance degrees of indicators is expressed by the degree of hesitation. The general idea is to minimize the results of the sum of the hesitancy degrees and the Euclidean distance from one expert judgment score to another expert.
In the first place, the importance of each indicator is judged by the experts. The experts’ judgments are described by hesitant fuzzy linguistic elements and converted into hesitant fuzzy numbers (extended to the same length
L), which can be expressed as follows:
where
L denotes the length of
.
As to the importance degree of indicator
, the total Euclidean distance or the judgment divergence between one evaluator and another, can be denoted as
and obtained by
Therefore, hesitant fuzzy judgments with expert weights are:
. According to Equation (
24), the weighted sum of the total Euclidean distance from one evaluator judgment score to another for the indicator can be defined below:
Secondly, the hesitant degree of the linguistic fuzzy sets provided by experts is also measured to obtain the final result with high certainty. The mean of the hesitant fuzzy element
can be expressed as follows:
Based on this, the hesitant degree of element
can be expressed as
Similarly, the total difference in hesitancy degree between one expert and another can be denoted as follows:
The hesitant degree of expert weight can be represented as
. According to Equation (
28), the weighted sum of the hesitancy degrees from one expert assessment to another for an indicator is expressed as follows:
To achieve maximum consensus and certainty, we must determine the optimal
by minimizing the sum of hesitations, based on which the fuzzy hesitations of all expert weights should be brought close to each other as far as possible. According to the former analysis, The optimization model for minimizing hesitant degrees and the divergence among experts is presented as follows:
The expert weights
obtained from model (
30) are obtained by minimizing the total sum of Euclidean distances and hesitant degree from one average evaluator judgment score to another, therefore, the determined
guarantees the consistency and superiority of group decision making.
3.4.3. Indicator Weights Computation
The importance of each indicator can be determined by combining the expert hesitant fuzzy judgments with the entropy weight method. As mentioned in the previous section, expert judgments on the importance degrees of indicators can be expressed as . This study employs a weighted average operator to calculate the indicator weights:
Step 1. As the lengths of hesitant fuzzy judgements may not be equal, we must use the extension precedure to ensure all fuzzy judgments have the same length: .
Step 2. With the expert weights
determined from optimization model (
30), the weighted and extended hesitant fuzzy judgments can be obtained as follows:
Step 3. Furthermore, the weighted average operator parameters can be calculated using the following formulas:
Step 4. Based on Equations (
32)–(
34), hesitant fuzzy judgments can be transformed into triangular fuzzy numbers
. Similar to de-fuzzification for the intuitionistic fuzzy numbers, the weighted average operator can be utilized to calculate the weight of the
hth indicator:
where
is determined by an optimization model that takes into account the maximum group consensus of experts and the minimum hesitation, and calculated using the weighted average operator.
Hesitant fuzzy linguistic judgments by experts exhibit high subjectivity as it is remarkably affected by expert’s knowledge, experience, and preference, while the objective methods such as EW method can make up for the deficiency of the artificial instability of subjective methods in determining indicators, and fully mine the information contained in the original data to obtain more practical results [
2,
55,
56]. Therefore, a combination method that incorporates the expert’s weight and EW method is presented to determine the indicator weights. The procedure of calculating objective weights based on EW method is listed as follows [
57]:
Step 1. Assuming that the original data matrix
R is obtained as follows:
Step 2. Then data matrix R is converted into the normalized matrix O as follows:
- (1)
Normalized matrix of benefit indicators:
- (2)
Normalized matrix of cost indicators:
Step 3. Calculate the entropy value of the
hth indicator:
where, if
, then
.
Step 4. Calculate the weight of the indicator as is as below:
Based on the above description, the final weight of
hth indicator (i.e.,
) can be determined as follows:
where the weight for the EW weight is represented by
v and
indicates the weight considering maximum group consensus and minimum hesitant degree. Without loss of generality, the value of
v is set as 0.5 in this paper.
3.5. Relative Closeness to the Ideal Solution Based on TOPSIS
Considering the complexity and variety of the emergency logistics performance evaluation system, the TOPSIS method’s relative closeness computation depends on the scope of available alternatives themselves without considering other influence factors, therefore, it is applicable to the regional performance evaluation of emergency logistics.
Based on the above description, as there are indicators
, results
are obtained from regional emergency logistics data. The original evaluation matrix is represented as follows:
In MCDM methods, TOPSIS exploits the positive-ideal solution and the negative-ideal solution in multi-criteria problems to rank the regions (i.e., alternatives).
Step 1. Calculate the normalized decision matrix, the vector normalization is applied to obtain
as follows.
Step 2. Obtain the expert weights
using optimization model (
30), and the indicator weights
are determined according to Equation (
41).
Step 3. Construct the weighted and normalized evaluation matrix
Z as follows:
Step 4. Determine the best indicator
and worst indicator
respectively. In this paper, there are both benefit indicators and cost indicators, so some indicators are best when they are close to a specific value (denoted
). Then the new values for these indicators are
, where
represents the real values. Therefore, the ideal indicator values
and
are determined as
where
,
.
Step 5. Obtain the Euclidean distance between each region (i.e., alternative) and
as follows:
Similarly, the Euclidean distance between each region (i.e., alternative) and
can be determined by
Step 6. Compute the relative closeness of each region (i.e., alternative) to the most preferable
using the following formula:
Step 7. Rank the alternatives (i.e., regions) by sorting in descending order as can serve as the evaluation score of the emergency logistics performance. In other words, the higher value of indicates better regional emergency logistics performance.
4. Case Study
4.1. Case Description
The occurrence of public emergencies usually has disastrous consequences, and its suddenness and destructiveness have brought great challenges to human beings. There have been more than 200 earthquakes in China in the past two decades. On 12 May 2008, the 8.0-magnitude Wenchuan Earthquake occurred in Sichuan, China. The event was China’s worst massive earthquake in the previous six decades in China, causing more than 70,000 fatalities, 18,000 missing, and 370,000 injured with around 4.8 million people becoming homeless [
58]. This incident has brought unprecedented challenges to the Chinese government and the public in China. The suddenness and destruction of the earthquake fully tested the ability of China to deal with unconventional emergencies.
In this study, the evaluation method is employed to 5 worst-hit regions of the 2008 Wenchuan Earthquake, including Wenchuan County (denoted as
), Shifang City (denoted as
), Mianzhu City (denoted as
), Beichuan County (denoted as
) and Qingchuan County (denoted as
). The study area is shown in
Figure 5. By evaluating the performance of emergency logistics in these regions, this paper provides feasible suggestions for the public to deal with unconventional emergencies.
4.2. Data Source
The indicators data of each region mainly come from the China Statistical Yearbook, China Knowledge Resource Integrated Database, and local government websites.
In this evaluation system, some indicators are difficult to directly obtain accurate values, such as the real-time road condition information collected after an earthquake of one city. As a result, a more effective approach may be to use linguistic judements instead of numerical values. This paper uses MGLA information [
28,
29] to solve the quantification of these indicators. Firstly, the multi-granularity linguistic comparison matrices are transformed and unified using the computational formula. Secondly, the method of mean and standard deviation is applied to calculate the indicator’s weight vectors with reference to the different decision-makers. Finally, the average matrix of the group decision matrix is obtained by computing the normalized decision matrix based on the determined weight vector of each indicator [
28].
4.3. Result Interpretation
Three experts are local emergency logistics management experts, who make evaluations based on their actual situation and working experience. They are asked to evaluate indicators () that were difficult to quantify in the study. The 3 multi-granularity linguistic term sets are presented as follows:
.
.
.
Three experts give their evaluation information shown in
Table 3,
Table 4 and
Table 5. According to Equations (
7)–(
10), the evaluation information of the three experts can be transformation and unified into 9 granularity evaluation matrices as shown in
Table 6,
Table 7 and
Table 8. Using Equations (
12) and (
14), we can get:
Using Equation (
18) to compute the indicators weight reference to different experts
, supposing that
, then we can get:
Use Equations (
19)–(
21) to normalize the decision matrix of expert
as follows:
Using Equation (
22) to get the weighted standardized evaluation matrices as follows:
The average matrix of the group decision matrix:
After all the indicators values are obtained, the indicator importance is evaluated. The assessment team consists of five experts (i.e.,
), the experts invited for this paper are emergency logistics decision-makers experienced in emergency allocation and evaluation, and they make linguistic judgements about the importance of each indicator according to his own experience. The five experts’ hesitant fuzzy judgments on the importance degree of each indicator are shown in
Table 9. The expert hesitant fuzzy judgments of unequal length are extended to the same length. Lingo software is used to solve model (
30), and the expert weights are computed as
. Next, we use the objective weight of EW calculation to adjust the subjective weight of experts. On that basis, the TOPSIS-EW method is used to calculate
, the rank results obtained can be seen in
Table 10. According to the proposed method, the five regions in the earthquake received performance ratings of V, III, I, II, and IV.
4.4. Comparison Analysis
(
) represents the relative closeness of the
ith region evaluated by the TOPSIS-EW method, in which the expert assessments on the importance of the degrees of the indicators is ignored. The results of the comparison analysis between the fuzzy TOPSIS-EW method proposed in this paper and the TOPSIS-EW method are shown in
Table 10. Compared with
based on the symmetrical method of fuzzy TOPSIS-EW, except for Beichuan County and Mianzhu City, the rankings of other regions remain unchanged, while the relative closeness is slightly different. One of the reasons for this difference is that the EW method can directly reflect the information of the original data, but it can not take into account the expert judgments on the importance degrees of the indicators. For example, Mianzhu City storage cost of emergency supplies is nearly four times that of Beichuan County, which is very important from the perspective of the EW principle, but experts think it is not so important. Therefore,
which takes into account the subjective influences is more persuasive than
.
(
) represents the evaluation results of the
ith region by TOPSIS with equal expert weights. Compared with
based on the symmetrical method of fuzzy TOPSIS-EW, the relative closenesses of all regions (i.e., alternatives) change. The reason for this difference is that different experts have different experience and knowledge when evaluating the importance of indicators, we must pay attention to the difference in importance of each expert, while the equal expert weight method ignores this aspect. Therefore, the model (
30) of maximizing group consistency and certainty proposed in the fuzzy TOPSIS-EW method of this paper can better solve this problem, with the objective value is 0.7362 which is better than the result by the TOPSIS method with equal expert weights (i.e., 0.7533). Therefore, the method put forward in this paper is more reliable.
To sum up, just considering the subjective factors or the objective factors, the determined weights cannot be regarded reasonable, only by taking into account both of these two aspects, we can get more effective and reliable weights and get more reasonable evaluation results.
4.5. Sensitivity Analysis
In the fuzzy TOPSIS-EW method, parameter
v is represented as a preference parameter for subjective and objective weights. Generally speaking, the value of
v is often set as 0.5. However,
v can be any number between 0 and 1. Therefore, it is necessary to perform sensitivity analysis on the parameter
v to verify the results, sensitivity analysis can be conducted from totally considering the subjective factor (i.e.,
) to totally considering the objective factor (i.e.,
). The relevant results according to
v value can be found in
Figure 6. It is shown in
Figure 6 that with the variation of
v value, the relative closeness of each region changes. The performance rankings of Qingchuan County, Shifang City, and Wenchuan County are relatively stable, whereas those of Beichuan County and Mianzhu City have changed. The results show that when only subjective or objective weight is considered, the ranking results of performance levels in different regions will be different, so this bias must be carefully considered in practical problems.
4.6. Managerial Suggestions
The analysis results based on the value of
show that Qingchuan county has the best performance and Wenchuan County has the worst.
value {0–0.2, 0.2–0.4, 0.4–0.6, 0.6–0.8, 0.8–1}, corresponding performance level is {poor, relatively poor, average, relatively good, good}. Therefore, as can be shown in
Table 10. In this earthquake, Qingchuan County’s emergency logistics performance is good, Mianzhu City and Beichuan County had average performance, emergency logistics performances in Shifang City is relatively poor, and the Wenchuan County had poor performance. Compared with the EW method and equal expert weight evaluation results, The fuzzy TOPSIS-EW method considers both subjective weight and objective weight, and with the higher group consensus so the relative closeness of all regions has changed. Therefore
evaluation results are more accurate and reliable than the
and
.
In this case analysis, some key problems are highlighted. First, the actual supply of emergency supplies is far below the quantity need, and the distribution of supplies is unreasonable. For example, before 25 May, Wenchuan County, which had the largest number of people affected, received less than 15 percent of the number of tents in Qingchuan County. Secondly, the long time it took the government to get initial information about the disaster, especially in Qingchuan County, Mianzhu City and Shifang City, reduced the efficiency of emergency logistics decision-making. Thirdly, The efficiency of material transportation and material distribution after the disaster was low. Therefore, the paper puts forward some suggestions to improve the emergency logistics system and improve regional emergency logistic performance.
- (1)
Increasing emergency material reserves. After the disaster, the disaster area is in urgent need of adequate supplies of life support. However, the actual amount of materials is always in short supply, affecting the follow-up relief work. In addition, reducing the storage space and saving storage costs can also improve relief work efficiency.
- (2)
Improving the informatization of emergency logistics management. it is advised to accelerate the speed of information acquisition and apply advanced information and communication technology to improve the speed and accuracy of pre-disaster prediction, material transportation, and information transmission, and further improve the speed of information transportation command and dispatch and emergency response. For example, it took several hours for Qingchuan County to obtain information about the disaster, which seriously affected the timeliness of disaster relief activities.
- (3)
Strengthening the construction of contingency logistics plans. Firstly, it is needed to rehearse the emergency logistics plan, improve the practical operation ability of professionals, and increase the emergency response ability. In addition, what should be done is to test, revise, and improve the emergency plan, and more effectively deal with sudden and complex emergencies in practice.
- (4)
Improving a cross-departmental and cross-regional linkage and cooperation mechanism. For the first time after the disaster, all departments should formulate a common code of action and strengthen mutual communication and cooperation to ensure that personnel and materials can reach the emergency site as quickly and safely as possible. For example, the Wenchuan County and Beichuan County after the earthquake set up an emergency response working group later than the other three areas.
5. Conclusions and Future Research Direction
The basic proposition of this research is that the occurrence of public emergencies are inevitable, so ensuring efficient emergency logistics capacity can mitigate the consequences of disasters. The MCDM method proposed in this paper provides an appropriate method for the performance evaluation of emergency logistics, some inspiration for increasing the ability of emergency logistics resilience are derived. The main contributions of this study are as follows: (1) Comprehensive consideration of the three stages of the emergency preparation, response, and recovery indicators system, based on which a more comprehensive evaluation indicator system of the emergency logistics performance is established. (2) The MCDM method (i.e., the fuzzy TOPSIS-EW method) with MGLA information is used to solve some indicators that are difficult to be quantified in the indicator system. (3) A hesitancy degree minimized divergence model is constructed to determine the weight of the experts, so as to achieve the maximum group consensus and reliability evaluation results. And apply the EW method to adjust subjective weights assigned by experts. This fuzzy TOPSIS-EW method synthetizes the merits of subjective and objective factors, thus improving the impartiality and reliability of the evaluation results. (4) A practical case study is conducted on the Wenchuan earthquake in China, which is the worst earthquake in China in recent years. Using the proposed method, the five regions (i.e., Wenchuan County, Beichuan County, Qingchuan County, Mianzhu City, and Shifang City) in the earthquake receive performance ratings of V, III, I, II, and IV. Moreover, a comparison analysis using the proposed method with the TOPSIS-EW method and TOPSIS method with equal expert weight is conducted, it verifies the reliability of the proposed method considering both subjective weight and objective weight, which is also demonstrated by a sensitivity analysis on parameter v illustrating the preference degree on subjective/objective weight. Finally, on the basis of case analysis, some concrete suggestions are put forward to improve the performance of emergency logistics.
The limitations of this paper and future research direction include the following aspects. First of all, this paper does not focus on the distance calculation formula of experts divergence and relative closeness of TOPSIS. Therefore, in future studies, we can improve the distance calculation formula, such as using Mahalanobis distance and Hamming distance. Moreover, due to the complexity of MCDM, the TOPSIS-DEA method, TOPSIS-ANP method, grey relational analysis, VIKOR, and AHP can be used to increase its stability in future studies. Finally, the proposed evaluation method can also be applied to the evaluation of public emergencies such as the evaluation and decision-making in the the COVID-19 Global Pandemic and the flood disaster in southern China in 2020, which is conducive to the sustainable development of public health and public safety.