1. Introduction
The transportation system is critical to the proper operation of a city. Many experts and professors have dedicated their careers to relevant research over the years. Adoption of artificial intelligence (AI) technology, integration of multimodal systems, and the advent of new unknown elements such as COVID-19 have all had a significant impact on the transportation system. Simultaneously, safety has begun to be recognized as a crucial element influencing travel decisions. With the emergence of new problems and demands, it is critical to further investigate the transportation system’s performance.
The evaluation of the transportation system has been studied by many researchers during the past years to better understand the key factors that can increase overall transportation system performance [
1,
2]. It is well known that we are confronted with multiple criteria in transportation system evaluation procedures. As a result, multi-criteria decision-making (MCDM) methods are rapidly growing in related problems [
3]. Taking Nantong urban expressway as an example, Jing et al. of Southeast University studied the scheme evaluation system of urban expressway by using analytic hierarchy process (AHP), fuzzy evaluation and grey relational analysis (GRA) [
4]. In order to establish a safety index that could be implemented in a decision support system (DSS) for the railway transportation system, Sangiorgio et al. took into consideration the damage antecedents in both the railway infrastructure and the train equipment [
5]. Senne et al. proposed an evaluation model based on AHP in terms of sustainability and integrated transportation [
6]. A consistent combination of the ELECTRE TRI multi-criteria decision-sorting method and the DELPHI procedure was proposed to identify which urban public transport vehicles are acceptable [
7]. It is undeniable that group decision making has evolved into a critical and vital component of MCDM. [
8,
9], and a group can better overcome the complexity of the problem [
10,
11]. In this study, we plan to analyze the structure of the transportation issue with the assistance of a group of experts, and decide how important the selected criteria are. As commonly asserted by its supporters, the benefits of AHP over other multi-criteria methodologies include its flexibility and intuitive appeal to experts [
12].
As urbanization accelerates, traffic congestion has become a major constraint to urban development, negatively impacting the performance of the transportation system [
13,
14]. At the same time, statistics show that congestion levels are still worsening. We could conclude that one of the crucial actions that might contribute to the provision of improved transportation services is the evaluation of the transportation system with regard to significant congestion factors. While many other metrics (such as “level of service”) have been employed by the transportation industry to quantify congestion, travel time is a more direct indicator of how congestion impacts users [
15]. Many audiences, both technical and nontechnical, use travel time to evaluate the efficacy of transportation systems. In summary, to acquire a better knowledge of regional traffic performance, we will focus more on travel time reliability evaluation in the transportation system.
However, experts usually have limited understanding of things and fail to have absolute confidence to make accurate judgments about the relative importance of factors expressed by Satty’s nine-point scale [
16,
17,
18]. Therefore, this issue can affect the evaluation of transportation system reliability. Moreover, the evaluation procedure in AHP problems frequently contains uncertain data, which can be challenging for experts. According to studies, the transportation problem is always a typical uncertainty problem [
13,
14]. In addition to the system’s random uncertainty, we should note that the transportation system’s primary service target is people. The amount of traffic information, cognition of travelers, their goal, personal preferences, and other factors all contribute to the system’s uncertainty, which cannot be accurately measured by probability theory. However, when researching issues on travel time reliability, the existing epistemic uncertainty has not been taken into consideration by researchers deeply [
19,
20,
21].
The fuzzy set theory, proposed by Zadeh in 1965, is the most widely used method for modeling the uncertainty of MCDM issues [
22]. The introduction of fuzzy set theory to these MCDM problems has been widely applied in scientific and engineering domains [
23]. However, fuzzy set theory still could not explain the actual existence of uncertain phenomena perfectly. Liu questioned the inconsistencies existing in fuzzy set theory, and put forward a novel axiomatic mathematical theory in 2007, which could better describe the uncertainty caused by subjective cognition [
24]. Uncertainty theory has gradually grown into a relatively complete mathematical system over the years. It can more reasonably quantify inaccurate data information, which is mainly provided by experts in consideration of personal experience. Especially when there is neither historical data nor experimental data for reference, people have to rely on empirical data, then the uncertainty theory could be very useful and effective.
Many studies have been conducted with focusing on applications of uncertainty theory in problems in uncertain environments. Lv et al. applied the uncertainty theory to the vehicle scheduling problem and proposed an uncertain programming model for multiple distribution centers [
25]. Song et al. proposed a new uncertain decision model to perform product configuration using redundancy and standardization in an uncertain environment [
26]. Kang proposed the theoretical framework and the basic method of belief reliability to examine the epistemic uncertainty in reliability research, introducing uncertainty theory to reliability industry [
27]. Although many financial and engineering industries employ uncertainty theory, there have been relatively few studies that have expanded on it or applied it to MCDM problems. In the current study, we intend to introduce the uncertainty theory to AHP to make up for the deficiency of ignoring epistemic uncertainty in the original method. In this extension, the preferences of experts on the criteria should be expressed as an uncertain valuable. The main contributions of this study are summarized as follows:
We provide an extension of AHP method using uncertainty theory to quantify the subjective weights of criteria;
The proposed uncertain AHP approach is applied to the evaluation of regional travel time belief reliability with congestion considerations, providing technical support to intelligent traffic systems (ITS) for intelligent decision making;
The validity of introducing uncertainty theory into the MCDM methods to describe the existing uncertain information is verified.
The structure of this article is shown as follows: the definitions and theorems of uncertainty theory are introduced in
Section 2, which provides a mathematical basis for the establishment of the evaluation procedure. In
Section 3, we describe the overall calculation procedure of how to combine the uncertainty theory with the AHP method. In
Section 4, we explain how to establish the evaluation model of the transportation system and provide a concrete case study to verify the validity and operability of the approach. Finally, the conclusions are presented in
Section 5.
3. Uncertain Analytic Hierarchy Process
Analytic hierarchy process (AHP) is a particularly effective comprehensive evaluation method when dealing with some complex systems [
30]. However, based on the essential characteristics of AHP, it is clear that AHP obviously very consistent with the assessors’ conduct. In summary, AHP heavily relies on personal experiences, knowledge, and intuition. As a result, it is critical that specialists provide absolute authoritative evaluation. It is also critical to better accurately measure the information provided by these specialists. However, when scaling preferences in classical AHP, the subjectivity of judgment is neglected.
Researchers have worked hard over the years to effectively evaluate the epistemic uncertainty present in the judgmental matrix. To describe uncertainty, experts have introduced theories such as fuzzy set theory, rough set theory, and gray system theory into AHP. However, certain inexplicable defects in these theories emerged throughout their practical use [
24]. Furthermore, as previously stated, uncertainty theory can better describe epistemic uncertainty. As a result, this section attempts to incorporate uncertainty theory into AHP in order to compensate for the inadequacies of classic AHP.
3.1. Uncertain Scale for Preferences
On the basis of the relative scale measurement of classical AHP, we consider the intensity of importance as uncertain variables with a zigzag uncertainty distribution
denoted by
where
are real numbers with
.
That is, the number
is set to represent the belief degree with which we think it will happen that the intensity of importance of index
i with respect to index
j is lower than
x. For the value of
x, we can refer to the fundamental scale of 1–9 in the classical AHP. In contrast to the classic scaling method, in uncertain AHP, evaluators assign preference to any value from 1 to 9, while also providing belief degree one-to-one. At the same time, we believe that following zigzag uncertainty distribution is a suitable choice because it better reflects the statistical data and simplifies the calculation. The relative scale measurement is then obtained, as indicated in
Table 1.
Table 1.
Pairwise comparison scale 1.
Table 1.
Pairwise comparison scale 1.
Evaluation | Explanation |
---|
| We totally believe index i is preferred to index j. |
| We totally believe index j is preferred to index i. |
| We totally believe index i is moderately preferred to index j. |
| We do not believe index i is moderately preferred to index j, and we consider it to be of a lower priority. |
| We totally believe index i is strongly preferred to index j. |
| We do not believe index i is strongly preferred to index j, and we consider it to be of a lower priority. |
| We totally believe index i is very strongly preferred to index j. |
| We do not believe index i is very strongly preferred to index j, and we consider it to be of a lower priority. |
| We totally believe index i is extremely preferred to index j. |
| We do not believe index i is very extremely preferred to index j, and we consider it to be of a lower priority. |
| Our belief level is somewhere between complete belief and complete disbelief. |
Table 2.
The fundamental scale for x 1.
Table 2.
The fundamental scale for x 1.
x | Definition | Explanation |
---|
1 | Equal importance | Two indexes contribute equally to the objective |
3 | Moderate importance of one over another | Experience and judgment strongly favor one index over another |
5 | Essential or strong importance | Experience and judgment strongly favor one index over another |
7 | Very strong importance | Experience and judgment strongly favor one index over another |
9 | Extreme importance | The evidence favoring one index over another is of tile highest possible order of affirmation |
2,4,6,8 | Intermediate values between the two adjacent judgments | When compromise is needed |
Reciprocals | If index i has one of the above numbers assigned to it when compared with index j, then j has the reciprocal value when compared with i |
As previously noted, the preference, or the intensity of importance, is determined by the expertise and personal knowledge of decision makers. In order to turn abstract data into tangible data and quantify decision makers’ knowledge and expertise, this paper cites a questionnaire survey procedure [
24]. To explain this procedure, an example, as shown below, is given.
Example 1. The questionnaire survey procedure of evaluating the preference of index i to index j.
Q1: To what extent do you think that the preference of index i to index j is less than 1?
A1: 1%. (An experimental datum (1,0.01) is obtained.)
Q2: To what extent do you think that the preferenceis less than 3?
A2: 40%. (An experimental datum (3,0.4) is obtained.)
Q3: To what extent do you think that the preferenceis less than 5?
A3: 70%. (An experimental datum (5,0.7) is obtained.)
Q4: To what extent do you think that the preferenceis less than 7?
A4: 99%. (An experimental datum (7,0.99) is obtained.)
Q5: So, to what extent do you think that the preferenceis less than 6?
A5: 98%. (An experimental datum (6,0.98) is obtained.)
Q6: And then, to what extent do you think that the preferenceis less than 4?
A6: 50%. (An experimental datum (4,0.5) is obtained.)
Six experimental data of the preference of index
i to index
j are obtained from the decision maker utilizing this questionnaire survey:
In the process of practical application, we can take as many values as possible near the points where the changes are sharp.
It is possible to use the principle of least squares to calculate the uncertainty distributions of uncertain variables Φ(
x) [
29].
Definition 8. (Principle of Least Squares [29]) If the expert’s experimental dataare obtained, and the vertical direction is accepted, then we have The optimal solution
of Equation (13) is called the least squares estimate of
θ, and then the least squares uncertainty distribution is
[
29].
3.2. Steps for Applying Uncertain AHP
Generally speaking, four steps are involved:
Building the hierarchical structure;
Constructing the uncertain judgmental matrix;
Calculating the relative importance factor;
Calculating comprehensive evaluation scores and making decisions.
3.2.1. Building the Hierarchical Structure
First and foremost, specify the objective of the stated problem. The top layer, which symbolizes the overarching goal, was then defined. Second, for the criteria layer, choose the primary criteria affecting the previously indicated target. Based on this, the sub-criteria with the greatest influence on the target are chosen from the elements contained in each criterion. The criteria layer and the sub-criteria layer are both middle levels that are used to evaluate alternatives. Finally, the bottom layer contains the possibilities for achieving the goal and solving the problem. The hierarchical structure was then organized from top to bottom. So far, the structure of the complex problem has been presented in a simple and concise manner. The hierarchical structure is shown in
Figure 2.
O stands for the top layer. The criteria layer, which contains
n criteria, is denoted as
C1,
C2, …, and
Cn. The sub-criteria layer is denoted in the same way. The problems to be solved are different, and the corresponding middle layers are also different.
A1,
A2, …, and
Am are used to identify the
m alternatives in the bottom layer.
3.2.2. Constructing the Uncertain Judgmental Matrix
Pairwise comparison of two elements produces an unclear judging matrix. Pairwise comparisons are used to assess the relative relevance of each criterion in relation to the goal and each sub-criterion in relation to each criterion. Domain experts of the assessment team must provide their judgment on the worth of one single pairwise comparison and related belief degree at a time through a questionnaire, using the scale shown in
Table 1. The gathered data is then fitted using the least square approach. As a result, each relative importance’s uncertainty distribution is provided.
Finally, we may obtain the comparison result that is represented by matrix . The pairwise comparison judgmental matrix from the goal layer to the criteria layer is designated by . In the same way, we can also get the pairwise comparison judgmental matrixes from the criteria layer to the sub-criteria layer, which are denoted as .
Definition 9. (Uncertain Judgmental Matrix) Let the relative importanceof the pairwise comparison be an uncertain variable that has a zigzag uncertainty distribution, that is.
After pairwise comparison of n objects, we can get a pairwise comparison judgmental matrix composed ofpairwise comparisons, which is denoted asin which when i equals j,when i is not equal to j, 3.2.3. Calculating the Relative Importance Factor
The relative importance of each element in one layer to the element in the layer above could be derived once the judgmental matrix has been constructed.
Definition 10. (Relative Importance Factor) For an upper-level goal/element, the relative importance of an element at this layer is called the relative importance factor, and the calculation formula is as follows. Supposing there are n factors for a target, the relative importance factor of the k-th factor iswhere theis the pairwise comparison among the corresponding uncertain judgmental matrix. Assuming that the relative importance factors are independent of each other, the inverse distribution function of
can be obtained as follows
where the
is the inverse uncertainty distribution of
:
Next, calculate the relative importance factor and its distribution function for each element and alternative in turn. The relative importance factors of the same level can form a vector:
In order to facilitate the next calculation, we need to simplify the relative importance vector. An essential numerical characteristic of an uncertain variable is its expected value. The expected value also represents the value of an uncertain variable in the average sense. Based on Theorem 1, we can find the expectations for each relative importance factor, and then the vector could be simplified as:
The vector for the sub-criteria layer can be obtained as well:
Next, assume a total of
p sub-criteria; we can obtain the weight value vector as:
3.2.4. Calculating Comprehensive Evaluation Scores and Making Decisions
For the
p-th sub-criteria, we can get the vector composed of each preference factor of the bottom layer called the score vector:
, and the inverse uncertainty distribution of
is
. Further merging the score vectors can form a score matrix:
Finally, we can get the total score vector
W of the bottom layer for the total goal:
where the
is the total score of
i-th alternative for the total goal.