1. Introduction
Two of the most outstanding characteristics of the Knowledge Society (KS), understood as a space for the talent, imagination and creativity of human beings, are [
1]: (i) the collaborative predisposition of citizens in the resolution of complex problems, motivated by the existence of a more educated and participative society that wants to be involved in decision-making processes; and, (ii) the relevance of the human factor and the need for the formal models to incorporate the subjective, intangible and emotional aspects inherent to the human being, alongside the tangible and rational objectives of the traditional scientific method.
In order to take advantage of the characteristics of the KS and to provide an adequate response to new challenges and needs, it is necessary to develop appropriate analytical and computing decision-making tools to solve the complex problems characterised by the existence of multiple scenarios, actors and both tangible and intangible criteria. One of the most utilised multicriteria techniques that best incorporates intangible aspects and multiple actors is the Analytic Hierarchy Process (AHP) proposed by Thomas L. Saaty in the mid-1970s [
2]. The methodology consists of three stages: (i) Hierarchical modelling; (ii) Valuation; (iii) Prioritisation and Synthesis.
AHP incorporates the intangible through the judgments issued when assessing the matrices of paired comparisons considered in the problem. The two most commonly used methods in AHP for the calculus of collective priorities in multi-actor decision making are [
3,
4,
5]: the Aggregation of Individual Judgments (AIJ) and the Aggregation of Individual Priorities (AIP). They obtain, as averages (geometric mean), the collective judgments or collective priorities. The average is not a representative indicator of the collective when it is not homogeneous. It is therefore necessary to evaluate the compatibility (an objective measure obtained automatically) or the agreement (a subjective measure that requires personal intervention) between the individual positions of the actors and the position of the group.
If not all actors are compatible with the collective priority vector, the different positions and the actors that support them must be identified in order to initiate posterior negotiation processes to achieve final decisions that are as representative as possible. This paper presents a Bayesian procedure to solve this problem in a local context (a single criterion). The procedure adopts the Bayesian hierarchical approach (Stochastic AHP) proposed in reference [
6]. It allows the estimation of the priorities of the group by incorporating restrictions on the maximum level of inconsistency of the actors involved in the problem. The procedure quantifies the homogeneity of the groups by means of the marginal density of the judgments elicited by their respective actors. The density evaluates the goodness of fit of the model and allows for comparisons between different partitions of the set of actors. The work further puts forward an algorithm for the exhaustive search of homogeneous groups with respect to their priorities based on the Bayesian comparison and selection of models. The methodology is illustrated by a practical example.
The paper is structured as follows:
Section 2 presents the model used to determine the priorities of a group of homogeneous decision makers;
Section 3 describes the algorithm that identifies decision groups with homogeneous preferences;
Section 4 applies the methodology to a case study; and,
Section 5 concludes by highlighting the most relevant aspects of the work and possible extensions.
2. Bayesian Local Priorities in an AHP-Multi-Actor Decision Making Context
This section deals with the problem of determining the total priorities of a group of actors with homogeneous opinions regarding a decision criterion. A Bayesian statistical approach based on the use of a log-linear model similar to that used in reference [
6] is employed to describe the process of the issuing judgments by the decision makers of a group. The posterior distribution of the group’s priorities is calculated by means of Bayes’ Theorem; this is followed by a description of how to make inferences about the most preferred alternative (alpha problem—P.α) and the priority ranking (gamma problem—P.γ).
2.1. Problem Formulation
First, the log-linear model that is used to determine the priorities of the groups of decision makers is explained: in what follows, N (µ, σ) denotes the univariate normal distribution of mean µ and standard deviation σ; Np (µ, ∑) denotes the p-variant normal distribution of mean vector µ and the matrix of variances and covariances ∑; Tp (µ, ∑, υ) denotes the p-variant Student t distribution with mean vector µ, scale matrix ∑ and degrees of freedom υ; Gamma(p, a) denotes the gamma distribution with shape parameter p and scale parameter 1/a; denotes the chi-squared distribution with υ degrees of freedom; IA denotes the indicator function of set A; ∝ indicates ‘proportional to’ and [Y|X] denotes the density function of the conditional distribution of Y given X.
Let G = {D[1],…., D[K]} be a group of K homogeneous decision makers (k = 1, …, K), A = {A1,…, An} be a set of n alternatives and R(k) = ; k = 1,…, K be the nxn paired comparison matrices issued by each decision maker.
We assume, without loss of generality, that the matrices of judgments are complete—all paired comparisons have been made. If some of the r
ij comparisons are missing, the proposed methodology could be analogously adapted, as shown in reference [
6].
We further assume that the decision makers of
G have homogeneous opinions regarding the priorities of each of the alternatives of
A so that:
with
, where:
- (a)
; i = 1, …, n being the priority (without normalising) given to the alternative Ai by the members of the group G
- (b)
(that is to say, ) to avoid identifiability problems
- (c)
; k = 1, …, K; 1 ≤ i < j ≤ n independents
The normalised priorities of the group will be given by the vector where ; i = 1, …, n. Likewise, the level of homogeneity will be determined by the standard deviation of the errors σ(G) that quantifies the inconsistency level of all decision makers in the group with the priority vector w(G).
2.2. Estimation of the Local Priorities for the Group
The estimation of the vector of group priorities
w(G) uses a Bayesian approach that allows exact inferences about their values. We adopt, as a prior, a normal-gamma distribution given by:
that is the standard conjugate distribution used in Bayesian literature [
7]. The constants c
0, n
0 and
determine the degree of strength of the prior distribution. In the illustrative example we have taken c
0 = 0.1 so that the influence of the prior distribution of
µ(G) is not significant. The hyper-parameters n
0 and
are determined from the maximum levels of inconsistency
allowed for each decision maker so that
being, 1 − α (0 < α < 1) the level of credibility that we want to achieve. The value of
has been set using the consistency thresholds of the geometric consistency index (GCI) proposed by [
8]. In our illustrative example, and given that n = 4, we take
= 0.35 and α = 0.05, which resulted in n
0 = 0.1 and
= 0.0014.
Using Bayes’ theorem, and taking into account (1)–(3), we calculate the posterior distribution of (
µ(G), τ
(G)) whose density is given by:
where
for k = 1, …, K and
X = (x
ij) (J × (n − 1)) with
is the regression matrix of model (1) so that:
- -
xij = 1 if the ith judgement is yjk with k ≠ j;
- -
xij = −1 if the ith judgement is ykj with k ≠ j;
- -
xij = 0 in any other case.
It follows that:
where
.
Therefore, it follows from (5) that:
where
.
Integrating with respect to τ
(G) in (5), it follows that:
From the posterior distributions (7) and (8), point estimates and credibility intervals of w(G) and σ(G) can be obtained using the posterior median and the corresponding quantiles.
In the case of σ2(G), and taking into account that from (7) , a 100 (1 − α)%, the Bayesian credibility interval for σ2(G) is given by where denotes the (1 − α)th quantile of the distribution .
To calculate a credibility interval for (1 ≤ i ≤ n) the Monte Carlo method is applied by extracting a sample from (8) and calculating a sample of the posterior distribution of w(G), with where . From this sample a credibility interval for is given by where is the αth quantile of the sample W(G).
Alpha distributions could also be calculated
with:
and gamma distributions with:
where
γh = (γ
h,1, …, γ
h,n) is the hth permutation of the elements of A sorted according to the lexicographical order. The approximate calculation of these probabilities is from the sample
W(G) by means of the expressions:
These distributions report on preferences as well as the most preferred alternative and ranking for the group.
3. Identification of Homogeneous Groups of Actors
The procedure for estimating the priorities of a group, as detailed in the previous section, is based on the hypothesis of the similarity of the opinions of the decision makers. However, it is quite possible that there will be different opinions. In this case, and in order to facilitate a subsequent negotiation process, it is useful to identify the different opinions within the group and the actors that support them; this section presents a systematic procedure for doing this. It utilises a Bayesian oriented tool selection model based on the use of the Bayes factor as a selection element.
3.1. Problem Formulation
Let D = {D[1], …, D[K]} be a group of K decision makers, = {G1, …, Gm} be a partition of D, with ⊆ D; g = 1, …, m, Gg ∩ Gg′ = ∅ if g ≠ g′, . To avoid identifiability problems we impose that and if g < g′.
The problem is to select the
partitions that best describe the opinions expressed by the decision makers about the alternative to be chosen from the judgments issued
. To this end we extend the approach made in the previous section to the case of several groups, assuming that the decision makers of each group {
Gg; g = 1, …, m} of the partition
have homogeneous opinions regarding the priorities of each alternative of set
A so that:
- (i)
with g(k) ∈ {1, …, m} the group to which the decision maker D[k] belongs
- (ii)
; i = 1, …, n being the priority (without normalising) given to the alternative Ai by the members of the group Gg
- (iii)
(that is to say, ) to avoid identifiability problems
- (iv)
and independent
Finally, we take the following prior distributions for the parameters of the normal-gamma model:
independents for g = 1, …, m.
3.2. Goodness of Fit Evaluation of
The selection of the best partitions is made by an evaluation of their adjustment to the Y issued judgments. We use [Y|], the prior marginal density of the model (13)–(15), which is one of the tools utilised in the Bayesian inference to quantify it, so that, the higher the value, the greater the degree of fit of as a description of the existing opinions in D and the greater is the explanatory power of the Y issued judgments.
This density is given by:
Taking into account that:
from (6), (13), (14) and (15) it follows that
where
. It follows that
where
.
Substituting in (16) it follows that:
3.3. Location of Opinion Groups
Now that the evaluation of the adjustment of a partition to the issued judgements is completed, in this section we describe the process followed to determine the most representative partitions. We use Bayesian selection models and the Bayes factor, as a tool of comparison of two elements and ′ of ℘(D), the set of possible partitions of D.
We set a threshold β (0 < β < 1) to discriminate if there are significant differences in the data adjustment of the partitions
and
′ so that if
then the degree of fit of
′ is significantly worse than that of
and, therefore,
is more representative than
′. In this case, and in line with [
9], we take β = 0.05.
The problem is to determine
∈ ℘(
D) so that:
where
and gives us the ‘Occam’s window’ of our problem [
10]. The partitions could be taken as starting points for subsequent negotiation processes in order to reach an agreement among the decision makers that is as representative as possible. In our case, we look for the partitions of the window that have the least number of groups, since it can be foreseen that the fewer groups there will be, the easier it will be to reach more representative agreements because there are fewer disparate opinions. In order to do this, we use an exhaustive search algorithm that calculates the values of [
Y|
] for all the elements of ℘(
D) using expression (19). Then
max is determined and, from this, the partitions of Occam’s window that verify (20) are identified. Other methods for consensus searching in group decision making can be seen in references [
11,
12,
13,
14,
15,
16].
Figure 1 shows the main steps for determining the groups with homogeneous opinions.
4. Case Study
In September 2006 the Government of Aragón and the Zaragoza City Council advanced the ‘Zaragoza Plan for Sustainable Mobility’, which led to the construction of the city’s Tram Line 1 that was completed in 2013. The construction was controversial and in the following municipal elections, the political parties presented their proposals for improving transport in the city. Representatives of the main political parties (PSOE, PP and CHA) attended the university to explain their preferred alternative. The case study concerns a citizen participation project in a local community which contemplated alternatives put forward by the political parties during the municipal elections for the extension of the city tram network.
Eleven students (K = 11) from the ‘Electronic-Government and Public Decisions’ course of the Faculty of Economics and Business at the University of Zaragoza (Spain) were involved in its implementation.
There were 4 alternatives:
- A1
Build a new tram line
- A2
Use a tram and bus combination called Tranbus
- A3
Use a tram combination with commuter lines
- A4
Do nothing
As the construction of Line 1 had a high economic cost, and the selection of any of first three alternatives assumes a significant investment, a fourth alternative (no cost) was included. The selection problem was solved using the Analytic Hierarchy Process [
2]. The hierarchical model comprised four levels (the goal, 3 criteria, 9 attributes and 4 alternatives).
The results of the Investment Cost attribute have been used to illustrate the proposed methodology. The prior distribution parameters were c0 = 0.1, n0 = 1 and = 0.0014 (corresponding to take = 0.35 and α = 0.05) and β = 0.05. The number of partitions was equal to the 678,570 that were processed in 98.84 s of CPU by a Toshiba Ultrabook KIRA with Intel (R) Core™ i7-4510U CPU @ 2.00GHz 2.60 GHz (64 bits) and 8 Gb of RAM.
The resulting number of groups was equal to five and the most probable composition was:
G1 = {D
1, D
2, D
3, D
7},
G2 = {D
4, D
10},
G3 = {D
5, D
6},
G4 = {D
9},
G5 = {D
11}. The results obtained are shown in
Table 1,
Table 2 and
Table 3. More specifically,
Table 1 contains the posterior medians of the priorities of each alternative for each decision maker and each group.
Table 2 shows the posterior probabilities that each alternative would be the most preferred, corresponding to the Pα distributions.
Table 3 gives the probabilities for each ranking corresponding to the Pγ distributions. The values were calculated from (7)–(8) and (11)–(12), as described in
Section 2.2, using S = 10,000 simulations.
So, for example, group G1 made up of decision makers D
1, D
2, D
3 and D
7, gives the highest priority (0.4502) to alternative A
4, followed by the alternatives A
2 (priority 0.3076), A
3 (0.1518) and A
1 (0.0879) (see
Table 1). This ranking is also reflected by its Pα and Pγ distributions, which give the maximum posterior probabilities to the A
4 alternative (97.31%, see
Table 2) and the ranking 4231 (96.94%, see
Table 3). Even though the individual opinion of D
3 is different to the rest of the members of the group (their preferred alternative is A
2 and the ranking is 2431), the consistency of the group G
1 (0.2790) is good, being lower than the maximum level of inconsistency 0.35. This is due to the high priority of D
3 for alternative A
4 (0.2705) and the similarity of their priorities to alternatives A
1 and A
3 which means that G1 can be considered as a homogeneous group.
From the tables, it can be observed that the compositions of the groups are very much determined by their similarity to the most preferred alternative. The decision makers from groups
G1 and
G3 mostly prefer the alternative A
4, those from group
G2 prefer alternative A
1, those from
G3 prefer alternative A
3 and those from
G4 prefer alternative A
2 (see
Table 1 and
Table 2). However, groups
G1 and
G3 differ in the rankings (see
Table 3). The decision makers from the group
G1 tend to prefer the 4231 ranking, while those from the group
G3 prefer 4123. Nevertheless, preferences within each group are not completely homogeneous; in group
G1, decision-maker D
3 shows a greater preference for alternative A
2. This opinion is shared with decision maker D
11 of group
G4, although it assigns a priority 0.2705 to alternative A
4 that justifies its inclusion in group
G1. Something similar happens in group
G3, in which decision maker D
5 shows a greater preference for alternative A
1, although it assigns a non-negligible priority (0.3613) to alternative A
4 and to the ranking 4123, hence its inclusion in group
G3.
The consistency levels of the actors and most of the groups are acceptable (<0.35). The only exception is G3 whose consistency is estimated as 0.4071, but with a 95% credibility interval [0.20, 1.43] that does not reject the consistency hypothesis .
The ambiguities of the opinions are revealed if we analyse the partitions selected by Occam’s window with the smaller number of groups, included in
Table 4 and
Figure 2.
Figure 2 incorporates, in each node, the groups of decision makers that are classified together in all the selected partitions and includes a link between two nodes if their components are classified together in some of the partitions. Most of the decision makers are linked because of their preferences for alternatives A
2 and A
4, the latter being the alternative which most decision makers support. Only D
4, D
9 and D
10 are isolated because of their preferences for alternatives A
1 (D
4 and D
10) and A
3 (D
9).
There are 4 homogeneous groups: {D1, D2, D7} that prefer alternative A4 and the ranking 4231; {D5, D6} position alternatives A2 and A3 in the last places and they show a non-negligible preference for A4; {D4, D10} prefer alternative A1 and put A3 in last place; decision maker {D9} prefers A3. Decision makers D3, D8, D11 are in more intermediate and ambiguous positions. In the case of D3, this is due to the greater preference for A2 (shared with D11) and the non-negligible preference for A4 (which places them close to the group {D1, D2, D7}). In the case of D8, the intermediate position is due to their preferences for A4 and A2, in that order, which places them close to the group {D1, D2, D7}, as well as to the rejection of A3, which places them close to the group {D5, D6}.
In order to achieve as broad an agreement as possible, alternative A4 could be suggested, given that a majority of decision makers (in groups G1 and G3) showed a preference for it. The negotiation should be aimed at convincing decision makers D4, D9, D10 and D11.
With regards to the practical implications of the Bayesian procedure proposed in this work, it is worth mentioning that, as in AHP, these applications are numerous, especially in matters of strategic planning where the number of actors is not usually very high.
5. Conclusions
This paper has proposed a methodology for the identification of homogenous opinion groups with AHP in a local context. The methodology is based on the use of Bayesian processes for the selection of hierarchical models that describe the judgments issued by each decision maker in their matrices of pairwise comparisons based on a set of priorities common to each of the members of the group.
Using an exhaustive search method of the most compatible partitions with the judgments issued, the Occam’s window of the compared models is defined. From these models it has been shown how it is possible to describe the existing opinions in the groups, information that can be very useful to identify consensus paths among the decision makers that can culminate in a more representative decision-making process.
The search method works in a local AHP context, but has some limitations. First, it functions if the number of decision makers is not very high (≤11). The total number of partitions of the set of decision makers is equal to the Bell number with B0 = 1, B1 = 1. The larger the number of decision makers, the more computationally infeasible is the problem. In our case (K = 11), the number of possible partitions is 687,570, which is computationally feasible. For instance, if K = 22 the number is 4507 × 1015, then it is necessary to use algorithms that approximately determine Occam’s window.
We are currently experimenting with stochastic search algorithms and the results obtained will be published in a future work. A second limitation is that it is necessary that the groups constitute a partition of the set of decision makers and this implies that a decision maker cannot belong to more than one group. Even though this requirement decreases the computational time of the algorithm, it also reduces the flexibility of the method. The development of search strategies that eliminate this unrealistic assumption is worthy of consideration. Finally, it would be interesting to extend the methodology to a global context in which a hierarchy of criteria and sub-criteria is used.