Fuzzy Analytic Hierarchy Process-Based Multi-Criteria Decision Making for Universities Ranking

Abstract

High competition between universities has been increasing over the years, and stimulates higher education institutions to attain higher positions in the ranking list. Ranking is an important performance indicator of university status evaluation, and therefore plays an essential role in students’ university selection. The ranking of universities has been carried out using different techniques. Main goal of decision processes in real-life problems is to deal with the symmetry or asymmetry of different types of information. We consider that multi-criteria decision making (MCDM) is well applicable to symmetric information modelling. Analytic hierarchy process (AHP) is a well-known technique of MCDM discipline, and is based on pairwise comparisons of criteria/alternatives for alternatives’ evaluation. Unfortunately, the classical AHP method is unable to deal with imprecise, vague, and subjective information used for the decision making process in complex problems. So, introducing a more advanced tool for decision making under such circumstances is inevitable. In this paper, fuzzy analytic hierarchy process (FAHP) is applied for the comparison and ranking of performances of five UK universities, according to four criteria. The criteria used for the evaluation of universities’ performances are teaching, research, citations, and international outlook. It is proven that applying FAHP approach makes the system consistent, and by the calculation of coefficient of variation for all alternatives, it becomes possible to rank them in prioritized order.

1. Introduction

In the real world, one of the characteristics of being human is having the ability to make appropriate decisions in various situations. These decisions offer benefits and conveniences in every aspect of life. The important elements of decision making process are alternatives and criteria. Decision making is a process of choosing the best alternative among several ones, by considering specific criteria, and this alternative should be suitable for the preferences or beliefs of the decision maker.

Uncertainty is a common phenomenon in the real world. Human decisions which include preferences are mostly vague or uncertain. In other words, the selection of alternatives is performed under the environment filled by complex and imprecise information. As the system complexity increases, uncertainty of problems and in human’s thoughts increases consequently. Therefore, there is a need for a system that provides a reliable and precise solution, while dealing with incomplete and uncertain information.

The classical decision making approaches are applied in the presence of certain and complete information. Unfortunately, such approaches are not always capable of providing an exact solution of complex problems, and are insufficient to work under many circumstances of real-life situations. For this reason, in order to provide an optimal solution of the problem, fuzzy decision making concept becomes extremely important in the presence of vague information, and this information can be assessed by applying fuzzy set theory, which was firstly proposed by Zadeh in 1965 [1].

Multi-criteria decision making (MCDM) has been a very fast-growing field in recent years. MCDM includes a finite set of alternatives, so that a decision maker can rank them, and there is a finite set of criteria which are weighted by decision maker, with respect to the importance of criteria. So, MCDM is an advanced discipline which can be applied to complex decision making problems, by providing an effective solution for ranking of alternatives. The desired result can be achieved, adhering to the appropriate criteria of the related decision making problem.

Decision making process is important in real-life problems to retrieve the symmetric or asymmetric information. MCDM is an explicitly applied tool to model the information symmetry.

Analytic hierarchy process (AHP) is a frequently used MCDM technique, which was firstly introduced by Thomas Saaty in 1980 [2]. AHP uses criteria and sub-criteria initial weights as well as hierarchical dependencies between criteria [3]. AHP is a powerful structured technique used to organize and analyze complex decisions when the alternatives in a problem are hardly quantified and compared. AHP provides appropriate results if the uncertainty in comparative judgment is not taken into consideration. On the other hand, preferences or judgments of decision makers always include ambiguous expressions and inconsistencies. Moreover, AHP method can cause some problems while dealing with rank reversal problem that means the alternatives’ preferences can be reversed in case of adding or deleting any alternative(s), priorities derivations method, the comparison scale [4,5,6,7,8,9,10,11] as well as decision maker’s preference aggregation from pairwise comparison matrices in the environment of inaccurate evaluations for determining an appropriate solution for decision making problem [12].

Therefore, AHP is not considered as a convenient method for decision making under uncertainty. Hence, it is necessary to reach better outcomes by using the extension of AHP which is fuzzy analytic hierarchy process (FAHP). Despite the fact that application of fuzzy approach in decision making process using AHP can sometimes lead to disorientation of the eigenvector of the matrix of pairwise comparisons while perturbing the entries of the matrix [13], fuzzy sets can be included in the pairwise comparison to cope with the uncertainty and vagueness in problems. The FAHP model allows decision makers to better specify their preferences in fuzzy environments.

In this paper, FAHP technique is applied on five United Kingdom (UK) universities to be ranked according to the following criteria specified in the well-recognized Times Higher Education data provider: teaching, research, citations, and international outlook.

There exist many publications devoted to the application of FAHP, and some of them are highlighted below.

In [14], fuzzy AHP method is applied on three Dutch universities to demonstrate the performance of the model, and the universities are ranked according to the importance of such criteria as networking and knowledge exchanging ability, general attractiveness, research ability and commercialization ability, and this method can provide obtaining the best university in an uncertain situation.

In [15], fuzzy AHP is used for evaluation of management quality at private higher education. As a case study, STMIC Pringsewu college located in Lampung’s Province is used, that needs an improvement in graduates’ quality. Six main criteria and 30 sub-criteria are used to make an evaluation of management quality. For this reason, the weights for each criterion are calculated, and ranking of criteria is performed according to the optimal weight.

The knowledge management, leadership effectiveness and organizational culture are the factors used to evaluate the university organizational performance in Taiwan [16]. The results show that the weights of these factors are 55.6%, 28.1% and 16.3%, respectively. So, the knowledge management is defined as being the most significant factor.

An intellectual capital (IC) evaluation model is developed to measure its contribution for the university performances in Taiwan [17]. IC measurement indicators are formulated by using AHP method to develop the IC evaluation model. The integration of AHP method and fuzzy approach allows one to eliminate the vagueness on decision makers’ judgments, and to develop a hierarchy structure to prioritize the IC measurement indicators for better understanding.

In [18], the selection of university academic staff involving uncertainty is made up by applying fuzzy AHP method. It is mentioned that the AHP model is unable to cope with imprecise judgment in pairwise comparisons, and this disadvantage can be overcome by using fuzzy AHP. Three alternatives based on three criteria are considered in numerical example, where the first criterion is work experience, the second criterion is academic background, and the third criterion is individual skill. The results show that the candidate with the highest normalized weight is determined as the best alternative for employment.

Examining fuzzy AHP for the optimal academic staff selection to be suitable for the required post is studied in [19]. Five candidates are evaluated and ranked according to ten distinct sub-criteria. Since AHP is insufficient to overcome the impreciseness and subjectivity in pairwise comparisons, the fuzzy AHP method becomes an important tool in terms of using fuzzy numbers and linguistic variables to achieve accuracy and consistency. In addition, triangular fuzzy numbers are used to set the fuzzy rating and fuzzy weights.

The combination of fuzzy AHP and fuzzy comprehensive evaluation approach to conduct a teaching performance evaluation is proposed in [20]. The weights of factors and sub-factors are estimated by analysis of fuzzy AHP method, which significantly reduces uncertainty in group decision making. The proposed framework is a useful tool to improve the education quality level in higher education institutions.

In [21], the proposed method evaluates the students’ performance in e-learning systems. Six main criteria and 24 sub-criteria are contained in a framework intended for selection of a best student involved, and the criteria weights are calculated by using fuzzy AHP method.

In [22], an e-learning system performance is evaluated on the base of FAHP and critical success factors (CSFs). The evaluation is realized according to seven main CSFs. This performance evaluation helps in the development of strategic planning of e-learning plan.

Fuzzy AHP method is used to assess the ranks of priorities of multiple factors affecting e-learning success in higher education [23]. The study defines the five most influential factors from lecturers’ points of view and five most influential factors from students’ point of view, to successfully implement the e-learning at Sebelas Maret University.

2. Preliminaries

Fuzzy Set. Let $X$ be the universe set of the set of objects and $x$ be the elements of the universe set $X$. Let y be the subset of $X$ which is used for the membership, and the characteristic function ${\mu }_y$ from $X$ to {0, 1} can be described as follows:

$${\mu }_y \left(x\right)=\{\begin{array}{c}1 if and only if x\in y, \\ 0 if and only if x\notin y\end{array}$$

(1)

{0, 1} is the value set where 1 shows the membership and 0 shows non-membership. If the value set is in the interval [0, 1], then $A$ is a fuzzy set. Moreover, ${\mu }_y \left(x\right)$ is the degree of membership of elements $x$ in the fuzzy set y, ${\mu }_y :X \to \left[0,1\right]$. As much as the value of membership ${\mu }_y \left(x\right)$ for the element $x$ is closer to 1, then so much element $x$ belongs to the fuzzy set y. This fuzzy set y is described as

$$y=\left\{\left(x, {\mu }_y\left(x\right)\right), x ϵ X\right\}$$

(2)

where x is an element in the universe set, ${\mu }_y \left(x\right)$ is the degree of membership of x and X is the universe set [24,25,26].

Fuzzy Number. Triangular Fuzzy Number. Let y be a fuzzy subset of the universe set. Fuzzy number y is a fuzzy subset of real numbers that has important characteristics:

• The membership function ${\mu }_y \left(x\right)$ is continuous from R to [0, 1].
• The membership function ${\mu }_y \left(x\right)$ is normal, that is, there exists the number $x_0$ so that ${\mu }_y \left(x_0\right)=1$.
• If all of the level sets are convex in classical sense for a fuzzy set y, that means that this fuzzy set y is convex.

A triangular fuzzy number $y$ can be represented as ($y_l,{ y}_m,{ y}_r$). Then, the membership function of the triangular fuzzy number ${\mu }_y \left(x\right)$ can be expressed in the following form [24,25]:

$${\mu }_y \left(x\right)=\{\begin{array}{cc}\frac{x-y_l}{y_m-y_l} ,\hfill & \hfill If y_l \le x \le y_m \\ \frac{y_u-x }{y_u-y_m},\hfill & \hfill If y_m \le x \le y_u\\ 0,\hfill & \hfill otherwise\end{array}$$

(3)

Fuzzy Decision Making. Fuzzy decision making is used to choose the best alternative among several ones in the presence of uncertainty. A set of alternatives $A_1,A_2,\dots ,A_n$depends on some criteria $H_1,H_2,\dots , H_m$. So, the best alternative is one that fulfills all criteria [24,25].

Fuzzy Preferences. Fuzzy preferences are actually based on fuzzy logic and fuzzy sets. In MCDM, fuzzy or uncertain preferences can be written as fuzzy utilities or weighted sums. These fuzzy utilities and fuzzy weighted sums are fuzzy numbers. A fuzzy preference is a significant type for fuzzy binary relation, and is used to generate the degree of preference between two alternatives when there are certainty and uncertainty preferences.

Let $A$ represent a set of alternatives $A_1,A_2,\dots ,A_n$ and $n >1$. A fuzzy preference for the set of alternatives $A$ is a fuzzy relation on $A$ denoted by $R={\left(r_{ij}\right)}_{\mathrm{nxn}}$which has a membership function denoted by ${\mu }_R : A x A \left[0,1\right]$. Here, ${\mu }_R \left(A_i,{ A}_j\right)={ r}_{ij}$ represents the degree of preference for alternative $A_i$ over $A_j$.

3. Statement of the Problem

The decision making problem should be stipulated by wide range of alternatives and criteria. In this research, five alternatives and four main criteria are addressed for the university ranking problem. These criteria are teaching, research, citations and international outlook [27].

There are five factors affecting the teaching criterion, which are reputation survey, staff to student ratio, doctorate to bachelor’s ratio, doctorates awarded to academic staff ratio and institutional income. Reputation survey, research income and research productivity are the factors affecting the research criterion. Field weighted citation impact is the factor affecting the citations criterion. There are three factors affecting the international outlook criterion which are the proportion of international students, proportion of international staff and international collaboration [27].

Fuzzy AHP has the capability and the power to represent the uncertain situations. This method investigates the pairwise comparisons of alternatives and criteria in terms of importance and dominance of these alternatives and criteria. Fuzzy AHP is frequently used in the solution of complex decision making problems, as it takes into account both qualitative and quantitative factors [28]. Fuzzy comparison matrices are used to tolerate uncertainty. When comparing alternatives, it is required to use uncertainty by the decision maker. For this reason, in such situations, the use of fuzzy numbers is preferred instead of using crisp numbers. In addition, consistency checking is an important factor in the fuzzy AHP method. Consistency checking proves that the constructed fuzzy pairwise matrices are acceptable and consistent [29,30].

The purpose of this paper is a selection of the optimal alternative, among given five alternatives A, B, C, D and E, and this optimal alternative should fit simultaneously all given four criteria.

4. Methodology

In addition to many decision-making problems in the field of education, ranking among universities is also considered as a decision-making problem. Main goal in this MCDM problem is to rank the universities from the best to the worst by using multiple criteria. In this section, the university ranking problem will be modelled by using the fuzzy AHP method according to eight steps. The steps of fuzzy AHP method are described below:

• Step 1. Construct the fuzzy matrix $\tilde{C}$ and then decompose it into three matrices called $C_l$, $C_m$, $C_u$ [31].
• Fuzzy matrix is a matrix with entries as triangular fuzzy numbers. Such a matrix shows the pairwise comparisons of the criteria (mxm matrix) or pairwise comparison of the alternatives with respect to each other (nxn matrix).
• After constructing the fuzzy triangular matrix, it is divided into three matrices as $C_l$,$C_m$,$C_u$ which mean matrices of lower, medium and upper values of triangular fuzzy numbers-based entries, respectively.
• Step 2. The three matrices obtained in step 1 will be used in the next step to calculate the system of fuzzy linear homogeneous equations [31].

$${\overline{C}}_l{w}_l+{\overline{C}}_m{w}_m+{\overline{C}}_u{w}_u-{\overline{\lambda }}_l{w}_l-{\overline{\lambda }}_m{w}_m-{\overline{\lambda }}_u{w}_u=0$$

(4)

$${\overline{C}}_l=2C_l+C_m, {\overline{C}}_m=C_l+4C_m+C_u, {\overline{C}}_u=C_m+2C_u$$

(5)

• Step 3. Calculate the eigenvalues ${\overline{\lambda }}_l$, ${\overline{\lambda }}_m$, ${\overline{\lambda }}_u$ of matrices ${\overline{C}}_l$, ${\overline{C}}_m$, ${\overline{C}}_u$ that were determined in step 2. After that, calculate ${\lambda }_l$, ${\lambda }_m$, ${\lambda }_u$ by using the following equations [31]:

$${\overline{\lambda }}_l=2{\lambda }_l+{\lambda }_m, {\overline{\lambda }}_m={\lambda }_l+4{\lambda }_m+{\lambda }_u, {\overline{\lambda }}_u={\lambda }_m+2{\lambda }_u$$

(6)

• Step 4. Calculate the eigenvectors $w_l$, $w_m$, $w_u$ of matrices ${\overline{C}}_l$, ${\overline{C}}_m$, ${\overline{C}}_u$. Next, calculate ${\overline{w}}_l$, ${\overline{w}}_m$, ${\overline{w}}_u$ by using the following formulas [31]:

$${\overline{w}}_l=\frac{w_l {\lambda }_l}{s_l {\lambda }_m}, {\overline{w}}_m=\frac{w_m }{s_m}, {\overline{w}}_u=\frac{w_u {\lambda }_u}{s_u {\lambda }_m}$$

(7)

$$s_l={\displaystyle \sum }_{i=1}^n{w}_{i,l}, s_m={\displaystyle \sum }_{i=1}^n{w}_{i,m} , s_u={\displaystyle \sum }_{i=1}^n{w}_{i,u}$$

(8)

• Step 5. Calculate the consistency index ($CI$) and consistency ratio ($CR$) of the matrix $C_m$ by using the following formulas. $CR$ should be ≤ 0.1 to claim that the comparison matrix is consistent and $RI$ is the random index [31]. $RI$ is used for random consistency which depends on the size of the matrix. The values of random index are recommended by Saaty in [2]. For example, if $n=4$ then $RI=0.90$, if $n=5$ then $RI=1.12$ [31].

$$CI=\frac{{\lambda }_{\max }-n}{n-1}, CR=\frac{CI}{RI}$$

(9)

• Step 6. Set the priority fuzzy matrices ${\overline{P}}_l, {\overline{P}}_m, {\overline{P}}_u$ that contain normalized eigenvectors ${\overline{w}}_l, {\overline{w}}_m, {\overline{w}}_u$ of the alternatives with respect to each criterion (use ${{\overline{w}}_l}^T, {{\overline{w}}_m}^T,{{\overline{w}}_u}^T$) [32].
• Step 7. Vectors of global priorities $g_l, g_m, g_u$ are calculated according to the following formulas (where ${\overline{w}}_l, {\overline{w}}_m, {\overline{w}}_u$ are the eigenvectors of criteria) [32]:

$${{\overline{w}}_l}^T={\left[{\overline{w}}_{1,l} {\overline{w}}_{2,l} \dots {\overline{w}}_{n,l}\right]}^T$$

(10)

$${{\overline{w}}_m}^T={\left[{\overline{w}}_{1,m} {\overline{w}}_{2,m} \dots {\overline{w}}_{n,m}\right]}^T$$

(11)

$${{\overline{w}}_u}^T={\left[{\overline{w}}_{1,u} {\overline{w}}_{2,u} \dots {\overline{w}}_{n,u}\right]}^T$$

(12)

$$g_l={\overline{P}}_l{\overline{w}}_l={\left[g_{1,l}{ g}_{2,l}\dots g_{m,l}\right]}^T$$

(13)

$$g_m={\overline{P}}_m{\overline{w}}_m={\left[g_{1,m}{ g}_{2,m}\dots g_{m,m}\right]}^T$$

(14)

$$g_u={\overline{P}}_u{\overline{w}}_u={\left[g_{1,u}{ g}_{2,u}\dots g_{m,u}\right]}^T$$

(15)

• Step 8. Calculate the expected value (fuzzy mean) and standard deviation (fuzzy spread) by using the following formulas [32]:

$$g_{i,e}=\frac{g_{i,l}+2g_{i,m}+g_u}{4}$$

(16)

$${\sigma }_i={\left(\frac{1}{80}\left(3{g_{i,l}}^2+4{g_{i,m}}^2+3{g_{i,u}}^2-4g_{i,l}{g}_{i,m}-2g_{i,l}{g}_{i,u}-4g_{i,m}{g}_{i,u}\right)\right)}^{1/2}$$

(17)

5. Numerical Example

An implementation of fuzzy AHP is discussed in this section. The expert’s decision about the collected information is mainly up to the amount and characteristics of information affecting its certainty degree. So, error rate of left and right deviations of comparison matrices can be 5%, 8%, 10% and so on. Left and right deviations of crisp comparison matrices in [33] are represented with 5% error rate, as triangular fuzzy number in this example. The eigenvalues, eigenvectors, and consistency are calculated for fuzzy AHP.

5.1. Fuzzy Pairwise Matrix of Criteria

Table 1. Fuzzy pairwise matrix of criteria.

Criterion	Teaching	Research	Citations	International Outlook
Teaching	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(3.8,4,4.2)
Research	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(3.8,4,4.2)
Citations	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(3.8,4,4.2)
International Outlook	(0.2375,0.25,0.2625)	(0.2375,0.25,0.2625)	(0.2375,0.25,0.2625)	(0.95,1,1.05)

shows the fuzzy pairwise matrix of criteria.

Fuzzy pairwise matrix of criteria is decomposed into three matrices $C_l,C_m,C_u$ as shown in

Table 2. Decomposing of fuzzy pairwise matrix of criteria into three matrices $C_l,C_m,C_u$.

$\mathbf{Matrix} {\mathit{C}}_{\mathit{l}}$				$\mathbf{Matrix} {\mathit{C}}_{\mathit{m}}$				$\mathbf{Matrix} {\mathit{C}}_{\mathit{u}}$
0.95	0.95	0.95	3.8	1	1	1	4	1.05	1.05	1.05	4.2
0.95	0.95	0.95	3.8	1	1	1	4	1.05	1.05	1.05	4.2
0.95	0.95	0.95	3.8	1	1	1	4	1.05	1.05	1.05	4.2
0.2375	0.2375	0.2375	0.95	0.25	0.25	0.25	1	0.2625	0.2625	0.2625	1.05

.

Then matrices ${\overline{C}}_l, {\overline{C}}_m, {\overline{C}}_u$ of criteria become as in

Table 3. Matrices ${\overline{C}}_l,{\overline{C}}_m,{\overline{C}}_u$ of criteria.

$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{l}}$				$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{m}}$				$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{u}}$
2.9	2.9	2.9	11.6	6	6	6	24	3.1	3.1	3.1	12.4
2.9	2.9	2.9	11.6	6	6	6	24	3.1	3.1	3.1	12.4
2.9	2.9	2.9	11.6	6	6	6	24	3.1	3.1	3.1	12.4
0.725	0.725	0.725	2.9	1.5	1.5	1.5	6	0.775	0.775	0.775	3.1

.

In the next step, the eigenvalues of matrices ${\overline{C}}_l$, ${\overline{C}}_m$ and ${\overline{C}}_u$ of criteria are calculated. The eigenvalues of these matrices are ${\overline{\lambda }}_l$ = 11.6, ${\overline{\lambda }}_m$ = 24, ${\overline{\lambda }}_u$ = 12.4 respectively, and it is obtained that ${\lambda }_l$ = 3.8, ${\lambda }_m$ = 4,${ \lambda }_u$ = 4.2.

The eigenvectors of matrices ${\overline{C}}_l$, ${\overline{C}}_m$, ${\overline{C}}_u$ of criteria are

• $w_l$= [0.5714 0.5714 0.5714 0.1429]
• $w_m$= [0.5714 0.5714 0.5714 0.1429]
• $w_u$= [0.5714 0.5714 0.5714 0.1429]

Then eigenvectors ${\overline{w}}_l,{\overline{w}}_m,{\overline{w}}_u$ of criteria become as

• ${\overline{w}}_l$ = [0.2923 0.2923 0.2923 0.0731]
• ${\overline{w}}_m$ = [0.3077 0.3077 0.3077 0.0769]
• ${\overline{w}}_u$ = [0.3230 0.3230 0.3230 0.0807]

The consistency index and consistency ratio for criteria are calculated as

$$CI=\left(4-4\right)/\left(4-1\right)=0$$

$$CR=0/0.9=0 \le 0.10$$

So, the comparison matrix is completely consistent for criteria.

5.2. Fuzzy Pairwise Matrix of Teaching Criterion

Fuzzy pairwise matrix of teaching criterion is represented in

Table 4. Fuzzy pairwise matrix of teaching criterion.

Teaching	A	B	C	D	E
A	(0.95,1,1.05)	(0.95,1,1.05)	(1.9,2,2.1)	(2.85,3,3.15)	(0.95,1,1.05)
B	(0.95,1,1.05)	(0.95,1,1.05)	(1.9,2,2.1)	(1.9,2,2.1)	(0.95,1,1.05)
C	(0.475,0.5,0.525)	(0.475,0.5,0.525)	(0.95,1,1.05)	(0.95,1,1.05)	(0.475,0.5,0.525)
D	(0.31635,0.333,0.34965)	(0.475,0.5,0.525)	(0.95,1,1.05)	(0.95,1,1.05)	(0.475,0.5,0.525)
E	(0.95,1,1.05)	(0.95,1,1.05)	(1.9,2,2.1)	(1.9,2,2.1)	(0.95,1,1.05)

.

Fuzzy pairwise matrix of teaching criterion is decomposed into three matrices $C_l,C_m,C_u$ as shown in

Table 5. Decomposing of fuzzy pairwise matrix of teaching criterion into three matrices $C_l,C_m,C_u$.

$\mathbf{Matrix} {\mathit{C}}_{\mathit{l}}$					$\mathbf{Matrix} {\mathit{C}}_{\mathit{m}}$					$\mathbf{Matrix} {\mathit{C}}_{\mathit{u}}$
0.95	0.95	1.9	2.85	0.95	1	1	2	3	1	1.05	1.05	2.1	3.15	1.05
0.95	0.95	1.9	1.9	0.95	1	1	2	2	1	1.05	1.05	2.1	2.1	1.05
0.475	0.475	0.95	0.95	0.475	0.5	0.5	1	1	0.5	0.525	0.525	1.05	1.05	0.525
0.31635	0.475	0.95	0.95	0.475	0.333	0.5	1	1	0.5	0.34965	0.525	1.05	1.05	0.525
0.95	0.95	1.9	1.9	0.95	1	1	2	2	1	1.05	1.05	2.1	2.1	1.05

.

Then, matrices ${\overline{C}}_l, {\overline{C}}_m, {\overline{C}}_u$ of teaching criterion become as in

Table 6. Matrices ${\overline{C}}_l, {\overline{C}}_m, {\overline{C}}_u$ of teaching criterion.

$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{l}}$					$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{m}}$					$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{u}}$
2.9	2.9	5.8	8.7	2.9	6	6	12	18	6	3.1	3.1	6.2	9.3	3.1
2.9	2.9	5.8	5.8	2.9	6	6	12	12	6	3.1	3.1	6.2	6.2	3.1
1.45	1.45	2.9	2.9	1.45	3	3	6	6	3	1.55	1.55	3.1	3.1	1.55
0.9657	1.45	2.9	2.9	1.45	1.998	3	6	6	3	1.0323	1.55	3.1	3.1	1.55
2.9	2.9	5.8	5.8	2.9	6	6	12	12	6	3.1	3.1	6.2	6.2	3.1

.

The eigenvalues of these matrices are ${\overline{\lambda }}_l$ = 14.5571, ${\overline{\lambda }}_m$ = 30.1181, ${\overline{\lambda }}_u$ = 15.5610.

From ${\overline{\lambda }}_l$, ${\overline{\lambda }}_m$, ${\overline{\lambda }}_u$, it is obtained that ${\lambda }_l$= 4.768708, ${\lambda }_m$= 5.019683, ${\lambda }_u$ = 5.270658.

The eigenvectors of matrices ${\overline{C}}_l$, ${\overline{C}}_m$, ${\overline{C}}_u$ of teaching criterion are

• $w_l$ = [0.5711 0.5228 0.2614 0.2424 0.5228]
• $w_m$ = [0.5711 0.5228 0.2614 0.2424 0.5228]
• $w_{u }$= [0.5711 0.5228 0.2614 0.2424 0.5228]

Then eigenvectors ${\overline{w}}_l$, ${\overline{w}}_m$, ${\overline{w}}_u$ of teaching criterion become as

• ${\overline{w}}_l$ = [0.2558 0.2342 0.1171 0.1085 0.2342]
• ${\overline{w}}_m$ = [0.2693 0.2465 0.1232 0.1143 0.2465]
• ${\overline{w}}_u$ = [0.2827 0.2588 0.1294 0.1200 0.2588]

The consistency index and consistency ratio for teaching criterion are calculated as

$$CI=\left(5.019683-5\right)/\left(5-1\right)=0.004920$$

$$CR=0.004920/1.12=0.0043 \le 0.10$$

So, the comparison matrix is consistent for teaching criterion.

5.3. Fuzzy Pairwise Matrix of Research Criterion

Fuzzy pairwise matrix of research criterion is represented in

Table 7. Fuzzy pairwise matrix of research criterion.

Research	A	B	C	D	E
A	(0.95,1,1.05)	(0.95,1,1.05)	(1.9,2,2.1)	(2.85,3,3.15)	(1.9,2,2.1)
B	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(1.9,2,2.1)	(0.95,1,1.05)
C	(0.475,0.5,0.525)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)
D	(0.31635,0.333,0.34965)	(0.475,0.5,0.525)	(0.95,1,1.05)	(0.95,1,1.05)	(0.475,0.5,0.525)
E	(0.475,0.5,0.525)	(0.95,1,1.05)	(0.95,1,1.05)	(1.9,2,2.1)	(0.95,1,1.05)

.

Fuzzy pairwise matrix of research criterion is decomposed into three matrices $C_l,C_m,C_u$ as shown in

Table 8. Decomposing of fuzzy pairwise matrix of research criterion into three matrices $C_l,C_m,C_u$.

$\mathbf{Matrix} {\mathit{C}}_{\mathit{l}}$					$\mathbf{Matrix} {\mathit{C}}_{\mathit{m}}$					$\mathbf{Matrix} {\mathit{C}}_{\mathit{u}}$
0.95	0.95	1.9	2.85	1.9	1	1	2	3	2	1.05	1.05	2.1	3.15	2.1
0.95	0.95	0.95	1.9	0.95	1	1	1	2	1	1.05	1.05	1.05	2.1	1.05
0.475	0.95	0.95	0.95	0.95	0.5	1	1	1	1	0.525	1.05	1.05	1.05	1.05
0.31635	0.475	0.95	0.95	0.475	0.333	0.5	1	1	0.5	0.34965	0.525	1.05	1.05	0.525
0.475	0.95	0.95	1.9	0.95	0.5	1	1	2	1	0.525	1.05	1.05	2.1	1.05

.

Then, matrices ${\overline{C}}_l$, ${\overline{C}}_m$, ${\overline{C}}_u$ of research criterion become as in

Table 9. Matrices ${\overline{C}}_l,{\overline{C}}_m,{\overline{C}}_u$ of research criterion.

$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{l}}$					$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{m}}$					$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{u}}$
2.9	2.9	5.8	8.7	5.8	6	6	12	18	12	3.1	3.1	6.2	9.3	6.2
2.9	2.9	2.9	5.8	2.9	6	6	6	12	6	3.1	3.1	3.1	6.2	3.1
1.45	2.9	2.9	2.9	2.9	3	6	6	6	6	1.55	3.1	3.1	3.1	3.1
0.9657	1.45	2.9	2.9	1.45	1.998	3	6	6	3	1.0323	1.55	3.1	3.1	1.55
1.45	2.9	2.9	5.8	2.9	3	6	6	12	6	1.55	3.1	3.1	6.2	3.1

.

The eigenvalues of these matrices are ${\overline{\lambda }}_l$ = 14.7725, ${\overline{\lambda }}_m$ = 30.5637, ${\overline{\lambda }}_u$ = 15.7912 and

${\lambda }_l$= 4.839275, ${\lambda }_m$= 5.09395, ${\lambda }_u$= 5.348625.

The eigenvectors of matrices ${\overline{C}}_l$, ${\overline{C}}_m$, ${\overline{C}}_u$ of research criterion are

• $w_l$= [0.6618 0.4657 0.3525 0.2457 0.4007]
• $w_m$= [0.6618 0.4657 0.3525 0.2457 0.4007]
• $w_u$= [0.6618 0.4657 0.3525 0.2457 0.4007]

Then eigenvectors ${\overline{w}}_l$, ${\overline{w}}_m$, ${\overline{w}}_u$ of research criterion become as

• ${\overline{w}}_l$ = [0.2956 0.2080 0.1574 0.1097 0.1790]
• ${\overline{w}}_m$ = [0.3112 0.2190 0.1657 0.1155 0.1884]
• ${\overline{w}}_u$ = [0.3267 0.2299 0.1740 0.1213 0.1978]

The consistency index and consistency ratio for research criterion are

$$CI=\left(5.09395-5\right)/\left(5-1\right)=0.0234875$$

$$CR=0.0234875/1.12=0.0209709821 \le 0.10$$

So, the comparison matrix is consistent for research criterion.

5.4. Fuzzy Pairwise Matrix of Citations Criterion

Table 10. Fuzzy pairwise matrix of citations criterion.

Citations	A	B	C	D	E
A	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(2.85,3,3.15)
B	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(2.85,3,3.15)
C	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(2.85,3,3.15)
D	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(1.9,2,2.1)
E	(0.31635,0.333,0.34965)	(0.31635,0.333,0.34965)	(0.31635,0.333,0.34965)	(0.475,0.5,0.525)	(0.95,1,1.05)

shows the fuzzy pairwise matrix of citations criterion.

Fuzzy pairwise matrix of citations criterion is decomposed into three matrices $C_l,C_m,C_u$ as shown in

Table 11. Decomposing of fuzzy pairwise matrix of citations criterion into three matrices $C_l,C_m,C_u$.

$\mathbf{Matrix} {\mathit{C}}_{\mathit{l}}$					$\mathbf{Matrix} {\mathit{C}}_{\mathit{m}}$					$\mathbf{Matrix} {\mathit{C}}_{\mathit{u}}$
0.95	0.95	0.95	0.95	2.85	1	1	1	1	3	1.05	1.05	1.05	1.05	3.15
0.95	0.95	0.95	0.95	2.85	1	1	1	1	3	1.05	1.05	1.05	1.05	3.15
0.95	0.95	0.95	0.95	2.85	1	1	1	1	3	1.05	1.05	1.05	1.05	3.15
0.95	0.95	0.95	0.95	1.9	1	1	1	1	2	1.05	1.05	1.05	1.05	2.1
0.31635	0.31635	0.31635	0.475	0.95	0.333	0.333	0.333	0.5	1	0.34965	0.34965	0.34965	0.525	1.05

.

Then, matrices ${\overline{C}}_l$, ${\overline{C}}_m$, ${\overline{C}}_u$ of citations criterion become as in

Table 12. Matrices ${\overline{C}}_l,{\overline{C}}_m,{\overline{C}}_u$ of citations criterion.

$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{l}}$					$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{m}}$					$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{u}}$
2.9	2.9	2.9	2.9	8.7	6	6	6	6	18	3.1	3.1	3.1	3.1	9.3
2.9	2.9	2.9	2.9	8.7	6	6	6	6	18	3.1	3.1	3.1	3.1	9.3
2.9	2.9	2.9	2.9	8.7	6	6	6	6	18	3.1	3.1	3.1	3.1	9.3
2.9	2.9	2.9	2.9	5.8	6	6	6	6	12	3.1	3.1	3.1	3.1	6.2
0.9657	0.9657	0.9657	1.45	2.9	1.998	1.998	1.998	3	6	1.0323	1.0323	1.0323	1.55	3.1

.

The eigenvalues of these matrices are ${\overline{\lambda }}_l$ = 14.5559, ${\overline{\lambda }}_m$ = 30.1157, ${\overline{\lambda }}_u$ = 15.5598 and ${\lambda }_l$= 4.768308, ${\lambda }_m$= 5.019283, ${\lambda }_u$= 5.270258.

The eigenvectors of matrices ${\overline{C}}_l$, ${\overline{C}}_m$, ${\overline{C}}_u$ of citations criterion are

• $w_l$= [0.5005 0.5005 0.5005 0.4642 0.1821]
• $w_m$= [0.5005 0.5005 0.5005 0.4642 0.1821]
• $w_u$= [0.5005 0.5005 0.5005 0.4642 0.1821]

Then eigenvectors ${\overline{w}}_l$, ${\overline{w}}_m$, ${\overline{w}}_u$ of citations criterion become as

• ${\overline{w}}_l$ = [0.2213 0.2213 0.2213 0.2053 0.0805]
• ${\overline{w}}_m$ = [0.2330 0.2330 0.2330 0.2161 0.0847]
• ${\overline{w}}_u$ = [0.2446 0.2446 0.2446 0.2269 0.0890]

The consistency index and consistency ratio for citations criterion are

$$CI=(5.019283-5)/\left(5-1\right)=0.00482075$$

$$CR=0.00482075/1.12=0.0043042411 \le 0.10$$

So, the comparison matrix is consistent with the citations criterion.

5.5. Fuzzy Pairwise Matrix of International Outlook Criterion

Table 13. Fuzzy pairwise matrix of international outlook criterion.

Inter. Outlook	A	B	C	D	E
A	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)
B	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)
C	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)
D	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)
E	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)	(0.95,1,1.05)

shows the fuzzy pairwise matrix of international outlook criterion.

Fuzzy pairwise matrix of international outlook criterion is decomposed into three matrices $C_l,C_m,C_u$ as shown in

Table 14. Decomposing of fuzzy pairwise matrix of international outlook criterion into three matrices $C_l,C_m,C_u$.

$\mathbf{Matrix} {\mathit{C}}_{\mathit{l}}$					$\mathbf{Matrix} {\mathit{C}}_{\mathit{m}}$					$\mathbf{Matrix} {\mathit{C}}_{\mathit{u}}$
0.95	0.95	0.95	0.95	0.95	1	1	1	1	1	1.05	1.05	1.05	1.05	1.05
0.95	0.95	0.95	0.95	0.95	1	1	1	1	1	1.05	1.05	1.05	1.05	1.05
0.95	0.95	0.95	0.95	0.95	1	1	1	1	1	1.05	1.05	1.05	1.05	1.05
0.95	0.95	0.95	0.95	0.95	1	1	1	1	1	1.05	1.05	1.05	1.05	1.05
0.95	0.95	0.95	0.95	0.95	1	1	1	1	1	1.05	1.05	1.05	1.05	1.05

.

Then, matrices ${\overline{C}}_l$, ${\overline{C}}_m$, ${\overline{C}}_u$ of international outlook criterion become as in

Table 15. Matrices ${\overline{C}}_l,{\overline{C}}_m,{\overline{C}}_u$ of international outlook criterion.

$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{l}}$					$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{m}}$					$\mathbf{Matrix} {\overline{\mathit{C}}}_{\mathit{u}}$
2.9	2.9	2.9	2.9	2.9	6	6	6	6	6	3.1	3.1	3.1	3.1	3.1
2.9	2.9	2.9	2.9	2.9	6	6	6	6	6	3.1	3.1	3.1	3.1	3.1
2.9	2.9	2.9	2.9	2.9	6	6	6	6	6	3.1	3.1	3.1	3.1	3.1
2.9	2.9	2.9	2.9	2.9	6	6	6	6	6	3.1	3.1	3.1	3.1	3.1
2.9	2.9	2.9	2.9	2.9	6	6	6	6	6	3.1	3.1	3.1	3.1	3.1

.

The eigenvalues of these matrices are ${\overline{\lambda }}_l$ = 14.5, ${\overline{\lambda }}_m$ = 30, ${\overline{\lambda }}_u$ = 15.5 and ${\lambda }_{l }$= 4.75, ${\lambda }_m$= 5, ${\lambda }_u$= 5.25.

The eigenvectors of matrices ${\overline{C}}_l$, ${\overline{C}}_m$, ${\overline{C}}_u$ of international outlook criterion are

• $w_l$= [0.4472 0.4472 0.4472 0.4472 0.4472]
• $w_m$= [0.4472 0.4472 0.4472 0.4472 0.4472]
• $w_u$ = [0.4472 0.4472 0.4472 0.4472 0.4472]

Then eigenvectors ${\overline{w}}_l$, ${\overline{w}}_m$, ${\overline{w}}_u$ of international outlook criterion become as

• ${\overline{w}}_l$ = [0.19 0.19 0.19 0.19 0.19]
• ${\overline{w}}_m$ = [0.2 0.2 0.2 0.2 0.2]
• ${\overline{w}}_u$ = [0.21 0.21 0.21 0.21 0.21]

The consistency index and consistency ratio for international outlook criterion are

$$CI=\left(5-5\right)/\left(5-1\right)=0$$

$$CR=0/1.12=0 \le 0.10$$

So, the comparison matrix is completely consistent for international outlook criterion.

Priority fuzzy matrices ${\overline{P}}_l, {\overline{P}}_m, {\overline{P}}_u$ that contain normalized eigenvectors ${\overline{w}}_l, {\overline{w}}_m, {\overline{w}}_u$ are given below:

$${\overline{P}}_l=\left[\begin{array}{cccc}0.2558& 0.2956& 0.2213& 0.19\\ 0.2342& 0.2080& 0.2213& 0.19\\ 0.1171& 0.1574& 0.2213& 0.19\\ 0.1085& 0.1097& 0.2053& 0.19\\ 0.2342& 0.1790& 0.0805& 0.19\end{array}\right]$$

$${\overline{P}}_m=\left[\begin{array}{cccc}0.2693& 0.3112& 0.2330& 0.2\\ 0.2465& 0.2190& 0.2330& 0.2\\ 0.1232& 0.1657& 0.2330& 0.2\\ 0.1143& 0.1155& 0.2161& 0.2\\ 0.2465& 0.1884& 0.0847& 0.2\end{array}\right]$$

$${\overline{P}}_u=\left[\begin{array}{cccc}0.2827& 0.3267& 0.2446& 0.21\\ 0.2588& 0.2299& 0.2446& 0.21\\ 0.1294& 0.1740& 0.2446& 0.21\\ 0.1200& 0.1213& 0.2269& 0.21\\ 0.2588& 0.1978& 0.0890& 0.21\end{array}\right]$$

Eigenvectors of criteria are

$${\overline{w}}_l=\left[0.2923 0.2923 0.2923 0.0731\right]$$

$${\overline{w}}_m=\left[0.3077 0.3077 0.3077 0.0769\right]$$

$${\overline{w}}_u=\left[0.3230 0.3230 0.3230 0.0807\right]$$

By multiplying priority fuzzy matrices ${\overline{P}}_l, {\overline{P}}_m, {\overline{P}}_u$ by ${\overline{w}}_l, {\overline{w}}_m, {\overline{w}}_u$, the global priorities are obtained.

Table 16. Global Priorities, Expected Value, Standard Deviation and Coefficient of Variation.

Alternative	Vector gl	Vector gm	Vector gu	Exp. Val. gi,e	Stand. Dev. (%)	CVi
A	0.2397	0.2657	0.2928	0.2660	0.8397	3.1568
B	0.2078	0.2303	0.2538	0.2306	0.7274	3.1544
C	0.1588	0.1760	0.1940	0.1762	0.5566	3.1589
D	0.1377	0.1526	0.1682	0.1528	0.4823	3.1564
E	0.1582	0.1753	0.1932	0.1755	0.5535	3.1538

represents global priorities, expected value, standard deviation and coefficient of variation.

According to [32], the alternative with higher expected value and lower standard deviation should be considered as the best one. Apart from the obtained results for these measures in Table 16, there is no possibility to rank the universities under such circumstances. For this reason, ranking can only be possible according to the values of coefficient of variation (${\mathrm{CV}}_{\mathrm{i}}={\sigma }_i/g_{i,e}$), which are also represented in Table 16. An alternative with a smaller ${\mathrm{CV}}_{\mathrm{i}}$ is taken as the best one [32]. So, the universities E and C are respectively best and worst alternatives, according to the results of coefficient of variation (${\mathrm{CV}}_{\mathrm{i}}$). Ranking of the universities has the prioritized order $E>B>D>A>C$.

6. Conclusions

The quality of a university is stipulated by its ranking in the international higher education sector; in other words, ranking is a tool which is used to measure the university performance. Selecting a prestigious university to study is a process that requires strategic decision making. Nowadays, most decisions are made in complex and uncertain environments. When the complexity of a decision making problem increases, it becomes difficult to reach the perfect solution. In such cases, a better decision making method and more precise results are required. Fuzzy AHP method can be a very useful tool for optimal problem solving. Since fuzzy AHP provides precise results in cases of uncertainty, it is one of the most widely used approaches among MCDM methodologies. In this paper, fuzzy AHP is applied to rank five UK universities according to four criteria. These criteria are teaching, research, citations and international outlook. After checking the consistency of all criteria and alternatives’ pairwise matrices, their eigenvectors are calculated. By using these eigenvectors, the ranking of five universities is carried out.