Next Article in Journal
Performance Evaluation and Influencing Factors of Scientific Communication in Research Institutions
Next Article in Special Issue
Comparative Analysis of Key Success Factors in S&OP: Focusing on Manufacturing and Retail Industry in South Korea
Previous Article in Journal
Fostering Directions for Digital Technology Adoption in Sustainable and Circular Fashion: Toward the Circular Fashion-Tech Lab
Previous Article in Special Issue
Fresh Produce Ordering, Pricing and Freshness-Keeping Decisions with Call Option Contracts and Spot Markets
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Procedure for Choosing among Different Solutions to the Multi-Criteria Supplier Selection Problem along with Two Solution Methods

Department of Marketing, Operations and Analytics, The Bill Munday School of Business, St. Edward’s University, 3001 S. Congress Ave., Austin, TX 78704-6489, USA
*
Author to whom correspondence should be addressed.
Systems 2024, 12(6), 191; https://doi.org/10.3390/systems12060191
Submission received: 22 April 2024 / Revised: 21 May 2024 / Accepted: 28 May 2024 / Published: 30 May 2024
(This article belongs to the Special Issue Multi-criteria Decision Making in Supply Chain Management)

Abstract

:
Supplier selection is a multi-attribute decision-making (MADM) problem that is affected by often-conflicting factors (e.g., price, quality, and delivery performance). If a supplier selection problem (SSP) is solved by different MADM methods, different solutions are likely to be obtained. This can be advantageous for decision makers because they have a good choice of alternative solutions. However, it brings about the need for a comparison approach for choosing the solution that best fits the decision maker’s purchasing strategy. So, decision makers may have two needs: (1) a good choice of alternative solutions and (2) a comparison approach. To help decision makers with the first need, we make two contributions to the literature on SSPs. For one, we formulate an integer nonlinear optimization model that evaluates and sorts the suppliers based on similarity to the ideal solution. For another, we make enhancements to the existing Factor Rating (FR) method. For the second need, we propose a comparison procedure to rank different solutions by measuring their relative closeness, both Rectilinear and Euclidean, to the ideal solution. The first two proposed methods along with the existing FR and TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution) methods are applied to a set of test SSPs, and then, the comparison procedure is used to identify the ‘superior’ method for each test problem.

1. Introduction

Supplier selection is a MADM problem involving a number of quantitative and qualitative factors such as price, quality, and environmental impact. Dickson [1] sent a questionnaire to 273 purchasing agents and managers in the United States and Canada, and subsequently identified and ranked 23 factors for SSPs. Some factors might conflict with one another, meaning a supplier that is favorable in one factor might not be favorable in another. The relative weight or importance of these factors can differ among decision makers in the supply chain depending on their purchasing strategies [2]. The consideration of numerous factors with different weights contributes to the complexity of SSPs [3,4]. In addition, the cost of component parts and raw materials in manufacturing can be up to 70% of product cost [5]. In such circumstances, supplier selection is a strategic decision and one of the most important functions of purchasing management [6].
There exist two scenarios in SSPs: single sourcing and multiple sourcing. In the first scenario, all candidate suppliers are individually capable of meeting a buyer’s needs, and therefore, it would suffice for the buyer to select a single supplier. In the second scenario, supplier constraints (e.g., production capacity) force a buyer to purchase the same item from more than one supplier. Also, multiple sourcing is a practical way of ensuring the reliability of a buyer’s supply stream [7]. For example, Toyota, Honda, and Nissan were affected by the devastating Japan earthquake and tsunami in March 2011, partly due to the disruptions faced by their Japanese parts suppliers. In this case, a buyer might prefer to split its orders among multiple suppliers who are, for example, geographically scattered even though single sourcing is possible. Typically, in multiple sourcing, the buyer can first rank the suppliers by an MADM method and then split the order among the ranked suppliers, with greater quantities ordered from the higher-ranked suppliers as capacities permit.

2. Literature Review

The various solution methods that have been applied to SSPs include the analytic hierarchy process or AHP [8,9], analytic network process or ANP [10], linear weighting methods [11,12], total cost approach [13], TOPSIS [14,15], machine learning algorithms [16], and mathematical programming techniques [4,17].
Among these methods, TOPSIS is one of the widely used techniques that evaluates and ranks suppliers based on the concept that the chosen alternative should have the shortest distance from the positive ideal solution (PIS) and the longest distance from the negative ideal solution (NIS). It is worth noting that TOPSIS is a variation of the classical Hellwig’s method [18] that dates back to 1968. TOPSIS considers distances to the ideal and anti-ideal, while Hellwig’s method considers only distances to the ideal.
Modibbo et al. [19] performed a multi-criteria decision analysis for pharmaceutical supplier selection using Fuzzy TOPSIS. Memari et al. [20] used Fuzzy TOPSIS for sustainable supplier selection. Junior et al. [21] developed a comparative analysis of Fuzzy TOPSIS and Fuzzy AHP methods in the context of supplier selection decision-making. Singh et al. [22] proposed a hybrid model of Fuzzy AHP and Fuzzy TOPSIS to evaluate and select an appropriate third-party logistics (3PL). Yu et al. [23] developed a novel integrated supplier selection approach incorporating a buyer’s risk attitude using the artificial neural network, AHP, and TOPSIS methods. Venkatesh et al. [24] applied integrated fuzzy AHP and TOPSIS methods to evaluate and rank supply partner alternatives. Leong et al. [25] integrate GRA (Grey Relational Analysis), BWM (Best Worst Model), and TOPSIS for resilient supplier selection.
Luan et al. [26] combined a genetic algorithm and ant colony optimization to solve a supplier selection problem. Zakeri et al. [27] proposed a method of evaluating suppliers based on optimal points and win–loss–draw decision-making. Stević et al. [28] present a method for sustainable supplier selection in healthcare industries they call MARCOS, for measurement of alternatives and ranking according to compromise solution. FR, also known as the simple additive weighting method, is another MADM method that has been used for facility location, scholarship applicant, and IT-project selection problems by researchers such as Sharma et al. [29] and Rizana and Soesanto [30].
Awasthi et al. [31] studied a multi-tier, global supplier selection problem using a fuzzy AHP-VIKOR-based approach. VIKOR is a Serbian acronym that translates to multi-criteria optimization and compromise solution. VIKOR uses vector normalization of criterion units, whereas TOPSIS uses linear normalization. Rajesh and Ravi [32], as well as Golmohammadi and Mellat-Parast [33], developed Grey relational analysis-based models for supplier selection. Hashemi et al. [34] combined the analytic network process and Grey relational analysis for supplier selection. Tsai et al. [35] developed a fuzzy data envelopment analysis model, while Wang et al. [36] combined DEA and Grey’s, for supplier selection and plant site selection, respectively.
We summarize the literature review in Table 1 where LWM is linear weighting methods; TCA is total cost approach; MLA is machine learning algorithms; MP is mathematical programming; and OM is other methods.

3. Research Focus

SSPs are akin to, say, forecasting problems in the sense that different methods can be used to generate solutions. As these methods produce different forecasts, alternate measures (e.g., mean absolute deviation and mean squared error) can be used to evaluate the forecast methods and select the one that best meets the forecaster’s overall strategy. The same can be said for MADM problems like SSPs: they can be solved by different MADM methods, resulting in different alternative solutions. Having a good choice of alternative solutions may be advantageous for the decision maker but a comparison approach is needed for picking the solution that best fits the desired purchasing strategy. So, decision makers may have two needs: (1) a good selection of alternative solutions and (2) a comparison approach for identifying the ‘best’ solution.
To help decision makers with the first need, we propose two new methods to evaluate and rank suppliers. The first new method involves the formulation of an integer nonlinear optimization model that evaluates and sorts the suppliers based on similarity to the ideal solution. We call the model INOSIS (Integer Nonlinear Optimization by Similarity to the Ideal Solution). The INOSIS method is based on the TOPSIS concept. For the second new method, we make enhancements to the existing Factor Rating (FR) method and call it the Modified Factor Rating (MFR) method. Our main objective of proposing the INOSIS and MFR methods is to complement the methods mentioned in the literature review and to provide more alternative solutions for decision makers. In this study, we show that no method consistently provides the most preferred/desirable solution.
For the second need, we propose a procedure referred to as ROS, for Ranking-of-Solutions, to rank different solutions by measuring their relative closeness, both rectilinear and Euclidean, to the ideal solution. The ROS procedure assumes that the decision maker would prefer a supplier that is closer to (or more resembles) the best-possible supplier compared to the other suppliers. It is believed to be the first of its kind that helps the decision maker identify which solution is most preferred.
In Section 4 of this paper, the single-source problem under study is defined, the proposed MFR and INOSIS solution methods and proposed ROS selection procedure are described. In Section 5, the FR, MFR, INOSIS, and TOPSIS methods are applied to a set of test SSPs, and the ROS procedure is used to rank their solutions. In Section 6, conclusions are drawn and suggested future research is discussed.

4. Methods

The two proposed SSP solution procedures, MFR and INOSIS, as well as the proposed ROS procedure are described in detail next. The following notations are used in the proposed methods:
S = { S 1 , …, S j , … S m }discrete set of m possible suppliers
Q = { Q 1 , …, Q i , … Q n }discrete set of n factors
W = { W 1 , …, W i , … W n }vector of n factor weights
W i weight assigned to factor Q i   i
NWinormalized weight calculated for factor Q i   i
  R i j rating of supplier j for factor i i j
Ddecision matrix containing R i j   i j
NRijnormalized rating of supplier j for factor i i j
NDnormalized decision matrix containing NRij i j
C N R i j converted normalized rating of supplier j for factor i i j
CNDconverted normalized decision matrix containing C N R i j   i j
Ojoverall score of supplier j  j
S + positive ideal solution
Ejweighted distance of supplier j from S +
f i + best-possible rating
f i worst-possible rating
αijrating’s relative closeness to the best-possible rating i j
SCSjweighted relative closeness score of supplier j  j
OCSoverall closeness score

4.1. Preliminary Steps

The four SSP solution methods (FR, MFR, TOPSIS, and INOSIS) employed in this paper all start with the seven steps described below.
Step i. Decide on the set of candidate suppliers, where S = { S 1 , …, S j , … S m } is a discrete set of m possible supplier alternatives.
Step ii. Decide the supplier factors (e.g., price, quality, and location) to be considered, where Q = { Q 1 , …, Q i , … Q n } is a discrete set of n factors. It is assumed there are i = 1 to n positive (or benefit) factors like reputation and i = n + 1 to n negative factors like wholesale price.
Step iii. Decide the factor weights to be used, where W = { W 1 , …, W i , … W n } is a vector of n factor weights and W i is the weight assigned to factor Q i   i . Decision makers usually use linguistic variables to express the factor weights. For example, the environmental impact of a supplier can be very low, low, moderate, high, or very high. In such a case, the factor weights can be expressed by the 5-level scale shown in Table 2.
Step iv. Normalize the factor weights. The sum of the weights should equal one, and thus they are normalized by Equation (1), getting N W i :
N W i = W i i = 1 n W i ;   i
Example: Assume that a buyer is evaluating three suppliers against two factors: Q 1 is service level that is a positive, qualitative factor; Q 2 is wholesale price that is a negative, quantitative factor. Based on the buyer’s strategy, the importance of Q 1 is “Very High” meaning W 1 = 1 . Or the importance of Q 2 is slightly lower than “Moderate” which means somewhere between “Moderate” and “Poor” but closer to “Moderate”. So, from Table 2, the weight can be a number between 0.25 and 0.50 but close to 0.50. How much closer this is to or far from “Moderate” (or 0.50) depends on the decision makers’ discretion. So, the decision makers may set W 2 to 0.43 . Table 2 is intended to show five discrete reference points on a continuous zero-to-one scale. By applying Equation (1), the resulting normalized weights, NW1 and NW2, are 1.00/1.43 = 0.7 and 0.43/1.43 = 0.3, respectively.
Step v. Decide on the quantitative scale to be used for the rating values of the m suppliers on the n factors. Decision makers often start with linguistic variables to express the scale for supplier factor ratings. The linguistic variables are then converted to quantitative values. Table 3a,b are two examples of how conversion can be accomplished, the former for monotonic variables and the latter for non-monotonic variables.
A monotonic factor, such as product quality, has strictly increasing or strictly decreasing levels. The optimal level is the minimum or maximum level. In contrast, a non-monotonic factor, such as supplier capacity utilization, has both increasing and decreasing levels. A non-monotonic supplier variable is analogous to a concave or convex utility function. The optimal level is not necessarily the maximum or minimum level. The classic Economies/Diseconomies of Scale concept that arises in operations management is an example of a non-monotonic scale.
Keep in mind, both Table 3 (a,b) happen to show just five discrete reference points on a continuous 0 to 100 scale.
Step vi. Decide rating values Rij, where R i j   i j is the rating of Supplier j for factor i. For qualitative factors, use Table 3 to identify the factor rating values for each supplier. Quantitative factors are scaled using their own real numbers.
Step vii. Construct decision matrix D as shown in Equation (2).
D = R 11 R 21 R 12 R 22 R 1 m R 2 m   R n 1 R n 2 R n m

4.2. Modified Factor Rating (MFR) Method

The MFR method is like the Factor Rating (FR) method in that it is used for evaluating and ranking alternatives against multiple factors. As the factors may have different scales or units, they need to be normalized. Furthermore, all the factors need to be converted to the same classification of either positive or negative. In the FR method used by Rizana and Soesanto [30], normalization and conversion are performed in one step (which is presented in Appendix A). However, in the MFR method, normalization and conversion are performed differently and separately. The difference between FR and MFR has a considerable impact on the solution and is discussed in the numerical analysis section. We explain the MFR method in this subsection, while the FR method is covered in Appendix A.

MFR Procedure

We continue with the example problem introduced in Section 4.1 involving three candidate suppliers and two factors, service level (a positive factor) and wholesale price (a negative factor). The execution of Steps i through vii, described above, resulted in the following decision matrix D:
   S 1    S 2    S 3 D = 0.25 0.75 0.25 $ 100 $ 110 $ 95 Q 1 Q 2
Here, one can see that Supplier 2 is offering the highest service level, 0.75, and Supplier 3 is offering the lowest wholesale price, $95.
Step 1. Normalize the ratings to get NRij using Equation (3) and construct the normalized decision matrix N D in Equation (4):
N R i j = R i j j = 1 m R i j ,   i j
N D = N R 11 N R 21 N R 12 N R 22 N R 1 m N R 2 m N R n 1 N R n 2 N R n m
Note: The factor ratings are normalized to transform the different factor scales into a common measurable scale to allow comparisons across the factors.
Applying Equation (3) to the service factor Q1 ratings: NR11 = 0.25/1.25, NR12 = 0.75/1.25, and NR13 = 0.25/1.25. Applying it to the price factor Q2 ratings: NR21 = 100/305, NR22 = 110/305, and NR23 = 95/305. The resulting normalized decision matrix ND is:
   S 1       S 2     S 3 N D = 0.2000 0.6000 0.2000 0.3279 0.3607 0.3115 Q 1 Q 2
Step 2. If any factor is negative, as is the case with wholesale price factor Q2, the factor’s ratings must be converted to positive by means of Equation (5). The resulting converted normalized decision matrix CND is denoted by Equation (6).
C N R i j =   N R i j     i = 1 , , n ; j   f o r   n   p o s i t i v e   f a c t o r s 1 N R i j m 1 i = n + 1 ,   ,   n ;   j   for   n n   negative   factors
C N D = C N R 11 C N R 21 C N R 12 C N R 22 C N R 1 m C N R 2 m C N R n 1 C N R n 2 C N R n m
Q2 is a negative factor, so the complements of the three suppliers’ normalized ratings are found to be 0.672, 0.639, and 0.689. In this instance, the complementary ratings sum to 2 (i.e., j = 1 3 ( 1 N R i j ) = 2 ,   i ), so if each complementary rating is divided by 2, we have j = 1 3 ( 1 N R i j 2 ) = 1 ,   i . Q2’s normalized ratings are CNR21 = 0.3360, CNR22 = 0.3195, and CNR23 = 0.3445. The resulting converted normalized decision matrix, CND, is:
   S 1       S 2     S 3 C N D = 0.2000 0.6000 0.2000 0.3360 0.3195 0.3445 Q 1 Q 2
If a fourth supplier were added, the sum of the complementary ratings for the four suppliers would be j = 1 4 ( 1 N R i j ) = 3   i . To generalize, we always have j = 1 m ( 1 N R i j ) = m 1   i . Therefore, we can normalize the complementary ratings by dividing them by m 1 , i.e., j = 1 m ( 1 N R i j m 1 ) = 1   i .
Step 3. Calculate each supplier’s overall score Oj by Equation (7):
O j = i = 1 n N W i × C N R i j
Continuing with the example and using Equation (7), the resulting overall scores of the three suppliers are:
O 1 =   0.241 ,   O 2 =   0.516 ,   and   O 3 =   0.243
Step 4. Rank the suppliers in decreasing order of their overall scores. The supplier with the highest overall score is the best-choice supplier. In this example, Supplier 2 is the best choice, Supplier 3 is the second best, and Supplier 1 is the third best.

4.3. Integer Nonlinear Optimization (INOSIS) Model

For the INOSIS model, we formulate an integer nonlinear optimization model to evaluate and sort the suppliers. The model does so based on the TOPSIS concept that the chosen alternative should have the shortest Euclidean distance from the positive ideal solution, PIS. The INOSIS model maximizes the sum of the products of the suppliers’ ranking and the suppliers’ distance from the PIS. A larger rank is assigned to a longer distance, and conversely, because it is a maximization model. So, the suppliers are sorted in the increasing order of the rankings obtained by the INOSIS method.
The INOSIS model requires execution of Steps 1 and 2 described in Section 4.2 for the MFR method. Thus, our discussion of the INOSIS model assumes the ratings have been normalized and negative-factor ratings have been converted to positive ratings (i.e., the CND matrix is completed).
Step 3. Determine the PIS, denoted S + , from the converted normalized decision matrix C N D .   S + = ( Q 1 + ,   Q 2 + , . , Q n + ) , where Q i + = m a x j ( C N R i j )   i .
Step 4. Compute the weighted distance of Supplier j from S + , denoted Ej, using Equation (8).
E j = i = 1 n N W i × C N R i j Q i + k k   j
where k = 1 and 2 are used for rectilinear and Euclidean distances, respectively.
Step 5. Formulate and solve the following integer nonlinear optimization model represented by Equation (9) through (12).
Z   = j = 1 m P j × E j
subject to
P j Z > 0     j
P j P l     j l ;   i ,   l 1 ,   2 ,   ,   m
j = 1 m P j = m = 0 m ( m m )
Equation (9) makes sure that P j = 1 is assigned to the smallest E j , P j = 2 to the second smallest E j , … and P j = m to the largest E j . Let us assume there are two suppliers (j = 1, 2), where P j is an integer decision variable and represents supplier j’s ranking. E 2 E 1 indicates that Supplier 2 is superior to Supplier 1, and thus, P 2 = 1 and P 1 = 2 . Since E 2 E 1 and P 2 < P 1 , we have P 2 × E 2 < P 1 × E 1 . So, the largest possible value for Z = P 2 × E 2 + P 1 × E 1 results when we assign the largest P j (i.e., P 1 = 2 ) to the largest E j (i.e., E 1 ) and the second largest P j (i.e., P 2 = 1 ) to the second largest E j (i.e., E 2 ). Therefore, the ranking of the suppliers, P j   j , can be obtained by maximizing Equation (9), subject to the constraints represented by Equations (10)–(12).
Equation (10) indicates that P j   j are strictly positive integer values. Equation (11) ensures that no two suppliers have the same ranking.
Equation (12) prevents P j   j from becoming infinite as Equation (9) is maximized. To see how Equation (12) works, assume that there are four suppliers (i.e., m = 4), where E 1 < E 2 < E 3 < E 4 . For m = 4, we have j = 1 4 P j = ( 4 0 ) 4 + ( 4 1 ) 3 + ( 4 2 ) 2 + ( 4 3 ) 1 + ( 4 4 ) 0 = 10 for Equation (12). Here, one can see that, since each supplier’s ranking must be unique and strictly positive integer, the only possible values for P j   j to make j = 1 4 P j = 10 ,   are 1, 2, 3, and 4.
Step 6. Rank the suppliers in the increasing order of the P j   j (since the smallest P j is assigned to the smallest E j , the second smallest P j to the second smallest E j , etc.).

4.4. Ranking of Solutions (ROS) Procedure

Here, it is assumed a buyer prefers a supplier that is closest to (or most resembles) the theoretical best supplier and supplier rankings are based on this preference. (In the example introduced in Section 4.1, the ratings of the theoretical best supplier for Q 1 and Q 2 are 0.75 and $95, respectively.) To be general as well as consistent with the TOPSIS and INOSIS methods, the proposed ROS procedure measures the weighted relative closeness (in both rectilinear and Euclidean distance) of a solution to the ideal solution.
Step 1. We express the suppliers’ ratings, R i j   i j , in the decision matrix D, by fuzzy sets whose membership function increases linearly from 0 to 1 as shown in Equation (13) and Figure 1. The membership function is 1 for the best-possible rating, f i + , and 0 for the worst-possible one, f i . For positive factors, f i + = m a x j ( R i j ) and f i = m i n j ( R i j )   i , and for negative factors, f i + = m i n j ( R i j ) and f i = m a x j ( R i j )   i .
( R i j ) = 1 R i j f i + f i + R i j f i + f i f i < R i j < f i + 0 R i j f i
Step 2. Compute each rating’s relative closeness, αij, to the best-possible rating, using Equation (14):
α i j = f i + R i j f i + f i i j
Step 3. Compute each supplier’s weighted relative closeness score, SCSj, by Equation (15):
S C S j = G j × i = 1 n W i × α i j k k j
where k = 1 for rectilinear and k = 2 for Euclidean, relative closeness.
The supplier’s ranking, obtained by the evaluation method in question, must be included in this calculation by means of a Gj score. Score G j is assigned to Supplier j, j , so that an inferior supplier cannot be scored greater than its superior. For example, G j = m if Supplier j is the best supplier, G l = m 1 if Supplier l is the second-best supplier, and so on.
Step 4. Compute the overall closeness score, OCS, by Equation (16):
O C S = j = 1 m S C S j
In Equation (16), one can see that smaller values of OCS are desirable because when R i j gets closer to f i + , OCS gets smaller.
Step 5. Rank the supplier selection methods in increasing order of their overall closeness scores. The method with the smallest OCS is the one preferred by the buyer.

5. Numerical Analysis

The FR, MFR, INOSIS, and TOPSIS methods, as well as the ROS procedure, were applied to a supplier selection problem involving 7 suppliers and 12 factors. The steps of the MFR method are presented, but only the results of the FR, INOSIS, and TOPSIS methods are shown to keep this paper concise. Then, we present a summary of the results of applying the four solution methods and ranking-of-solutions procedure to 100 test problems whose parameters were generated randomly in MS Excel.

5.1. Single Test Problem

5.1.1. Preliminary Steps

Step i. It is assumed there are seven suppliers (m = 7).
Step ii. It is assumed there are twelve factors (n = 12). The first six factors are assumed to be positive ( n = 6) and the other six (n − n = 6) are negative. The positive factors might include supplier production capacity and product-option variety because higher values for these factors would likely be more appealing to buyers. The negative factors might include supplier wholesale price and product defective rate, for which buyers would likely prefer lower values.
Step iii. In practice, the weight of each of the twelve factors is decided by the buyer. For this demonstration, the weights were randomly generated in MS Excel using “RANDBETWEEN(0, 100)/100”.
Step iv. The weights are normalized by Equation (1) and appear in Table 4.
Steps v and vi. In practice, the supplier ratings for each factor are decided by the buyer. For this demonstration, the suppliers’ ratings for the twelve factors were randomly generated by the “RANDBETWEEN” function in MS Excel. For example, the suppliers’ ratings for the first factor was generated by “=RANDBETWEEN(8, 10)”. For the remaining eleven factors, the values “(0, 100)”, “(0, 1)”, “(0, 1)”, “(8, 10)”, “(5, 12)”, “(5, 20)”, “(0, 1)”, “(0, 1)”, “(0, 1)”, “(0, 1)”, and “(20, 50)” were used as the lower and upper bounds, respectively, in the “RANDBETWEEN” function.
Step vii. The resulting decision matrix D containing the supplier ratings for the 12 factors appears in Table 5.

5.1.2. MFR Procedure

Steps 1 and 2. Using Equations (3) and (5), the converted normalized decision matrix CND in Table 6 is computed.
Step 3. The suppliers’ overall scores for the MFR method are computed by Equation (7) and shown, along with their subsequent rankings, in Table 7. Table 7 also shows the results of the other three methods.
The INOSIS model was formulated in MS Excel and solved by Solver and finds only the supplier rankings, not the scores. For the FR, MFR, and TOPSIS methods, the supplier with the highest overall score is the best supplier. For example, for the MFR method Supplier 3’s overall score is the highest (i.e., O 3 = 0.172 ) , and thus it has a ranking of “1”.

5.1.3. ROS Procedure

For this particular problem, all four solution methods ranked Supplier 3 as “1”, but the methods differed in their other supplier rankings, which would be meaningful if this was a multiple-source SSP and prompts the application of the proposed ROS procedure.
Steps 1. From Table 5, we obtain the best-possible rating, f i + , and the worst-possible one, f i , shown in Table 8. For positive factors, f i + = m a x j ( R i j ) and f i = m i n j ( R i j )   i , and for negative factors, f i + = m i n j ( R i j ) and f i = m a x j ( R i j )   i .
Step 2. Using Equation (14), the ratings’ relative closeness, α i j , to the best-possible ratings are calculated and shown in Table 9.
Step 3. Using Equation (15) and k = 1, each supplier’s weighted relative closeness score, SCSj, is computed and shown in Table 10.
Step 4. Using Equation (16), the overall closeness score, OCS, is computed to be 11.35.
The overall closeness score, OCS, for the other three methods was found to be (in ascending order) 11.44 for FR, 11.51 for TOPSIS, and 11.56 for INOSIS. In this instance, the MFR method is superior because its overall closeness score is the lowest. When k = 2, the OCS scores were 0.94 for MFR, 0.96 for FR, 0.95 for TOPSIS, and 0.99 for INOSIS, again resulting in the MFR method being superior.

5.2. Set of 100 Test Problems

To have a robust analysis, random numbers were generated in MS Excel to produce the supplier factor ratings and factor weights for 100 cases involving 7 suppliers and 12 factors. For each case, the four methods were used to score and rank the suppliers. Then, the ROS procedure was employed to measure their effectiveness and determine the superior method. Table 11 shows the number of times each of the four methods was, or tied for, the superior method.
The results show that the FR method provided superior (most preferred) solutions far more frequently than the other three methods when k = 1. However, when k = 2, TOPSIS provided superior solutions nearly as frequently (40 times) as did the top-performing FR method (42 times). No method tested was consistently superior, which is why the decision maker can benefit from using a number of methodologies and picking the solution that best fits their purchasing strategy.

6. Conclusions and Suggestions for Future Research

A host of different methods for evaluating and ranking suppliers has appeared in the literature. When a SSP is solved by those methods, different solutions are likely to be obtained. This can be advantageous for decision makers because they have a good choice of alternative solutions. However, this may bring a question that what solution can be the superior/most-preferred one. In other words, decision makers need a comparison approach for choosing the solution that best fits their purchasing strategy or that is the superior/most-preferred solution. To help the decision makers with this need, a ROS procedure was proposed here.
In this study, we applied four SSP solution methods, two proposed (MFR and INOSIS) and two established (FR and TOPSIS) ones, to 100 test problems whose parameters were generated randomly in MS Excel. As expected, the solutions (i.e., supplier rankings) determined by the four solution methods often varied in the case of each test problem. Then, we used the proposed ROS method to determine the superior/most-preferred solutions. The analysis on the 100 test problems showed no method was consistently superior or provided the superior/most-preferred solution. Therefore, our main objective of proposing the INOSIS and MFR methods is to provide a good choice of alternative solutions for the decision makers. And the reason for proposing the ROS method is to determine the superior/most-preferred solutions.
Based on the analysis, it is suggested that different methods be used to solve a problem and that the ROS procedure be used to realize which solution is preferred. More robust testing of solution methods and the proposed ROS procedure would be worthwhile.
There might still be methods, new or modified, that can be developed for the multi-attribute supplier selection problem defined in this study. In addition, the proposed ROS procedure is but one way to evaluate the solutions of the different MADM methods; the development of other approaches could be beneficial.
For future research, it might be worthwhile to investigate how the uncertainty of, or changes in, suppliers’ performance on the various evaluation criteria can be considered in the supplier ranking process. For example, the quality of a raw material purchased from Supplier 1 is currently better than Supplier 2. However, the quality of Supplier 1 is getting worse over time while that of Supplier 2 is getting better. A stochastic approach to scoring supplier performance might be a realistic consideration. Going further, sensitivity (i.e., what-if) analysis could be conducted to determine the change in supplier rankings that results from changes in performance criteria weights or scores.

Author Contributions

All authors contributed to the paper’s conceptualization, new methodology development, formal analysis, validation of results, original draft writing, and paper refinement/editing. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

The original contributions presented in the study are included in the article; further inquiries can be directed to the corresponding author.

Conflicts of Interest

The authors confirm that there are no relevant financial or non-financial competing interests to report.

Appendix A

In this subsection, it is shown how the FR and TOPSIS methods can be used for a supplier selection problem. For more about these two methods, the reader is referred to Singh et al. [22], Yu et al. [23], and Venkatesh et al. [24] for TOPSIS, and to Rizana and Soesanto [30] for FR. To compare the FR and TOPSIS methods with the MFR method, we also show the steps of the MFR method here.
FR and TOPSIS Procedures
The first seven steps in these two procedures are the same as those in MFR.
Step 1A. Normalize the ratings by the following formulas:
TOPSISFRMFR
N R i j = R i j j R i j , ij N R i j = R i j m a x j ( R i j ) , i = 1, …, n ; j
N R i j = m i n j ( R i j ) R i j , i = n + 1, …, n ; j
N R i j = R i j j = 1 m R i j , i j
Note: For FR method, normalization and conversion are performed together.
Step 2A. Construct the converted normalized decision matrix by the following formulas:
TOPSISFRMFR
Do nothing for TOPSIS method.Do nothing for FR method. C N R i j = N R i j , i = 1, …, n ; j
C N R i j = 1 N R i j m 1 , i = n + 1, …, n ; j
Step 3A. Construct the weighted normalized decision matrix by the following formulas:
TOPSISFRMFR
N R i j w = N R i j × W i , ijDo nothing for FR method.Do nothing for MFR method.
Step 4A. Find the best (PIS)-, S b , and the worst (NIS)-, S w , possible solutions as follows:
TOPSISFRMFR
S b = B 1 ,   B 2 , , B m
S w = N 1 , N 2 , ,   N m
Do nothing for FR method.Do nothing for MFR method.
where B i = N R i 1 w , , N R i m w i and N i = N R i 1 w , , N R i m w i for cost attributes; B i = N R i 1 w , , N R i m w i and N i = N R i 1 w , , N R i m w j for benefit attributes.
Step 5A. Calculate the separation of each weighted normalized score from the PIS and NIS as follows:
TOPSISFRMFR
Δ j + = j = 1 m ( N R i j w B i ) 2 , i  
Δ j = j = 1 m ( N R i j w N i ) 2 , i
Do nothing for FR method.Do nothing for MFR method.
Step 6A. Calculate the supplier’s overall score as follows:
TOPSISFRMFR
O i = Δ j Δ j + + Δ j , j O j = i = 1 n N W i × N R i j , j O j = i = 1 n N W i × C N R i j , j
Step 7A. For the three methods, the suppliers are ranked in decreasing order of their overall scores.
Table A1 better shows all the steps that these three techniques should take in order to evaluate the suppliers.
Table A1. The difference in the three techniques.
Table A1. The difference in the three techniques.
StepsFRMFRTOPSIS
Step 1A. Constructing the normalized decision matrix***
Step 2A. Constructing the converted decision matrix*Do NothingDo Nothing
Step 3A. Constructing the weighted normalized decision matrixDo NothingDo Nothing*
Step 4A. Find the PIS and the NISDo NothingDo Nothing*
Step 5A. Calculate the distance of each weighted normalized score from the PIS and the NISDo NothingDo Nothing*
Step 6A. Calculate the suppliers’ overall score***
Note: * indicates the procedural step applies to the solution method.
As one can observe here, for TOPSIS, there are five steps to ranking the suppliers while FR and MFR methods have three and two steps, respectively. Hence, FR and MFR have less computational complexity compared to TOPSIS. However, as was demonstrated in the numerical analysis section, there is no superior method that always gives the preferable solution.

References

  1. Dickson, G.W. An analysis of vendor selection: Systems and decisions. J. Purch. 1996, 2, 5–17. [Google Scholar] [CrossRef]
  2. Wang, G.; Hang, S.H.; Dismukes, J.P. Product-driven supply chain selection using integrated multi-criteria decision-making methodology. Int. J. Prod. Econ. 2004, 91, 1–15. [Google Scholar] [CrossRef]
  3. Wang, T.Y.; Yang, Y.H. A fuzzy model for supplier selection in quantity discount environments. Expert Syst. Appl. 2009, 36, 12179–12187. [Google Scholar] [CrossRef]
  4. Jadidi, O.; Zolfaghari, S.; Cavalieri, S. A new normalized goal programming model for multi-objective problems: A case of supplier selection and order allocation. Int. J. Prod. Econ. 2014, 148, 158–165. [Google Scholar] [CrossRef]
  5. Ghodsypour, S.H.; O’Brien, C. A decision support system for supplier selection using an integrated analytical hierarchy process and linear programming. Int. J. Prod. Econ. 1998, 56–57, 199–212. [Google Scholar] [CrossRef]
  6. Frej, E.A.; Roselli, L.R.P.; Almeida, J.A.d.; Almeida, A.T.d. A multicriteria decision model for supplier selection in a food industry based on FITradeoff method. Math. Probl. Eng. 2017, 2017, 4541914. [Google Scholar] [CrossRef]
  7. Aissaoui, N.; Haouari, M.; Hassini, E. Supplier selection and order lot sizing modeling: A review. Comput. Oper. Res. 2007, 34, 3516–3540. [Google Scholar] [CrossRef]
  8. Dweiri, F.; Kumar, S.; Khan, S.A.; Jain, V. Designing an integrated AHP based decision support system for supplier selection in automotive industry. Expert Syst. Appl. 2016, 62, 273–283. [Google Scholar] [CrossRef]
  9. Barbarosoglu, G.; Yazgac, T. An application of the analytic hierarchy process to the supplier selection problem. Prod. Inventory Manag. J. 1997, 38, 14–21. [Google Scholar]
  10. Sarkis, J.; Talluri, S. A model for strategic supplier selection. J. Supply Chain Manag. 2002, 38, 18–28. [Google Scholar] [CrossRef]
  11. Thompson, K.N. Vendor profile analysis. J. Purch. Mater. Manag. 1990, 26, 11–18. [Google Scholar] [CrossRef]
  12. Soesant, R.P.; Tripiawan, W.; Darmawan, I. Design of multicriteria decision making tools for IT project selection: A case from software house. In IOP Conference Series: Materials Science and Engineering; OIP Publishing Ltd.: East Java, Indonesia, 2020; Volume 847. [Google Scholar]
  13. Smytka, D.L.; Clemens, M.W. Total cost supplier selection model: A case study. Int. J. Purch. Mater. Manag. 1993, 29, 42–49. [Google Scholar] [CrossRef]
  14. Jadidi, O.; Firouzi, F.; Bagliery, E. TOPSIS method for supplier selection problem. Int. J. Econ. Manag. Eng. 2010, 4, 2198–2200. [Google Scholar]
  15. Kumar, S.; Kumar, S.; Barman, A.G. Supplier selection using fuzzy TOPSIS multi criteria model for a small-scale steel manufacturing unit. Procedia Comput. Sci. 2018, 133, 905–912. [Google Scholar] [CrossRef]
  16. Kıran, M.S.; Eşme, E.; Torğul, B.; Paksoy, T. Supplier selection with machine learning algorithms. In Logistics 4.0: Digital Transformation of Supply Chain Management; CRC Press: Boca Raton, FL, USA, 2020; pp. 103–125. [Google Scholar]
  17. Chaudhry, S.S.; Forst, F.G.; Zydiak, J.L. Vendor selection with price breaks. Eur. J. Oper. Res. 1993, 70, 52–66. [Google Scholar] [CrossRef]
  18. Hellwig, Z. Zastosowanie Metody Taksonomicznej Do Typologicznego Podziału Krajów Ze Względu Na Poziom Ich Rozwoju Oraz Zasoby i Strukturę Wykwalifikowanych Kadr [Application of the taxonomic method to the typological division of countries according to the level of their development and the resources and structure of qualified personnel]. Przegląd Stat. 1968, 4, 307–326. [Google Scholar]
  19. Modibbo, U.M.; Hassan, M.; Ahmed, A.; Ali, I. Multi-criteria decision analysis for pharmaceutical supplier selection problem using fuzzyTOPSIS. Manag. Decis. 2022, 60, 806–836. [Google Scholar] [CrossRef]
  20. Memari, A.; Dargi, A.; Akbari Jokar, M.R.; Ahmad, R.; Abdul Rahim, A.R. Sustainable supplier selection: A multi-criteria intuitionistic fuzzy TOPSIS method. J. Manuf. Syst. 2019, 50, 9–24. [Google Scholar] [CrossRef]
  21. Junior, F.R.L.; Osiro, L.; Carpinetti, L.C.R. A comparison between fuzzy AHP and fuzzy TOPSIS methods to supplier selection. Appl. Soft Comput. 2014, 21, 194–209. [Google Scholar] [CrossRef]
  22. Singh, R.K.; Gunasekaran, A.; Kumar, P. Third party logistics (3PL) selection for cold chain management: A fuzzy AHP and fuzzy TOPSIS approach. Ann. Oper. Res. 2018, 267, 531–553. [Google Scholar] [CrossRef]
  23. Yu, C.; Zou, Z.; Shao, Y.; Zhang, F. An integrated supplier selection approach incorporating decision maker’s risk attitude using ANN, AHP and TOPSIS methods. Kybernetes 2019, 49, 2263–2284. [Google Scholar] [CrossRef]
  24. Venkatesh, V.G.; Zhang, A.; Deakins, E.; Luthra, S.; Mangla, S. A fuzzy AHP-TOPSIS approach to supply partner selection in continuous aid humanitarian supply chains. Ann. Oper. Res. 2019, 283, 1517–1550. [Google Scholar] [CrossRef]
  25. Leong, W.Y.; Wong, K.Y.; Wong, W.P. A new integrated multi-criteria decision-making model for resilient supplier selection. Appl. Syst. Innov. 2022, 5, 8. [Google Scholar] [CrossRef]
  26. Luan, J.; Yao, Z.; Zhao, F.; Song, X. A novel method to solve supplier selection problem: Hybrid algorithm of genetic algorithm and ant colony optimization. Math. Comput. Simul. 2019, 156, 294–309. [Google Scholar] [CrossRef]
  27. Zakeri, S.; Chatterjee, P.; Cheikhrouhou, N.; Konstantas, D. Ranking based on optimal points and win-loss-draw multi-criteria decision-making with application to supplier evaluation problem. Expert Syst. Appl. 2020, 191, 116258. [Google Scholar] [CrossRef]
  28. Stević, Ž.; Pamučar, D.; Puška, A.; Chatterjee, P. Sustainable supplier selection in healthcare industries using a new MCDM method: Measurement of alternatives and ranking according to compromise solution (MARCOS). Comput. Ind. Eng. 2020, 140, 106231. [Google Scholar] [CrossRef]
  29. Sharm, P.; Phanden, R.K.; Baser, V. Analysis for site selection based on factors rating. Int. J. Emerg. Trends Eng. Dev. 2012, 2, 616–622. [Google Scholar]
  30. Rizana, A.F.; Soesanto, R.P. Design of decision support system application for determining scholarship grantee using analytical hierarchy process and factor rating. In Atlantis Highlights in Engineering, Proceedings of the 2018 International Conference on Industrial Enterprise and System Engineering; Atlantis Press: Amsterdam, The Netherlands, 2019. [Google Scholar]
  31. Awasthi, A.; Govindan, K.; Gold, S. Multi-tier sustainable global supplier selection using a fuzzy AHP-VIKOR based approach. Int. J. Prod. Econ. 2018, 195, 106–117. [Google Scholar] [CrossRef]
  32. Rajesh, R.; Ravi, V. Supplier selection in resilient supply chains: A Grey Relational Analysis approach. J. Clean. Prod. 2015, 86, 343–359. [Google Scholar] [CrossRef]
  33. Golmohammadi, D.; Mellat-Parast, M. Developing a grey-based decision-making model for supplier selection. Int. J. Prod. Econ. 2012, 137, 191–200. [Google Scholar] [CrossRef]
  34. Hashemi, H.; Karimi, A.; Tavana, M. An integrated green supplier selection approach with analytic network process and improved Grey relational analysis. Int. J. Prod. Econ. 2015, 159, 178–191. [Google Scholar] [CrossRef]
  35. Tsai, C.-M.; Lee, H.-S.; Gan, G.-Y. A new fuzzy DEA model for solving the MCDM problems in supplier selection. J. Mar. Sci. Technol. 2021, 29, 7. [Google Scholar] [CrossRef]
  36. Wang, C.-N.; Dang, T.-T.; Nguyen, N.-A.-T.; Wang, J.-W. A combined Data Envelopment Analysis (DEA) and Grey Based Multiple Criteria Decision Making (G-MCDM) for solar PV power plants site selection: A case study in Vietnam. Energy Rep. 2022, 8, 1124–1142. [Google Scholar] [CrossRef]
Figure 1. Membership function for supplier rating, R i j .
Figure 1. Membership function for supplier rating, R i j .
Systems 12 00191 g001
Table 1. The literature review.
Table 1. The literature review.
Research PaperSolution Method Type
AHPANPTOPSISVIKORFRLWMGRADEAMLAMPOM
Jadidi et al. [4] *
Ghodsypour and O’Brien [5]* *
Dweiri et al. [8]*
Barbarosoglu and Yazgac [9]*
Sarkis and Talluri [10] *
Thompson [11] *
Soesant et al. [12] *
Smytka and Clemens [13] *
Jadidi et al. [14] *
Kumar et al. [15] *
Kiran et al. [16] *
Chaudhry et al. [17] *
Modibbo et al. [19] *
Memari et al. [20] *
Junior et al. [21]* *
Singh et al. [22]* *
Yu et al. [23]* *
Venkatesh et al. [24]* *
Leong et al. [25] * * *
Luan et al. [26] *
Zakeri et al. [27] *
Stević et al. [28] *
Sharm et al. [29] *
Rizana and Soesanto [30] *
Awasthi et al. [31]* *
Rajesh and Ravi [32] *
Golmohammadi and Mellat-Parast [33] *
Hashemi et al. [34] * *
Tsai et al. [35] *
Wang et al. [36] **
Note: * indicates the solution method is used in the research paper.
Table 2. Scale of factor weights.
Table 2. Scale of factor weights.
LevelWeight, w
Very low0.00
Low0.25
Moderate0.50
High0.75
Very high1.00
Table 3. (a) Scale of supplier factor ratings for a factor with monotonic levels. (b) Scale of supplier factor ratings for a factor with non-monotonic levels.
Table 3. (a) Scale of supplier factor ratings for a factor with monotonic levels. (b) Scale of supplier factor ratings for a factor with non-monotonic levels.
(a)
LevelRating, R
Very poor0
Poor25
Medium50
Good75
Very good100
(b)
Sufficiency LevelRating, RExcessiveness Level
Extremely Insufficient0Extremely Excessive
Very Insufficient25Very Excessive
Moderately Insufficient50Moderately Excessive
Slightly Insufficient75Slightly Excessive
Optimal100Optimal
Table 4. Normalized factor weights.
Table 4. Normalized factor weights.
Factors Q 1 Q 2 Q 3 Q 4 Q 5 Q 6 Q 7 Q 8 Q 9 Q 10 Q 11 Q 12
N W i 0.1860.1320.1080.0430.0240.0020.1820.1260.0980.0670.0290.004
Table 5. Decision matrix D containing Rij values and each factor i’s j R i j .
Table 5. Decision matrix D containing Rij values and each factor i’s j R i j .
Factor S 1 S 2 S 3 S 4 S 5 S 6 S 7 j R i j
Q19.0010.009.008.0010.010.009.0065.00
Q253.0053.0084.022.0023.037.0019.00291.00
Q30.760.740.950.180.530.890.804.85
Q40.270.350.850.970.640.500.393.97
Q510.008.0010.08.008.008.008.0060.00
Q610.009.0012.07.007.0011.0012.0068.00
Q75.007.008.0018.0010.020.0013.0081.00
Q80.790.370.840.580.660.430.444.11
Q90.180.570.180.330.800.320.623.00
Q100.601.000.850.730.660.600.074.51
Q110.990.520.170.000.430.810.743.66
Q1227.0022.0033.048.0029.049.0038.00246.00
Note: The last column in Table 5 shows the sum of the suppliers’ ratings for each factor that is used in the next step to normalize the decision matrix.
Table 6. Converted normalized decision matrix, CND.
Table 6. Converted normalized decision matrix, CND.
Factor S 1 S 2 S 3 S 4 S 5 S 6 S 7
Q 1 0.1380.1540.1380.1230.1540.1540.138
Q 2 0.1820.1820.2890.0760.0790.1270.065
Q 3 0.1570.1530.1960.0370.1090.1840.165
Q 4 0.0680.0880.2140.2440.1610.1260.098
Q 5 0.1670.1330.1670.1330.1330.1330.133
Q 6 0.1470.1320.1760.1030.1030.1620.176
Q 7 0.1560.1520.1500.1300.1460.1260.140
Q 8 0.1350.1520.1330.1430.1400.1490.149
Q 9 0.1570.1350.1570.1480.1220.1490.132
Q 10 0.1440.1300.1350.1400.1420.1440.164
Q 11 0.1220.1430.1590.1670.1470.1300.133
Q 12 0.1480.1520.1440.1340.1470.1330.141
Table 7. Overall score and ranking of each supplier for the four methods.
Table 7. Overall score and ranking of each supplier for the four methods.
Methods S 1 S 2 S 3 S 4 S 5 S 6 S 7
MFR O j 0.1480.1500.1720.1220.1320.1440.133
MFR Ranking3217645
TOPSIS O j 0.6500.6110.7020.3150.4050.4090.436
TOPSIS Ranking2317654
FR O j 0.8140.8340.9160.7280.7940.8540.776
FR Ranking4317526
INOSIS Ranking2417635
Table 8. The best- and the worst-possible ratings.
Table 8. The best- and the worst-possible ratings.
Factor Q 1 Q 2 Q 3 Q 4 Q 5 Q 6 Q 7 Q 8 Q 9 Q 10 Q 11 Q 12
Best-possible rating10.084.00.950.9710.012.05.000.370.180.070.0022.0
Worst-possible rating8.0019.00.180.278.007.0020.00.840.801.000.9949.0
Table 9. The relative closeness, α i j , to the best-possible ratings.
Table 9. The relative closeness, α i j , to the best-possible ratings.
Factor S 1 S 2 S 3 S 4 S 5 S 6 S 7
Q10.500.000.501.000.000.000.50
Q20.480.480.000.950.940.721.00
Q30.250.270.001.000.550.080.19
Q41.000.890.170.000.470.670.83
Q50.001.000.001.001.001.001.00
Q60.400.600.001.001.000.200.00
Q70.000.130.200.870.331.000.53
Q80.890.001.000.450.620.130.15
Q90.000.630.000.241.000.230.71
Q100.571.000.840.710.630.570.00
Q111.000.530.170.000.430.820.75
Q120.190.000.410.960.261.000.59
Table 10. The suppliers’ weighted relative closeness scores.
Table 10. The suppliers’ weighted relative closeness scores.
Factor S 1 S 2 S 3 S 4 S 5 S 6 S 7
Q 1 0.090.000.090.190.000.000.09
Q 2 0.060.060.000.130.120.100.13
Q 3 0.030.030.000.110.060.010.02
Q 4 0.040.040.010.000.020.030.04
Q 5 0.000.020.000.020.020.020.02
Q 6 0.000.000.000.000.000.000.00
Q 7 0.000.020.040.160.060.180.10
Q 8 0.110.000.130.060.080.020.02
Q 9 0.000.060.000.020.100.020.07
Q 10 0.040.070.060.050.040.040.00
Q 11 0.030.020.000.000.010.020.02
Q 12 0.000.000.000.000.000.000.00
Table 11. Number of times each of the four methods is superior.
Table 11. Number of times each of the four methods is superior.
MFRTOPSISFRINOSIS
k = 117255713
k = 213404215
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Jadidi, O.; Firouzi, F.; Loucks, J.S. A Procedure for Choosing among Different Solutions to the Multi-Criteria Supplier Selection Problem along with Two Solution Methods. Systems 2024, 12, 191. https://doi.org/10.3390/systems12060191

AMA Style

Jadidi O, Firouzi F, Loucks JS. A Procedure for Choosing among Different Solutions to the Multi-Criteria Supplier Selection Problem along with Two Solution Methods. Systems. 2024; 12(6):191. https://doi.org/10.3390/systems12060191

Chicago/Turabian Style

Jadidi, Omid, Fatemeh Firouzi, and John S. Loucks. 2024. "A Procedure for Choosing among Different Solutions to the Multi-Criteria Supplier Selection Problem along with Two Solution Methods" Systems 12, no. 6: 191. https://doi.org/10.3390/systems12060191

APA Style

Jadidi, O., Firouzi, F., & Loucks, J. S. (2024). A Procedure for Choosing among Different Solutions to the Multi-Criteria Supplier Selection Problem along with Two Solution Methods. Systems, 12(6), 191. https://doi.org/10.3390/systems12060191

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop