Next Article in Journal
Distributed Fixed-Time Energy Management for Port Microgrid Considering Transmissive Efficiency
Next Article in Special Issue
Building Up of Fuzzy Evaluation Model of Life Performance Based on Type-II Censored Data
Previous Article in Journal
Can a Hand-Held 3D Scanner Capture Temperature-Induced Strain of Mortar Samples? Comparison between Experimental Measurements and Numerical Simulations
Previous Article in Special Issue
A Hybrid Fuzzy MCDM Approach to Open Innovation Partner Evaluation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessing Knowledge Quality Using Fuzzy MCDM Model

Ph.D. Program of Management, Chung Hua University, Hsinchu City 30012, Taiwan
*
Author to whom correspondence should be addressed.
Mathematics 2023, 11(17), 3673; https://doi.org/10.3390/math11173673
Submission received: 20 July 2023 / Revised: 21 August 2023 / Accepted: 23 August 2023 / Published: 25 August 2023

Abstract

:
The purpose of knowledge management is to excavate the tacit knowledge accumulated by each enterprise member through the knowledge proposal system. Each knowledge proposal must be assessed, and after passing the quality assessment, the knowledge proposal will be stored in the knowledge repository and shared with other employees who need the knowledge at work. In the long run, the capabilities of all employees will gradually enhance and the competitiveness of enterprises will naturally increase. The correct assessment of knowledge quality is the key to the success of knowledge management. Some scholars propose to use the AHP (analytical hierarchical process) to determine the quality of knowledge. The problem with this approach is that the AHP can only obtain the relative quality of all knowledge, not the actual quality of knowledge. Therefore, this study proposes a fuzzy assessment model to measure knowledge quality, which includes a knowledge quality fuzziness index (KQFI) and a checking gate. First, experts conduct linguistic evaluation on the weight of criteria and knowledge quality. All linguistic evaluations are then integrated into a knowledge quality fuzziness index (KQFI), which is compared with a fuzzy threshold (FT); then, the level of goodness of KQFI to FT is obtained. If it is greater than 0.5, it means that the quality of the knowledge proposal is qualified; otherwise, it means that the quality of the knowledge proposal is unqualified. This study uses a case including five experts and nine knowledge proposals to demonstrate the applicability of the method. The results show that the method finally judges six knowledge instances as qualified and three as unqualified. The results show that the proposed method can indeed assist enterprises to effectively screen knowledge proposals.

1. Introduction

Enterprises are facing stiff global competition, and the best way to effectively lead competitors is to develop new products, new services, and new business models [1]. One of the ways to achieve this goal is to promote knowledge management. First, establish a culture of knowledge sharing; then, collect, review, store, and reuse existing knowledge within the enterprise. Employees can socialize, externalize, combine, and internalizing existing knowledge to create new knowledge [2,3]. Enterprise knowledge includes tacit knowledge and explicit knowledge; each can be subdivided into personal knowledge and organizational knowledge [4,5]. Explicit organizational knowledge includes operating standards, procedures, and manuals. Tacit organizational knowledge refers to the knowledge that a group of people can effectively complete a project. Explicit personal knowledge includes notes and computer files. Tacit personal knowledge includes work experience, work skills, techniques, etc. Tacit organizational knowledge and tacit personal knowledge generally remain in the brains of individuals. Therefore, when personnel retire or leave the enterprise, this knowledge is permanently lost. Most importantly, tacit knowledge is the most critical knowledge that enterprises can win the competition. Therefore, enterprises must be equipped with knowledge management systems to preserve these tacit knowledge [6,7]. The method most often used to preserve tacit knowledge is to set up a knowledge community (community of practice) with a reward system to establish a collaborative work culture so that knowledge can be transferred from one person’s brain to another [8,9]. In this way, problems that only one person could solve in the past can now be solved by many people and everyone’s ability will gradually improve. When the company needs to cope with competition, the company’s personnel can quickly and effectively develop new products and new services to overcome challenges.
The community of practice must correspond to the strategy of the enterprise. For example, the enterprise hopes to establish independent product design and development capabilities; so, several related communities of practice can be established and each with a clear objective to achieve. Each community of practice has a management team and a process for receiving and reviewing knowledge proposals. Finally, people are encouraged to participate in communities of practice and rewards are offered for knowledge proposals. The knowledge proposals put forward by community members will be reviewed by senior personnel in related fields, and the knowledge that passes the review will be shared, published, and stored in the knowledge base. Obviously, if the judgment on the quality of knowledge is wrong, poorer knowledge will also pass the review; so, the overall ability of the enterprise will not be improved. On the contrary, if quality knowledge fails to pass the review all the time, after a period, the ability of the enterprise will become worse and worse.
The criteria of measuring knowledge quality in different fields may be different but most of them must be evaluated from multiple aspects at the same time. In the past, scholars mentioned that measuring knowledge quality should include correctness, completeness, consistency, relevance, etc. [10]. Some studies mentioned that measuring knowledge quality should include certainty, accuracy, and operability [11], while Arora et al. (2013) believed that measuring knowledge quality should include completeness, timeliness, accuracy, transparency, and relevancy [12]. The assessment of knowledge quality is a multi-attribute decision-making problem. In practice, when experts assess the quality of knowledge, they do not only make qualitative and subjective judgments; more importantly, it is difficult to make a completely correct quality judgment while considering multiple aspects at the same time. Further, academically, there have been very few papers on knowledge quality assessment in the past. The methods used mainly included the AHP and statistical analysis of questionnaires [10,13,14]. The problem with the AHP is that it is necessary to compare the relative importance of all knowledge proposals at the same time. When there are many knowledge proposals, it is difficult to know what is wrong with the large matrix obtained by pairwise comparison. If the consistency checks fail, the adjustment process will be very complicated, not to mention that the quality of knowledge should be an absolute judgment of good or bad rather than a comparison of relative good or bad. Moreover, most papers on statistical analysis of questionnaires discuss the impact of knowledge quality on corporate innovation and operational performance rather than measuring the quality of knowledge.
Obviously, a method that can correctly assess knowledge quality is nonexistent. In addition, it is difficult for humans to give specific numbers to measure the quality of knowledge. It is relatively easy to use fuzzy linguistic assessment of very good, good, fair, poor, and very poor to evaluate the quality of knowledge. Therefore, the objective of this study is to develop a multi-criteria knowledge quality assessment model, including a knowledge quality fuzziness index and a checking gate, to effectively determine the quality of knowledge proposals. This study can improve the shortcomings of existing methods, assist enterprises to screen out high-quality knowledge, and improve the performance of enterprise knowledge management.

2. Literature Review

This section reviews literature related to this study, including knowledge quality, and fuzzy set and group decision making.

2.1. Knowledge Quality

Quality is defined by the Oxford Dictionary as the degree of excellence of a thing; relative nature or kind or character of a thing; or class or grade of something determined by this [1]. Additionally, qualities need to be described using some attributes. For example, the quality of products is expressed in terms of functionality and reliability while the quality of services is measured in terms of responsiveness and empathy [15]. Enterprises determine the specifications of products and services, while quality is judged by customers. Enterprises usually use many methods to try to tap customers’ needs for products and services, and hope that products and services can meet customers’ requirements 100%. However, it has been proved in practice that this is almost an impossible task. For example, even for a company as large as Microsoft, the development of Windows Vista still cannot meet customer needs and is called the biggest failure of Microsoft ever [16]. Product development not only involves product-related knowledge but also involves marketing-related knowledge. Both must conform to the overall strategy of the enterprise, and the quality of knowledge must be accurately evaluated to ensure that the retained and stored knowledge can enhance the competitiveness of the enterprise [13,14].
Chakrabarti et al. (2018) proposed an approach to relate knowledge quality with elements that consist of attributes; thus, an enterprise can discover which element provides the most effective direction to improve knowledge quality [10]. Lim et al. (2013) examined the relationship between sentiment and quality of knowledge shared among knowledge workers and job performance [17]. It was indicated that data quality and information quality are often used to assess knowledge quality, and a reliable knowledge quality measure is nonexistent [11]. Zhou et al (2022) explored the impact of knowledge transfer among supply chain members on firm innovation and operational performance, and how knowledge quality affects the relationship between them [18]. Abdollahbeigi and Salehi (2021) found that the quality of knowledge significantly affects the innovation of enterprises, and the ability of innovation will have a significant impact on non-financial performance [19]. Ganguly et al. (2019) concluded that the transfer of tacit knowledge and the quality of knowledge are positively related to the innovation ability of enterprises [20]. Zhou et al. (2022) discovered that the knowledge quality of relational capital and cognitive capital positively affects product innovation performance but structural social capital does not affect the quality of knowledge [18,21]. From these past literatures, it can be found that up to now, no effective assessment method of knowledge quality has been proposed that can assist enterprises to correctly measure the quality of knowledge.

2.2. Fuzzy Set and Group Decision Making

Deterministic and quantifiable information with values between 0 and 1 are usually handled using classical set theory; however, when the information contains uncertainties that cannot be quantified, classical sets cannot be used. The evaluation of knowledge proposals is uncertain, and quantitative methods cannot be used to judge whether they meet the quality requirements. Therefore, classical set theory is not applicable. This situation where the value can vary continuously between zero and one is where fuzzy theory comes in handy. Fuzzy theory uses membership functions to express the degree of membership between components and sets. A fuzzy set A can be expressed as Equation (1).
A = ( x , μ A ( x ) ) x X
where X is a universe of discourse and μA(x) indicates the degree of membership between component x and fuzzy set A.
Because the triangular fuzzy function has been proven to be very suitable for dealing with the imprecision and uncertainty of the multi-criteria decision-making process [12], this study uses the triangular fuzzy function to evaluate the attribute weight and knowledge quality. Let triangular fuzzy number A = ( a , b , c ) ; then, the membership function of A can be expressed as Equation (2) [22,23,24].
μ A = ( x a ) ( b a ) a x b ( c x ) ( c b ) b x c 0 o t h e r w i s e
The α - cut is applied to convert a fuzzy number into a crisp set, and the α - cut of a triangular fuzzy number A can be described as Equation (3), where A α is a crisp set [25,26].
A α = x μ A ( x ) α α 0 , 1
The confidence of interval α - level of A α can be described as Equation (4), and A α implies the confidence level of a decision maker in the evaluation outcome.
A = ( b a ) α + a , c ( c b ) α
Chen (2000) indicated that precise quantified information and solving real problems are not necessarily relevant [22]. Li et al. (2022) pointed out that linguistic variables can be used in fuzzy theory to manipulate the operations [27]. When assessors judge the importance of the criteria using fuzzy method, the linguistic variables can be converted into a fuzzy number and results can be obtained using fuzzy algebra [28]. For instance, the linguistic variables of very good, good, fair, poor, and very poor in Table 1 can be used to assess the quality of the knowledge proposal, and the assessment of a knowledge proposal can be obtained using the triangular fuzzy number (TFN).
Because the measurement of knowledge quality involves imprecise information that cannot be quantified, and the quality of knowledge must be evaluated by a group of experts and several attributes at the same time, it is suitable to use the fuzzy multi-criteria group decision making method [29]. Past studies mostly used the average value as the final group decision [26,30,31,32,33]; however, average of opinion cannot accurately reflect the overall judgment. Therefore, Hsu and Chen proposed a similarity aggregation method (SAM) [34,35], and Lee developed an optimal aggregation method (OAM), to help obtain the consistence of fuzzy opinion [1,36]. Because OAM is an effective method for integrating expert opinions, this study adopts OAM to consolidate the opinions of experts. The steps of OAM can be described as below:
(1)
Let the fuzzy number of the expert’s opinion of A and B be A ˜ = ( a 1 , a 2 , a 3 ) and B ˜ = ( b 1 , b 2 , b 3 ) ; then, the distance between A ˜ and B ˜ can be computed using Equation (5), and the similarity between A ˜ and B ˜ can be obtained using Equation (6).
d 2 ( A ˜ , B ˜ ) = i = 1 3 ( a i b i ) 2
S 2 ( A ˜ , B ˜ ) = 1 ( d 2 ( A ˜ , B ˜ ) ) 2 4 u 2
where u = max ( U ) min ( U ) , U is the universe of discourse, and 0 S 2 ( A ˜ , B ˜ ) 1 .
(2)
Set the initial aggregated weight as the weight of the first expert. 0 < w i ( 0 ) < 1 and i = 1 n w i ( 0 ) = 1 , i = 1 , 2 , , n , n is the number of criteria, and iteration l = 0 ,   1 ,   2 ,   .
i = 1 n w i l = 1
(3)
Compute aggregated opinion using Equation (8); R ˜ i is the ith expert’s individual opinion.
R ˜ ( l + 1 ) = i = 1 n ( w i ( l ) ) m R ˜ i i = 1 n ( w i ( l ) ) m , where   m   is an exponential weight .
(4)
Let aggregated weight W ( l ) = ( w 1 ( l ) , w 2 ( l ) , , w n ( l ) ) , and compute W ( l + 1 ) using Equation (9).
w i ( l + 1 ) = 1 ( c S 2 ( R ˜ i , R ˜ ( l + 1 ) ) ) 1 m 1 j = 1 n 1 ( c S 2 ( R ˜ j , R ˜ ( l + 1 ) ) ) 1 m 1 , where   c   is an integer constant .
(5)
If W ( l + 1 ) W ( l ) ε , stop; otherwise, l = l + 1 , go to Step (3).
In terms of literature on multi-criteria decision-making (MCDM), Stojčić et al. (2019) reviewed the application of MCDM methods in sustainable engineering. From a review of 108 related literatures from 2008 to 2018, they found that MCDM methods are very suitable for sustainable engineering [37]. Zavadskas et al. (2014) also reviewed the relevant literature on MCDM and believed that there is a need for research to compare the strengths and weaknesses of different decision-making methods [38]. Jamwal et al. (2021) explored how MCDM methods were applied in sustainable manufacturing and found that most of the methods used are based on fuzzy theory [39]. Kumar et al. (2017) developed an insight into various MCDM methods, and the application progress in renewable energy and prospects [40].
From past fuzzy theory literature and knowledge management literature, no papers have been found that use fuzzy MCDM to measure the quality of knowledge; thus, this study should be the latest attempt.

3. Model Formulation

This section describes the proposed method, including knowledge quality fuzziness index, fuzzy gate selection, and implementation procedures.

3.1. Knowledge Quality Fuzziness Index

Based on the fuzzy weight average (FWA) method [30,31,32,41,42,43,44,45], this study proposes a knowledge quality fuzziness index (KQFI) to help make the Go/No go decision of the knowledge proposal. KQFI can be described as Equation (10), where r i and w i are the fuzzy assessment and fuzzy weight of the knowledge proposal, respectively, and i denotes the criteria for evaluating the knowledge proposal.
K Q F I = i = 1 n ( r i w i ) i = 1 n w i
Because the computation of FWA can reach O ( n   log   n ) [35,46], Kao and Liu proposed a fractional programming approach (FPA) to solve the above problem [47]. Conducting α-cut to r i and w i of KQFI produces ( r i ) α   =   [ ( r i ) α L   ,   ( r i ) α U ] and ( w i ) α   =   [ ( w i ) α L   ,   ( w i ) α U ] , and let t = 1 i = 1 n w i and v i = t w i ; then, the membership function of KOFI can be obtained using Equations (11) and (12) by employing different values of α-cut.
K Q F I α L = M i n i = 1 n v i ( r i ) α L s . t .                   t ( w i ) α L v i t ( w i ) α U i = 1 n v i = 1 t 0
K Q F I α U = M a x i = 1 n v i ( r i ) α U s . t .                 t ( w i ) α L v i t ( w i ) α U i = 1 n v i = 1 t 0
For example, a triangular membership function (0.42, 0.57, 0.69) of KQFI is obtained by solving Equations (11) and (12) at α-cut = 0 and α-cut = 1. When α-cut = 0, one can obtain K Q F I α L = 0.42 and K Q F I α U = 0.69; when α-cut = 1, one can obtain K Q F I α L = 0.57 and K Q F I α U = 0.57.

3.2. Fuzzy Gate Selection

Based on previous researches [48,49,50,51,52], this study proposes a checking gate to screen the knowledge proposals (see Figure 1). Enterprises can choose a fuzzy threshold (FT) according to strategic objectives, and FT is used to decide if a knowledge proposal meets the minimum quality level. Figure 1 shows that the farther the FT is to the right, the higher the standard for reviewing knowledge quality. The dotted line in the figure represents FT.
The procedure for making the Go/No go decision of a knowledge proposal is listed as below:
(a)
Compute fuzzy preference z based on Equation (13).
(b)
Conduct α -cut to z and obtain z α l < 0 and z α u > 0 as in Figure 2 and Equation (14).
(c)
Compute the level of goodness e K F T of KQFI to FT using Equations (15) and (16); if e K F T > 0.5 , then the knowledge proposal is qualified and accepted.
z = K Q F I F T
z a = z α l , z α u
e K F T = S 1 S 1 + S 2
where   S 1 = x > 0 μ z ˜ ( x ) d x ,   S 2 = x < 0 μ z ˜ ( x ) d x

3.3. Implementation Procedures

The flowchart of the proposed model is depicted in Figure 3, and the implementation procedures are described as below:
  • The expert penal receives the knowledge proposal and decides the assessment criteria, the linguistic variables, and the fuzzy number.
  • Experts assess the criteria weight and quality performance of knowledge proposals, and obtain the consensus of the expert decision.
  • Obtain the membership function of the KQFI for each knowledge proposal.
  • Specify the FT value according to enterprise strategic objectives.
  • Compute fuzzy preference z and level of goodness e K F T , and make a Go/No go decision for each knowledge proposal.

3.4. Size of Expert Panel

Past studies did not agree on the number of group decision-making experts. Lynn (1986) believed that 5 experts was enough to produce good judgments, and even as few as 3 experts was possible [4]. Hashmi et al. (2023) mentioned that the optimal number is 5 to 7 people [53]. Emmerling and Rooders (2022) believed that the number of experts should be controlled at 3 to 5 [54]. Axtell (2018) researched that the optimal number of participants in a meeting is 8 people [55,56]. From the above research, it can be found that the number of people making group decisions is between 3 and 8 people. Therefore, this study uses five experts to measure the quality of knowledge proposals.

4. Case Implementation

This section uses an example to demonstrate the applicability of the proposed model. The knowledge assessment expert panel of a company wants to select qualified knowledge from nine knowledge proposals, and the detailed steps are as follows:
  • The expert panel composed of five experts receives nine knowledge proposals; decides the assessment criteria of knowledge quality as (1) originality (A1), (2) applicability (A2), (3) practicality (A3), (4) value (A4), and (5) uniqueness (A5); and uses linguistic variables of very good, good, fair, poor, and very poor, and the triangular fuzzy number listed in Table 1, to assess the criteria weight and knowledge quality.
  • Experts assess the criteria weight and quality performance of knowledge proposals (Table 2) and obtain the consensus of the expert opinion. D1 to D5 indicate experts and K1 to K9 represent knowledge proposals in Table 2. The consensus of the expert decision is described below.
    A1, K8 (Table 2), and Table 1 are used to obtain the consensus of the expert opinion.
    (i)
    Let c = 1.5, m = 2, and u = max ( U ) min ( U ) = 0.7 , where the initial aggregated weight is set as the weight of the first expert, i.e., W ( 0 ) = ( 1 , 0 , 0 , 0 , 0 ) . Then, the aggregated opinion R ˜ ( 1 ) can be obtained using Equation (8), and R ˜ i is the opinion of an individual expert.
    R ˜ ( 1 ) = i = 1 5 ( w i ) 2 R ˜ i i = 1 5 ( w i ) 2 = W ( 1 ) ( 0 ) R ˜ 1 + W ( 2 ) ( 0 ) R ˜ 2 + W ( 3 ) ( 0 ) R ˜ 3 + W ( 4 ) ( 0 ) R ˜ 4 + W ( 5 ) ( 0 ) R ˜ 5 = 1 M + 0 M + 0 MG + 0 M + 0 MG = 1 ( 0.3 , 0.5 , 0.7 ) + 0 ( 0.3 , 0.5 , 0.7 ) + 0 ( 0.5 , 0.7 , 0.9 ) + 0 ( 0.3 , 0.5 , 0.7 ) + 0 ( 0.5 , 0.7 , 0.9 ) = ( 0.3 , 0.5 , 0.7 )
    (ii)
    The similarity between the individual R ~ i and the aggregated R ~ ( 1 ) are computed using Equation (6), where u = 0.7.
    S 2 ( R ˜ 1 , R ˜ ( 1 ) ) = 1 ( d 2 ( R ˜ 1 , R ˜ ( 1 ) ) ) 2 4 u 2 S 2 ( R ˜ 2 , R ˜ ( 1 ) ) = 1 ( d 2 ( R ˜ 2 , R ˜ ( 1 ) ) ) 2 4 u 2 S 2 ( R ˜ 3 , R ˜ ( 1 ) ) = 1 ( d 2 ( R ˜ 3 , R ˜ ( 1 ) ) ) 2 4 u 2 S 2 ( R ˜ 4 , R ˜ ( 1 ) ) = 1 ( d 2 ( R ˜ 4 , R ˜ ( 1 ) ) ) 2 4 u 2 S 2 ( R ˜ 5 , R ˜ ( 1 ) ) = 1 ( d 2 ( R ˜ 5 , R ˜ ( 1 ) ) ) 2 4 u 2
    (iii)
    The new aggregated weight can be computed using Equation (9) and obtained as
    W ( 1 ) = ( 0.2864 , 0.2864 , 0.1811 , 0.2462 , 0.2864 ) . W ( l ) = ( w 1 ( l ) , w 2 ( l ) , , w n ( l ) ) and w 1 ( 1 ) can be computed as below:
    w 1 ( 1 ) = 1 ( 1.5 S 2 ( R ˜ 1 , R ˜ ( 1 ) ) ) 1 2 1 j = 1 n 1 ( 1.5 S 2 ( R ˜ j , R ˜ ( 1 ) ) ) 1 2 1 , c = 1.5 , m = 2
    (iv)
    The new aggregated opinion can be computed using Equation (8) as below:
    R ˜ ( 2 ) = i = 1 n ( w i ( 1 ) ) m R ˜ i i = 1 n ( w i ( 1 ) ) m = i = 1 n ( w i ( 1 ) ) 2 R ˜ i i = 1 n ( w i ( 1 ) ) 2 , m = 2 ,
    R ˜ ( 2 ) can be obtained as ( 0.4583 , 0.6583 , 0.6583 , 0.8444 ) .
    (v)
    Repeat the above steps, the consensus of the fuzzy weight of A1 can be obtained, and it will converge to (0.4334, 0.6334, 0.6334, 0.8144) (Table 3) at l = 8 , meaning that the consensus of the experts toward the criteria has been reached. Table 4 lists the results.
  • Obtain the membership function of KQFI1 to KQFI9 using Equations (11) and (12) at different values of α-cut. The results are listed in Table 5.
  • Specify FT value as (0.5, 0.6, 0.7) according to the enterprise strategic objectives.
  • Compute fuzzy preference z and level of goodness e K F T using Equations (13) and (15); KQFI8 is demonstrated at α - cut = 0.5 in Figure 4, and the values of z, z 0.5 , and Go/No go decisions are listed in Table 5. The level of goodness e K F T of knowledge K6, K7, and K8 are less than 0.5; therefore, they are rejected.

4.1. Summary

This section summarizes the method proposed in this study as follows: (1) Experts assign weights to the criteria and evaluate the quality of knowledge proposal based on the fuzzy linguistic scale. (2) Aggregate the weights and evaluations, including (a) setting the initial integrated weight, (b) computing the aggregated evaluation, (c) computing the similarity between the individual evaluation and the integrated evaluation, (d) computing the new integrated weight according to the similarity, (e) computing the new integrated evaluation based on the integrated weight, and repeating these steps until the integrated weight and the integrated evaluation converge to one unchanged state. (3) Use the integrated weight and integrated evaluation to find the fuzzy membership function of KQFI. (4) Compute z = KQFIFT (fuzzy threshold). (5) Obtain S1 and S2 according to the z membership function; then, calculate e K F T . If e K F T > 0.5, it indicates that the knowledge proposal is qualified; otherwise, it is not qualified.
The whole process described above can be computerized and combined with the existing knowledge management system of the enterprise; every time the system receives a new knowledge proposal, it will notify the experts to evaluate the knowledge proposal. Experts only need to conduct linguistic fuzzy evaluation on the weight and knowledge quality. The rest can be completed by the computer, because the fuzzy threshold can be set in advance; the system will finally make a qualified or unqualified judgment on the knowledge proposal, and the qualified knowledge proposal will be automatically stored in the knowledge repository so that the burden on personnel can be greatly reduced and the efficiency of the knowledge management system can be significantly improved.

4.2. Comparisons with Past Method

In the past, one scholar used the AHP to measure the quality of knowledge [10]. Therefore, this section compares the proposed fuzzy method with the AHP method. Table 6 shows the results of the comparison. It can be seen from the table that both methods need to form an expert panel and both need to decide the criteria of knowledge quality. To measure the weight of criteria, this research invites experts to directly conduct intuitive fuzzy linguistic assessments while AHP requires a pairwise comparison of criteria. Pairwise comparisons can easily lead to inconsistent importance. When there are many criteria, the adjustments can be challenging. Furthermore, for the evaluation of knowledge proposals, the proposed method asks experts to evaluate the quality of knowledge proposals one by one according to the criteria, while AHP needs to conduct pairwise evaluation of all knowledge proposals for each criterion. Relative comparisons, therefore, will produce inconsistencies. Most importantly, the proposed method directly evaluates the quality of each knowledge and, thus, obtains absolute knowledge quality while AHP makes an indirect relative comparison and obtains relative knowledge quality. The problem with the quality of relative knowledge is that knowledge may not be very useful; in fact, because other knowledge is worse, it is considered relatively good knowledge, which may not help the enterprise at all in the long run. Finally, this study has a very clear Go/No checking threshold. Knowledge above the threshold is qualified knowledge. On the contrary, AHP has no qualified judgment threshold. Therefore, how to screen out relatively high-quality knowledge from the comparison results in the end is a difficult task because the relative ranking of knowledge does not represent the quality of knowledge. Based on the above comparison, one can find that the proposed method can indeed measure the knowledge quality of enterprises more accurately than AHP.

5. Conclusions

Knowledge management has been proven to be an effective management method for enterprises to enhance core capabilities, and one of the important tasks is to screen quality knowledge into the knowledge repository. Current industrial and academic methods cannot ensure that quality knowledge is screened out. This study proposes a multi-attribute fuzzy group decision-making model, which can effectively integrate the opinions of experts into a knowledge quality fuzziness index and then compare it with the fuzzy threshold set by the enterprise; finally, it can discover whether the quality of knowledge meets the enterprise quality threshold. There have been very few studies on measuring knowledge quality in the literature. The contribution of this study is twofold. First, this study can fill the academic research gap. Secondly, the systematic method of this study can assist enterprises to screen out genuine quality knowledge, directly promote the success of knowledge management, and improve the innovation ability and business performance of enterprises. The implication of this study to management practice is that the quality of knowledge proposals is the key to whether an enterprise can promote its competitiveness, and the correct knowledge evaluation method must be adopted in order to allow the enterprise’s knowledge repository to accumulate knowledge that can truly enhance core competencies.
Finally, this study uses the triangular fuzzy function to measure the criteria weight and knowledge quality; however, it cannot be determined whether it is the best choice. Subsequent research can use other fuzzy membership functions to verify and compare the results.

Author Contributions

Conceptualization, C.-C.W. Methodology, S.-C.L.; Validation, M.-L.C.; Supervision, C.-C.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

All data used for this research are available in the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Liu, W.; Wang, Y.; Li, L. Research on the optimal aggregation method of judgment matrices based on spatial steiner-weber point. J. Syst. Sci. Complex. 2023, 36, 1228–1249. [Google Scholar] [CrossRef]
  2. Ko, A.; Vas, R.; Kovacs, T.; Szabo, I. Knowledge Creation from the perspective of the supply chain, the role of ICT. Soc. Econ. 2019, 41, 311–329. [Google Scholar]
  3. Nonaka, I. A Dynamic Theory of Organizational Knowledge Creation; Institute of Business Research, Hitotsubashi University: Kunitachi, Japan, 1994; pp. 14–37. [Google Scholar]
  4. Lynn, M.R. Determination and quantification of content validity. Nurs. Res. 1986, 35, 382–386. [Google Scholar] [CrossRef]
  5. Mohajan, H.K. The impact of knowledge management models for the development of organizations. J. Environ. Treat. Tech. 2017, 5, 12–33. [Google Scholar]
  6. Chen, W.; Tan, J.S.H.; Pi, Z. The spiral model of collaborative knowledge improvement: An exploratory study of a networked collaborative classroom. Int. J. Comput. Support. Collab. Learn. 2021, 16, 7–35. [Google Scholar] [CrossRef]
  7. Spangler, S.C.; Skovira, R.J.; Kohun, F.G. Key factors in a successful knowledge management model. Online J. Appl. Knowl. Manag. 2015, 3, 51–60. [Google Scholar]
  8. Aljuwaiber, A. Communities of practice as an initiative for knowledge sharing in business organizations: A literature review. J. Knowl. Manag. 2016, 20, 731–748. [Google Scholar] [CrossRef]
  9. Choi, H.J.; Ahn, J.C.; Jung, S.H.; Kim, J.H. Communities of practice and knowledge management systems: Effects on knowledge management activities and innovation performance. Knowl. Manag. Res. Pract. 2020, 18, 53–68. [Google Scholar] [CrossRef]
  10. Chakrabarti, D.; Arora, M.; Sharma, P. Evaluating knowledge quality in knowledge management systems. J. Stat. Appl. Probab. 2018, 7, 75–84. [Google Scholar] [CrossRef]
  11. Waheed, M.; Kaur, K. Knowledge quality: A review and a revised conceptual model. Inf. Dev. 2016, 32, 271–284. [Google Scholar] [CrossRef]
  12. Arora, M.; Chakrabarti, D. Knowledge Quality Assessment in Knowledge Management Systems. Int. J. Knowl. Manag. Pract. 2014, 2, 1. [Google Scholar]
  13. Xiang, Y.D.; Zhang, P.Z.; Wu, S. Content-based knowledge quality assessment and its application in health management system. J. Shanghai Jiaotong Univ. 2021, 26, 116–128. [Google Scholar] [CrossRef]
  14. Yoo, D.K.; Vonderembse, M.A.; Ragu-Nathan, T.S. Knowledge quality: Antecedents and consequence in project teams. J. Knowl. Manag. 2011, 15, 329–343. [Google Scholar]
  15. Leonardo, M.A.; Szczerbicki, E.; Sanín, C. A proposal for a knowledge market based on quantity and quality of knowledge. Cybern. Syst. 2013, 44, 118–132. [Google Scholar]
  16. Krishnaraj, N. Windows Vista: Why did it fail? TechTalkers, 22 June 2020. [Google Scholar]
  17. Lim, R.A.; Siew Lee, H.A.; Lim, T.M. A Study on Knowledge Quality and Job Performance of Knowledge Workers by Analyzing Content of Social Network Sites Using Sentiment Network Analysis. Inf. Manag. Bus. Rev. 2013, 5, 525–530. [Google Scholar]
  18. Zhou, X.; Min, M.; Zhang, Z. Research on the social capital, knowledge quality and product innovation performance of knowledge-intensive firms in China. Front. Psychol. 2022, 13, 946062. [Google Scholar] [CrossRef] [PubMed]
  19. Abdollahbeigi, B.; Salehi, F. Knowledge quality and non-financial performance-A Malaysian experience. Knowl. Process Manag. 2021, 29, 12–22. [Google Scholar] [CrossRef]
  20. Ganguly, A.; Talukdar, A.; Chatterjee, D. Evaluating the role of social capital, tacit knowledge sharing, knowledge quality and reciprocity in determining innovation capability of an organization. J. Knowl. Manag. 2019, 23, 1105–1135. [Google Scholar] [CrossRef]
  21. Zubielqui, G.; Lindsay, N.; Lindsay, W. Knowledge quality, innovation and firm performance: A study of knowledge transfer in SMEs. Small Bus. Econ. 2019, 53, 145–164. [Google Scholar] [CrossRef]
  22. Chen, C.T. Extensions of the TOPIS for group decision-making under fuzzy environment. Fuzzy Sets Syst. 2000, 114, 1–9. [Google Scholar] [CrossRef]
  23. Clement, A.M.; Bharatraj, J. Theory of triangular fuzzy number. In Proceedings of the National Conference on Advanced Trends in Mathematics, Tamil Nadu, India, 27 March 2017. [Google Scholar]
  24. Sudha, T.; Jayalalitha, G. Fuzzy triangular numbers in—Sierpinski triangle and right-angle triangle. J. Phys. Conf. Ser. 2022, 1597. [Google Scholar] [CrossRef]
  25. Tamilmani, C. Arithmetic operation of fuzzy numbers using A-cut method. Int. J. Innov. Sci. Eng. Technol. 2015, 2, 299–315. [Google Scholar]
  26. Zhang, G.; Lu, J. An integrated group decision-making method dealing with fuzzy preference for alternatives and individual judgments for selection criteria. Group Decis. Negot. 2003, 12, 501–515. [Google Scholar] [CrossRef]
  27. Li, H.L.; Yang, J.Q.; Xiang, Z.Q. A fuzzy linguistic multi-criteria decision-making approach to assess emergency suppliers. Sustainability 2022, 14, 13114. [Google Scholar] [CrossRef]
  28. Kukkurainen, P. Fuzzy logic and Zadeh algebra. Adv. Pure Math. 2017, 7, 350–365. [Google Scholar] [CrossRef]
  29. Efe, B. An integrated fuzzy multi criteria group decision making approach for ERP system selection. Appl. Soft Comput. 2016, 38, 106–117. [Google Scholar] [CrossRef]
  30. Lin, C.; Tan, B.; Hsieh, P.J. Application of the fuzzy weighted average in strategic portfolio management. Decis. Sci. 2005, 36, 489–510. [Google Scholar] [CrossRef]
  31. Pavlacka, O.; Pavlackova, M.; Hetflei, V. Fuzzy weighted average as a fuzzified aggregation operator and its properties. Kybernetika 2017, 53, 137–160. [Google Scholar] [CrossRef]
  32. Pavlacka, O.; Pavlackova, M. On the properties of the fuzzy weighted average of fuzzy numbers with normalized fuzzy weights. Iran. J. Fuzzy Syst. 2021, 18, 1–17. [Google Scholar]
  33. Wang, R.C.; Chu, S.J. Group decision-making using a fuzzy linguistic approach for evaluating the flexibility in a manufacturing system. Eur. J. Oper. Res. 2004, 154, 563–572. [Google Scholar] [CrossRef]
  34. Kaushik, M.; Kumar, M. Distance and similarity-based aggregation method in intuitionistic fuzzy fault tree analysis. SSRN 2023. [Google Scholar] [CrossRef]
  35. Lee, D.H.; Park, D. An efficient algorithm for fuzzy weight average. Fuzzy Sets Syst. 1997, 87, 39–45. [Google Scholar] [CrossRef]
  36. Lee, H.S. Optimal consensus of fuzzy opinions under group decision making environment. Fuzzy Sets Syst. 2002, 132, 303–315. [Google Scholar] [CrossRef]
  37. Stojčić, M.; Zavadskas, E.K.; Pamučar, D.; Stević, Ž.; Mardani, A. Application of MCDM Methods in Sustainability Engineering: A Literature Review 2008–2018. Symmetry 2019, 11, 350. [Google Scholar] [CrossRef]
  38. Zavadskas, E.K.; Turskis, Z.; Kildienė, S. State of art surveys of overviews on MCDM/MADM methods. Technol. Econ. Dev. Econ. 2014, 20, 165–179. [Google Scholar] [CrossRef]
  39. Jamwal, A.; Agrawal, R.; Sharma, M.; Kumar, V. Review on multi-criteria decision analysis in sustainable manufacturing decision making. Int. J. Sustain. Eng. 2021, 14, 202–225. [Google Scholar] [CrossRef]
  40. Kumar, A.; Sah, B.; Singh, A.R.; Deng, Y.; He, X.N.; Kumar, P.; Bansal, R.C. A review of multi criteria decision making (MCDM) towards sustainable renewable energy development. Renew. Sustain. Energy Rev. 2017, 69, 596–609. [Google Scholar] [CrossRef]
  41. Chang, P.T.; Hung, K.C. Applying the fuzzy-weighted-average approach to evaluate network security systems. Comput. Math. Appl. 2005, 49, 1797–1814. [Google Scholar] [CrossRef]
  42. Leonardo, M.A.; Sanín, C.; Szczerbicki, E. Quality assessment of experiential knowledge. Cybern. Syst. 2012, 43, 96–113. [Google Scholar]
  43. Lin, C.; Hsieh, P.J. A fuzzy decision support system for strategic portfolio management. Decis. Support Syst. 2004, 38, 383–398. [Google Scholar] [CrossRef]
  44. Lin, C.T.; Chen, C.T. Bid/no-bid decision-making—A fuzzy linguistic approach. Int. J. Proj. Manag. 2004, 22, 585–593. [Google Scholar] [CrossRef]
  45. Verma, R.; Sharma, B. Intuitionistic fuzzy Einstein prioritized weighted average operators and their application to multiple attribute group decision making. Appl. Math. Inf. Sci. 2015, 9, 3095–3107. [Google Scholar]
  46. Dong, W.M.; Wong, F.S. Fuzzy weighted averages and implementation of the extension principle. Fuzzy Sets Syst. 1987, 21, 183–199. [Google Scholar] [CrossRef]
  47. Kao, C.; Liu, S.T. Fractional programming approach to fuzzy weighted average. Fuzzy Sets Syst. 2001, 120, 435–444. [Google Scholar] [CrossRef]
  48. Cheng, S.L.; Kuan, Y.W. A fuzzy logic-based knowledge management performance measurement system for SMEs. Cybern. Syst. 2017, 48, 277–302. [Google Scholar]
  49. Cheng, C.H.; Lin, Y. Evaluating the main battle tank using fuzzy decision theory with linguistic criteria evaluation. Eur. J. Oper. Res. 2002, 142, 174–186. [Google Scholar] [CrossRef]
  50. Chu, P.V. A decision support for project portfolio selection. Comput. Ind. 1996, 32, 141–149. [Google Scholar] [CrossRef]
  51. Fan, Z.P. An approach to multiple attribute decision making based on fuzzy preference information on alternative. Fuzzy Sets Syst. 2002, 131, 101–106. [Google Scholar] [CrossRef]
  52. Hsu, H.M.; Chen, C.T. Aggregation of fuzzy opinions under group decision making. Fuzzy Sets Syst. 1996, 79, 279–285. [Google Scholar]
  53. Hashmi, N.; Shankaranarayanan, G.; Malone, T.W. Is bigger better? A study of the effect of group size on collective intelligence in online groups. Decis. Support Syst. 2023, 167, 113914. [Google Scholar] [CrossRef]
  54. Emmerling, T.; Rooders, D. 7 strategies for better group decision-making. Harvard Business Review, 22 September 2022. [Google Scholar]
  55. Axtell, P. The most productive meetings have fewer than 8 people. Harvard Business Review, 22 June 2018. [Google Scholar]
  56. Taylor, E. We Agree, Don’t We? The Delphi method for health environments research. Health Environ. Res. Des. J. 2020, 13, 11–23. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Checking gate.
Figure 1. Checking gate.
Mathematics 11 03673 g001
Figure 2. e K F T .
Figure 2. e K F T .
Mathematics 11 03673 g002
Figure 3. Flowchart of the proposed model.
Figure 3. Flowchart of the proposed model.
Mathematics 11 03673 g003
Figure 4. The e K F T of knowledge proposal K8 ( α - cut = 0.5 ).
Figure 4. The e K F T of knowledge proposal K8 ( α - cut = 0.5 ).
Mathematics 11 03673 g004
Table 1. Weight, quality, and TFN of knowledge proposal.
Table 1. Weight, quality, and TFN of knowledge proposal.
WeightQualityTFN
VL (Very low)VP (Very poor)(0, 0, 0.1)
L (Low)P (Poor)(0, 0.1, 0.3)
ML (Medium low)MP (Medium poor)(0.1, 0.3, 0.5)
M (Medium)M (Medium)(0.3, 0.5, 0.7)
MH (Medium high)MG (Medium good)(0.5, 0.7, 0.9)
H (High)G (Good)(0.7, 0.9, 1.0)
VH (Very high)VG (Very good)(0.9, 1.0, 1.0)
Table 2. Criteria weight and fuzzy assessment of knowledge proposal.
Table 2. Criteria weight and fuzzy assessment of knowledge proposal.
ExpertD1D2W
D3
D4D5D1D2K1
D3
D4D5D1D2K2
D3
D4D5D1D2K3
D3
D4D5D1D2K4
D3
D4D5
Criteria
A1MMHMHMGVGGMGMGGMMGMMGMMPMMGMGVGMGMGMG
A2MHMHVHMHGGMMGGGMGGGMMVGVGGMGMGMMG
A3HVHMHHHGGMGMGGGMMMGGMGGMGGMGGMMGG
A4MHMHHMGGGMGGGGGMGMGMMGMGMGMGGGMGG
A5MHMHHMMPMGMMGMMMGMGMGMMMGMGMGMGMGMGGMG
ExpertD1D2K5
D3
D4D5D1D2K6
D3
D4D5D1D2K7
D3
D4D5D1D2K8
D3
D4D5D1D2K9
D3
D4D5
Criteria
A1MMMGGMGGGMGMGMPMMMMGMMMGMMGGMMGMMG
A2MMMGMGMMMGGMPMGMGMGGMGMGMGGGMGM
A3GGMGMMGMMPMMGGMGMGMGMMGMMMGMMGMMM
A4MPMGMGMMMPMMGMGMMGMGMGGMPMMMGMPMMMGM
A5MGMGMGGMGMMGMGMGMMMMMGGMGMPGMMMMGMGMGM
Table 3. Consensus of criteria A1.
Table 3. Consensus of criteria A1.
l W ( l ) R ( l + 1 )
0100000.30000.50000.50000.7000
10.28650.28650.18120.24630.28650.39810.59810.59810.7854
20.26510.26510.20730.26300.26500.42280.62280.62280.8058
30.25920.25920.21520.26680.25910.43020.63020.63020.8118
40.25740.25740.21760.26790.25730.43240.63240.63240.8134
50.25690.25690.21840.26820.25680.43310.63310.63310.8141
60.25670.25670.21860.26830.25660.43330.63330.63330.8143
70.25670.25670.21870.26840.25670.43340.63340.63340.8144
80.25670.25670.21870.26840.25670.43340.63340.63340.8144
Table 4. Consensus of fuzzy weight and fuzzy assessment.
Table 4. Consensus of fuzzy weight and fuzzy assessment.
CriteriaA1A2A3A4A5
Knowledge
Weight(0.4332, 0.6332, 0.8142)(0.6131, 0.7931, 0.9155)(0.6002, 0.8002, 0.9503)(0.6552, 0.8552, 0.9776)(0.5686, 0.7686, 0.9158)
K1(0.7065, 0.8837, 0.9516)(0.5002, 0.7002, 0.8502)(0.6001, 0.8001, 0.9501)(0.6601, 0.8601, 0.9801)(0.3572, 0.5476, 0.7287)
K2(0.4332, 0.6334, 0.8142)(0.6601, 0.8601, 0.9801)(0.3576, 0.5574 0.7432)(0.6601, 0.8601, 0.9801)(0.3652, 0.5652, 0.7652)
K3(0.3001, 0.5001, 0.7001)(0.5883, 0.7402, 0.8443)(0.6001, 0.8001, 0.9501)(0.4586, 0.6584, 0.8586)(0.4586, 0.6584, 0.8586)
K4(0.6328, 0.8141, 0.9475)(0.4001, 0.6001, 0.8001)(0.5016, 0.7018, 0.8797)(0.6601, 0.8601, 0.9801)(0.4332, 0.6334, 0.8144)
K5(0.3186, 0.5186, 0.7141)(0.3436, 0.5436, 0.7436)(0.5688, 0.7686, 0.9158)(0.3652, 0.5652, 0.7652)(0.5018, 0.7016, 0.8795)
K6(0.6424, 0.8424, 0.9568)(0.3574, 0.5576, 0.7432)(0.2537, 0.4539, 0.6537)(0.3001, 0.5001, 0.7001)(0.4586, 0.6584, 0.8586)
K7(0.2547, 0.4547, 0.6547)(0.3204, 0.5203, 0.7032)(0.5447, 0.7448, 0.9226)(0.4561, 0.6564, 0.8562)(0.346, 0.5436, 0.7436)
K8(0.3416, 0.5414, 0.7416)(0.5016, 0.7016, 0.8797)(0.4001, 0.6001, 0.8001)(0.2537, 0.4537, 0.6537)(0.4023, 0.6025, 0.7811)
K9(0.4332, 0.6332, 0.8142)(0.6001, 0.8001, 0.9501)(0.3574, 0.5574, 0.7432)(0.3001, 0.5001, 0.7001)(0.4586, 0.6584, 0.8586)
Table 5. Decision outcome of knowledge proposal.
Table 5. Decision outcome of knowledge proposal.
α   =   0.5 KQFIz ( z l , z u ) ( S 1 , S 2 ) e K F T ResultDecision
K1(0.5352, 0.7561, 0.9101)(−0.1648, 0.1561, 0.4102)(−0.0042, 0.2833)(0.1415, 0.0023)0.9851>0.5Go
K2(0.4721, 0.7007, 0.8838)(−0.1648, 0.1563, 0.4102)(−0.0635, 0.2422)(0.1213, 0.0317)0.7923>0.5Go
K3(0.4675, 0.6786, 0.8614)(−0.2323, 0.0786, 0.3616)(−0.0768, 0.2202)(0.1101, 0.0385)0.7412>0.5Go
K4(0.5028, 0.7207, 0.8986)(−0.1972, 0.1207, 0.3984)(−0.0382, 0.2598)(0.1297, 0.0192)0.8718>0.5Go
K5(0.4019, 0.6226, 0.8247)(−0.2982, 0.0226, 0.3247)(−0.1378, 0.1737)(0.0868, 0.0688)0.5578>0.5Go
K6(0.3642, 0.5901, 0.7982)(−0.3358, −0.0097, 0.2982)(−0.1728, 0.1443)(0.0722, 0.0865)0.4548<0.5No go
K7(0.3694, 0.5912,0.8047)(−0.3306, −0.0088, 0.3047)(−0.1698, 0.1481)(0.0741, 0.0847)0.4657<0.5No go
K8(0.3646, 0.5791, 0.7831)(−0.3354, −0.0207, 0.2831)(−0.1782, 0.1312)(0.0657, 0.0892)0.4241<0.5No go
K9(0.4092, 0.6272, 0.8276)(−0.2909, 0.0273, 0.3276)(−0.1318, 0.1775)(0.0886, 0.0658)0.5736>0.5Go
Table 6. Comparisons between the proposed method and AHP.
Table 6. Comparisons between the proposed method and AHP.
MethodExpert PenalCriteriaWeightKnowledge EvaluationKnowledge QualityGo/No Threshold
ProposedvvLinguistic assessmentdirectabsolutev
AHPvvpairwise comparisonindirectrelativex
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wei, C.-C.; Tai, C.-C.; Lee, S.-C.; Chang, M.-L. Assessing Knowledge Quality Using Fuzzy MCDM Model. Mathematics 2023, 11, 3673. https://doi.org/10.3390/math11173673

AMA Style

Wei C-C, Tai C-C, Lee S-C, Chang M-L. Assessing Knowledge Quality Using Fuzzy MCDM Model. Mathematics. 2023; 11(17):3673. https://doi.org/10.3390/math11173673

Chicago/Turabian Style

Wei, Chiu-Chi, Chih-Chien Tai, Shun-Chin Lee, and Meng-Ling Chang. 2023. "Assessing Knowledge Quality Using Fuzzy MCDM Model" Mathematics 11, no. 17: 3673. https://doi.org/10.3390/math11173673

APA Style

Wei, C. -C., Tai, C. -C., Lee, S. -C., & Chang, M. -L. (2023). Assessing Knowledge Quality Using Fuzzy MCDM Model. Mathematics, 11(17), 3673. https://doi.org/10.3390/math11173673

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop