Next Article in Journal
Spatiotemporal Differentiation Characteristics of Land Ecological Quality and Its Obstacle Factors in the Typical Compound Area of Mine Agriculture Urban
Previous Article in Journal
Wagner’s Law vs. Keynesian Hypothesis: Dynamic Impacts
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Comparative Study on the Efficiency of R&D Activities of Universities in China by Region Using DEA–Malmquist

1
School of Economics and Management, Huainan Normal University, Huainan 232038, China
2
Graduate School of Management of Technology, Pukyong National University, 365 Sinseon-ro, Nam-gu, Busan 48547, Korea
3
Major in Industrial Data Science and Engineering, Department of Industrial and Data Engineering, Pukyong National University, Busan 48513, Korea
*
Author to whom correspondence should be addressed.
Sustainability 2022, 14(16), 10433; https://doi.org/10.3390/su141610433
Submission received: 25 June 2022 / Revised: 30 July 2022 / Accepted: 17 August 2022 / Published: 22 August 2022

Abstract

:
This paper analyzes the efficiency of the input and output of R&D activity and the status of its development and management in universities in each region of China and proposes suggestions for improvement. The DEA–Malmquist model was used to analyze the static and dynamic science and technology statistics for universities in each region during 2006–2019 to reveal changes in the input and output of R&D activity. The overall efficiency of the R&D activity of universities in all regions of China was low. Among the 27 regions studied, DEA revealed effective efficiency in 20 regions in 2006, accounting for 74.07%, and in 19 regions in 2019, accounting for 70.37%. The Malmquist index was greater than 1 in 17 regions in 2006–2019, with an average value of 1.023 during 2006–2019. The technological progress of R&D activity in universities in each region plays a major role in the improvement of the overall efficiency. Conclusions: The efficiency of the R&D activity of Chinese universities in all regions is low in general, with large disparities between regions. The R&D activity of Chinese universities lacks scientific management. It is necessary to optimize the allocation of research resources, construct an evaluation system for the efficiency of R&D activity, and offer incentives for research to improve the output and promote the transformation of results in Chinese universities.

1. Introduction

Colleges and universities are the main sites of scientific and technological innovation nationally. In terms of the types of R&D (research and development) activity, funds for it in universities are divided into three categories: basic research, applied research and experimental development. Research and development, including both scientific research and experimental development in the fields of science and technology aims to increase the total amount of knowledge and the use of this knowledge to create new applications for systematic and creative activities. Research and development activity in colleges and universities has always been an important theoretical and practical issue among science and technology administrators. On the issue of improving the efficiency of R&D activity in colleges and universities, the huge investment of R&D funds in colleges and universities has brought about many scientific research achievements. However, the scientific, rational, and efficient allocation and operation of limited R&D resources remains one of the problems to be solved in China’s universities. At the same time, the efficiency of R&D achievements in colleges and universities needs to be measured and evaluated. In this way, the management department can improve them more pertinently to achieve the goal of sustainable development. Thus, measurement of the efficiency of R&D activity in colleges and universities has become a concern for scholars.
There are different methods for evaluating the efficiency of R&D activity. Data envelopment analysis (DEA) is a new field of interdisciplinary research in operations research, management science and mathematical economics. It is a quantitative analysis method to evaluate the relative effectiveness of comparable units of the same type that uses linear programming based on several input and output indicators. The data envelopment analysis method is widely used because it is more objective than other efficiency evaluation methods and has advantages in measuring the relative efficiency of decision-making units (DMU) with multiple inputs and outputs. To overcome the shortcomings of the current static and dynamic analyses of the efficiency of R&D activity, this paper combines the DEA method and the Malmquist productivity index to portray the changing patterns of the efficiency of the R&D activity of universities in each region of China.
In view of this, this paper studies the efficiency of the R&D inputs and outputs of universities in each region (provinces, autonomous regions and municipalities directly under the central government) in China during 2006–2019, analyzes the patterns of changes in the efficiency of R&D activities in each region, and explores the factors that cause these changes, to provide a reference for measuring and promoting R&D activity in Chinese universities.
The remainder of this paper is structured as follows. Section 2 reviews previous literature related to the research topic and research methods. Section 3 proposes evaluation indicators and models and uses the models to assess the efficiency of universities in each region of China. The presentation and interpretation of applying the DEA-based Malmquist model to the data is illustrated in Section 4. Concluding statements are presented in Section 5.

2. Literature Review

The DEA model is an input–output analysis method based on relative efficiency, proposed by Charnes et al. in 1978 [1]. It is widely used in efficiency assessments because of its advantages in terms of not requiring a priori weights to be assigned to inputs and outputs and for its ability to measure the relative efficiency of decision units with multiple inputs and outputs.
To overcome the problems in the traditional DEA model, many scholars have improved it. For example, to enable further comparative analysis of efficient units, Andersen et al. proposed the super-efficiency DEA model (super-efficiency DEA) [2], which enables the comparison of efficiency between efficient decision units. To address the problem whereby traditional DEA models ignore slack adjustment and cannot further distinguish effective decision units, Tone constructed a non-radial slack measure model (SBM) [3], which incorporates all slack measures into the objective function through a scalar approach. The DEA has been widely used in the field of university performance evaluation. Athanassopoulos and Shale used the DEA method to measure the overall efficiency of 45 colleges and universities in the UK and verified the rationality of the method for evaluating the efficiency of college operations [4]. McMillan and Datta used the DEA method to assess the relative efficiency of 45 Canadian colleges and universities and found that the majority had high efficiency scores; they argued that the method provides a new way to understand the efficiency of Canadian colleges and universities [5]. Abbott and Doucouliagos used a DEA model based on a system of different input–output indicators and found that Australian universities have relatively high operational efficiency [6]. Johnes used the DEA method to analyze and evaluate the efficiency of educational resource allocation in more than 100 higher education institutions in the UK and found that the majority of institutions have high technical efficiency and scale efficiency [7]. Agasisti conducted a cross-country comparative study of the efficiency of resource allocation in higher education systems in European countries using the DEA methodology and found that the influence of the public sector has a key role in resource allocation efficiency [8]. Subsequently, many scholars have evaluated and analyzed the scientific research activities of colleges and universities from different perspectives, considering various influencing factors. Nigsch and Schenker provided an overview of the strengths and limitations of the DEA approach for higher education performance evaluation over the past 20 years [9]. Yang et al. developed a network directional distance framework based on a two-stage network DEA model to measure the inefficiencies of Chinese research universities. The empirical results showed that the average efficiencies of the 64 sampled universities increased within the examined period of 2010–2013. The productivity gains were primarily driven by improvements in efficiency. In other words, the efficiency increased on average over the examined period [10]. Based on the triple helix theory, Wang established three groups of DEA models—personnel funds versus projects, projects versus achievements and personnel funds versus achievements—and evaluated the performance of social science research in 46 universities in Jiangsu Province [11]. Duan used the super-efficiency DEA method to establish an evaluation index system for the scientific research performance of colleges and universities from the two dimensions of the scientific and technological investment of colleges and universities and the output of the scientific and technological achievements of colleges and universities, and conducted empirical research and analysis on the scientific research performance of Chinese colleges and universities [12]. The DEA is frequently used to measure the efficiency of universities, however, it can also be applied to different industries, such as ICT [13], banking [14,15], hospitals [16,17,18], supplier selection [19,20,21], energy [22,23,24], regional innovation evaluation [25,26,27] and port performance [28,29,30,31], and has many other applications [32,33,34,35,36,37].
The Swedish economist and statistician Sten Malmquist proposed the Malmquist index to analyze changes in consumption over time. On this basis, the Malmquist total factor productivity index (abbreviated as Malmquist TFP index) was first proposed by Caves, Christensen and Diewert in 1982 [38]. They used the Malmquist input or output function to define the TFP index, but it did not receive much attention at the time. It was not until 1994, when Färe et al. proposed the Malmquist productivity index using a nonparametric linear programming algorithm to examine total factor productivity growth, that the Malmquist TFP index was widely used in various fields, such as finance, public administration and research management [39]. The results of the Malmquist productivity index evaluation mainly focus on three dimensions: productivity change, efficiency change and technological change analysis. Meng et al. evaluated the efficiency of basic research in China and found that funding input was the main reason for the growth in output, while the efficiency of scientific research increased significantly from 1991 to 1996, and then gradually slowed down [40]. Hung et al. decomposed the growth rate of research papers into four components. Through the empirical study of 27 countries, they showed that the factors affecting the growth rate of output varied greatly among different countries; researchers have a greater impact on the quality of output and research funding has a greater role in the impact of citations [41]. Worthington and Lee used the Malmquist index methodology to analyze the productivity growth of 35 Australian universities over the period 1998–2003. The analysis included five inputs of full-time equivalent academic and non-academic personnel, non-labor expenditure and the number of undergraduate and postgraduate students, while the six outputs were undergraduate, postgraduate and doctoral graduates, national competitiveness and industry funding and publications [42]. Fernandez-Santos et al. used the Malmquist production index method to study the efficiency of teaching and research in Spanish public universities [43]. Wang used the Malmquist productivity index model to examine the technical efficiency, technological change and productivity performance of eight New Zealand universities over the period 2013–2018, and the results showed that the average catch-up efficiency and frontier shift efficiency of the universities were roughly in a “no change” scenario, meaning that these universities have not made any progress over the years [44]. Xue applied the three-stage data envelopment analysis (DEA) and Malmquist index method to evaluate the static and dynamic efficiency of the research output and input data of universities directly under the Ministry of Education in China from 2010 to 2017 [45]. Zhou used the DEA–Malmquist index model and constructed an evaluation index system to analyze the input–output efficiency of China’s educational science and technology development from three aspects: comprehensive efficiency, pure technical efficiency and scale efficiency [46]. The Malmquist index method is also used in other areas. Chen and Ali adopted the Malmquist productivity index to measure changes in productivity over time and used the method to empirically study Fortune Global 500 computer and office equipment companies from 1991 to 1997 [47]. Wu et al. applied data envelopment analysis (DEA) and the Malmquist index to study the energy efficiency of 30 provinces in China. The results showed that, from 2006 to 2009, the average industrial energy efficiency in the eastern region was the best, followed by the central region [48]. Wang et al. proposed a mixed data envelopment analysis (DEA) model, which combined the DEA–Malmquist method with epsilon-based measurement (EBM), to solve the performance evaluation problem of harbor terminal operators [49]. Firsova and Chernyshova adopted the Malmquist productivity index to evaluate the dynamics of regional innovation development and compare the Russian regions according to their innovation efficiency, used resources and achieved results [50]. Liu and Bai used the DEA–Malmquist index method and DEA–Tobit stochastic response model to evaluate the inter-provincial differences in regional innovation efficiency in China in terms of four aspects—technical efficiency, efficiency index changes, returns to scale and predictive analysis—to explore the impact of government funding on regional innovation efficiency [51]. Because the Malmquist index can better analyze panel data, it can better reflect the dynamic change status of relative efficiency and better measure the dynamic continuous change characteristics, to effectively analyze the reasons for efficiency changes. Therefore, this paper adopts the DEA–Malmquist index method to evaluate the efficiency of the R&D activity of universities, analyzes their input–output efficiency and further decomposes the technical change index in the measurement results to explore the management information implied by it.

3. Evaluation Index System and Evaluation Analysis Model

3.1. Evaluation Index System

Based on science and technology statistics and related economic and social statistics, the indicators for measuring the allocation of scientific and technological resources and their output in universities are divided into two categories, input indicators and output indicators, which mainly included the two aspects of scientific research input and innovation output. In the existing literature on the efficiency of R&D activities in universities, inputs usually refer to indicators such as research and development personnel and funds, and outputs usually refer to research results, such as academic papers, income from patent applications and patent sales. Therefore, this paper constructs an index system for evaluating the efficiency of R&D activity in universities, dividing input into scientific and technological manpower and research funds. The manpower input index includes the number of teaching and research personnel, the number of associate professors and professors, the direct R&D personnel input, the personnel for the application of R&D results (R&D indirect personnel input). The financial input index mainly refers to R&D fund expenditure and R&D results application fund expenditure. The innovation output includes the number of papers published, the number of scientific and technical monographs published, the number of patent applications, the number of patents granted, the income from the sale of patents and the income from technology transfer (as shown in Table 1).
In this paper, the above six input variables and six output indicators were incorporated into the R&D activity efficiency analysis model to analyze the characteristics of R&D resource allocation patterns and output efficiency of universities in each region of China. The data for the statistical analysis were obtained from the compilation of the science and technology statistics of Chinese higher education institutions published in each year from 2006 to 2019, and the data did not include Hong Kong, Macao and Taiwan. The data for four regions—Tibet, Hainan, Ningxia and Qinghai—were omitted because of missing data in some years.

3.2. Data Envelopment Analysis (DEA)

The DEA model treats each evaluated unit as a decision-making unit (DMU), which is, to some extent, a convention, and consists of all decision units forming the evaluation group. Each decision unit under the same group DMU has the same input indicators and output indicators. The DEA base model includes the CCR model (denoting the three authors, A. Charnes, W. W. Cooper E. Rhodes) and the BCC model (denoting the authors, Bankerl, Chames and Cooper), in which the CCR model considers constant returns to scale and its technical efficiency contains a scale efficiency component, while the BCC model considers variable returns to scale and its technical efficiency refers to pure technical efficiency. Then R&D activities in universities have significant knowledge economy characteristics, which can perturb the diminishing marginal returns of traditional factors of production and cause uncertainty in the returns of scientific and technological activities or technology transfer. Therefore, in this paper, the BCC model (variable payoff of scale) is chosen to evaluate the efficiency of R&D activities in China’s universities, and, for any decision unit, the model can be expressed as follows.
m i n θ ε e ^ T S + e T S +   s . t .   j = 1 n   X j λ j + S = θ X 0 j = 1 n   Y j λ j S + = Y 0 λ j 0 , S , S + 0
where,   j = 1 ,   2 , , n represents the decision-making unit, and X and Y are the input and output vectors, respectively; if θ = 1 , S + = S = 0 , the DEA of the decision-making unit is efficient; if θ = 1 , S + 0 , or S 0 , the DEA of the decision-making unit is slightly efficient; if θ < 1, the DEA of the decision-making unit is inefficient.

3.3. Malmquist Index Model

Both the CCR model and the BCC model are evaluations of static data, which means that efficiency can only be evaluated for multiple subjects in one period or multiple periods for one subject. The Malmquist model, on the other hand, allows for dynamic evaluation, and it can perform efficiency measurements over multiple subjects and periods. The Malmquist productivity index, used to measure productivity, is a measure of the dynamic trend of total factor productivity (tfpch) in a sector from moment t to moment t + 1 using a nonparametric distance function, i.e., the ratio of the distance functions before and after the two periods, and the index is expressed in the form of
  M t = D t X t + 1 , Y t + 1 D t X t , Y t  
  M t + 1 = D t + 1 X t + 1 , Y t + 1 D t + 1 X t , Y t    
  M t , t + 1 = D t X t + 1 , Y t + 1 D t X t , Y t × D t + 1 X t + 1 , Y t + 1 D t + 1 X t , Y t
According to Färe et al. [31], the Malmquist index can be decomposed into an index of technical efficiency change (effch) and an index of technical progress (techch) through an equivalence transformation. Furthermore, the technical efficiency change index (effch) can be decomposed into pure efficiency change (pech) and scale efficiency change (sech).
M t , t + 1 = D t + 1 X t + 1 , Y t + 1 D t X t , Y t × D t X t + 1 , Y t + 1 D t + 1 X t + 1 , Y t + 1 × D t X t , Y t D t + 1 X t , Y t = D t + 1 X t + 1 , Y t + 1 C R S D t X t , Y t V R S × D t + 1 X t + 1 , Y t + 1 C R S D t + 1 X t + 1 , Y t + 1 V R S D t X t , Y t C R S D t X t , Y t V R S × D t X t + 1 , Y t + 1 D t + 1 X t + 1 , Y t + 1 × D t X t , Y t D t + 1 X t , Y t = D t + 1 X t + 1 , Y t + 1 V R S D t X t , Y t V R S × S E t + 1 X t + 1 , Y t + 1 S E t X t , Y t × D t X t + 1 , Y t + 1 D t + 1 X t + 1 , Y t + 1 × D t X t , Y t D t + 1 X t , Y t
The three factors on the right-hand side of the equation represent the change in pure technical efficiency, scale efficiency and technical progress efficiency, respectively. Thus,
M = e f f c h t e c h c h
= p e c h s e c h t e c h c h
If M > 1, this means that the level of total factor productivity has increased from period t to period t + 1.
If M = 1, this means that there is no change in the total factor productivity level from period t to period t + 1.
If M < 1, this means that the total factor productivity level has decreased from period t to period t + 1.

4. Empirical Study

4.1. Static Analysis of DEA Model

Using DEAP2.1 software to calculate and organize the annual data of R&D activities corresponding to each index of the universities in each region of China, the overall technical efficiency of the R&D input–output status of the universities in each region and its decomposition results were obtained (see Table 2). The technical efficiency consists of two parts, namely pure technical efficiency and scale efficiency, and technical efficiency = pure technical efficiency × scale efficiency, where “irs” indicates that the decision unit is in the increasing scale payoff stage; “drs” indicates that the decision unit is in the decreasing scale payoff stage; and “-” indicates that the decision unit is in the constant scale payoff stage; crste = technical efficiency from constant returns to scale DEA(CRS DEA); vrste = technical efficiency from variable returns to scale (VRS DEA); scale = scale efficiency = crste/vrste.
(1)
The comprehensive technical efficiency index (crste) obtained by DEA showed that R&D in 2006 and 2019, with values of 0.96 and 0.973, respectively, while having an overall increasing trend, revealed efficiency was still not very high. From the regional perspective, there were still some disparities in the R&D innovation efficiency of universities in different regions, among which the comprehensive efficiency of Shanxi, Liaoning, Jilin, Heilongjiang, Fujian, and Hunan increased, and the comprehensive efficiency of Hebei, Jiangxi, Shandong, Hubei, and Guangxi decreased. The regions with combined efficiency values of less than 1 in both 2006 and 2019 were Hebei, Liaoning, Heilongjiang and Fujian, accounting for 14.81%. Twenty regions reached the production frontier surface in 2006, accounting for 74.07%, and nineteen regions reached the production frontier surface in 2019, accounting for 70.37%. Beijing, Tianjin, Inner Mongolia, Shanghai, Jiangsu, Zhejiang, Anhui, Henan, Chongqing, Sichuan, Guizhou, Yunnan, Shaanxi, Gansu, and Xinjiang were DEA effective in both study periods, accounting for 55.56%, indicating that the innovation efficiency of the universities in these regions achieves optimal allocation, a reasonable investment structure and optimal inputs and outputs under different combinations.
(2)
The pure technical efficiency (vrste) of R&D activities in colleges and universities shows an increasing trend. In 2019, the pure technical efficiency of R&D activities in colleges and universities across the country was 0.983, which indicated a 0.017 difference from the production frontier, reflecting that there is room for improvement at the management level. The scale efficiency of R&D activities in colleges and universities was greater than the pure technical efficiency, indicating that the management and technical level were the main factors restricting the efficiency of scientific and technological innovation in Chinese colleges and universities. The number of purely technically efficient provinces was 20 and 21 in 2006 and 2019, respectively, and the number of scale-efficient provinces was 20 and 19, respectively, while the number of purely technically efficient regions was more than the number of scale-efficient regions, indicating that these regions were more advanced in terms of management and technology, etc., and the established inputs maximize output. The pure technical efficiency values of Hebei, Liaoning, Jilin, Heilongjiang, Fujian, and Hunan were low, at 0.963, 0.737, 0.89, 0.719, 0.886 and 0.931, respectively, in 2006, accounting for 22.22%, except for Hebei and Hunan, whose values were much lower than the national average of 0.967 in the same year. There is a need to further improve the management and technical level of university science and technology innovation in these regions. The pure technical efficiency of Liaoning, Heilongjiang, Fujian, Jiangxi, and Hubei in 2019 was lower than the national average of 0.983 in the same year, accounting for 18.52%. Among them, Hebei, Liaoning, Heilongjiang, and Fujian had lower pure technical efficiency than the national average in the same year in both study periods, accounting for 14.81%.
(3)
The scale efficiency of the R&D activities of universities can reflect whether the supply of science and technology innovation infrastructure of universities in each region is at the optimal scale. From Table 2, it can be concluded that the scale efficiency declined from 0.992 in 2006 to 0.99 in 2019, and the number of scale-optimal regions lowered from 20 to 19. Regions with increasing returns to scale should reasonably increase their investments in university infrastructure, while regions with decreasing returns to scale have obvious efficiency loss problems because the funds are not effectively used, and special attention should be paid to improving the efficiency of the use of funds. In 2006 and 2019, the scale efficiency reached the production frontier surface in 20 and 19 regions, accounting for 74.07% and 70.37%, respectively. The scale efficiency did not reach the production frontier surface in seven regions (Hebei, Shanxi, Liaoning, Jilin, Heilongjiang, Fujian, and Hunan) and eight regions (Hebei, Liaoning, Heilongjiang, Fujian, Jiangxi, Shandong, Hubei and Guangxi), respectively, accounting for 25.93% and 29.63%. Among them, Hebei, Liaoning, Heilongjiang, and Fujian did not reach the front line of efficiency in both study periods, accounting for 14.81%.

4.2. Dynamic Analysis of the Malmquist Index

The Malmquist index can dynamically reflect the trend of the R&D innovation efficiency of universities in each region. Therefore, the DEAP2.1 software was used to analyze the R&D input and output data of 27 regions in China from 2006 to 2019, and then examine the dynamic changes and heterogeneity of total factor productivity; the results of the analysis are shown in Table 3, Table 4 and Table 5 (effch: efficiency change, techch: technology change, pech: pure efficiency change, sech: scale efficiency change, tfpch: total factor productivity change).
(1)
Analysis of overall efficiency changes. Table 3 shows that during the period 2006–2019, regarding the current year compared to the previous year, effch (efficiency change) was greater than 1 for eight years, techch (technology change) was greater than 1 for nine years, pech (pure efficiency change) was greater than 1 for five years, and sech (scale efficiency change) was greater than 1 for five years. As can be seen from Table 4, tfpch (total factor productivity change) varied annually during the period 2006–2019, with an average tfpch greater than 1 in nine years (69.23%) and less than 1 in four years (30.77%), with eight years having a Malmquist index greater than the average for the entire study period (1.023). From Table 3 and Table 4, it can be concluded that, from 2006 to 2019, the average Malmquist index of scientific and technological innovation in universities in China was 1.023, showing an overall upward trend. The total factor productivity index of each year during the study period was greater than 1, indicating that the total factor productivity of universities in each region was in an increasing stage. The mean values of the technical efficiency change index, technical progress change index, pure technical efficiency change index and scale efficiency change index were 1.001, 1.022, 1.001, 1 and 1.023, respectively. tfpch = effch × techch (1.023 = 1.001 × 1.022). The average value for technical efficiency increased by 0.1%, the average value of technological progress increased by 2.2%, and the average value of scale efficiency did not change. These results show that the technological progress of scientific and technological innovation in colleges and universities in various regions plays a major role in the improvement of comprehensive efficiency, and there is still significant room for improvement regarding the efficiency of scientific and technological innovation in colleges and universities by improving the management level and resource utilization efficiency.
(2)
Comparison of changes in efficiency in each region. From Table 4 and Table 5, it can be concluded that the value of total factor productivity was less than 1 for 10 regions, Hebei, Shanxi, Inner Mongolia, Fujian, Shandong, Henan, Hubei, Hunan, Guangdong, and Xinjiang, from 2006 to 2019. The total factor productivity indices of the other 17 regions were all greater than 1, accounting for 62.96%, indicating that total factor productivity in most of China’s regions was increasing and the development trend was good. Nine regions, Shanxi, Inner Mongolia, Fujian, Shandong, Henan, Hubei, Hunan, Guangdong, and Xinjiang had a technological progress index of less than 1, accounting for 33.33%. There were 18 regions (66.67%) where the improvement in the scientific research and innovation efficiency of colleges and universities can be attributed to the improvements in technological progress and pure technical efficiency. Throughout the whole study cycle, Jiangsu experienced 11 years with a Malmquist index greater than 1; Zhejiang experienced 10 years with a Malmquist index greater than 1, indicating that it was a fast-growing region; Shanghai, Jiangxi and Yunnan experienced 9 years with a Malmquist index greater than 1; Beijing, Tianjin, Hebei, Guangxi, Sichuan, Guizhou, Shaanxi and Gansu had a Malmquist index greater than 1 for 8 years; Jilin, Anhui, Fujian, Shandong and Hubei had a Malmquist index greater than 1 for 7 years; Shanxi, Inner Mongolia, Hunan, Guangdong and Chongqing had Malmquist indices greater than 1 for 6 years; Liaoning, Heilongjiang and Xinjiang had Malmquist indices greater than 1 for 5 years, and Henan had a Malmquist index greater than 1 for 4 years. The improvement in the scientific research and innovation efficiency of universities in various regions of China mainly depends on technological progress and pure technical efficiency improvement. This shows that increasing scientific research investment has had little effect on improving scientific research efficiency. At present, Chinese universities should mainly improve their innovation efficiency through technological progress and scientific research management.
(3)
Analysis of influencing factors from Malmquist. The tfpch is composed of effch and techch, where effch is composed of pech and sech, which are related as tfpch = effch × techch = pech × sech × techch. From Table 4, the average value of tfpch (total factor productivity change) during 2006–2019 was 1.023, the average value of effch (efficiency change) was 1.001, the average value of techch (technology change) was 1.022, the average value of pech (pure efficiency change) was 1.001, and the mean value of sech (scale efficiency change) was 1, where the 2.3% average growth in tfpch consisted of 0.1% of the average growth in effch and 2.2% of the growth in techch, and the 0.1% average growth in effch consisted of 0.1% of the average growth in pech, where sech did not grow on average, i.e., it did not contribute to growth. During the study period, 17 regions (Beijing, Tianjin, Liaoning, Jilin, Heilongjiang, Shanghai, Jiangsu, Zhejiang, Anhui, Jiangxi, Guangxi, Chongqing, Sichuan, Guizhou, Yunnan, Shaanxi, and Gansu) had an average tfpch greater than 1, accounting for 62.96%, and these regions were in the growth period. Six regions (Shanxi, Liaoning, Jilin, Heilongjiang, Fujian, and Hunan) had an average effch greater than 1, accounting for 22.22%, indicating that the R&D efficiency in these regions was increasing. There were 18 regions (Beijing, Tianjin, Hebei, Liaoning, Jilin, Heilongjiang, Shanghai, Jiangsu, Zhejiang, Anhui, Jiangxi, Guangxi, Chongqing, Sichuan, Guizhou, Yunnan, Shaanxi, and Gansu) with an average techch greater than 1, accounting for 66.67% of the total, and the technological progress in these regions was faster. The average pech of five regions (Hebei, Liaoning, Jilin, Heilongjiang, and Hunan) was greater than 1, accounting for 18.52%, which indicates that the pure technical efficiency of these regions was increasing. There were three regions with an average sech greater than 1 (Shanxi, Jilin, and Fujian), accounting for 11.11%, indicating that the scale efficiency of these regions was increasing. The improvement in pure technical efficiency focuses on the appropriate structuring of research personnel, research funds and the improvement in the management system. The improvement in scale efficiency depends on the scale stage in which it is located: if it is at the stage of increasing returns to scale, the scale of research investment needs to be increased. If it is in the stage of diminishing returns to scale, this means that the scientific research of universities in the region has exceeded a certain scale, resulting in diseconomies of scale, which is likely to be related to redundant scientific researchers, institutions and funds, and the research structure needs to be adjusted reasonably.

5. Conclusions

This paper draws the following conclusions from an empirical study of R&D innovation efficiency in universities in 27 regions of China from 2006 to 2019.
Based on the calculations of the DEA model, the comprehensive efficiency of R&D innovation in universities in all regions of China did not reach DEA effectiveness in 2006 and 2019.
The R&D innovation efficiency of colleges and universities in different regions varies widely and there is room for the improvement of pure technical efficiency and scale efficiency in most provinces. Regions should focus on improving the management level of R&D innovation in universities, designing a reasonable incentive system, and moderately expanding investment to reach the optimal scale. A dynamic analysis based on the Malmquist index shows that the average value of the total factor productivity index of the R&D innovation efficiency of universities in each region of China from 2006 to 2019 was 1.023, which indicates that the overall trend of R&D innovation efficiency was increasing. Changes in technological progress in the efficiency of R&D innovation at universities in each region of China play a major role in the improvement of the overall efficiency, with changes in technical efficiency playing a secondary role as a driver. From the perspective of spatial distribution, the changes in the R&D innovation efficiency of colleges and universities in different regions are quite different. Moreover, it shows fluctuations at different times; each region should take strong measures according to the constraints in a targeted manner, to effectively improve the efficiency of R&D innovation in universities. Only in this way can the sustainable development of R&D activities in colleges and universities be realized.
The R&D activity requires higher intellectual resources, and colleges and universities are complex organizations. Limited by the availability of data, this study only uses a few representative indicators to study the R&D activity in colleges and universities; in particular, we find that the indicators that characterize people’s abilities are not prominent enough. In future research, we will strengthen the analysis of the indicators and choose indicators that are more representative and influential and can better represent R&D activities and achievements.

Author Contributions

Conceptualization, Y.D. and W.S.; data curation, Y.D.; formal analysis, Y.D.; funding acquisition, Y.D.; methodology, Y.D. and W.S.; software, Y.D.; supervision, W.S.; validation, Y.D.; visualization, W.S.; writing—original draft, Y.D.; writing—review and editing, W.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Charnes, A.; Cooper, W.W.; Rhodes, E. Measuring the Efficiency of Decision Making Units. Eur. J. Oper. Res. 1978, 2, 429–444. [Google Scholar] [CrossRef]
  2. Andersen, P.; Petersen, N.C. A Procedure for Ranking Efficient Units in Data Envelopment Analysis. Manag. Sci. 1993, 39, 1261–1264. [Google Scholar] [CrossRef]
  3. Tone, K. A Slacks-Based Measure of Efficiency in Data Envelopment Analysis. Eur. J. Oper. Res. 2001, 130, 498–509. [Google Scholar] [CrossRef] [Green Version]
  4. Athanassopoulos, A.D.; Shale, E. Assessing the Comparative Efficiency of Higher Education Institutions in the UK by the Means of Data Envelopment Analysis. Educ. Econ. 1997, 5, 117–134. [Google Scholar] [CrossRef]
  5. McMillan, M.L.; Datta, D. The Relative Efficiencies of Canadian Universities: A DEA Perspective. Can. Public Policy/Anal. Polit. 1998, 24, 485–511. [Google Scholar] [CrossRef]
  6. Abbott, M.; Doucouliagos, C. The Efficiency of Australian Universities: A Data Envelopment Analysis. Econ. Educ. Rev. 2003, 22, 89–97. [Google Scholar] [CrossRef]
  7. Johnes, J. Data Envelopment Analysis and Its Application to the Measurement of Efficiency in Higher Education. Econ. Educ. Rev. 2006, 25, 273–288. [Google Scholar] [CrossRef] [Green Version]
  8. Agasisti, T. Performances and Spending Efficiency in Higher Education: A European Comparison through Non-Parametric Approaches. Educ. Econ. 2011, 19, 199–224. [Google Scholar] [CrossRef]
  9. Nigsch, S.; Schenker-Wicki, A. Frontier Efficiency Analysis in Higher Education. In Incentives and Performance; Springer: Berlin/Heidelberg, Germany, 2015; pp. 155–170. [Google Scholar]
  10. Yang, G.; Fukuyama, H.; Song, Y. Measuring the Inefficiency of Chinese Research Universities Based on a Two-Stage Network DEA Model. J. Informetr. 2018, 12, 10–30. [Google Scholar] [CrossRef]
  11. Ji, Q.; Li, X.; Xu, Y. On Performance Evaluation of Social Science Research in Universities Based on Three Helix Theory—Taking Jiangsu Province as an Example. Heilongjiang Res. High. Educ. 2019, 37, 45–49. (In Chinese) [Google Scholar]
  12. Duan, X. Super Efficiency DEA Evaluation of Scientific Research Efficiency of Universities in China Under Systematic Thinking. Chin. J. Syst. Sci. 2019, 27, 51–54+76. (In Chinese) [Google Scholar]
  13. Wang, C.-N.; Nguyen, T.-D.; Le, M.-D. Assessing Performance Efficiency of Information and Communication Technology Industry-Forecasting and Evaluating: The Case in Vietnam. Appl. Sci. 2019, 9, 3996. [Google Scholar] [CrossRef] [Green Version]
  14. Asmild, M.; Paradi, J.C.; Aggarwall, V.; Schaffnit, C. Combining DEA Window Analysis with the Malmquist Index Approach in a Study of the Canadian Banking Industry. J. Product. Anal. 2004, 21, 67–89. [Google Scholar] [CrossRef]
  15. Schaffnit, C.; Rosen, D.; Paradi, J.C. Best Practice Analysis of Bank Branches: An Application of DEA in a Large Canadian Bank. Eur. J. Oper. Res. 1997, 98, 269–289. [Google Scholar] [CrossRef]
  16. Biørn, E.; Hagen, T.P.; Iversen, T.; Magnussen, J. The Effect of Activity-Based Financing on Hospital Efficiency: A Panel Data Analysis of DEA Efficiency Scores 1992–2000. Health Care Manag. Sci. 2003, 6, 271–283. [Google Scholar] [CrossRef]
  17. Ouellette, P.; Vierstraete, V. Technological Change and Efficiency in the Presence of Quasi-Fixed Inputs: A DEA Application to the Hospital Sector. Eur. J. Oper. Res. 2004, 154, 755–763. [Google Scholar] [CrossRef]
  18. Ferrier, G.D.; Rosko, M.D.; Valdmanis, V.G. Analysis of Uncompensated Hospital Care Using a DEA Model of Output Congestion. Health Care Manag. Sci. 2006, 9, 181–188. [Google Scholar] [CrossRef]
  19. Wang, C.-N.; Huang, Y.-F.; Cheng, I.-F.; Nguyen, V.T. A Multi-Criteria Decision-Making (MCDM) Approach Using Hybrid SCOR Metrics, AHP, and TOPSIS for Supplier Evaluation and Selection in the Gas and Oil Industry. Processes 2018, 6, 252. [Google Scholar] [CrossRef] [Green Version]
  20. Kuo, R.; Lee, L.; Hu, T.-L. Developing a Supplier Selection System through Integrating Fuzzy AHP and Fuzzy DEA: A Case Study on an Auto Lighting System Company in Taiwan. Prod. Plan. Control 2010, 21, 468–484. [Google Scholar] [CrossRef]
  21. Kumar, A.; Jain, V.; Kumar, S. A Comprehensive Environment Friendly Approach for Supplier Selection. Omega 2014, 42, 109–123. [Google Scholar] [CrossRef]
  22. Shi, G.-M.; Bi, J.; Wang, J.-N. Chinese Regional Industrial Energy Efficiency Evaluation Based on a DEA Model of Fixing Non-Energy Inputs. Energy Policy 2010, 38, 6172–6179. [Google Scholar] [CrossRef]
  23. Wang, C.-N.; Nguyen, V.T.; Thai, H.T.N.; Duong, D.H. Multi-Criteria Decision Making (MCDM) Approaches for Solar Power Plant Location Selection in Viet Nam. Energies 2018, 11, 1504. [Google Scholar] [CrossRef] [Green Version]
  24. Wang, C.-N.; Le, T.-M.; Nguyen, H.-K.; Ngoc-Nguyen, H. Using the Optimization Algorithm to Evaluate the Energetic Industry: A Case Study in Thailand. Processes 2019, 7, 87. [Google Scholar] [CrossRef] [Green Version]
  25. Chen, K.; Guan, J. Measuring the Efficiency of China’s Regional Innovation Systems: Application of Network Data Envelopment Analysis (DEA). Reg. Stud. 2012, 46, 355–377. [Google Scholar] [CrossRef]
  26. Broekel, T.; Rogge, N.; Brenner, T. The Innovation Efficiency of German Regions—A Shared-Input DEA Approach. Rev. Reg. Res. 2018, 38, 77–109. [Google Scholar] [CrossRef] [Green Version]
  27. Zemtsov, S.; Kotsemir, M. An Assessment of Regional Innovation System Efficiency in Russia: The Application of the DEA Approach. Scientometrics 2019, 120, 375–404. [Google Scholar] [CrossRef]
  28. Périco, A.E.; Ribeiro da Silva, G. Port Performance in Brazil: A Case Study Using Data Envelopment Analysis. Case Stud. Transp. Policy 2020, 8, 31–38. [Google Scholar] [CrossRef]
  29. Quintano, C.; Mazzocchi, P.; Rocca, A. Examining Eco-Efficiency in the Port Sector via Non-Radial Data Envelopment Analysis and the Response Based Procedure for Detecting Unit Segments. J. Clean. Prod. 2020, 259, 120979. [Google Scholar] [CrossRef]
  30. Da Cruz, M.R.P.; de Matos Ferreira, J.J. Evaluating Iberian Seaport Competitiveness Using an Alternative DEA Approach. Eur. Transp. Res. Rev. 2016, 8, 1. [Google Scholar] [CrossRef] [Green Version]
  31. Ding, Z.-Y.; Jo, G.-S.; Wang, Y.; Yeo, G.-T. The Relative Efficiency of Container Terminals in Small and Medium-Sized Ports in China. Asian J. Shipp. Logist. 2015, 31, 231–251. [Google Scholar] [CrossRef] [Green Version]
  32. Ramanathan, R. Evaluating the Comparative Performance of Countries of the Middle East and North Africa: A DEA Application. Socio-Econ. Plan. Sci. 2006, 40, 156–167. [Google Scholar] [CrossRef]
  33. Sexton, T.R.; Lewis, H.F. Two-Stage DEA: An Application to Major League Baseball. J. Product. Anal. 2003, 19, 227–249. [Google Scholar] [CrossRef]
  34. Cullinane, K.; Song, D.-W.; Ji, P.; Wang, T.-F. An Application of DEA Windows Analysis to Container Port Production Efficiency. Rev. Netw. Econ. 2004, 3, 184–206. [Google Scholar] [CrossRef] [Green Version]
  35. Tarim, Ş.; Dener, H.I.; Tarim, Ş.A. Efficiency Measurement in the Hotel Industry: Output Factor Constrained DEA Application. Anatolia 2000, 11, 111–123. [Google Scholar] [CrossRef]
  36. Martín, J.C.; Roman, C. An Application of DEA to Measure the Efficiency of Spanish Airports Prior to Privatization. J. Air Transp. Manag. 2001, 7, 149–157. [Google Scholar] [CrossRef]
  37. Wang, C.-N.; Le, A.L. Measuring the Macroeconomic Performance among Developed Countries and Asian Developing Countries: Past, Present, and Future. Sustainability 2018, 10, 3664. [Google Scholar] [CrossRef] [Green Version]
  38. Malmquist, S. Index Numbers and Indifference Surfaces. Trab. Estadística 1953, 4, 209–242. [Google Scholar] [CrossRef]
  39. Färe, R.; Grosskopf, S.; Norris, M.; Zhang, Z. Productivity Growth, Technical Progress, and Efficiency Change in Industrialized Countries. Am. Econ. Rev. 1994, 84, 66–83. [Google Scholar]
  40. Meng, W.; Hu, Z.; Liu, W. Efficiency Evaluation of Basic Research in China. Scientometrics 2006, 69, 85–101. [Google Scholar] [CrossRef] [Green Version]
  41. Hung, W.-C.; Lee, L.-C.; Tsai, M.-H. An International Comparison of Relative Contributions to Academic Productivity. Scientometrics 2009, 81, 703–718. [Google Scholar] [CrossRef]
  42. Worthington, A.C.; Lee, B.L. Efficiency, Technology and Productivity Change in Australian Universities, 1998–2003. Econ. Educ. Rev. 2008, 27, 285–298. [Google Scholar] [CrossRef] [Green Version]
  43. Fernández-Santos, Y.; Martínez-Campillo, A. Has the Teaching and Research Productivity of Spanish Public Universities Improved since the Introduction of the LOU? Evidence from the Bootstrap Technique. Rev. Educ. 2015, 367, 90–114. [Google Scholar] [CrossRef]
  44. Wang, C.-N.; Tibo, H.; Nguyen, V.T.; Duong, D.H. Effects of the Performance-Based Research Fund and Other Factors on the Efficiency of New Zealand Universities: A Malmquist Productivity Approach. Sustainability 2020, 12, 5939. [Google Scholar] [CrossRef]
  45. Xue, W.; Li, H.; Ali, R.; Rehman, R.u.; Fernández-Sánchez, G. Assessing the Static and Dynamic Efficiency of Scientific Research of HEIs China: Three Stage Dea–Malmquist Index Approach. Sustainability 2021, 13, 8207. [Google Scholar] [CrossRef]
  46. Zhou, G.; Zhang, F.; Fei, Y. Research on the Development Efficiency of Educational Science and Technology in China: An Approach from Three-Stage DEA Malmquist Model. Technol. Anal. Strateg. Manag. 2022, 1–16. [Google Scholar] [CrossRef]
  47. Chen, Y.; Ali, A.I. DEA Malmquist Productivity Measure: New Insights with an Application to Computer Industry. Eur. J. Oper. Res. 2004, 159, 239–249. [Google Scholar] [CrossRef]
  48. Wu, A.-H.; Cao, Y.-Y.; Liu, B. Energy Efficiency Evaluation for Regions in China: An Application of DEA and Malmquist Indices. Energy Effic. 2014, 7, 429–439. [Google Scholar] [CrossRef]
  49. Wang, C.-N.; Nguyen, N.-A.-T.; Fu, H.-P.; Hsu, H.-P.; Dang, T.-T. Efficiency Assessment of Seaport Terminal Operators Using DEA Malmquist and Epsilon-Based Measure Models. Axioms 2021, 10, 48. [Google Scholar] [CrossRef]
  50. Firsova, A.; Chernyshova, G. Efficiency Analysis of Regional Innovation Development Based on DEA Malmquist Index. Information 2020, 11, 294. [Google Scholar] [CrossRef]
  51. Liu, W.; Bai, Y. An Analysis on the Influence of R&D Fiscal and Tax Subsidies on Regional Innovation Efficiency: Empirical Evidence from China. Sustainability 2021, 13, 12707. [Google Scholar] [CrossRef]
Table 1. R&D innovation efficiency input–output indicators of Chinese universities.
Table 1. R&D innovation efficiency input–output indicators of Chinese universities.
Indicator CategoriesIndicatorsIndicator Units
Input IndicatorsNo. of teaching and research staff
No. of associate professors and professors
Amount of R&D expenditureCNY
No. of R&D direct personnel input
No. of R&D results application expenditure fundsCNY
No. of R&D results application personnel input
Output IndicatorsNo. of papers published
No. of patent applications
No. of scientific and technical monographs publishedVolume
Amount of revenue from patent salesCNY
No. of patents grantedCNY
Amount of technology transfer incomeCNY
Table 2. Efficiency values of R&D activities of universities in 27 regions of China in 2006 and 2019.
Table 2. Efficiency values of R&D activities of universities in 27 regions of China in 2006 and 2019.
Region20062019
CrsteVrsteScale CrsteVrsteScale
Beijing111-111-
Tianjin111-111-
Hebei0.9580.9630.995irs0.86310.863drs
Shanxi0.9270.9960.93irs111-
Inner Mongolia111-111-
Liaoning0.7320.7370.994irs0.9010.910.99drs
Jilin0.8770.890.986irs111-
Heilongjiang0.7170.7190.996irs0.8690.8780.99irs
Shanghai111-111-
Jiangsu111-111-
Zhejiang111-111-
Anhui111-111-
Fujian0.780.8860.881irs0.8660.8770.987irs
Jiangxi111-0.8770.9040.97irs
Shandong111-0.97310.973drs
Henan111-111-
Hubei111-0.9460.9660.979drs
Hunan0.9270.9310.995drs111-
Guangdong111-111-
Guangxi111-0.9860.9960.99drs
Chongqing111-111-
Sichuan111-111-
Guizhou111-111-
Yunnan111-111-
Shaanxi111-111-
Gansu111-111-
Xinjiang111-111-
Mean0.960.9670.992 0.9730.9830.99
Table 3. Malmquist index summary of annual means.
Table 3. Malmquist index summary of annual means.
YearEffchTechchPechSechTfpch
21.0070.9921.0160.9910.999
31.0131.0561.0021.0111.069
41.0021.1530.9971.0051.155
511.11.0160.9841.1
61.0060.8620.9981.0080.867
70.9951.1090.99511.103
80.9931.0450.9940.9991.037
91.0011.0551.0030.9981.056
101.0121.1281.0130.9991.142
111.0131.00811.0141.021
120.9761.0580.9920.9841.032
131.0090.90511.0090.914
140.9910.8680.9930.9990.861
Mean1.0011.0221.00111.023
>189559
>Mean68458
Table 4. Malmquist index summary of region means.
Table 4. Malmquist index summary of region means.
RegionEffchTechchPechSechTfpch
Beijing11.031111.031
Tianjin11.045111.045
Hebei0.9921.0041.0030.9890.996
Shanxi1.0060.95811.0060.963
Inner Mongolia10.985110.985
Liaoning1.0161.0071.01611.023
Jilin1.011.0391.0091.0011.049
Heilongjiang1.0151.0381.0150.9991.054
Shanghai11.03111.03
Jiangsu11.056111.056
Zhejiang11.103111.103
Anhui11.063111.063
Fujian1.0080.980.9991.0090.988
Jiangxi0.991.0440.9920.9981.033
Shandong0.9980.99610.9980.994
Henan10.935110.935
Hubei0.9960.9920.9970.9980.988
Hunan1.0060.9911.00610.997
Guangdong10.997110.997
Guangxi0.9991.04610.9991.045
Chongqing11.012111.012
Sichuan11.026111.026
Guizhou11.107111.107
Yunnan11.082111.082
Shaanxi11.017111.017
Gansu11.075111.075
Xinjiang10.955110.955
Mean1.0011.0221.00111.023
Table 5. Malmquist index of efficiency of R&D activities in universities in 27 regions of China during 2006–2019.
Table 5. Malmquist index of efficiency of R&D activities in universities in 27 regions of China during 2006–2019.
06–0707–0808–0909–1010–1111–1212–1313–1414–1515–1616–1717–1818–19
Beijing1.0821.7491.1482.6960.3251.0730.9360.9421.0520.9181.031.0410.798
Tianjin1.0050.8661.1312.1450.4870.9981.6320.911.1141.0920.7941.1341.063
Hebei0.91.0221.0851.0771.0680.9081.0250.9381.1941.1030.7961.0810.834
Shanxi1.0791.0091.1490.8110.8540.9990.8631.2321.1950.7441.3880.5950.91
Inner Mongolia0.5961.7730.9660.6471.2721.1130.9761.1571.2431.2960.8120.7780.762
Liaoning1.3050.9031.4691.2610.8831.0470.8880.9750.9481.1480.9650.8660.846
Jilin0.8511.2920.9871.3320.821.241.0940.9631.3761.1030.970.7831.048
Heilongjiang1.3621.0240.9891.6230.81.1810.9730.9741.1720.970.9380.9480.974
Shanghai1.0071.1311.1291.151.0120.9840.9191.0131.0271.08811.1570.831
Jiangsu1.0191.1161.2271.0291.1751.1461.0370.9541.0581.0451.0611.0510.857
Zhejiang1.2351.1221.3681.330.7951.451.1090.8241.4571.0741.0191.0130.839
Anhui1.3110.9111.3221.3040.6651.8031.1460.9970.8690.7491.2450.9661.002
Fujian1.0541.0442.2360.3751.0711.3070.9571.180.771.1260.9730.770.901
Jiangxi1.2050.7231.1291.1260.9231.0971.0141.0161.0551.121.4520.8910.87
Shandong0.8660.8751.1480.9421.170.9251.1261.091.141.0311.3930.5290.979
Henan0.8950.9491.0760.6310.8990.9590.9731.1281.07511.1420.8090.768
Hubei1.0140.9721.0231.2120.9280.960.9591.0341.0211.0330.9851.0250.741
Hunan1.0450.9731.0710.9980.9191.0520.8961.0111.1360.9991.1640.9370.814
Guangdong0.9330.8741.1021.0980.8591.020.9080.961.0751.2210.9641.1970.842
Guangxi0.8971.1611.0640.9950.9911.1881.0041.3111.2630.90.8371.0061.077
Chongqing1.2431.0631.0990.9930.9170.8790.9431.0231.11.280.9060.8170.994
Sichuan1.0410.9621.221.2150.9050.8141.0281.0081.0340.9751.0380.9861.193
Guizhou0.7371.2031.971.6490.4631.2441.6182.1234.3520.6051.2080.6470.318
Yunnan0.712.0040.8631.0511.051.3191.2721.1190.981.0271.0441.1130.94
Shaanxi1.0811.050.9731.0740.9971.0220.9111.0791.1811.0431.150.9260.799
Gansu0.8031.0391.2361.1861.0321.8461.2210.9090.9481.2770.8821.0080.924
Xinjiang1.190.8860.7990.8161.0010.8490.9691.1210.9710.9691.0691.0470.821
mean0.9991.0691.1551.10.8671.1031.0371.0561.1421.0211.0320.9140.861
M > 1171621189171316211714125
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Du, Y.; Seo, W. A Comparative Study on the Efficiency of R&D Activities of Universities in China by Region Using DEA–Malmquist. Sustainability 2022, 14, 10433. https://doi.org/10.3390/su141610433

AMA Style

Du Y, Seo W. A Comparative Study on the Efficiency of R&D Activities of Universities in China by Region Using DEA–Malmquist. Sustainability. 2022; 14(16):10433. https://doi.org/10.3390/su141610433

Chicago/Turabian Style

Du, Yamin, and Wonchul Seo. 2022. "A Comparative Study on the Efficiency of R&D Activities of Universities in China by Region Using DEA–Malmquist" Sustainability 14, no. 16: 10433. https://doi.org/10.3390/su141610433

APA Style

Du, Y., & Seo, W. (2022). A Comparative Study on the Efficiency of R&D Activities of Universities in China by Region Using DEA–Malmquist. Sustainability, 14(16), 10433. https://doi.org/10.3390/su141610433

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop