Next Article in Journal
On LP-Kenmotsu Manifold with Regard to Generalized Symmetric Metric Connection of Type (α, β)
Previous Article in Journal
Projective Vector Fields on Semi-Riemannian Manifolds
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Combined OCBA–AIC Method for Stochastic Variable Selection in Data Envelopment Analysis

Zhongshan Institute, University of Electronic Science and Technology of China, Zhongshan 528402, China
Mathematics 2024, 12(18), 2913; https://doi.org/10.3390/math12182913
Submission received: 13 August 2024 / Revised: 16 September 2024 / Accepted: 18 September 2024 / Published: 19 September 2024

Abstract

:
This study introduces a novel approach to enhance variable selection in Data Envelopment Analysis (DEA), especially in stochastic environments where efficiency estimation is inherently complex. To address these challenges, we propose a game cross-DEA model to refine efficiency estimation. Additionally, we integrate the Akaike Information Criterion (AIC) with the Optimal Computing Budget Allocation (OCBA) technique, creating a hybrid method named OCBA–AIC. This innovative method efficiently allocates computational resources for stochastic variable selection. Our numerical analysis indicates that OCBA–AIC surpasses existing methods, achieving a lower AIC value. We also present two real-world case studies that demonstrate the effectiveness of our approach in ranking suppliers and tourism companies under uncertainty by selecting the most suitable partners. This research enriches the understanding of efficiency measurement in DEA and makes a substantial contribution to the field of performance management and decision-making in stochastic contexts.

1. Introduction

Data Envelopment Analysis (DEA) is a prominent method for assessing the efficiency of decision-making units (DMUs) [1]. Critical to its success is the selection of appropriate inputs and outputs, a task that poses significant challenges for decision-makers, particularly in stochastic environments where data uncertainties can significantly affect efficiency estimates [2,3].
Despite DEA’s widespread adoption, variable-selection methods often fall short. The lack of standardized procedures has led analysts to rely heavily on subjective experiences [4]. Existing techniques, while helpful, may lack the robustness and precision required for stochastic data, frequently underestimating the impact of randomness on efficiency assessments [5]. Recent studies have highlighted the pivotal role of variable selection in enhancing DEA’s accuracy. Innovations such as machine learning for variable selection [6], a three-stage DEA for electric utility modeling [7], and mathematical frameworks for feature selection [8] have contributed to the field. Additionally, the role of variable selection in port efficiency evaluation has been insightfully discussed [9].
In response to these challenges, we introduce a novel game cross-DEA model to refine efficiency estimation [10]. We also present a pioneering method that integrates Optimal Computing Budget Allocation (OCBA) with the Akaike Information Criterion (AIC) for stochastic variable selection [11]. This integration is designed to navigate the complexities of variable selection amid randomness, offering innovative solutions to the field.
By incorporating advanced analytics and statistical techniques like AIC, this study bolsters the robustness of DEA models, leading to more precise and reliable efficiency measurements [12]. AIC’s role in model selection ensures the choice of the most suitable model based on its goodness of fit and simplicity, therefore enhancing the decision-making process [13].
The implications of this research are profound for DMUs operating in dynamic and uncertain environments. The capacity to make informed decisions based on a comprehensive evaluation of variables and their interactions is essential for strategic planning and resource allocation [14]. The strategic role of decision-making, particularly in aligning organizational goals with resource management, is well-established [15]. This study, therefore, not only deepens the theoretical understanding of DEA in stochastic settings but also offers tangible benefits to decision-makers, equipping them with tools to navigate complexity and uncertainty in their decision-making processes.
This paper makes three key contributions to the literature. First, it enhances DEA by integrating self and peer evaluations for a more nuanced assessment of DMUs. Second, it advances stochastic DEA with a novel model that combines game cross-efficiency, entropy, and AIC, improving efficiency measurement accuracy amid data uncertainties [16]. Third, it refines the stochastic DEA model by [11] through OCBA, optimizing computational resources and enhancing model efficacy in stochastic contexts [13]. Collectively, these contributions provide a robust variable-selection approach for DEA, offering both theoretical enrichment and practical tools for decision-making [17,18]. Our methodology supports strategic and operational planning and aligns organizational objectives with resource management, addressing the complexities of the modern business environment [19].
The paper is structured as follows: Section 2 offers an extensive literature review, critiquing current methodologies and their shortcomings. Section 3 elaborates on our proposed methodology. Section 4 provides a numerical example to demonstrate our method’s variable-selection prowess. Section 5 features two real-world case studies applying our approach, and Section 6 concludes the paper, encapsulating our contributions and proposing avenues for future inquiry.

2. Literature Review

Data Envelopment Analysis (DEA), introduced by [20], is a non-parametric method for assessing the relative efficiency of decision-making units (DMUs). Since then, DEA has evolved substantially, with key models such as the CCR model and the BCC model being widely implemented across various sectors, including healthcare [19], banking [1], and manufacturing [21]. These models operate under the assumption of constant and variable returns to scale, respectively, providing a robust framework for efficiency measurement [22].
The selection of appropriate input and output variables in DEA is crucial since it directly affects the efficiency scores and interpretations of the analysis. Currently, there are no standardized guidelines for selecting optimal inputs and outputs. Friedman and Sinuany-Stern [23] proposed a general rule of thumb suggesting that the total number of variables should not exceed one third of the total DMUs. Norman and Stoker [24] developed a model to assess the correlation of efficiencies when adding variables to the DEA model, finding that efficiency can be significantly affected by a variable if a high statistical correlation is present. Jenkins and Anderson [17] utilized regression and partial correlation methods to determine which variables should be omitted; however, these approaches can yield unstable results even under similar conditions, necessitating caution in selecting suitable methods for identifying model variables [4].
A comprehensive summary of the literature on variable selection in DEA is provided in Table 1. The table highlights various models, key findings, and the types of methodologies employed across different years. As shown, each study contributes uniquely to the discourse, emphasizing either specific techniques for variable selection or broader guidelines, therefore illuminating the evolving nature of DEA methodology.
Wagner and Shimshak [2] employed a stepwise selection approach to analyze changes in efficiencies, though this method does not account for inter-variable relationships and risks losing important information. Each of these techniques has strengths; for example, stepwise methods can simplify model complexity, but they may overlook critical interactions among variables [25].
Table 1. Summary of Literature on Variable Selection in DEA.
Table 1. Summary of Literature on Variable Selection in DEA.
ReferenceModelKey FindingTypeYear
[23]Ranking scalesVariable selection in DEA contextStatic1998
[17]Statistical approachReduces variables in DEAStatic2003
[2]Stepwise selectionProcedures for variable selectionStatic2007
[4]Variable-selection techniquesGuidelines for selection methodsStatic2011
[26]Multicriteria selectionClassifies production batchesStatic2012
[27]cross-efficiencyInterval DEAStochastic2012
[5]Alternative approachesAlternative performance measuresStatic2015
[28]cross-efficiencysupplier selectionStatic2015
[11]Akaike’s criteriaVariable selection via AICstochastic2017
[9]Stepwise selectionPort efficiency assessmentStatic2020
[29]Variable selectionOverview of variable selectionStatic2020
[30]Relevance measuresCritical values methodologyStatic2020
[7]Virtual frontierEfficiency modelingStatic2021
[31]Stepwise methodNew method for variable selectionStatic2021
[32]Entropy measuresNovel selection methodStatic2021
[6]Machine learningVariable selection in DEAStatic2023
To refine variable selection, Toloo and Tichy [5] introduced a model that determines the number of variables by solving a series of mixed-integer linear programming (MILP) problems. However, it remains unable to specifically identify which variables should be selected, as it primarily considers the frequency of variable occurrence.
Furthermore, the issue of stochastic data significantly impacts the reliability of efficiency results. In real-world scenarios, various factors contribute to uncertainty, such as behavioral biases, technical malfunctions, and human errors, often resulting in data with stochastic characteristics [3]. This longstanding issue continues to obstruct efficiency measurement and performance evaluation [33].
Several methodologies have been developed to address these challenges. Despotis and Smirlis [33] treated efficiency as an interval and introduced the concept of interval efficiency for measurement, which is effective only when extreme values are out of range, as differing degrees of intervals can lead to varying levels of uncertainty [34]. Kao and Liu [35] investigated interval efficiency and its impact on efficiency scores, measuring data uncertainty through simulations with specific distributions. However, results may lack robustness when estimating efficiency over multiple periods, as technological changes can significantly influence performance, particularly regarding the identification of the best-performing DMU.
Wong et al. [18] combined Monte Carlo simulations with the Optimal Computing Budget Allocation (OCBA) model [16] for efficiency measurement in stochastic environments. The OCBA technique offers a novel approach to efficiently allocate computational resources in the context of simulation-based optimization. Its innovative features include the ability to balance the trade-off between exploration and exploitation, thus maximizing the accuracy of efficiency estimates while minimizing computational costs [16]. By intelligently selecting the most promising simulations based on early performance indicators, OCBA enhances the robustness of efficiency measurement, especially in complex and stochastic environments. Utilizing OCBA not only streamlines the simulation process but also significantly reduces the overall data collection burden [18]. This is particularly advantageous in efficiency studies where time and resource constraints are common. The innovative aspect of OCBA lies in its adaptive nature, allowing for real-time adjustments based on the performance of the evaluated DMUs.
In conclusion, the literature on DEA is replete with innovative methodologies that have evolved to address the complexities of efficiency measurement. The integration of OCBA with DEA, as well as the application of statistical techniques for variable selection, signifies a significant leap forward in the field. As we continue to navigate the challenges posed by stochastic data and the need for precise variable selection, the contributions of [5,11,18,20,22,33,35] among others, provide a solid foundation for future research and application in DEA.
This study aims to contribute to the literature by leveraging the OCBA technique to determine the optimal number of simulation replications and select the best combination of input and output variables. By doing so, we seek to provide a robust methodology for variable selection in DEA applications, therefore advancing both theoretical understanding and practical implications for decision-makers [16].

3. Our Proposed Method

3.1. Stochastic DEA

In a system with multiple inputs and outputs, consider n independent decision-making units (DMUs), each equipped with m inputs and s outputs. For DMU j, let x i j denote its i-th input and y r j its r-th output, where i { 1 , , m } and r { 1 , , s } . The efficiency score for any DMU d can be calculated by solving the following CCR model:
E d d = max r = 1 s u r d y r d s . t . r = 1 s u r d y r j i = 1 m v i d x i j 0 , j = 1 , , n i = 1 m v i d x i d = 1 u r d 0 , r = 1 , , s , v i d 0 , i = 1 , , m .
For each DMU d within the evaluation set { 1 , 2 , , n } , the optimal weights u r d * and v i d * are derived by solving the aforementioned model. This model, labeled as Equation (1), is a static frontier model that assumes all inputs and outputs are deterministic. When accounting for the stochastic characteristics of the variables, as discussed by [36], the input and output variables are denoted by x ˜ i j N ( x ¯ i j , δ x i j 2 ) and y ˜ r j N ( y ¯ r j , δ y r j 2 ) , respectively. Consequently, the DEA model transforms into the following stochastic DEA programming model:
E ˜ d d = max r = 1 s u r d y ˜ r d s . t . r = 1 s u r d y ˜ r j i = 1 m v i d x ˜ i j 0 , j = 1 , , n i = 1 m v i d x ˜ i d = 1 u r d 0 , r = 1 , , s , v i d 0 , i = 1 , , m .
Based on the game model proposed by [21], the aggressive and benevolent game cross-efficiencies are defined as follows:
E d j L = min r = 1 s u r d y ˜ r j s . t . r = 1 s u r d y ˜ r d E d d i = 1 m v i d x ˜ i d = 0 r = 1 s u r d y ˜ r j i = 1 m v i d x ˜ i j 0 , j = 1 , , n , j d i = 1 m v i d x ˜ i j = 1 u r d 0 , r = 1 , , s , v i d 0 , i = 1 , , m .
E d j U = max r = 1 s u r d y ˜ r j s . t . r = 1 s u r d y ˜ r d E d d i = 1 m v i d x ˜ i d = 0 r = 1 s u r d y ˜ r j i = 1 m v i d x ˜ i j 0 , j = 1 , , n , j d i = 1 m v i d x ˜ i j = 1 u r d 0 , r = 1 , , s , v i d 0 , i = 1 , , m .
Model (3)—The Aggressive Model: This model is crafted with an aggressive strategy, focusing on minimizing a specific output. The essence of this model lies in its competitive drive, striving to reduce costs or mitigate negative impacts to the greatest extent feasible.
Model (4)—The Benevolent Model: In contrast, Model (4) embodies a benevolent strategy, with its objective function aimed at maximizing an output. This model is designed to optimize and amplify the benefits or positive outcomes to their fullest potential.
For DMU j ( j = 1 , 2 , , n ), the cross-efficiency evaluated by DMU d is bounded by the interval [ E ˜ d j L , E ˜ d j U ] . The generalized matrix of cross-efficiencies is detailed in Table 2.
Utilizing Gibbs’ entropy theory, ref. [37] introduced an entropy index derived from the cross-efficiency matrix. The entropy for the cross-efficiency of DMU j is defined as H j , where:
H j = K j d = 1 n G d j ln G d j
where K j = E ¯ j L + E ¯ j U 2 and G d j = E d j d = 1 n E d j .
Given that the true cross-efficiency E ^ d j for DMU j lies within the interval [ E d j L , E d j U ] , the model presented in Equation (5) can be expressed as:
H j = K j d = 1 n E ^ d j d = 1 n E ^ d j ln E ^ d j d = 1 n E ^ d j
To identify the DMU that preserves the most information, we seek to maximize the entropy value as expressed in Equation (8). This objective is achieved through the following model:
H ^ j = max K j d = 1 n E ^ d j d = 1 n E ^ d j ln E ^ d j d = 1 n E ^ d j s . t . E d j L E ^ d j E d j U , d = 1 , , n .
In Equation (7), H ^ j denotes the maximum entropy value for DMU j. The goal is to solve for the set E ^ d j for d = 1 , 2 , , n that achieves this maximum entropy. The model’s objective function is nonlinear and fractional, presenting bound constraints. Drawing on the approach by [20], we introduce t = 1 d = 1 n E ^ d j and w d j = t E ^ d j , therefore transforming the model into a linearly constrained form as shown in Equation (8).
H ^ j = max K j d = 1 n w d j ln w d j s . t . d = 1 n w d j = 1 t E d j L w d j t E d j U t > 0 , d = 1 , , n .
Equation (8) aims to maximize a concave function within the bounds of linear constraints, ensuring the identification of a global optimum. Solving this model provides the optimal values for H ^ j * , w d j * , and t * . Utilizing the relationship w d j = t E ^ d j , we derive the optimal E ^ d j * , aligning with the maximum entropy. Therefore, the optimal cross-efficiency value for DMU j ( j = 1 , 2 , , n ) is determined as:
E ¯ j * = 1 n d = 1 n E ^ d j *
Having obtained the optimal cross-efficiency value E ˜ j * that minimizes entropy, we proceed to substitute the CCR efficiency θ j with E ¯ j * as suggested by [11], yielding the following result:
E ˜ j * = r Q β r y ˜ r j i P α i x ˜ i j + ε ˜ j , j = 1 , 2 , , N α i , β r 0 , i P , r Q .
where α i and β r denote the coefficients for the i-th input and r-th output, respectively. The error terms ε ˜ j are independently and identically distributed as a normal distribution with mean 0 and variance σ ε ˜ 2 . P, Q represent the set of input and output variables, where P , Q are nonempty subsets, with P being a subset of P and Q being a subset of Q ( P P , Q Q ).
These stochastic problems pose theoretical challenges, making the Monte Carlo simulation an essential tool for efficiency estimation under stochastic conditions. However, determining the optimal number of simulation replications remains an open question [11]. In a static model, selecting a inputs and b outputs requires N a b computational and estimation runs to explore all possible AIC values.
N a b = m a × s b
In the stochastic model, the challenge lies in the need for multiple simulations for each combination of input and output variables. Let T i represent the number of simulations for the i-th variable combination, with i ranging from 1 to N a b . We denote τ as the total simulation budget. The variable-selection model in a stochastic environment can then be formulated as follows:
min A I C ( P , Q , T i ) = 1 T i l = 1 T i n ln ( 2 π ) + ln σ ^ ε l 2 + 1 + 2 P + Q s . t . T 1 + T 2 + + T N a b = τ
where
σ ^ ε l 2 = 1 n j = 1 n E ˜ j * + i P α i x ˜ i j r Q β r y ˜ r j 2

3.2. The Model of OCBA

Optimal Computing Budget Allocation (OCBA) is a strategic simulation optimization approach that intelligently allocates additional simulations to variable combinations with the potential to yield lower Akaike Information Criterion (AIC) values [16]. This method is crucial for identifying the optimal number of simulation replications and selecting the variable combination that minimizes the AIC value. In the application of the OCBA model, we introduce the following notation:
  • γ : Total number of simulation replications.
  • B ¯ i : Sample mean of the AIC for the i-th variable combination.
  • σ i 2 : Variance of the AIC for the i-th variable combination.
  • c 1 : The variable combination with the smallest estimated AIC.
  • c 2 : The variable combination with the second smallest estimated AIC.
  • T i : Number of replications allocated to the i-th variable combination.
  • δ i , j : The difference between the sample means of the AIC for combinations i and j, calculated as δ i , j = B ¯ i B ¯ j .
These parameters facilitate the determination of simulation runs for each design, ensuring that computational effort is directed toward the most promising variable combinations.
T c 1 T c 2 = σ c 1 σ c 2 j = 1 l δ c 1 , c 2 δ c 1 , i 2 , i c 1
T c 1 T c 2 = σ c 1 / δ c 1 , i σ c 2 / δ c 1 , c 2 2 , i c 1 , c 2
At the outset, we initiate the process by simulating all l combinations with t o replications each. As the simulations progress, the sample means B ¯ i and variances σ i 2 for each combination are iteratively updated. The simulation budget is then incremented by d, and Equations (14) and (15) are utilized to determine the number of new simulations required. This process continues until the total simulation budget is fully utilized. The OCBA allocation procedure is outlined as follows:
(1)
Initialize: Set t = 1 and conduct t o simulations for all l combinations. Initialize T 1 t , T 2 t , , T l t to t o .
(2)
Update: Calculate the sample means B ¯ i and variances σ i 2 for each combination.
(3)
Allocate: Increase the simulation budget by d and compute the new simulation counts T 1 t + 1 , T 2 t + 1 , , T l t + 1 using Equations (14) and (15).
(4)
Simulate: For each combination i, perform an additional T i t + 1 T i t simulations.
(5)
Termination: If the cumulative simulation count i = 1 l T i t is less than the total budget γ , increment t by 1 and return to the Update step; otherwise, terminate the process.

4. Numerical Example with Stochastic Data

In this section, we validate our proposed method through a numerical example using a stochastic dataset from [11]. The dataset introduces random variations in inputs and outputs as follows: X ˜ i j d = X i j d + ε ^ j d x and Y ˜ r j d = Y r j d + ε ^ j d y , where ε ^ j d x and ε ^ j d y represent error terms. These error terms are normally distributed with zero mean and variances of 0.36 and 0.6, respectively ( ε ^ j d x N ( 0 , 0.36 ) ; ε ^ j d y N ( 0 , 0.6 ) ). The deterministic components of the variables are detailed in Table 3.
Given the limited literature on stochastic variable selection, we selected two studies for comparison: [11,27]. As shown in Table 4, these studies use a fixed number of simulations for AIC evaluation, unlike our OCBA–AIC method that intelligently allocates computational resources. This dynamic allocation in our approach leads to a more efficient variable-selection process, as demonstrated by the lower AIC values achieved, indicating a superior fit to the data.
Table 4 presents a comparative analysis of the optimal combinations of inputs and outputs under varying numbers of variables, utilizing two distinct methods. The left portion of the table details the results obtained through our Optimal Computing Budget Allocation (OCBA) method, while the right part displays the outcomes from the model presented in [11,27]. All methods converge on the identification of the core service model ( | P | = | Q | = 1 ), where input variable X1 and output variable Y1 emerge as the optimal selection from the possible 21 variable combinations.
Notably, our OCBA approach, despite yielding the same variable set as the methods in [11,27], consistently delivers a lower AIC value. This achievement is attributed to the enhancement of the original AIC model with an optimal cross-efficiency estimator, which strategically allocates increased simulation replications to variable combinations with the potential to yield even lower AIC scores.
Our comprehensive reanalysis has demonstrated that with a mere 980 simulation replications, our method not only matches but exceeds the performance of those requiring 2100 replications. Remarkably, our OCBA-enhanced approach has achieved an average reduction of 45% and 52% in AIC scores compared to the traditional approaches. This significant enhancement underscores the efficiency, robustness, and computational thrift of our method while preserving or enhancing the quality of the outcomes. The integration of OCBA with DEA represents a notable advancement in the field, offering a more efficient and effective strategy for simulation-based optimization.
In this paper, we extend the existing variable-selection methods in stochastic environments by introducing two key innovations: First, we enhance efficiency estimation by incorporating both self and peer evaluations using a game cross model. Second, we address the challenge of determining the optimal number of simulation replications in stochastic variable selection by integrating the Akaike Information Criterion (AIC) with the Optimal Computing Budget Allocation (OCBA) technique. This approach provides a compelling case for the adoption of our method in relevant applications, offering a superior performance in terms of statistical rigor and computational efficiency.

5. Real Case Study

5.1. Supplier Selection

Our proposed model offers a structured framework for variable selection within DEA, applicable across various implementation scenarios. Specifically, this section addresses a supplier selection challenge, drawing on insights from [28]. The associated input and output variables are outlined in Table 5.
In this dataset, with m = 4 inputs, s = 3 outputs, and n = 15 decision-making units (DMUs), we apply a heuristic that the sum of selected inputs and outputs, | P | + | Q | , should not exceed 5. Consequently, our method evaluates all possible variable combinations to identify the optimal set, ensuring the total number of variables does not surpass this limit. The outcomes are detailed in Table 6. Notably, an increase in the number of selected variables correlates with a higher average AIC value, indicating greater information redundancy. As discussed in Section 2, a lower AIC signifies a more efficient model with less redundancy. Therefore, in DEA model variable selection, it is crucial to minimize the number of inputs and outputs while maintaining the necessary information to avoid redundancy.
When decision-makers aim to select 5 variables from a total of 7 inputs and outputs, our model guides them to identify the optimal combination by omitting 2 variables. With the constraint | P | + | Q | = 5 , the model suggests three potential configurations: 4 inputs and 1 output, 3 inputs and 2 outputs, or 2 inputs and 3 outputs. Table 6 reveals that the combination (X1, X2, X3, Y1, Y2) yields the minimum AIC value of 26.957, making it the optimal selection. This indicates that variables X4 and Y3 contribute least to performance measures and can be excluded with minimal impact on information retention.
For scenarios where decision-makers are interested in selecting 3 or 4 variables, our model provides alternative optimal combinations. With 4 variables, the combination (X1, X2, X3, Y2) is optimal with an AIC value of 14.814. When selecting only 3 variables, the combination (X1, X2, Y2) is favored, with the lowest AIC value of 3.615. Our method also aids in identifying core variables crucial for company operations by maintaining efficiency ranks close to the original model even after other variables are omitted. In Table 6, X1 and Y2 emerge as key variables, highlighting their significance in the DEA model.
Table 7 presents the ranking of decision-making units (DMUs) based on the Borda method, a voting system that assigns points to alternatives based on their order of preference. In this method, each DMU receives points for its ranking in each criterion, with the DMU ranking first receiving n 1 points, where n is the total number of DMUs. The points are then summed across all criteria to obtain the Borda score for each DMU. The DMU with the highest Borda score is considered to have the most robust performance. According to the findings, DMU14 emerges as the top-ranked DMU, achieving the highest Borda score of 123 points and securing the first rank. This indicates its consistent superior performance across various criteria. Conversely, DMU8 is identified as the lowest-ranked DMU, with a Borda score of 4 points, and is consistently placed at the bottom rank of 15 across all criteria. These results underscore that DMU14 demonstrates the most robust performance and should be the preferred choice for a supplier partnership, providing the decision-maker with a data-driven basis for selection. The Borda method ensures a comprehensive evaluation by considering the overall performance rather than focusing on a single criterion, thus facilitating a more informed decision-making process.

5.2. Tourism Technology Jobs Ranking

We have amassed data across 220 unique decision-making units (DMUs) within the tourism technology industry, with each DMU representing a distinct job profile. Our analytical framework meticulously assesses the attractiveness of these opportunities. The dataset includes key variables that shape job desirability, as detailed in Table 8. Here, input variables such as Experience (X1), Education (X2), and Skill (X3) represent the candidate’s qualifications and the prerequisites for the role. Conversely, output variables like Environment (Y1), Welfare (Y2), and Salary (Y3) reflect the incentives and work conditions provided by the companies, offering a comprehensive view of the value proposition for potential employees.
Experience (X1) reflects the depth of professional background expected for a position, Education (X2) indicates the level of academic achievement required, and Skill (X3) assesses the proficiency and expertise necessary for the role. Environment (Y1) relates to the work atmosphere and organizational culture, Welfare (Y2) covers the range of benefits beyond salary, and Salary (Y3) is the monetary value offered for the job. Utilizing our advanced methodological approach, we rank these tourism technology companies based on the composite attractiveness of their job offerings, providing insights into the job market’s trends and assisting in strategic decision-making for both employers and potential candidates.
Table 9 presents the optimal combinations of input and output variables for each DMU, along with their corresponding AIC scores. These combinations are determined by maximizing the AIC scores, indicating the most efficient variable configurations for each DMU. The table provides a detailed breakdown of the input and output variables, the total number of variables, the number of replications used in the analysis, and the AIC scores. This ranking system allows for a comparative analysis of the job offerings, providing insights into the job market’s trends and assisting in strategic decision-making for both employers and potential candidates.
Furthermore, Table 10 enhances our analysis by ranking tourism technology jobs using a Borda score, which integrates various criteria to measure job appeal. This ranking system, distilled from the optimal combinations in Table 9, offers a nuanced view of the job market’s most attractive and least compelling opportunities. It serves as a valuable guide for strategic decision-making in the tourism technology sector, aiding both employers in refining their recruitment strategies and job seekers in making informed career choices. Due to space constraints, the table highlights the top and bottom ten jobs, focusing on those that are particularly sought-after and those that may require improvements to enhance their appeal. The Borda score, a reliable statistical measure, ensures a comprehensive evaluation, providing a solid benchmark for assessing job attractiveness based on a holistic set of factors, including qualifications, benefits, and market trends. This ranking not only identifies the top ten most enticing job prospects but also reveals the ten that are least favored, offering a vivid portrayal of the job market’s standout and underperforming positions.
Based on the data presented in Table 10, DMU92 emerges as the most sought-after job type, securing the top position with a Borda score of 2155 points. This ranking indicates that DMU92 provides a compelling package of qualifications and benefits that resonate strongly with prospective candidates. On the other end of the spectrum, DMU35 is identified as the least popular, with a Borda score of 9 points, suggesting that it may lack the competitive edge in the job market, possibly due to an unappealing mix of qualifications and benefits on offer. These insights from the Borda score analysis offer valuable guidance for companies to refine their job offerings and for job seekers to identify the most attractive opportunities in the tourism technology sector.
The AIC scores play a crucial role in this analysis, as they provide a quantitative measure of the attractiveness of each job offering. A lower AIC score indicates a better fit of the model to the data, which in this context means a more attractive job profile. The AIC scores are used to rank the job offerings, allowing companies to assess the effectiveness of their recruitment strategies and job seekers to make informed decisions about which jobs to pursue.
By comparing the AIC scores, both companies and candidates can identify trends and make strategic decisions. Companies can adjust their job postings to better align with the qualifications and benefits that are most valued by the job market, while candidates can focus their job search on positions that offer the best combination of qualifications, prerequisites, and incentives. This analysis contributes to a more efficient and effective recruitment process in the tourism technology industry.
Our advanced methodological approach not only ranks the tourism technology companies based on the composite attractiveness of their job offerings but also offers a data-driven perspective on the job market trends. This comprehensive analysis assists in strategic decision-making for both employers and potential candidates, ensuring that job seekers can make informed choices about their employment opportunities and employers can align their job profiles with the qualifications and expectations of potential candidates.
The strategic role of decision-making in aligning organizational goals with resource management is well-established, with a focus on optimizing the allocation of resources to achieve the best outcomes [15]. This study aims to contribute to the literature by leveraging the Optimal Computing Budget Allocation (OCBA) technique, which provides a systematic approach to allocating computational resources efficiently [16]. The application of OCBA in the context of Data Envelopment Analysis (DEA) allows for the determination of the optimal number of simulation replications and the selection of the best combination of input and output variables. This approach is particularly beneficial in stochastic environments where traditional methods may fall short in capturing the inherent variability and uncertainty [13].
By integrating advanced analytics and statistical techniques such as AIC, this study enhances the robustness of DEA models, leading to more accurate and reliable efficiency measurements [12]. The use of AIC in model selection ensures that the most appropriate model is chosen based on its goodness of fit and simplicity, therefore improving the decision-making process [13]. Furthermore, the insights from career counseling and job market dynamics provide a foundation for understanding the multifaceted nature of decision-making, emphasizing the importance of aligning individual and organizational goals.

6. Conclusions

In this study, we introduce a novel method, OCBA–AIC, designed to select the optimal combinations of inputs and outputs in stochastic DEA. Our approach enhances existing variable-selection techniques by incorporating the stochastic nature of the variables. Specifically, we build upon the game cross-efficiency DEA model by leveraging the OCBA technique and Monte Carlo simulations.
Our method effectively integrates traditional and cross-DEA models, considering both self and peer evaluations to identify the most relevant variables based on efficiency entropy values and the Akaike Information Criterion (AIC). By employing the OCBA technique, OCBA–AIC not only determines the optimal number of simulation replications but also identifies the best combinations of inputs and outputs. Additionally, this method provides decision-making units (DMUs) with insights into which variables have the most significant impact on maintaining efficiency.
Our empirical results both corroborate and diverge from previous studies, highlighting the importance of context in variable selection and efficiency measurement. For instance, while our findings align with Nataraja et al. (2011) regarding the necessity for tailored variable selection, discrepancies arise in certain sectors where traditional assumptions of linearity may not hold [27]. From a practical perspective, our results have significant implications for organizations seeking to enhance efficiency measurement methodologies. By clearly identifying the most impactful variables, organizations can make more informed decisions regarding resource allocation and performance evaluation, ultimately driving operational improvements [38].
The implications of this research are significant for decision-making units operating in dynamic and uncertain environments. The ability to make informed decisions based on a comprehensive evaluation of variables and their interactions is crucial for strategic planning and resource allocation [14]. This study, therefore, not only advances the theoretical understanding of DEA in stochastic settings but also offers practical benefits to decision-makers, equipping them with the tools to navigate complexity and uncertainty in their decision-making processes.
Furthermore, our study offers valuable insights into the identification of a core efficiency model utilizing a single input and output. Overall, this method serves as a robust decision-making tool for DEA variable selection in stochastic environments, particularly due to its capability to rank DMUs effectively.
It is crucial to recognize the limitations inherent in this study. The efficacy of the OCBA–AIC method is heavily dependent on the quality and accuracy of the data, which may be subject to errors or biases [39]. Additionally, the method’s reliance on stochastic assumptions could limit its applicability in contexts where these assumptions do not hold or where data are limited. The computational intensity of the method may also pose challenges for less powerful systems. To address these limitations, future research should integrate advanced analytical techniques, such as machine learning and fuzzy logic, to refine variable selection and strengthen the robustness of DEA models [40]. Efforts should also be directed towards exploring alternative data sources, validating the method in various contexts, and developing more efficient computational algorithms.
In conclusion, the OCBA–AIC method introduced in this study provides a comprehensive framework for variable selection in DEA, offering both theoretical advancements and practical applications. It enhances the field’s ability to address the complexities of stochastic environments and provides a foundation for future research and development in performance management and decision-making.

Funding

This research was funded by the Guangdong Philosophy and Social Science “14th Five-Year Plan” Project, grant number GD23YGL02, and the Guangdong Ordinary Higher Education Characteristic Innovation Project, grant number 2023WTSCX114.

Data Availability Statement

The original contributions presented in the study are included in the article, further inquiries can be directed to the corresponding author.

Acknowledgments

We would like to express our sincere gratitude to the reviewers for their valuable comments and constructive suggestions, which have significantly contributed to the improvement of this manuscript. Their expertise and insights have been instrumental in enhancing the quality and clarity of our research.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Emrouznejad, A.; Yang, G. A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016. Socio-Econ. Plan. Sci. 2017, 61, 4–8. [Google Scholar] [CrossRef]
  2. Wagner, J.M.; Shimshak, D.G. Stepwise selection of variables in data envelopment analysis: Procedures and managerial perspectives. Eur. J. Oper. Res. 2007, 180, 57–67. [Google Scholar] [CrossRef]
  3. Dyson, R.G.; Shale, E.A. Data envelopment analysis, operational research and uncertainty. J. Oper. Res. Soc. 2010, 61, 25–34. [Google Scholar] [CrossRef]
  4. Nataraja, N.R.; Johnson, A.L. Guidelines for using variable selection techniques in data envelopment analysis. Eur. J. Oper. Res. 2011, 215, 662–669. [Google Scholar] [CrossRef]
  5. Toloo, M.; Tichỳ, T. Two alternative approaches for selecting performance measures in data envelopment analysis. Measurement 2015, 65, 29–40. [Google Scholar] [CrossRef]
  6. Duras, T.; Javed, F.; Kristofer, M.; Pär, S.; Magnus, S. Using machine learning to select variables in data envelopment analysis: Simulations and application using electricity distribution data. Energy Econ. 2023, 120, 106621. [Google Scholar] [CrossRef]
  7. Kannan, P.M.; Govindan, M.; Rathimala, K. Modelling Efficiency of Electric Utilities Using Three Stage Virtual Frontier Data Envelopment Analysis with Variable Selection by Loads Method. Energies 2021, 14, 3436. [Google Scholar] [CrossRef]
  8. Benítez-Peña, S.; Bogetoft, P.; Romero Morales, D. Feature Selection in Data Envelopment Analysis: A Mathematical Optimization approach. Omega 2020, 96, 102068. [Google Scholar] [CrossRef]
  9. Sonal, S.; Qianmei, F. Assessment of port efficiency using stepwise selection and window analysis in data envelopment analysis. Marit. Econ. Logist. 2020, 22, 536–561. [Google Scholar]
  10. Emrouznejad, A.; Parker, B.R.; Tavares, G. Evaluation of research in efficiency and productivity: A survey and analysis of the first 30 years of scholarly literature in DEA. Socio-Econ. Plan. Sci. 2008, 42, 151–157. [Google Scholar] [CrossRef]
  11. Li, Y.; Shi, X.; Yang, M.; Liang, L. Variable selection in data envelopment analysis via Akaike’s information criteria. Ann. Oper. Res. 2017, 253, 453–476. [Google Scholar] [CrossRef]
  12. Boudreau, J.W.; Ramstad, P.M. Using advanced analytics to improve talent management decisions: Examples and lessons from leading firms. J. Bus. Psychol. 2013, 28, 445–459. [Google Scholar]
  13. Burnham, K.P.; Anderson, D.R. Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach; Springer Texts in Statistics; Springer: New York, NY, USA, 2002. [Google Scholar]
  14. Rynes, S.L.; Gerhart, B.; Parks, L. E-Recruitment: A Review and Future Research Agenda. Hum. Resour. Manag. Rev. 2015, 25, 302–316. [Google Scholar]
  15. Lepak, D.P.; Smith, K.G.; Taylor, M.S. HR strategy and firm performance: When is HR strategic and why does it impact firm performance? Acad. Manag. Ann. 2016, 10, 107–148. [Google Scholar]
  16. Chen, C.H.; Lee, L.H. Stochastic Simulation Optimization: An Optimal Computing Budget Allocation; World Scientific: Singapore, 2011; Volume 1. [Google Scholar]
  17. Jenkins, L.; Anderson, M. A multivariate statistical approach to reducing the number of variables in data envelopment analysis. Eur. J. Oper. Res. 2003, 147, 51–61. [Google Scholar] [CrossRef]
  18. Wong, W.P.; Jaruphongsa, W.; Lee, L.H. Budget allocation for effective data collection in predicting an accurate DEA efficiency score. IEEE Trans. Auto. Control 2011, 56, 1235–1246. [Google Scholar] [CrossRef]
  19. Gholami, R.; Higón, D.A.; Emrouznejad, A. Hospital performance: Efficiency or quality? Can we have both with IT? Expert Syst. Appl. 2015, 42, 5390–5400. [Google Scholar] [CrossRef]
  20. Charnes, A.; Cooper, W.W.; Rhodes, E. Measuring the efficiency of decision making units. Eur. J. Oper. Res. 1978, 2, 429–444. [Google Scholar] [CrossRef]
  21. Liang, L.; Wu, J.; Cook, W.D.; Zhu, J. The DEA game cross-efficiency model and its Nash equilibrium. Oper. Res. 2008, 56, 1278–1288. [Google Scholar] [CrossRef]
  22. Cooper, W.W. Data envelopment analysis. In Encyclopedia of Operations Research and Management Science; Springer: Cham, Switzerland, 2013; pp. 349–358. [Google Scholar]
  23. Friedman, L.; Sinuany-Stern, Z. Combining ranking scales and selecting variables in the DEA context: The case of industrial branches. Comp. Oper. Res. 1998, 25, 781–791. [Google Scholar] [CrossRef]
  24. Norman, M.; Stoker, B. Data Envelopment Analysis: The Assessment of Performance; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 1991. [Google Scholar]
  25. Adler, N.; Golany, B. Evaluation of deregulated airline networks using data envelopment analysis combined with principal component analysis with an application to Western Europe. Eur. J. Oper. Res. 2001, 132, 260–273. [Google Scholar] [CrossRef]
  26. Anzanello, M.J.; Albin, S.L.; Chaovalitwongse, W.A. Multicriteria variable selection for classification of production batches. Eur. J. Oper. Res. 2012, 218, 97–105. [Google Scholar] [CrossRef]
  27. Yang, F.; Ang, S.; Xia, Q.; Yang, C. Ranking DMUs by using interval DEA cross efficiency matrix with acceptability analysis. Eur. J. Oper. Res. 2012, 223, 483–488. [Google Scholar] [CrossRef]
  28. Dotoli, M.; Epicoco, N.; Falagario, M.; Sciancalepore, F. A stochastic cross-efficiency data envelopment analysis approach for supplier selection under uncertainty. Int. Trans. Oper. Res. 2016, 23, 725–748. [Google Scholar] [CrossRef]
  29. Peyrache, A.; Rose, C.; Sicilia, G. Variable selection in Data Envelopment Analysis. Eur. J. Oper. Res. 2020, 282, 644–659. [Google Scholar] [CrossRef]
  30. Jeyms, V.C.; Manuel, M.M. Methodology for calculating critical values of relevance measures in variable selection methods in data envelopment analysis. Eur. J. Oper. Res. 2020, 290, 657–670. [Google Scholar]
  31. Subramanyam, T.; Donthi, R.; Satish Kumar, V.; Amalanathan, S.; Zalki, M. A new stepwise method for selection of input and output variables in data envelopment analysis. J. Math. Comput. Sci. 2021, 11, 703–715. [Google Scholar]
  32. Deng, Q.; Fu, Q.; Lian, Z. A Novel Method of Variable Selection in Data Envelopment Analysis with Entropy Measures. Int. Trans. Oper. Res. 2021, 41, 514. [Google Scholar] [CrossRef]
  33. Despotis, D.K.; Smirlis, Y.G. Data envelopment analysis with imprecise data. Eur. J. Oper. Res. 2002, 140, 24–36. [Google Scholar] [CrossRef]
  34. Jahanshahloo, G.R.; Lotfi, F.H.; Izadikhah, M. An algorithmic method to extend TOPSIS for decision-making problems with interval data. App. Math. Comp. 2006, 175, 1375–1384. [Google Scholar] [CrossRef]
  35. Kao, C.; Liu, S.T. Stochastic data envelopment analysis in measuring the efficiency of Taiwan commercial banks. Eur. J. Oper. Res. 2009, 196, 312–322. [Google Scholar] [CrossRef]
  36. Morita, H.; Seiford, L.M. Characteristics on stochastic DEA efficiency: Reliability and probability being efficient. J. Oper. Res. Soc. Jpn. 1999, 42, 389–404. [Google Scholar]
  37. Lu, T.; Liu, S.T. Ranking DMUs by Comparing DEA Cross-Efficiency Intervals Using Entropy Measures. Entropy 2016, 18, 452. [Google Scholar] [CrossRef]
  38. Halkos, G.E.; Salamouris, D.S. Efficiency measurement of the Greek commercial banks with the use of financial ratios: A data envelopment analysis approach. Manag. Account. Res. 2004, 15, 201–224. [Google Scholar] [CrossRef]
  39. Hamilton, L.C. Statistics with Stata: Version 12; Cengage Learning: Boston, MA, USA, 2012. [Google Scholar]
  40. Yang, H.; Pollitt, M. Incorporating both undesirable outputs and uncontrollable variables into DEA: The performance of Chinese coal-fired power plants. Eur. J. Oper. Res. 2009, 197, 1095–1105. [Google Scholar] [CrossRef]
Table 2. Generalized matrix of cross-efficiency.
Table 2. Generalized matrix of cross-efficiency.
DMU12n
1[ E ˜ 11 L , E ˜ 11 U ][ E ˜ 12 L , E ˜ 12 U ][ E ˜ 1 n L , E ˜ 1 n U ]
2[ E ˜ 21 L , E ˜ 21 U ][ E ˜ 22 L , E ˜ 22 U ][ E ˜ 2 n L , E ˜ 2 n U ]
n[ E ˜ n 1 L , E ˜ n 1 U ][ E ˜ n 2 L , E ˜ n 2 U ][ E ˜ n n L , E ˜ n n U ]
Average[ E ¯ 1 L , E ¯ 1 U ][ E ¯ 2 L , E ¯ 2 U ][ E ¯ n L , E ¯ n U ]
Table 3. Data set from [11].
Table 3. Data set from [11].
DMUX1X2Y1Y2Y3
143253
285341
357594
428132
513671
641264
Table 4. Comparison of Methods.
Table 4. Comparison of Methods.
No.X1X2Y1Y2Y3Our MethodRef. [11]Ref. [27]
Reps. AIC1 Reps. AIC2 Imp. Reps AIC3 Imp.
110100466−3.94100−1.9899%100−2.3865%
210110157−0.981000.66248%1001.16184%
30100197−0.911001.24173%1002.44137%
410010102.111003.1132%1004.2851%
501011342.021003.9549%1005.5964%
601010102.751004.3437%1005.6151%
711010104.381005.0513%1006.0528%
801101103.381005.5039%1007.0752%
901110123.851005.6231%1006.8344%
1011110106.341007.1211%1008.5526%
1101100323.931005.6530%1007.2746%
1201111105.221006.8924%1008.3137%
1310101314.441005.9125%1007.2138%
1410011104.561006.0925%1007.6240%
1510001105.411005.888%1007.1424%
1611100105.541007.2624%1009.5042%
1710111195.701007.3222%1009.3539%
1811011106.621007.9917%10010.5337%
1911101107.341008.2311%10010.3829%
2011001126.311007.0410%1009.1031%
2111111108.121009.6616%10010.3021%
Total 980 2100 2100
Average 47 100 45% 52%
Note: the improvement (imp.) of AIC is calculated by | A I C 1 A I C 2 | | A I C 2 | × 100 % and | A I C 1 A I C 3 | | A I C 3 | × 100 % .
Table 5. Data from an experimental study reported in [28].
Table 5. Data from an experimental study reported in [28].
X1X2X3X4Y1Y2Y3
DMU1(152;153;229)(280;282;421)299(272;274;410)(13.0;14.5;15.9)(98.1;109.0;120.0)(8.5;9.5;10.4)
DMU2(118;118;132)(242;242;272)160(235;235;264)(9.4;10.5;11.5)(66.6;74.0;81.4)(5.6;6.2;6.8)
DMU3(109;109;122)(245;245;270)205(238;238;268)(9.0;10.0;11.0)(67.6;75.1;82.6)(7.9;8.8;9.6)
DMU4(34;34;39)(93;93;107)120(101;101;128)(4.7;5.2;5.8)(31.2;34.7;38.1)(2.1;2.3;2.6)
DMU5(92;106;123)(176;203;237)276(180;207;242)(7.0;7.8;8.6)(51.3;57.0;62.7)(9.8;10.9;12.0)
DMU6(143;157;182)(198;217;252)233(251;275;318)(13.0;14.5;15.9)(85.9;95.4;105.0)(10.7;11.9;13.1)
DMU7(122;122;194)(215;215;339)257(157;157;248)(8.3;9.2;10.2)(60.39;67.1;73.8)(11.2;12.5;13.7)
DMU8(162;162;249)(338;338;518)635(169;169;259)(6.9;7.7;8.5)(55.1;61.3;67.4)(9.7;10.7;11.8)
DMU9(185;185;304)(376;376;625)481(336;336;557)(18.7;20.7;22.8)(145.8;162.0;178.2)(23.4;25.9;28.5)
DMU10(106;106;134)(296;296;379)339(173;173;235)(7.3;8.2;9.0)(53.4;59.4;65.3)(5.2;5.7;6.3)
DMU11(933;933;1033)(1782;1782;1955)1762(1392;1392;1532)(48.9;54.4;59.8)(366.5;407.2;447.9)(94.6;105.1;115.6)
DMU12(69;86;71)(124;155;129)123(104;130;130)(4.4;4.9;5.4)(19.2;21.4;23.5)(8.3;9.3;10.2)
DMU13(57;68;57)(94;113;94)123(101;122;122)(3.7;4.1;4.5)(26.8;29.8;32.7)(2.4;2.7;3.0)
DMU14(34;35;35)(88;90;89)150(226;230;230)(2.8;3.2;3.4)(69.0;76.7;84.4)(0.0;0.0;0.0)
DMU15(240;240;243)(668;668;672)439(571;571;600)(21.8;24.3;26.7)(155.9;173.2;190.5)(37.3;41.4;45.6)
Table 6. Optimal combination for different number of variables.
Table 6. Optimal combination for different number of variables.
No.X1X2X3X4Y1Y2Y3Total VariablesRep. TimesAIC
K1100001024100.3397
K2110001035103.6151
K31000011351715.4299
K41110010466214.8139
K51000111446722.0476
K61010011454323.1462
K71110110550426.9565
K81010111547928.0382
K91111010551928.9712
Table 7. DMU rankings with the Borda method.
Table 7. DMU rankings with the Borda method.
SupplierK1K2K3K4K5K6K7K8K9Borda ScoreRanking
DMU141111212211231
DMU4235819118972
DMU15392432537973
DMU6729374453914
DMU9444745872905
DMU268112103344846
DMU3578566669777
DMU186126118785648
DMU5910612811111012469
DMU12141431457109154410
DMU712111091212121164011
DMU1310513101313912133712
DMU1113127119101313143313
DMU101113141314141414101814
DMU8151515151515151511415
Table 8. Descriptive Statistics for Tourism Technology Company with 220 DMUs.
Table 8. Descriptive Statistics for Tourism Technology Company with 220 DMUs.
VariableNMinimumMaximumMeanStandard Deviation
Experience (X1)2200.310.02.9572.0802
Education (X2)22014.022.015.5821.0103
Skill (X3)22015.045.029.5275.3143
Environment (Y1)2202.020.07.8915.2861
Welfare (Y2)2201.076.027.33619.3373
Salary (Y3)2200.445.017.2097.7670
Table 9. Optimal Combinations with Corresponding AIC Scores.
Table 9. Optimal Combinations with Corresponding AIC Scores.
IDX1X2X3Y1Y2Y3Total VariablesRep. TimesAIC
K11000102462−2.291644
K21100103391−1.665309
K310001133252.252313
K411101045715.488801
K510011143616.319803
K610101145139.650136
K711101043759.866833
K810111156529.952996
K9111011545710.024476
K10111111655910.066365
Table 10. Ranking of Tourism Technology Jobs.
Table 10. Ranking of Tourism Technology Jobs.
JobK1K2K3K4K5K6K7K8K9K10Borda ScoreRanking
DMU921251912153621551
DMU2124161167231221462
DMU1991810153144106521243
DMU2195119213131281121164
DMU27452438172341821125
DMU7461671212115251221126
DMU169139652937251321087
DMU148141912161358111121008
DMU19791511177214149420989
DMU1468682251818978209110
DMU38209205201210208218203217208217104211
DMU16320721620021621221220821221520795212
DMU12621220820521721420921021320921093213
DMU15021321421120921519721520821820991214
DMU18420521121321520021619821921321991215
DMU17521720921821819921520920621221285216
DMU3021821821221221320521621020720584217
DMU7321921721420621120021721620321681218
DMU1021522021722021922022021822022011219
DMU352202192202192202192192202172189220
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Deng, Q. A Combined OCBA–AIC Method for Stochastic Variable Selection in Data Envelopment Analysis. Mathematics 2024, 12, 2913. https://doi.org/10.3390/math12182913

AMA Style

Deng Q. A Combined OCBA–AIC Method for Stochastic Variable Selection in Data Envelopment Analysis. Mathematics. 2024; 12(18):2913. https://doi.org/10.3390/math12182913

Chicago/Turabian Style

Deng, Qiang. 2024. "A Combined OCBA–AIC Method for Stochastic Variable Selection in Data Envelopment Analysis" Mathematics 12, no. 18: 2913. https://doi.org/10.3390/math12182913

APA Style

Deng, Q. (2024). A Combined OCBA–AIC Method for Stochastic Variable Selection in Data Envelopment Analysis. Mathematics, 12(18), 2913. https://doi.org/10.3390/math12182913

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop