Next Article in Journal
RMOBF-Net: Network for the Restoration of Motion and Optical Blurred Finger-Vein Images for Improving Recognition Accuracy
Previous Article in Journal
An Intrusion Detection System Based on Genetic Algorithm for Software-Defined Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Conic Duality for Multi-Objective Robust Optimization Problem

by
Khoirunnisa Rohadatul Aisy Muslihin
*,
Endang Rusyaman
and
Diah Chaerani
Department of Mathematics, Universitas Padjadjaran, Sumedang 45363, Indonesia
*
Author to whom correspondence should be addressed.
Mathematics 2022, 10(21), 3940; https://doi.org/10.3390/math10213940
Submission received: 22 September 2022 / Revised: 17 October 2022 / Accepted: 20 October 2022 / Published: 24 October 2022

Abstract

:
Duality theory is important in finding solutions to optimization problems. For example, in linear programming problems, the primal and dual problem pairs are closely related, i.e., if the optimal solution of one problem is known, then the optimal solution for the other problem can be obtained easily. In order for an optimization problem to be solved through the dual, the first step is to formulate its dual problem and analyze its characteristics. In this paper, we construct the dual model of an uncertain linear multi-objective optimization problem as well as its weak and strong duality criteria via conic duality. The multi-objective form of the problem is solved using the utility function method. In addition, the uncertainty is handled using robust optimization with ellipsoidal and polyhedral uncertainty sets. The robust counterpart formulation for the two uncertainty sets belongs to the conic optimization problem class; therefore, the dual problem can be built through conic duality. The results of the analysis show that the dual model obtained meets the weak duality, while the criteria for strong duality are identified based on the strict feasibility, boundedness, and solvability of the primal and dual problems.
MSC:
90C17; 90C25; 90C29; 90C46

1. Introduction

In mathematical optimization, data uncertainty may be due to various factors, such as measurement/prediction errors or unknown future demands [1]. Robust optimization (RO) is a methodology that can be used to deal with problems affected by data uncertainty, where there is no probability distribution that satisfies the parameter uncertainty [2]. RO was first introduced by [3], which was later developed by [4]. This method assumes that the data uncertainty is in the uncertainty set, including the box, ellipsoidal, and polyhedral set. This uncertainty assumption can then be handled by formulating the problem into a robust counterpart (RC) [5].
The RC formulation for these uncertainty sets is included in the conic optimization problem class (linear and conic quadratic programming). Conic optimization (CO) is a class of convex optimization which is related to the minimization of linear functions at the intersection of the affine subspace and convex cone [6]. It is important to study CO because many practical non-linear problems can be treated as CO, and a wide class of CO problems can be solved using the interior point method [7].
The dual formulation of the CO problem is an important step for determining the optimal solution. Duality can be used to detect infeasibility and to check the accuracy of the primal solution [8]. Several studies that discuss optimality and duality are [9,10,11]. In the convex optimization problem, duality plays a role in determining the solution of primal problem to determine the lower bound of the solution [12,13]. The development of the dual problem in CO is an extension of the duality in linear programming (LP), where in conic duality, strict feasibility is required in order to establish strong duality [14]. In fact, the linear optimization problem is a special case of the simplest CO problem, where the convex cone is a non-negative orthant R + m .
The term “dual problem” usually refers to the Lagrangian dual problem. However, several studies also use other types of duality in constructing dual problems, such as the Wolfe duality discussed by [15] in [16] and the Fenchel dual problem discussed by [17]. In addition, Shapiro [18] discusses duality for the linear conic problem through conjugation duality. Another approach is Mond–Weir duality, which is a modification of the Wolfe-type duality that weakens the convexity requirement [19]. Furthermore, Komodakis and Pesquet in [20] discuss the application of the primal–dual approach in solving large scale optimization problems such as alternating direction method of multipliers (ADMM).
Research on duality for the RO problem has been carried out, including that of Beck and Ben-tal [21] which shows that the primal worst is equal to the dual best. Moreover, ref. [22] extends the study for the multi-objective case. The cone-convexity is used in this article to determine the primal worst and dual best in robust multi-objective optimization with the RC represented as a set-valued function. Other studies that discuss duality for multi-objective RO problems can be seen in [23,24,25,26]. In RO, conic duality also plays a role in constructing RC from nonlinear inequalities and turning them into computationally tractable constraint sets [27]. Research that uses dual principles in solving RO problems includes [28,29,30].
The main purpose of this paper is to construct the dual model for an uncertain multi-objective linear optimization problem in which multiple objectives must be solved simultaneously. Whereas a single-objective optimization problem may have a unique optimal solution, a multi-objective problem can have an uncountable set of solutions [31]. Some such multi-objective problems do not have a single solution that simultaneously optimizes each goal. The purpose of solving this problem is to find a representative Pareto optimal solution, i.e., a solution in which there is no function that can be increased in value without decreasing some other objective value [32].
In this paper, the multi-objective problem is handled using the weighted sum utility function method so that the optimization problem to be solved remains linear with the single objective function [33]. In addition to making problems easier to solve, this method ensures the achievement of the Pareto optimality by selecting non-negative weights [34]. To overcome the uncertainty that exists in the model, we use the RC formulation by assuming the uncertainty is in the coefficients of the objective function and the constraints and is contained in the ellipsoidal and polyhedral uncertainty sets. We use the recipe for building conic dual by [7,35] to construct the dual problem of the RC formulation. Along with this, we also address the weak and strong duality criteria from the primal and dual forms.
This paper is constructed as follows. In Section 2, we recall some basic theories, such as the convex cone, CO, RO, and utility function method. Section 3 provides the method used in the paper. We build the dual problem of the multi-objective RO problem through conic duality in Section 4. The weak and strong duality analysis is given in Section 5. Section 6 concludes the finding.

2. Supporting Theory

In this section, we provide the theories used, i.e., cone and convex cone, conic optimization and conic duality, robust optimization, and the utility function method. In this paper, we consider vectors to be column vectors, and they are written in bold and italic. In addition, the inequality a b for vectors a , b R n is defined as
a i b i , for i = 1 , , n .
Other descriptions are given throughout the paper.

2.1. Convex Cone

In this subsection, the theory regarding convex cone is given as an introduction to convex optimization and conic optimization. This subsection is sourced from [12,36].
Definition 1.
A set K is called a cone if for every x K and θ 0 implies θ x K . K is called convex cone if it is a cone and convex, i.e., for x 1 , x 2 K and θ 1 , θ 2 0 implies
θ 1 x 1 + θ 2 x 2 K .
Definition 2.
Let K be a cone. The dual cone of K is given by
K * = { y : x T y 0 , x K } .
Convex cone K is called pointed if it contains no lines, i.e., satisfies
a K , a K a = 0 .
K is closed if it satisfies
a i K i = 1 , 2 , , a = lim i a i a K .
Moreover, K is solid if K has a nonempty interior. If cone K is pointed, closed and solid, then K is called a proper cone. For example, the linear cone is
R + m = { x R m : x 0 } ,
and the Lorentz cone is
L m = x R m : i = 1 m 1 x i 2 1 2 x m .
Cone K is called self-dual if K * = K . Furthermore, the dual cone of the direct product
K = K 1 × × K m ,
is direct product of the dual cones K i * , i.e.,
K * = K 1 * × × K m * .

2.2. Conic Optimization and Conic Duality

The conic optimization (CO) problem is part of the convex optimization in the form of minimizing a linear function with convex constraint functions contained in a convex cone [37]. The general form of the CO problem is given by
min { c T x : A x b K } ,
where x R n is the decision variable vector, A R m × n , c R n , K R m is a proper cone, and x A x b is an affine mapping from R n to R m .
The dual form of CO problem (6) is given by
max { b T y : A T y = c , y K * } ,
where K * is the dual cone of K [7]. Weak and strong duality theorems in conic duality are given in the following theorems [35].
Theorem 1.
Given the primal problem (6) and the dual (7), then b T y c T x .
Theorem 2.
Let x be a feasible solution of (6) and y be a feasible solution of (7), then
1 .
The duality is symmetric: the dual problem is conic, and the problem dual of the dual problem is equivalent to the primal problem.
2 .
(a) 
If the primal problem (6) is below bounded and strictly feasible, then the dual (7) is solvable, and the optimal values for both problems are equal.
(b) 
If the dual problem (7) is above bounded and strictly feasible, then the primal (6) is solvable, and the optimal values for both problems are equal.
3 .
Suppose that at least one of the two problems (6) and (7) is bounded and strictly feasible. Then a primal–dual feasible pair ( x , y ) is comprised of optimal solutions to the respective problems:
(a) 
If and only if b T y = c T x (zero duality gap);
(b) 
If and only if y T ( A x b ) = 0 (complementary slackness).
In practice, a typical conic optimization problem can consist of several constraints with different convex cones as follows.
min { c T x : A i x b i K i , i = 1 , , m } ,
where K i for i = 1 , , m are different convex cones. Therefore, the dual problem of (8) can be obtained by combining all constraints into one conical constraint A x b K assuming
A = A 1 A 2 A m , b = b 1 b 2 b m , and K = K 1 × K 2 × K m ,
so that it can be transformed into a (6) conic problem. By writing the dual variable as
y = y 1 y 2 y m , y i K i * , i = 1 , 2 , , m ,
we obtain A T y = A 1 T y 1 + A 2 T y 2 + + A m T y m . Moreover, due to the dual property of the direct multiplication of convex cone, we obtain the dual cone of K as
K * = K 1 * × K 2 * × K m * .
Hence, the dual problem of (8) is given by
max i = 1 m b i T y i T : i = 1 m A i T y i = c , y i K i * , i = 1 , 2 , , m .

2.3. Robust Optimization

Robust optimization (RO) is a method for solving optimization problems with uncertain data and is only known in an uncertainty set [5]. The general model of the uncertain linear optimization problem is given as follows [38]:
min { c T x : ( c , A , b ) U } ,
where x R n is the decision variable vector, c R n , A R m × n , b R m , and U is uncertainty set.
In RO, an uncertain linear optimization problem model can always be formed into a problem that only contains the uncertainty in the constraint functions. In the RO approach, uncertainty is eliminated by formulating the problem into a deterministic problem called the robust counterpart (RC). According to Ben-Tal and Nemirovski [5] we can analyze the computational tractability of the optimization model by representing RC into the linear programming (LP), conic quadratic programming (CQP), or semidefinite programming (SDP) problem. In this paper, we use the box and ellipsoidal uncertainty sets. The RC reformulation for these uncertainty sets is given in Table 1.

2.4. Utility Function Method

Multi-objective optimization is an optimization problem that has more than one objective function. In general, the multi-objective optimization problem is given by [32]:
min ( f 1 ( x ) , f 2 ( x ) , , f k ( x ) ) s . t . g j ( x ) 0 , j = 1 , , m .
where f i , for i = 1 , , l , are the objective functions, g j , for j = 1 , , m , are the constraint functions, and x denotes the decision variable.
Multi-objective optimization problems can be solved using utility functions. In the field of economics, utility, which is represented by the utility function, is used to measure the level of satisfaction or benefits felt by an individual or group obtained when consuming goods or services [39]. In the case of multi-objective optimization, the utility function is a combination of the individual utility functions of each objective function and is a mathematical expression to model the decision maker’s desires [33]. This method requires preference information before the problem can be solved. One of the simplest forms of utility functions is the weighted sum, which has the form
U = i = 1 l α i f i x , α i 0 , i = 1 , , l .
where α i is the scalar weighting, and i = 1 l α i = 1 . In the utility function method, the solution x * obtained by maximizing the utility function U with constraints, i.e.,
max U s . t . g j ( x ) 0 ; j = 1 , , m .
The value of x * of (13) can also be obtained by changing the problem to a minimization problem; based on the transformation of the objective function, we obtain the following.
min U s . t . g j ( x ) 0 ; j = 1 , , m .

3. Method

The initial model used in this study is a linear multi-objective optimization model with finite constraints and non-negative decision variables. This form of multi-objective optimization is then handled by the utility function method so that it becomes an optimization problem with a single objective function. This method allows the problem to remain linear, and the optimal solution x * can be obtained by considering all objective functions together.
The uncertainty is assumed to exist in the coefficients of the objective and constraint functions and is contained in the ellipsoidal and polyhedral sets of uncertainties. Furthermore, the RC formulation is formed for each form of the set of uncertainty. The dual problem form is formulated from the RC formulation using conic duality by redefining the constraints into the conic form. Moreover, we also analyze weak and strong duality based on the primal and dual problems that have been obtained.

4. Results

4.1. Initial Model and Utility Function Method

In this paper, we use the following linear multi-objective optimization problem as the initial model:
min c 1 T x , c 2 T x , , c k T x s . t . A x b x 0 ,
where x R n , c i R n , i = 1 , , k , A R m × n , and b R m . Furthermore, the utility function method is used to solve the multi-objective form of the (15). Using the weighted sum (12), we obtain the utility function
U = i = 1 k α i c i T x ,
where α i 0 for i = 1 , , k and i = 1 k α i = 1 . The optimal solution x * is found by maximizing the utility function (16) with constraint, i.e.,
max U s . t . A x b x 0 .
The optimal solution can also be obtained by changing (17) to a minimization problem:
min ( U ) s . t . A x b x 0 .
Note that the objective function in (18) can be changed to
U = i = 1 k α i c i T x = i = 1 k α i c i T x .
Therefore, suppose that w = i = 1 k α i c i R n , and model (18) can also be written as
min w T x s . t . A x b x 0 .

4.2. Robust Counterpart Formulation for Multi-Objective Linear Optimization Problem

In this study, we assume that the uncertainty lies in the coefficient of the objective function ( w ) and the constraint functions (A). In this case, we formulate the RC for (19). The first step is to form a nominal model as follows.
We modify the model so that the objective function can be replaced by an additional variable t R with t w T x to eliminate the uncertainty in the objective function,
min t s . t . w T x t 0 A x b x 0 , t R w , A U .
In the (20) problem, t is unsigned. According to the standard form of linear programming, it must be converted into a non-negative variable, that is, by assuming t as t = δ 1 δ 2 where δ 1 , δ 1 R and δ 1 , δ 2 0 . Therefore, (20) becomes
min δ 1 δ 2 s . t . w T x δ 1 + δ 2 0 A x b x 0 δ 1 , δ 2 0 w , A U .
The (21) problem is equivalent to the following nominal problem.
min 0 1 1 T x δ 1 δ 2 s . t . w T 1 1 A 0 0 x δ 1 δ 2 0 b x δ 1 δ 2 0 w , A U .
The uncertainty in (22) only contained in the constraint coefficient. Because of the constraint-wise robustness, the RC can be formulated for each constraint. First, we construct the RC formulation for the first constraint, namely
w T x δ 1 + δ 2 0 .
Note that the assumption of uncertainty in w can be substituted for uncertainty in c i for i = 1 , , k . Suppose c i U 0 ( i ) for i = 1 , , k can be expressed as an affine function of the primitive uncertain parameter ζ i Z 0 ( i ) R M i , i.e.,
c i = c i ¯ + C i ζ i , ζ i Z 0 ( i ) ,
where C i R n × M i and Z 0 ( i ) be a primitive uncertainty set. Hence, we obtain
w = i = 1 k α i c i = i = 1 k α i c i ¯ + C i ζ i = i = 1 k α i c i ¯ + α i C i ζ i = i = 1 k α i c i ¯ i = 1 k α i C i ζ i .
Note that the second term on the right side of (25) can be written as
i = 1 k α i C i ζ i = α 1 C 1 ζ 1 α 2 C 2 ζ 2 α k C k ζ k = α 1 C 1 α 2 C 2 α k C k ζ 1 ζ 2 ζ k .
Let
w ¯ = i = 1 k α i c ¯ i , P 0 = α 1 C 1 α 2 C 2 α k C k , and ζ 0 = ζ 1 ζ 2 ζ k .
We have
w = w ¯ + P 0 ζ 0 U 0 ,
which is an affine function of ζ 0 Z 0 where Z 0 = Z 0 ( 1 ) × Z 0 ( 2 ) × × Z 0 ( k ) and U 0 = { w | w = w ¯ + P 0 ζ 0 , ζ 0 Z 0 } . By substituting (26) in constraint (23) we obtain
w ¯ + P 0 ζ 0 T x δ 1 + δ 2 0 .
Furthermore, the A constraint matrix can be assumed as follows,
A = a 1 a 2 a m T ,
where a j R n and b j R for j = 1 , , m . The constraint A x b can be modified to
a j T x b j , j = 1 , , m .
The uncertainty in A can be formulated as an uncertainty in a j for j = 1 , , m . Suppose that a j U j is defined as an affine function over the primitive indefinite parameter ζ j
a j = a ¯ j + P j ζ j , ζ j Z j ,
where a j ¯ is nominal value vector, P j R n × L j , and Z j R L j . Substituting a j in (28) with (29), we obtain
a ¯ j + P j ζ j T x b j , ζ j Z j , j = 1 , , m .
The RC formulation for problem (19) with ellipsoidal and polyhedral uncertainty set is given by Table 2.

4.3. Dual Problems

In this section, the dual problem form of the RC formulation is given for the two cases of the set of uncertainties that have been obtained previously.

4.3.1. Dual Problem for Problem with Ellipsoidal Uncertainty Sets

We formulate the dual problem of (22) using the RC of constraints with the ellipsoidal set of uncertainties in Table 2, namely
w ¯ T x + P 0 T x 2 δ 1 + δ 2 0
a ¯ j T x + P j T x 2 b j
(31) and (32) constraints can be converted to the form of a conic constraint
P 0 T 0 0 w ¯ T 1 1 x δ 1 δ 2 L L 0 + 1 ,
P j T 0 0 a ¯ j T 0 0 x δ 1 δ 2 0 b j L L j + 1 .
Problem (22) can be changed to
min 0 1 1 T x δ 1 δ 2 s . t . P 0 T 0 0 w ¯ T 1 1 x δ 1 δ 2 L L 0 + 1 P j T 0 0 a ¯ j T 0 0 x δ 1 δ 2 0 b j L L j + 1 x δ 1 δ 2 0 .
Let
z = x δ 1 δ 2 , g = 0 1 1 , H 0 = P 0 T 0 0 w ¯ T 1 1 ,
H j = P j T 0 0 a ¯ j T 0 0 , v j = 0 b j , j = 1 , , m ,
and I be the identity matrix. In addition, define the convex cones
K 0 = L L 0 + 1 , K j = L L j + 1 , j = 1 , , m , R N = R n + 2 .
Model (35) can be simplified to
min g T z s . t . H 0 z K 0 H j z v j K j , j = 1 , , m I z R + N .
Based on the conic duality formulation, the dual model of (36) is given as follows:
max j = 1 m v j T λ j s . t . H 0 T λ 0 + j = 1 m H j T λ j + I λ m + 1 = g λ 0 K 0 * λ j K j * , j = 1 , , m λ m + 1 R + N * ,
with dual variable λ = λ 0 , λ 1 , , λ m , λ m + 1 .
Returning to the initial form and the fact that the Lorentz cone and linear cone are self-dual,
K 0 * = L L 0 + 1 * = L L 0 + 1 K j * = L L j + 1 * = L L j + 1 , j = 1 , , m , R + N * = R + N = R + n + 2 .
Therefore, (37) can be changed to
max j = 1 m 0 b j T λ j s . t . P 0 T 0 0 w ¯ T 1 1 T λ 0 + j = 1 m P j T 0 0 a ¯ j T 0 0 T λ j + I λ m + 1 = 0 1 1 λ 0 L L 0 + 1 λ j L L j + 1 , j = 1 , , m λ m + 1 R + n + 2 .
Furthermore, define
λ 0 = μ 0 τ 0 L L 0 + 1 where μ 0 R L 0 , τ 0 R , and μ 0 2 τ 0 , λ j = μ j τ j L L j + 1 where μ j R L j , τ j R , and μ j 2 τ j , untuk j = 1 , , m , λ m + 1 = s σ 1 σ 2 R + n + 2 where s 0 , σ 1 0 , and σ 2 0 .
Problem (38) can be modified to
max j = 1 m 0 T b j μ j τ j s . t . P 0 w ¯ 0 1 0 1 μ 0 τ 0 + j = 1 m P j a ¯ j 0 0 0 0 μ j τ j + s σ 1 σ 2 = 0 1 1 μ 0 2 τ 0 μ j 2 τ j , j = 1 , , m s 0 , σ 1 0 , σ 2 0 .
By describing each form of the constraint and the objective function, (39) becomes
max j = 1 m b j τ j s . t . P 0 μ 0 w ¯ τ 0 + j = 1 m P j μ j a ¯ j τ j + s = 0 τ 0 + σ 1 = 1 τ 0 + σ 2 = 1 μ 0 2 τ 0 μ j 2 τ j , j = 1 , , m s 0 , σ 1 0 , σ 2 0 .

4.3.2. Dual Problem for Problem with Polyhedral Uncertainty Sets

The dual problem formulation is built from the (22) problem with RC constraints, i.e.,
min δ 1 δ 2 s . t . w ¯ T x + q 0 T y 0 δ 1 + δ 2 0 , D 0 T y 0 = P 0 T x , a ¯ j T x + q j T y j b j , D j T y j = P j T x , x 0 , δ 1 0 , δ 2 0 , y 0 0 , y j 0 j = 1 , , m .
The first step is to convert the above problem into a CO problem. Define the decision variable
z = x y 0 y m δ 1 δ 2 T R N , where N = n + j = 0 m L j + 2 .
The objective function of (41) can be changed to
δ 1 δ 2 = 0 0 0 1 1 T x y 0 y m δ 1 δ 2 = g T z , where g = 0 0 0 1 1 .
Then the first constraint on (41) becomes
w ¯ T x q 0 T y 0 + δ 1 δ 2 0
w ¯ T q 0 0 T 0 T 1 1 x y 0 y 1 y m δ 1 δ 2 0
r 0 T z R + .
where r 0 = w ¯ T q 0 0 T 0 T 1 1 T . Furthermore, the second constraint from (41) becomes
P 0 T x D 0 T y 0 = 0
P 0 T D 0 T O L 1 , M 1 O L m , M m 0 0 x y 0 y 1 y m δ 1 δ 2 = 0
Q 0 z = 0
where Q 0 = P 0 T D 0 T O L 1 , M 1 O L m , M m 0 0 and O L j , M j is L j × M j zero matrix. Equation (48) can be converted into the form of a conic constraint
Q j 0 T z L L 0 + 1
Combining constraints (45) and (49), we obtain
Q 0 0 T r 0 T z L L 0 + 1 × R + .
Furthermore, the third and fourth constraints of (41) can be changed to
a ¯ j T x q j T y j + b j 0
P j T x D j T y j = 0 ,
for j = 1 , , m . By defining the r j given by
r 1 = a ¯ 1 T 0 T q 1 0 T 0 T 0 0 T r 2 = a ¯ 2 T 0 T 0 T q 2 0 T 0 0 T r m = a ¯ m T 0 T 0 T 0 T q m 0 0 T ,
and Q j given by
Q 1 = P 1 T O L 0 , M 0 D 1 T O L 2 , M 2 O L m , M m 0 0 Q 2 = P 2 T O L 0 , M 0 O L 1 , M 1 D 2 T O L m , M m 0 0 Q m = P 2 T O L 0 , M 0 O L 1 , M 1 O L 2 , M 2 D m T 0 0 ,
In the same way, (51) and (52) can be converted into conic constraint forms and combined into
Q j 0 T r j T z 0 b j L L j + 1 × R + .
Let
H 0 = Q 0 0 T r 0 T , H j = Q j 0 T r j T , v j = 0 b j , j = 1 ,
and cone
K 0 = L L 0 + 1 × R + , K j = L L j + 1 × R + , j = 1 , ,
the constraints (50) and (53) become
H 0 z K 0 ,
H j z v j K j , j = 1 , , m ,
and the model can be simplified to
min g T z s . t . H 0 z K 0 H j z v j K j , j = 1 , , m I z R + N .
Based on the conic duality formulation, the dual model of (56) is as follows:
max j = 1 m v j T λ j s . t . H 0 T λ 0 + j = 1 m H j T λ j + I λ m + 1 = g λ 0 K 0 * λ j K j * , j = 1 , , m λ m + 1 R + N * ,
with dual variable λ = λ 0 , λ 1 , , λ m , λ m + 1 .
Furthermore, considering that the Lorentz cone and linear cone are self-dual and based on the dual property of the direct product of the convex cone, the following is obtained:
K 0 * = L L 0 + 1 × R + * = L L 0 + 1 × R + , K j * = L L j + 1 × R + * = L L j + 1 × R + , j = 1 , , m , R + N * = R + N .
Let
λ 0 = μ 0 τ 0 θ 0 L L 0 + 1 × R +
where μ 0 R L 0 , τ 0 R , μ 0 2 τ 0 , and θ 0 0 ,
λ j = μ j τ j θ j L L j + 1 × R + ,
where μ j R L j , τ j R , μ j 2 τ j , θ j 0 for j = 1 , , m , and
λ m + 1 = s d 0 d m σ 1 σ 2 R + N ,
where s R + n , d 0 R + L 0 , d j R + L j for j = 1 , , m , σ 1 0 , and σ 2 0 . The (57) problem becomes
max j = 1 m 0 b j T μ 0 τ 0 θ 0 s . t . Q 0 0 T r 0 T T μ 0 τ 0 θ 0 + j = 1 m Q j 0 T r j T T μ 0 τ 0 θ 0 + s d 0 d m σ 1 σ 2 = 0 0 0 1 1 μ 0 2 τ 0 , μ j 2 τ j , j = 1 , , m , θ 0 0 , θ j 0 , j = 1 , , m , s 0 , d 0 0 , d j 0 , j = 1 , , m , σ 1 0 , σ 2 0 .
By describing the respective forms of the objective function and the constraint, problem (58) becomes
max j = 1 m b j θ j s . t . Q 0 T μ 0 + j = 1 m Q j T μ j + r j θ j + s d 0 d m σ 1 σ 2 = 0 0 0 1 1 μ 0 2 τ 0 , μ j 2 τ j , j = 1 , , m , θ 0 0 , θ j 0 , j = 1 , , m , s 0 , d 0 0 , d j 0 , j = 1 , , m , σ 1 0 , σ 2 0 .
Note that
Q 0 T μ 0 = P 0 μ 0 D 0 μ 0 O M 1 , L 1 O M m , L m 0 T 0 T , r 0 θ 0 = w ¯ θ 0 q 0 θ 0 0 0 θ 0 θ 0 .
Moreover, we also obtain
Q 1 T μ 1 = P 1 μ 1 O M 0 , L 0 D 1 μ 1 O M m , L m 0 T 0 T , , Q m T μ m = P m μ m O M 0 , L 0 O M 1 , L 1 D m μ m 0 T 0 T r 1 θ 1 = a ¯ 1 θ 1 0 q 1 θ 1 0 0 0 , , r m θ m = a ¯ m θ m 0 0 q m θ m 0 0 .
Therefore the first constraint of (59) can be changed to
P 0 μ 0 + j = 1 m P j μ j D 0 μ 0 D 1 μ 1 D m μ m 0 T 0 T + w ¯ θ 0 j = 1 m a ¯ j θ j q 0 θ 0 q 1 θ 1 q m θ m θ 0 θ 0 + s d 0 d 1 d m σ 1 σ 2 = 0 0 0 0 1 1 .
μ 0 2 τ 0 and μ j 2 τ j , j = 1 , , m can be ignored because the objective function does not contain μ 0 , μ j , τ 0 , and τ j , hence (59) can be written as
max j = 1 m b j θ j s . t . P 0 μ 0 + j = 1 m P j μ j w ¯ θ 0 j = 1 m a ¯ j θ j + s = 0 D 0 μ 0 q j θ 0 + d 0 = 0 D j μ j q j θ j + d j = 0 , j = 1 , , m θ 0 + σ 1 = 1 θ 0 + σ 2 = 1 θ 0 0 , θ j 0 , j = 1 , , m , s 0 , d 0 0 , d j 0 , j = 1 , , m , σ 1 0 , σ 2 0 .

5. Discussion

The primal problem forms for each of the problems in Section 4.3, namely (36) and (56), can be simplified to
min g T z s . t . H 0 z K 0 H j z v j K j , j = 1 , , m z R + N .
In addition, the duals, namely (37) and (57), are given in the form
max j = 1 m v j T λ j s . t . H 0 T λ 0 + j = 1 m H j T λ j + λ m + 1 = g λ 0 K 0 * λ j K j * , j = 1 , , m λ m + 1 R + N * ,
where g , z , H 0 , , v j , H j ( j = 1 , , m ) and the convex cones K 0 , K j , R + N are defined for each problem. Therefore, duality analysis is performed on the primal–dual pairs, (61) and (62).

5.1. Duality Symmetry

Based on (61) and (62), we obtain the following.
1.
The dual variable of (62), λ = ( λ 0 , , λ m + 1 ) , corresponds to the number of rows of each constraint of (61).
2.
There is a natural one-to-one correspondence between the constraints of (61) and (62). Moreover, the underlying convex cone of the primal–dual pair are dual to each other.
3.
Dual problem of (62) is equivalent to (61).
To see the duality symmetry in point 3 above, we construct the dual of (62) as follows. First, the objective function of (62) is changed to the minimization form as follows.
min j = 1 m v j T λ j s . t . H 0 T λ 0 + j = 1 m H j T λ j + λ m + 1 = g λ 0 K 0 * λ j K j * , j = 1 , , m λ m + 1 R + N * .
Furthermore, let z correspond to the equation constraint of (63) and let the dimension of z be equal to the dimension of g . Let η j , j = 0 , , m + 1 be responsible for other corresponding constraints, respectively. Hence, the dual problem of (63) is given by
max g T z s . t . H 0 z + η 0 = 0 H j z + η j = v j , j = 1 , , m z + η m + 1 = 0 η 0 K 0 η j K j , j = 1 , , m η m + 1 R + N .
Note that by changing the objective function to minimization and setting z = z , we can see that (64) is equivalent to (61).

5.2. Weak Duality

In this section, we examine the weak duality for the primal–dual problem pairs (61) and (62). Fulfillment of the weak duality condition is seen by examining
j = 1 m v j T λ j g T z .
Let z be a feasible solution of (61) and λ = λ 0 , λ 1 , , λ m , λ m + 1 be a feasible solution (62). Because λ 0 K 0 * and z satisfies H 0 z K 0 , then by the dual cone definition, we obtain
λ 0 T H 0 z 0 .
Variables λ j K j for j = 1 , , m satisfy
λ j T H j z v j 0 λ j T H j z λ j T v j 0 λ j T H j z λ j T v j .
Because (67) holds for every j = 1 , , m , then
j = 1 m λ j T H j z j = 1 m λ j v j .
Furthermore, for λ m + 1 satisfies
λ m + 1 T z = λ m + 1 T z 0 .
Moreover, λ satisfies the constraint of (62). Consequently,
g T z = H 0 T λ 0 + j = 1 m H j T λ j + λ m + 1 T z = H 0 T λ 0 T z + j = 1 m H j T λ j T z + λ m + 1 T z = λ 0 T H 0 z + j = 1 m λ j T H j z + λ m + 1 T z .
By (66), (68), and (69), we obtain
g T z 0 + j = 1 m λ j T v j + 0 = j = 1 m v j T λ j .
The inequality (70) is equivalent to (65), so we can conclude that the primal–dual pair problems, (61) and (62), satisfy the weak duality.

5.3. Strong Duality

In this section, we provide strong duality criteria for the primal–dual problem pairs (61) and (62). Based on the strong assumptions for the conic problem stated by [7,35], we obtain the following.
1.
No vector z 0 that satisfies H 0 z = 0 and H j z = 0 for j = 1 , , m .
2.
The duality is symmetric, i.e., the dual of (62) is equivalent to (61). This statement is explained in Section 5.1.
3.
Primal problem (61) is strictly feasible if there is a feasible solution z that satisfies
H 0 z int K 0 , H j z v j int K j ( j = 1 , , m ) , and z int R + N .
4.
Dual problem (62) is strictly feasible if there is a feasible solution λ that satisfies
λ 0 int K 0 * , λ j int K j * , and λ m + 1 int R + N * .
5.
Weak duality: The optimal value of (62) is less than or equal to (61). This is explained in Section 5.2.
6.
Strong duality: If either (61) or (62) is strictly feasible and finite, then the other is solvable, and the optimal values are equal. If (61) and (62) are strictly feasible, then both are solvable with the same optimal value.
Returning to the original problem, (35), the strictly feasible condition (71) for the problem with the ellipsoidal uncertainty set can be broken down as follows.
H 0 z int K 0 P 0 T 0 0 w ¯ T 1 1 x δ 1 δ 2 int L L 0 + 1 P 0 T x w ¯ T x + δ 1 δ 2 int L L 0 + 1 ,
H j z v j int K j P j T 0 0 a ¯ j T 0 0 x δ 1 δ 2 0 b j int L L j + 1 P j T x a ¯ j T x + b j int L L j + 1 ,
and
z int R + N x δ 1 δ 2 int R + m + 2 .
Note that the interiors of a linear cone and a Lorentz cone are given by
int R + m = x R m : x i > 0 , i = 1 , , m , and int L m = x R m : x 1 2 + + x m 1 2 < x m .
Therefore, (73)–(75) become
P 0 T x 2 < w ¯ T x + δ 1 δ 2 , P j T x 2 < a ¯ j T x + b j , j = 1 , , m , x > 0 , δ 1 > 0 , δ 2 > 0 .
Furthermore, the strictly feasible condition (72) for the dual problem (37) is satisfied if there is a feasible solution λ that satisfies
λ 0 L L 0 + 1 λ j int L L j + 1 , j = 1 , , m , λ m + 1 int R + n + 2 ,
or there is a feasible solution that satisfies
μ 0 2 < 1 , μ j 2 < τ j , j = 1 , , m , s > 0 .
The strictly feasible condition (71) for the problem with polyhedral uncertainty set (56) is equivalent to the existence of a feasible solution z = ( x , y 0 , , y m , δ 1 , δ 2 ) that satisfies the following conditions:
w ¯ T x + q 0 T y 0 δ 1 + δ 2 > 0 , a ¯ j T x + q j T y 0 b j > 0 , x > 0 , y 0 > 0 , y j > 0 ( j = 1 , , m ) , δ 1 > 0 , δ 2 > 0 .
The strictly feasible condition (72) for the dual problem is equivalent to the existence of a feasible solution that satisfies
θ 0 > 0 , θ j > 0 , j = 1 , , m , s > 0 , d 0 > 0 , d j > 0 , j = 1 , , m , σ 1 > 0 , σ 2 > 0 .
Furthermore, the optimality condition can be stated as follows. Let z be a feasible solution of (61) and λ = ( λ 0 , λ 1 , , λ m , λ m + 1 ) be a feasible solution of (62). The duality gap of the pair ( z , λ ) given by
Δ ( z , λ ) = g T z j = 1 m v j T λ j ,
is non-negative and is equal to
λ 0 T H 0 z + j = 1 m λ j T H j z v j + λ m + 1 T z .
The duality gap is zero if and only if the complementary slackness holds, i.e.,
λ 0 T H 0 z = 0 , λ j T H j z v j = 0 , j = 1 , , m , λ m + 1 T z = 0 .
This means that the duality gap is zero if and only if z and λ are the optimal solutions of (61) and (62), respectively, and the optimal values are equal.

6. Conclusions

In this paper, the dual of a multi-objective linear RO problem is formed through conic duality. This is based on the fact that the RC obtained using ellipsoidal and polyhedral uncertainty sets forms a CO problem, namely the CQP and LP. We also use the utility function method in solving multi-objective forms so that the problem solved is a single-objective optimization. Based on the analysis results, the primal and dual problems obtained meet the weak duality theorem. Moreover, the strong duality criteria are identified based on the strictly feasible, boundedness, and solvability properties of the primal and dual problem.
The selection of weights in the weighted sum utility function method does not always guarantee that the final or optimal solution is acceptable because this weight is the preference of each user. Therefore, the weight selection can be performed using the guidelines and methods discussed by [34]. In addition, further research can also use other types of utility function or other multi-objective problem solving methods, such as the lexicographic method or goal programming.

Author Contributions

Conceptualization, K.R.A.M.; Formal analysis, K.R.A.M. and E.R.; Methodology, D.C.; Writing—original draft, K.R.A.M.; Writing—review and editing, E.R. and D.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research is supported by the Indonesian Ministry of Education, Culture, Research, and Technology for Master Thesis Research Project 2022 entitled “Analisis Dualitas Konik untuk Masalah Optimisasi Robust Multiobjektif” under contract number 1318/UN6.3.1/PT.00/2022. The APC was funded by Universitas Padjadjaran.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors would like to thank the Directorate of Research and Community Service (DRPM) Universitas Padjadjaran also the Indonesian Ministry of Education, Culture, Research, and Technology.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
COConic Optimization
CQPConic Quadratic Programming
LPLinear Programming
RORobust Optimization
RCRobust Counterpart

References

  1. Ahmad, I.; Kaur, A.; Sharma, M.K. Robust duality for generalized convex nonsmooth vector programs with uncertain data in constraints. RAIRO-Oper. Res. 2021, 55, 2181–2188. [Google Scholar] [CrossRef]
  2. Gabrel, V.; Lacroix, M.; Murat, C.; Remli, N. Robust location transportation problems under uncertain demands. Discret. Appl. Math. 2014, 164, 100–111. [Google Scholar] [CrossRef]
  3. Soyster, A.L. Technical Note—Convex Programming with Set-Inclusive Constraints and Applications to Inexact Linear Programming. Oper. Res. 1973, 21, 1154–1157. [Google Scholar] [CrossRef] [Green Version]
  4. Ben-Tal, A.; Nemirovski, A. Robust solutions of uncertain linear programs. Oper. Res. Lett. 1999, 25, 1–13. [Google Scholar] [CrossRef] [Green Version]
  5. Ben-Tal, A.; Nemirovski, A. Robust optimization—Methodology and applications. Math. Program. 2002, 92, 453–480. [Google Scholar] [CrossRef]
  6. Glineur, F. Conic optimization: An elegant framework for convex optimization. Belg. J. Oper. Res. Stat. Comput. Sci. 2001, 41, 5–28. [Google Scholar]
  7. Chaerani, D. Recipes for Building the Dual of Conic Optimization Problem. J. Indones. Math. Soc. 2010, 16, 9–23. [Google Scholar] [CrossRef] [Green Version]
  8. Ekeocha, R.J.O.; Uzor, C.; Anetor, C. The Use of the Duality Principle to Solve Optimization Problems. Int. J. Recent Contrib. Eng. Sci. IT (iJES) 2018, 6, 33. [Google Scholar] [CrossRef]
  9. Wanka, G. Multiobjective control approximation problems: Duality and optimality. J. Optim. Theory Appl. 2000, 105, 457–475. [Google Scholar] [CrossRef]
  10. Luu, D.V.; Linh, P.T. Optimality and duality for nonsmooth multiobjective fractional problems using convexificators. J. Nonlinear Funct. Anal. 2021, 2021, 1. [Google Scholar]
  11. Mishra, S.K.; Kumar, R.; Laha, V.; Maurya, J.K. Optimality and duality for semidefinite multiobjective programming problems using convexificators. Appl. Numer. Optim. 2022, 4, 103–118. [Google Scholar]
  12. Boyd, S.; Vandenberghe, L. Convex Optimization; Cambridge University Press: Cambridge, UK, 2004. [Google Scholar]
  13. Wolf, S. An Introduction to Duality in Convex Optimization. Network 2011, 153, 153–162. [Google Scholar] [CrossRef]
  14. Im, J.; Wolkowicz, H. Strict Feasibility and Degeneracy in Linear Programming. arXiv 2022, arXiv:2203.02795. [Google Scholar]
  15. Wolfe, P. A duality theorem for non-linear programming. Q. Appl. Math. 1961, 19, 239–244. [Google Scholar] [CrossRef]
  16. Wu, H.C. Wolfe duality for interval-valued optimization. J. Optim. Theory Appl. 2008, 138, 497–509. [Google Scholar] [CrossRef]
  17. Guoyin, L.; Fu, N.K. On extension of Fenchel duality and its application. SIAM J. Optim. 2008, 19, 1489–1509. [Google Scholar] [CrossRef]
  18. Shapiro, A. On duality theory of conic linear problems. In Semi-Infinite Programming; Springer: Berlin/Heidelberg, Germany, 2001; pp. 135–165. [Google Scholar]
  19. Mond, B. Mond–Weir Duality. In Optimization; Springer: Berlin/Heidelberg, Germany, 2009; pp. 157–165. [Google Scholar]
  20. Komodakis, N.; Pesquet, J.C. Playing with duality: An overview of recent primal? dual approaches for solving large-scale optimization problems. IEEE Signal Process. Mag. 2015, 32, 31–54. [Google Scholar] [CrossRef] [Green Version]
  21. Beck, A.; Ben-Tal, A. Duality in robust optimization: Primal worst equals dual best. Oper. Res. Lett. 2009, 37, 1–6. [Google Scholar] [CrossRef]
  22. Caprari, E.; Baiardi, L.C.; Molho, E. Primal worst and dual best in robust vector optimization. Eur. J. Oper. Res. 2019, 275, 830–838. [Google Scholar] [CrossRef]
  23. Kim, M.H. Duality theorem and vector saddle point theorem for robust multiobjective optimization problems. Commun. Korean Math. Soc. 2013, 28, 597–602. [Google Scholar] [CrossRef] [Green Version]
  24. Goberna, M.A.; Jeyakumar, V.; Li, G.; Vicente-Pérez, J. Robust solutions of multiobjective linear semi-infinite programs under constraint data uncertainty. SIAM J. Optim. 2014, 24, 1402–1419. [Google Scholar] [CrossRef] [Green Version]
  25. Chuong, T.D. Linear Matrix Inequality Conditions and Duality for a Class of Robust Multiobjective Convex Polynomial Programs. SIAM J. Optim. 2018, 28, 2466–2488. [Google Scholar] [CrossRef]
  26. Chuong, T.D. Robust Optimality and Duality in Multiobjective Optimization Problems under Data Uncertainty. SIAM J. Optim. 2020, 30, 1501–1526. [Google Scholar] [CrossRef]
  27. Ben-Tal, A.; den Hertog, D.; Vial, J.P. Deriving robust counterparts of nonlinear uncertain inequalities. Math. Program. 2015, 149, 265–299. [Google Scholar] [CrossRef] [Green Version]
  28. Wang, L.; Li, Q.; Ding, R.; Sun, M.; Wang, G. Integrated scheduling of energy supply and demand in microgrids under uncertainty: A robust multi-objective optimization approach. Energy 2017, 130, 1–14. [Google Scholar] [CrossRef]
  29. Souza, D.L.; Lobato, F.S.; Gedraite, R. Robust Multiobjective Optimization Applied to Optimal Control Problems Using Differential Evolution. Chem. Eng. Technol. 2015, 38, 721–726. [Google Scholar] [CrossRef]
  30. Singh, S.; Biswal, M.P. A robust optimization model under uncertain environment: An application in production planning. Comput. Ind. Eng. 2021, 155, 107169. [Google Scholar] [CrossRef]
  31. Chiandussi, G.; Codegone, M.; Ferreroc, S.; Varesio, F. Comparison of multi-objective optimization methodologies for engineering applications. Comput. Math. Appl. 2012, 63, 912–942. [Google Scholar] [CrossRef] [Green Version]
  32. Rao, S.S. Engineering Optimization: Theory and Practice, 4th ed.; John Wiley & Son: New York, NY, USA, 2009. [Google Scholar] [CrossRef]
  33. Marler, R.T.; Arora, J.S. Survey of multi-objective optimization methods for engineering. Struct. Multidiscip. Optim. 2004, 26, 369–395. [Google Scholar] [CrossRef]
  34. Marler, R.T.; Arora, J.S. The weighted sum method for multi-objective optimization: New insights. Struct. Multidiscip. Optim. 2010, 41, 853–862. [Google Scholar] [CrossRef]
  35. Ben-Tal, A.; Nemirovski, A. Lectures on Modern Convex Optimization: Analysis, Algorithms, and Engineering Applications; MPS-SIAM Series on Optimization: Philadelphia, PA, USA, 2001. [Google Scholar]
  36. Brinkhuis, J. Convex Analysis for Optimization: A Unified Approach, 1st ed.; Springer Nature: Berlin/Heidelberg, Germany, 2020. [Google Scholar] [CrossRef]
  37. Ben-Tal, A.; Ghaoui, L.E.; Nemirovski, A. Robust Optimization; Princeton University Press: Princeton, NJ, USA, 2009. [Google Scholar] [CrossRef]
  38. Gorissen, B.L.; Yanikoğlu, I.; den Hertog, D. A practical guide to robust optimization. Omega 2015, 53, 124–137. [Google Scholar] [CrossRef]
  39. Mansfield, E. Microeconomics Theory/Applications, 5th ed.; W.W. Norton: New York, NY, USA, 1985. [Google Scholar]
Table 1. RC reformulation for ellipsoidal and polyhedral uncertainty sets.
Table 1. RC reformulation for ellipsoidal and polyhedral uncertainty sets.
Uncertainty SetRC FormulationTractabilityDescription
Ellipsoidal a T x + P T x 2 b CQP P R n × L
a T x + q T y b D R m × L
Polyhedral D T y = P x LP P R n × L
y 0 q , y R m
Table 2. RC formulation for problem (19).
Table 2. RC formulation for problem (19).
Uncertainty SetRC FormulationDescription
Ellipsoidal w ¯ T x + P 0 T x 2 δ 1 + δ 2 0 P 0 R n × L 0
a ¯ j T x + P j T x 2 b j P j R n × L j
Polyhedral w ¯ T x + q 0 T y 0 δ 1 + δ 2 0 P 0 R n × L 0
D 0 T y 0 = P 0 T x D 0 R M 0 × L 0
y 0 y 0 , q 0 R M 0
a ¯ j T x + q j T y j b j P j R n × L j
D j T y j = P j T x D j R M j × L j
y j 0 y j , q j R M j
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Muslihin, K.R.A.; Rusyaman, E.; Chaerani, D. Conic Duality for Multi-Objective Robust Optimization Problem. Mathematics 2022, 10, 3940. https://doi.org/10.3390/math10213940

AMA Style

Muslihin KRA, Rusyaman E, Chaerani D. Conic Duality for Multi-Objective Robust Optimization Problem. Mathematics. 2022; 10(21):3940. https://doi.org/10.3390/math10213940

Chicago/Turabian Style

Muslihin, Khoirunnisa Rohadatul Aisy, Endang Rusyaman, and Diah Chaerani. 2022. "Conic Duality for Multi-Objective Robust Optimization Problem" Mathematics 10, no. 21: 3940. https://doi.org/10.3390/math10213940

APA Style

Muslihin, K. R. A., Rusyaman, E., & Chaerani, D. (2022). Conic Duality for Multi-Objective Robust Optimization Problem. Mathematics, 10(21), 3940. https://doi.org/10.3390/math10213940

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop