Next Article in Journal
Special Issue: Algorithms in Bioinformatics
Next Article in Special Issue
Self-Sustainability Assessment for a High Building Based on Linear Programming and Computational Fluid Dynamics
Previous Article in Journal
Improved Anomaly Detection by Using the Attention-Based Isolation Forest
Previous Article in Special Issue
MIRROR: Methodological Innovation to Remodel the Electric Loads to Reduce Economic OR Environmental Impact of User
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Variational Bayes to Accelerate the Lagrange Multipliers towards the Dual Optimization of Reliability and Cost in Renewable Energy Systems

by
Pavlos Nikolaidis
Department of Electrical Engineering, Cyprus University of Technology, 3036 Limassol, Cyprus
Algorithms 2023, 16(1), 20; https://doi.org/10.3390/a16010020
Submission received: 30 November 2022 / Revised: 19 December 2022 / Accepted: 26 December 2022 / Published: 29 December 2022
(This article belongs to the Special Issue Optimization in Renewable Energy Systems)

Abstract

:
Renewable energy sources are constantly increasing in the modern power systems. Due to their intermittent and uncertain potential, increased spinning reserve requirements are needed to conserve the reliability. On the other hand, each action towards efficiency improvement and cost reduction contradicts the participation of variable resources in the energy mix, requiring more accurate tools for optimal unit commitment. By increasing the renewable contribution, not only does the overall system inertia decrease with the decreasing conventional generation, but more generators that are expensive are also introduced. This work provides a radically different approach towards a tractable optimization task based on the framework of Lagrange relaxation and variational Bayes. Following a dual formulation of reliability and cost, the Lagrange multipliers are accelerated via a machine learning mechanism, namely, variational Bayesian inference. The novelty in the proposed approach stems from the employed acquisition function and the effect of the Gaussian process. The obtained results show great improvements compared with the Lagrange relaxation alternative, which can reach over USD 1 M in production cost credits at the least number of function evaluations. The proposed hybrid method promises global solutions relying on a proper acquisition function that is able to move towards regions with minimum objective value and maximum uncertainty.

1. Introduction

Under the consequences of one of the biggest energy crises, all countries around the globe are exploring viable solutions for alternatives to fossil fuels and especially natural gas. In the light of polluting emissions and climate change, the necessity of renewable energy sources (RES) grew exponentially during the last two years, under the shadow of a war that is still plaguing European countries and states around the world. Apart from the public concerns relating to the upcoming living conditions, a huge uncertainty has been added to the price of essential products that are either directly or indirectly affected by the dependency on imported natural gas [1].
As more stakeholders seek greater clarity and confidence in long-term investments and their respective opportunities in the forthcoming years, the impact of a potential integration of renewable and storage systems needs to be evaluated. To mitigate the environmental concerns around fossil fuels exploitation, the benefit list of a transition towards sectors electrification, de-carbonization and sustainability must be strengthened, facilitated by efficient tools that are able to consolidate the real-world constraints. Recent research activities on renewable sources and storage have been concentrated successfully on single operations and objectives. New objectives have recently appeared, targeting the co-optimization of cost, emissions, security and reliability within the power systems. These targets can be examined in depth, considering resources hybridization, multi-sectoral energy satisfaction and smart grid consolidation. As the missing link between intermittent renewable power and constant reliability, the various energy storage technologies can be compared, accounting for microgrid and virtual power plant formations.
The current state of research carefully reviews and assesses various approaches in optimal unit commitment (UC), which forms one of the most important tasks of the modern electric industry. Empirical methods simply consider the satisfaction of load by adjusting electricity production to demand during normal conditions [2,3]. In the case of generation deficits, load shedding takes place, while during excess generation, the electricity from RES is curtailed. More evolutionary methods aim at the co-optimization of load shedding and RES curtailment, following a priority with respect to generating the incremental cost of the participating units [4]. In this direction, priority-list schemes [5], Benders decomposition [6], Branch-and-Bound [7] and Lagrange relaxation (LR) [8] are some representative techniques that are able to offer only near-optimal solutions. Their relevant advantages rely on the mathematical process, which facilitates both the traceable transitions towards the final recommendation and the computational complexity irrespective of the number of examined generators. On the other hand, the obtained duality gap cannot be eliminated due to the imposed, real-world constraints that plague the generation activity today. These refer to the complicating constraints of power balance and spinning reserve in order to deal with the intermittent and stochastic behaviour of RES [9].
To offer adaptive mechanisms that are able to satisfy the required ramping capability, unit capacity and operating times, a heuristic search has been proposed in several research works. These approaches rely on physical- or biological-based algorithms and involve genetic algorithms [10], particle swarm optimization [11], simulated annealing [12], ant colony [13], tabu search [14] and so on. Although flexible, these techniques cannot guarantee optimality, especially in large systems where the magnitude of their sub-optimality cannot be evaluated [15]. As a result, the most recent version of UC solvers includes meta-heuristic alternatives. Binary grey wolf [16], binary whale [17], binary successive civilized swarm optimization [18], binary fish migration [19], binary cuckoo search [20], binary differential evolution [21], binary moth flame [22], coyote [23], binary [24] and artificial bee colony [25], monarch butterfly [26] and sine-cosine variant [27] are only some of the optimization approaches that exploit the merits derived from mathematical and heuristic methods to hybridize the process with one critical goal—to provide optimal exploration–exploitation trade-offs. This way, the last category aims at providing near-optimal solutions to the UC, consolidating several complicating equality and inequality constraints, conditional limitations and space boundaries while examining a large number of participating generating units over different time horizons. However, together with heuristics, meta-heuristic methods involve randomness and use the stochastic (or fuzzy) approach in moving from one solution to another [28].
To ameliorate for the demerits arising from the aforementioned approaches involved in emerging UC proposals, this work exploits the most recent advancements of the Lagrange framework and Bayesian inference to develop a radically new optimization tool for optimal UC schedules. Using the duality gap theory to form a Lagrangian objective, the problem is repeatedly minimized by updating the Lagrange multipliers based on Bayesian optimization. The multipliers account for both the security (power balance) and reliability (spinning reserve). The proposed approach essentially improves the computational performance via the dual optimization of reliability and cost in systems with highly variable resources. In addition, it offers global explorations in a minimum number of function evaluations, ensuring the transparency between the recommended solutions. The innovation in the proposed approach stems from the employed acquisition function and the effect of the Gaussian process. In this way, the expected improvement function properly guides optimization towards regions with either a minimum, mean or maximum uncertainty.
The rest of the paper is organized as follows. In Section 2, the dual formulation of the problem is presented, along with the complicating and unit-specific constraints. Section 3 deals with the mathematical formulation of Lagrange relaxation and variational Bayes as the primer for Lagrange-multipliers acceleration towards rapid convergence. The experimental evaluation is included in Section 4, where the obtained results are discussed in detail. Finally, the conclusions are drawn in Section 5.

2. Dual Problem Formulation

In its most analytical form, the objective of the unit commitment task is formulated to minimize the total generation cost (TGC), considering three main expenses. First, the fuel consumption cost F ( S , P ) is estimated based on the dynamic state ( S i t ) and actual power output ( P i t ) of each committed generator i during the time interval t. This expenditure relies on the cost coefficients of each independent generator, which in turn accounts for the heat rate coefficients (ai, bi, ci) and fuel specific cost fc. The following quadratic equation is generally used to define these expenses.
F ( S i t , P i t ) = S i t { f c [ a i ( P i t ) 2 + b i P i t + c i ] }  
The second aspect regards the emission cost E ( S , P ) that evaluates the gaseous emissions from different pollutants, including carbon dioxide (CO2), carbon oxide (CO), nitrogen oxides (NOx), sulfur oxides (SOx) and other hydrocarbon byproducts (CxHy). Assuming the emission cost coefficients (ei1, ei2, ei3) of each generator, the following equation can be utilized to account for this expenditure [29].
E ( S i t , P i t ) = S i t [ e i 1 ( P i t ) 2 + e i 2 P i t + e i 3 ]
The last portion of costs refers to the penalties (Πt of Equation (3)) and deteriorates reliability. This relates the energy not-served (PENS), translated as load shedding, the spinning reserve not-served (PSRNS) and the curtailed power from RES (Pcut-RES) with their respective penalty costs of πE, πSR and πRES [4].
Π t = π Ε P E N S t + π S R P S R N S t + π R E S P c u t R E S t
Finally, a factor is added to both unit-specific costs to include the start-up cost with respect to fuel consumption (FSUi) and associated emissions (ESUi). The comprehensive objective can now be represented with the aid of Equation (4), considering a time horizon T and participating generators N.
T G C = t = 1 T { i = 1 N [ F ( S i t , P i t ) + E ( S i t , P i t ) + S i t ( F S U i + E S U i ) S i t 1 ] + Π t }
The complicating constraints of the UC objective give priority to every action towards emissions inclination, efficiency improvement and RES integration. To this end, the power equilibrium expresses the equality constraints such that:
i = 1 N S i t P i t = P n e t t   ,   t T
P n e t t = P l o a d t P V R E S t
P V R E S t = P P V t + P w i n d t + P b i o m a s s t + P w a t e r t + P g e o t + P C H P t + P F C t
While the net load ( P n e t t ) equals the residual demand after the variable RES ( P V R E S t ) involvement, the contribution of solar PVs ( P P V t ), wind ( P w i n d t ), biomass ( P b i o m a s s t ), hydro and water alternatives such as wave and tidal ( P w a t e r t ), geothermal ( P g e o t ), combined heat and power ( P C H P t ) and fuel cells using renewable fuels ( P F C t ) for electricity demand satisfaction requires increased spinning reserves (SRt) to conserve the system’s reliability. These requirements are represented by the following inequality constraint:
i = 1 N S i t R U i t S R t   ,   t T
To adequately respond to probable, sudden deviations between actual and forecasted values, for both the demand and VRES contribution, the ramp-up capability ( R U i t ) from all committed generators during the interval t must satisfy the following requirements [30]:
S R t = ξ l o a d P l o a d t + ξ V R E S P V R E S t
In order to account for the unit-specific and plant-wide constraints, the limitations of power capacity, ramping capability, minimum state-change periods and compulsory status are taken into consideration. The power-output boundaries for each generator are shown in Equation (10). The positive (RUi) and negative (RDi) rate of change of the power output are presented with Equations (11) and (12). Equations (13) and (14) are used to calculate the minimum time (MUi) that must be elapsed before a generating unit can switch from on-status to off-status ( S i t = 1 0 ) and vice versa (MDi). The unavailability of a generator due to an unintentional failure or intentional maintenance is translated as a “must out” value. On the contrary, based on security and stability issues, at least one unit has to operate in “must run” within each independent power plant. Combined cycle units possess an exception and interchange between these states according to their mode of operation. Consequently, each mode is expressed via a different quadratic function, the state of which becomes “on” only when called upon [31].
P i , m i n P i t P i , m a x   , t T
P i t P i t 1 R U i   , t T
P i t 1 P i t R D i   , t T
t = t o n t S i t M U i   , t T
t = t o f f t ( 1 S i t ) M D i   , t T
S i t = { 0   , i f   i = m u s t   o u t 1   , i f   i = m u s t   r u n   , t T
The plant-wide restriction (cp) regards the maximum number of actions that can simultaneously be performed within a power plant. It is reflected by the maximum number of system operators and/or the capability of the integrated auxiliary equipment. The so-called crew constraint is formulated as:
c p = i = 1 N p S i t ( 1 S i t 1 )   , t T
where Np is the number of generating units within the power plant p.

3. Mathematical Framework

In this section, the mathematical framework relating to the algorithm developed for global optimization is presented and explained in detail. The objective function is expressed as Lagrangian, and the UC problem is decomposed into sub-problems that are coupled by making use of Lagrangian multipliers. In this way, the constrained optimum can be obtained through the dual optimization of reliability and cost, which can manifest as spinning reserve satisfaction and power balance.

3.1. Lagrange Relaxation Approach

The Lagrangian function can be written with respect to the non-negative multipliers of λt and μt as:
= F ( S i t , P i t ) + t = 1 T λ t ( P n e t t i = 1 N S i t P i t ) + t = 1 T μ t [ P n e t t + S R t i = 1 N S i t ( P i t + R U i ) ]
To separately minimize the contribution of each generating unit, Equation (17) is rewritten in the following form:
= i = 1 N t = 1 T { S i t [ F ( S i t , P i t ) + ( 1 S i t 1 ) F S U i ] λ t S i t P i t μ t S i t P i t } + t = 1 T [ λ t P n e t t + μ t ( P n e t t + S R t ) ]
At this stage, the complicating constraints can temporarily be ignored, and the first term of the expression can be minimized based on the problem:
m i n S i t , P i t ˙ = i = 1 N m i n t = 1 T { S i t [ F ( S i t , P i t ) + ( 1 S i t 1 ) F S U i ] λ t S i t P i t μ t S i t P i t }
This is subject to the constraints (10)–(15). By eliminating the coupling constraints, a guaranteed solution is expected if the constrained optimization task forms a relaxed problem that offers a lower bound to the original problem [32]. In the Lagrange relaxation method, the separability of the constraints is the underlying assumption that allows for the violation penalization towards optimality. Denoting with sk the mismatches of the coupling constraints at iteration k, the vector of Lagrange multipliers is updated considering the sub-gradient method as follows [9]:
[ λ k + 1   μ k + 1 ] = [ λ k   μ k ] + a k s k | | s k | |  
a k = 1 α + β k
The terminating criterion is called a duality gap (ε) and shows the difference percentage between the primal (J) and the dual (q) problem, respectively, according to Equation (22).
ε = J q | J | e r r o r
The repeating procedure stops when ε becomes lower than either a pre-specified tolerance (error) or a maximum number of defined iterations. Although the sub-gradient method is simple and computationally non-intensive, the oscillating behavior makes it difficult to design an appropriate stopping criterion. Typical solutions propose different step-size values for the over-constrained and under-constrained conditions at the expense of the exploration-space decrease and convergence time. In addition, unlike linear programming, integer linear programming cannot provide a strong duality theory. In this way, the optimal value of the dual Langrangian problem does not have to be the same as the optimal value of the original (primal) problem, which implies that the magnitude of the sub-optimality is controversial [33].

3.2. Bayesian Primer

To overcome the drawbacks of the weak duality and the oscillatory behavior of Lagrange relaxation, the Lagrange multipliers are modeled to form a Gaussian process. This constitutes a stochastic process that governs the properties of functions rather than describing random variables, which are scalars or vectors. Consequently, the new population is produced by adding the Gaussian number N ( 0 , σ 2 ) with a mean of zero and a pre-determined standard deviation to each multiplier such that:
λ k + 1 = λ k + N ( 0 , σ 2 )
μ k + 1 = μ k + N ( 0 , σ 2 )
This allows for giving a prior probability to every feasible function, with higher probabilities being given to functions that are more likely to be seen. Then, Bayesian inference techniques can be used in order to make progressive observations towards the final solution. In this realization, X represents the pairs of binary states S i t and the continuous output P i t , whereas Y is the scalar objective value of cost [34]. According to Bayes’ theorem, the updated posterior p(f|Y,X) is given considering an observed likelihood p(Y|f), the prior p(f|X) and the marginal likelihood p(Y|X), which will optimize the kernels and normalize the posterior such that:
p ( f | Y , X ) = p ( f | X ) p ( Y | f ) p ( Y | X )
Any set of the correlated, real values of independent and identically distributed random variables X and the postulated prior imposed over f(x) is expressed as p ( f | X ) ~ N ( 0 , K ) , where K represents the kernel, covariance matrix [35]. In this work, variational Bayes is taken into account due to its notably better scalability related to computational costs, which is of vital importance when having to deal with large datasets. Assuming D to be the set of the model parameters over which a prior distribution has been imposed, and considering Ξ|xi as the set of all model-hyperparameter priors and kernel functions, variational Bayesian inference provides a distribution q(D) in order to approximate the actual posterior p(D|Ξ,X,Y), which is computationally intractable, yielding:
log p ( X , Y ) = ( q ) + K L ( q | p )
( q ) = d D q ( D ) log p ( X ,   Y ,   D | Ξ ) q ( D )
where K L ( q | p ) represents the Kullback–Leibler divergence between the actual posterior p(D|Ξ,X,Y) and the approximate variational posterior, q(D). Since KL divergence is nonnegative, ( q ) forms a strict lower bound of the log evidence and would become exact if q(D) = p(D|Ξ,X,Y). Therefore, by maximizing this lower bound ( q ) such that it becomes as tight as possible, not only can the KL-divergence be minimized between the true and the variational posterior, but the unknown D can also implicitly be integrated out [36].

4. Experimental Evaluation

The experimental evaluation was performed considering a power system consisting of 18 generating units, the thermal characteristics of which are listed in Table 1.
The hourly, net demand (load minus RES) for a representative week (5 weekdays) in summer is presented in Figure 1.
The simulations were realized with the aid of MATLAB (MATLAB R2020, MathWorks) on a computer with an Intel-Core i7-4510U CPU @2.6 GHz, a 64-bit operating system (Windows 10) and 6 GB of memory. Utilizing the program developed based on the Lagrange relaxation approach, the parameters considered regard 120 hourly intervals, a 3500 MW peak load, a 5% spinning reserve requirement, 0.01 and 0.002 for the α and β update coefficients, respectively, a 0.01 gap error, a 10−9 tolerance for power balance and a maximum number of iterations of 350.

4.1. Comparison with Conventional Methods

Penalizing the curtailed RES, the energy not-served and the spinning reserve deficits with the most expensive production cost (using Equation (28)), the oscillating performance of the conventional LR approach can be observed in Figure 2.
π t = m a x i { F ( P i , m a x ) }
This corresponds to a TPC of 861.36 k$, obtained based on the following UC schedule (Figure 3).
Similar results were obtained by implementing simulations for the rest of the four weekdays. The performance is depicted in Table 2, where the number of iterations, the dual gap and the total production cost are included.

4.2. Comparison with Modern Insights

In this section, the most recent advances in the field of gradient-based optimization (GBO) and genetic algorithms are presented in order to evaluate and compare them with the proposed solution. Based on simulations obtained by applying the gradient-based optimization of [15], the TPC pertaining to the five-day optimal UC is rated at 2355.145 k$. The high production cost is formed by the increased number of committed generating units responding to the rapid changes in net load. Figure 4 justifies the obtained TPC, presenting the respective UC and power dispatch on the participating generating units.
With respect to genetic algorithms, the available function GA in the MATLAB optimization toolbox was taken into account, considering two coupling constraints and mixed-integer limitations. The drawback of the developed algorithm lies in the increased number of function evaluations (showing an exponential increase compared with LR) and the violation of coupling constraints. As a result, a penalty cost for the PENS and PSRNS retrieved as a ^ = m a x   a i ,   b ^ = m a x   b i ,   c ^ = m a x   c i was considered, resulting in a final TPC of 2378.296 k$. The power deficits can be seen in Figure 5.
On the contrary, the variational Bayes alternative completely avoided oscillations based on a proper acquisition function. The employed acquisition function helps the optimization move toward regions with lower mean values (lowest cost) and maximum uncertainty (posterior variance) [37]. In this way, the procedure not only avoids trapping at local oscillations but also promises a guaranteed global solution, increasing the exploration space with the minimum number of function evaluations. In normalized values, the performance of the proposed approach during a certain time interval can be explained with the help of Figure 6. Figure 6a shows the estimated objective function across the Lagrange multipliers. The respective minimum TPC over the required function evaluations (iterations) is illustrated in Figure 6b. Assuming that the formulated coupling constraint of power balance is satisfied only when ( S i t P i t P n e t t 10 9 ) 0 , its actual violation degree during an optimization loop can be expressed by Figure 7.
Applying simulations pertaining to the five weekdays, the optimal UC schedule greatly improved. Figure 8 presents the obtained contribution of the least committed units. The cumulative TPC achieved a drastic decrease in the order of −1.254 M$ (or a final of 2258.349 k$). The start-up cost, along with the fuel cost during each hourly interval, can be seen in Figure 9.
For the realization of the model developed based on variational Bayes, the settings utilized for control, initialization and stopping were the expected improvement acquisition function, 50% exploration ratio, 300-point Gaussian process fitness, four initial evaluation points, two non-deterministic coupling constraints and 30 maximum function evaluations without any initialization values for the optimizable variables, constraint violations or objective.

4.3. Prospects for Real-World Conditions

In real-world implementations, the RES contribution possesses the priority in the energy mix. Consequently, the penalty costs for the power not served from variable resources become superior in order to eliminate their curtailment. By enhancing the variable and uncertain resource penetration, the overall system inertia in terms of spinning reserve decreases, since the conventional generating units constitute the only source for the spinning reserve provision. An actual paradigm representing the residual load in contrast to the variable energy sources integration is depicted in Figure 10.
The actual values of the considered energy system pertaining to the worst day are tabulated in Table 3, along with the dynamic, spinning reserve requirement.
The sharp changes in the net load observed during periods with a high RES contribution require rapid-response generators to get online and follow the curve with minimum deviations. Apart from the increased ramping capability, these generators are usually expensive to start up, and in power systems with frequent renewable intermittency (e.g., due to unexpected cloud occurrences or steep wind gusts or falls), they may start up/shut down multiple times a day. On the contrary, the fuels used by rapid units with a high ramp capacity contribute less in terms of GHG emissions than they do in terms of energy consumption. They offer cleaner conversion with poor combustion indices [38]. Table 4 lists the CO2 emission coefficients of the assessed generators in relation to their fuel type [29]. The indicated values account for 5$/tn of released CO2 [37].
It is worth noting that expert systems and efficient algorithms are needed to handle the exploration–exploitation rates and, avoiding the local optima trapping, guide the optimization task towards global UC schedules with minimum TPC and maximum reliability. A realization of the problem based on the proposed approach is included in Figure 11.

5. Conclusions

In this work, a radically different approach to accelerating the Lagrangian multipliers towards optimal unit commitment has been presented. Based on the most recent advancements in variational Bayes, the conventional Lagrange relaxation technique has been enhanced to provide improved generation schedules during longer time-horizons at the least number of function evaluations. Formulating the complicating dual problem of unit commitment, an attempt was made in order to design a proper model that is able to lead optimization towards regions with minimum objective values and maximum uncertainty. In this way, the solutions cannot be trapped at the local minima but are driven to global solutions that undeniably improve the conventional mechanism that relied on simple dual decomposition. Utilizing the characteristics of 18 thermal generating units, the new approach compared well with its potential competitor under the same power system paradigm: a 120 h net-load demand. Based on the obtained results, the conventional Lagrange relaxation falls into oscillations which restrict the overall optimization task. As a result, to decrease the computational burden, smaller time horizons needed to take place (24 h load). Even in this case, the total production cost was too high in contrast to the overall cost obtained by making use of variational Bayes. This solution appears quite promising since it offers improved overall costs with less of a computational effort. Future works may regard the inclusion of renewable uncertainty in load and electricity storage.

Funding

This research received no external funding.

Data Availability Statement

Not applicable.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Celasun, O.; Mineshima, A.; Arregui, N.; Mylonas, V.; Ari, A.; Teodoru, I.; Black, S.; Zhunussova, K.; Iakova, D.; Parry, I. Surging Energy Prices in Europe in the Aftermath of the War: How to Support the Vulnerable and Speed up the Transition Away from Fossil Fuels. IMF Work. Pap. 2022, 152, 1–41. Available online: https://ssrn.com/abstract=4184693 (accessed on 1 November 2022). [CrossRef]
  2. Arias, A.F.; Lamadrid, A.; Valencia, C. Virtual Power Plant Day Ahead Energy Unit Commitment. In Proceedings of the 55th Hawaii International Conference on System Sciences, Maui, HI, USA, 4–7 January 2022; pp. 1–10. [Google Scholar] [CrossRef]
  3. Feng, Z.-K.; Niu, W.-J.; Wang, W.-C.; Zhou, J.-Z.; Cheng, C.-T. A mixed integer linear programming model for unit commitment of thermal plants with peak shaving operation aspect in regional power grid lack of flexible hydropower energy. Energy 2019, 175, 618–629. [Google Scholar] [CrossRef]
  4. Nikolaidis, P.; Poullikkas, A. Co-optimization of active power curtailment, load shedding and spinning reserve deficits through hybrid approach: Comparison of electrochemical storage technologies. IET Renew. Power Gener. 2022, 16, 92–104. [Google Scholar] [CrossRef]
  5. Shahbazitabar, M.; Abdi, H. A novel priority-based stochastic unit commitment considering renewable energy sources and parking lot cooperation. Energy 2018, 161, 308–324. [Google Scholar] [CrossRef]
  6. Colonetti, B.; Finardi, E.C. Combining Lagrangian relaxation, benders decomposition, and the level bundle method in the stochastic hydrothermal unit-commitment problem. Int. Trans. Electr. Energy Syst. 2020, 30, e12514. [Google Scholar] [CrossRef]
  7. Shen, J.-J.; Shen, Q.-Q.; Cheng, C.-T.; Zhang, X.-F.; Wang, J. Large-Scale Unit Commitment for Cascaded Hydropower Plants with Hydraulic Coupling and Head-Sensitive Forbidden Zones: Case of the Xiluodu and Xiangjiaba Hydropower System. J. Water Resour. Plan. Manag. 2020, 146, 05020023. [Google Scholar] [CrossRef]
  8. Scuzziato, M.R.; Finardi, E.C.; Frangioni, A. Solving stochastic hydrothermal unit commitment with a new primal recovery technique based on Lagrangian solutions. Int. J. Electr. Power Energy Syst. 2021, 127, 106661. [Google Scholar] [CrossRef]
  9. Nikolaidis, P.; Poullikkas, A. Enhanced Lagrange relaxation for the optimal unit commitment of identical generating units. IET Gener. Transm. Distrib. 2020, 14, 3920–3928. [Google Scholar] [CrossRef]
  10. Ponciroli, R.; Stauff, N.E.; Ramsey, J.; Ganda, F.; Vilim, R.B. An improved genetic algorithm approach to the unit commitment/economic dispatch problem. IEEE Trans. Power Syst. 2020, 35, 4005–4013. [Google Scholar] [CrossRef]
  11. Jordehi, A.R. An improved particle swarm optimisation for unit commitment in microgrids with battery energy storage systems considering battery degradation and uncertainties. Int. J. Energy Res. 2021, 45, 727–744. [Google Scholar] [CrossRef]
  12. Garlík, B.; Křivan, M. Renewable energy unit commitment, with different acceptance of balanced power, solved by simulated annealing. Energy Build. 2013, 67, 392–402. [Google Scholar] [CrossRef]
  13. Columbus, C.C.; Chandrasekaran, K.; Simon, S.P. Nodal ant colony optimization for solving profit based unit commitment problem for GENCOs. Appl. Soft Comput. J. 2012, 12, 145–160. [Google Scholar] [CrossRef]
  14. Sudhakaran, M.; Raj, P. Integrating genetic algorithms and tabu search for unit commitment problem. Int. J. Eng. Sci. Technol. 2010, 2, 57–69. [Google Scholar] [CrossRef]
  15. Said, M.; Houssein, E.H.; Deb, S.; Alhussan, A.A.; Ghoniem, R.M. A Novel Gradient Based Optimizer for Solving Unit Commitment Problem. IEEE Access 2022, 10, 18081–18092. [Google Scholar] [CrossRef]
  16. Srikanth, K.; Panwar, L.K.; Panigrahi, B.; Herrera-Viedma, E.; Sangaiah, A.K.; Wang, G.-G. Meta-heuristic framework: Quantum inspired binary grey wolf optimizer for unit commitment problem. Comput. Electr. Eng. 2018, 70, 243–260. [Google Scholar] [CrossRef]
  17. Yang, K.; Yang, K. Short-Term Hydro Generation Scheduling of the Three Gorges Hydropower Station Using Improver Binary-coded Whale Optimization Algorithm. Water Resour. Manag. 2021, 35, 3771–3790. [Google Scholar] [CrossRef]
  18. Anand, H.; Narang, N.; Dhillon, J. Profit based unit commitment using hybrid optimization technique. Energy 2018, 148, 701–715. [Google Scholar] [CrossRef]
  19. Pan, J.-S.; Hu, P.; Chu, S.-C. Binary fish migration optimization for solving unit commitment. Energy 2021, 226, 120329. [Google Scholar] [CrossRef]
  20. Zhao, J.; Liu, S.; Zhou, M.; Guo, X.; Qi, L. An Improved Binary Cuckoo Search Algorithm for Solving Unit Commitment Problems: Methodological Description. IEEE Access 2018, 6, 43535–43545. [Google Scholar] [CrossRef]
  21. Dhaliwal, J.S.; Dhillon, J. Profit based unit commitment using memetic binary differential evolution algorithm. Appl. Soft Comput. J. 2019, 81, 105502. [Google Scholar] [CrossRef]
  22. Reddy, S.; Panwar, L.K.; Panigrahi, B.K.; Kumar, R. Solution to unit commitment in power system operation planning using binary coded modified moth flame optimization algorithm (BMMFOA): A flame selection based computational technique. J. Comput. Sci. 2018, 25, 298–317. [Google Scholar] [CrossRef]
  23. Ali, E.; Elazim, S.A.; Balobaid, A. Implementation of coyote optimization algorithm for solving unit commitment problem in power systems. Energy 2023, 263, 125697. [Google Scholar] [CrossRef]
  24. Kumar, V.; Naresh, R. Application of baron solver for solution of cost based unit commitment problem. Int. J. Electr. Eng. Inform. 2020, 12, 807–827. [Google Scholar] [CrossRef]
  25. Amudha, A.; Varghese, M.P. A Hybrid CS-ABC optimization technique for Solving Unit Commitment Problem with Wind Power Uncertainty. Appl. Math. Inf. Sci. 2019, 13, 417–429. [Google Scholar] [CrossRef]
  26. Singh, V.; Fozdar, M.; Malik, H.; Márquez, F.P.G. Transmission congestion management through sensitivity based rescheduling of generators using improved monarch butterfly optimization. Int. J. Electr. Power Energy Syst. 2023, 145, 108729. [Google Scholar] [CrossRef]
  27. Nandi, A.; Kamboj, V.K.; Khatri, M. Metaheuristics approaches to profit based unit commitment for GENCOs. Mater. Today Proc. 2022, 60, 1874–1881. [Google Scholar] [CrossRef]
  28. Mrówczyńska, M.; Skiba, M.; Leśniak, A.; Bazan-Krzywoszańska, A.; Janowiec, F.; Sztubecka, M.; Grech, R.; Kazak, J. A new fuzzy model of multi-criteria decision support based on Bayesian networks for the urban areas’ decarbonization planning. Energy Convers. Manag. 2022, 268, 116035. [Google Scholar] [CrossRef]
  29. Nikolaidis, P.; Poullikkas, A. A Thorough Emission-Cost Analysis of the Gradual Replacement of Carbon-Rich Fuels with Carbon-Free Energy Carriers in Modern Power Plants: The Case of Cyprus. Sustainability 2022, 14, 10800. [Google Scholar] [CrossRef]
  30. Nikolaidis, P.; Poullikkas, A. A novel cluster-based spinning reserve dynamic model for wind and PV power reinforcement. Energy 2021, 234, 121270. [Google Scholar] [CrossRef]
  31. Nikolaidis, P.; Poullikkas, A. Evolutionary Priority-Based Dynamic Programming for the Adaptive Integration of Intermittent Distributed Energy Resources in Low-Inertia Power Systems. Eng 2021, 2, 643–660. [Google Scholar] [CrossRef]
  32. Cheng, C.-P.; Liu, C.-W.; Liu, C.-C. Unit commitment by Lagrangian Relaxation and Genetic Algorithms. IEEE Trans. Power Syst. 2000, 15, 707–714. [Google Scholar] [CrossRef]
  33. Rush, A.M.; Collins, M.J. A tutorial on dual decomposition and lagrangian relaxation for inference in natural language processing. J. Artif. Intell. Res. 2012, 45, 305–362. [Google Scholar] [CrossRef]
  34. Nikolaidis, P.; Antoniades, A.; Chatzis, S. A bayesian optimization approach for the robust unit commitment of identical generating units. In Proceedings of the 12th Mediterranean Conference on Power Generation, Transmission, Distribution and Energy Conversion (MEDPOWER 2020), Online, 9–12 November 2020; pp. 264–269. [Google Scholar]
  35. Hernández-Lobato, J.M.; Gelbart, M.A.; Adams, R.P.; Hoffman, M.W.; Ghahramani, Z. A general framework for constrained Bayesian optimization using information-based search. J. Mach. Learn. Res. 2016, 17, 1–53. [Google Scholar]
  36. Jordan, L.K.; Ghahramani, M.I.; Jaakkola, Z.; Saul, T.S. An Introduction to Variational Methods for Graphical Models. Mach. Learn. 1999, 37, 183–233. [Google Scholar] [CrossRef]
  37. Nikolaidis, P.; Chatzis, S. Gaussian process-based Bayesian optimization for data-driven unit commitment. Int. J. Electr. Power Energy Syst. 2021, 130, 106930. [Google Scholar] [CrossRef]
  38. Fritt-Rasmussen, J.; Wegeberg, S.; Gustavson, K.; Sørheim, K.R.; Daling, P.S.; Jørgensen, K.; Tonteri, O.; Holst-Andersen, J.P. Heavy Fuel Oil (HFO): A Review of Fate and Behaviour of HFO Spills in Cold; Nordic Council of Ministers: Copenhagen, Denmark, 2018. [Google Scholar] [CrossRef]
  39. Nikolaidis, P.; Poullikkas, A. Optimal carbon-electricity trade-offs through the virtual power plant concept. Discov. Energy 2022, 2, 1–16. [Google Scholar] [CrossRef]
Figure 1. Net-load demand (MW) for 120 weekday hours.
Figure 1. Net-load demand (MW) for 120 weekday hours.
Algorithms 16 00020 g001
Figure 2. Performance of the conventional LR approach during the first 24 h residual demand.
Figure 2. Performance of the conventional LR approach during the first 24 h residual demand.
Algorithms 16 00020 g002
Figure 3. Optimal UC schedule via the LR approach pertaining to the first 24 h residual demand.
Figure 3. Optimal UC schedule via the LR approach pertaining to the first 24 h residual demand.
Algorithms 16 00020 g003
Figure 4. Performance of the gradient-based optimization pertaining to the five-day paradigm.
Figure 4. Performance of the gradient-based optimization pertaining to the five-day paradigm.
Algorithms 16 00020 g004
Figure 5. Power deficits applying the genetic algorithm mechanism.
Figure 5. Power deficits applying the genetic algorithm mechanism.
Algorithms 16 00020 g005
Figure 6. Estimated minimum objective function value across (a) the Lagrange multipliers and (b) the required function evaluations.
Figure 6. Estimated minimum objective function value across (a) the Lagrange multipliers and (b) the required function evaluations.
Algorithms 16 00020 g006
Figure 7. Power-balance violation degree during a variational Bayes optimization loop.
Figure 7. Power-balance violation degree during a variational Bayes optimization loop.
Algorithms 16 00020 g007
Figure 8. Optimal UC through the novel variational Bayes approach.
Figure 8. Optimal UC through the novel variational Bayes approach.
Algorithms 16 00020 g008
Figure 9. Start-up versus total production cost with the variational Bayes paradigm.
Figure 9. Start-up versus total production cost with the variational Bayes paradigm.
Algorithms 16 00020 g009
Figure 10. Residual load and renewable energy contribution during the examined period.
Figure 10. Residual load and renewable energy contribution during the examined period.
Algorithms 16 00020 g010
Figure 11. Optimal UC schedule obtained by the proposed approach in a real-world scenario.
Figure 11. Optimal UC schedule obtained by the proposed approach in a real-world scenario.
Algorithms 16 00020 g011
Table 1. Characteristics of the thermal generating units.
Table 1. Characteristics of the thermal generating units.
Unit ia ($/MW2h)b ($/MWh)c ($/h)SU ($)Pmin (MW)Pmax (MW)MU (h)MD (h)RU (MW/h)RD (MW/h)
10.0014510,00010080088350350
20.0026510,00010080088350350
30.002582080008040044160160
40.0025102080008040044160160
50.002103060006030033120120
60.002123060006030033120120
70.00151440500050200227575
80.00151640500050200227575
90.00121555250025100114040
100.00121755250025100114040
110.00121755250025100114040
120.002103060006030033120120
130.002123060006030033120120
140.00151440500050200227575
150.00151640500050200227575
160.00121555250025100115050
170.00121755250025100115050
180.00121755250025100115050
Table 2. Results obtained through the conventional LR.
Table 2. Results obtained through the conventional LR.
Assessed WeekdayMax (k)εJ (k$)
11010.003783.89
2930.008625.66
3970.008604.86
41230.007636.45
51610.007861.36
Table 3. MW-output of different renewable systems across the residual load.
Table 3. MW-output of different renewable systems across the residual load.
IntervalBiomassGeothermalPVWindHydroResidual LoadSR
11018023305145845
2101802296143637
3101700287139535
4101700283137434
51017012287138439
6101804296143438
7101818021305127958
810192002322136455
910202200339143158
1010222201374160062
11102424035409171681
1210273123514611584211
1310292401604871975137
1410302201524962046134
1510292206484921528320
1610282002794791854178
1710291801504812013128
18102801214662147102
191027046459218973
20102702774521925159
21102701254452044101
221023096394182084
23102204377183347
24102000334162441
Table 4. Emission features of the thermal generating units [39].
Table 4. Emission features of the thermal generating units [39].
Unit ie1 ($/MW2h)e2 ($/MWh)e3 ($/h)SU Emission Cost ($)Fuel Type
10.00220.4787.712743.84Higher hydrocarbon
20.00220.4787.712743.84Higher hydrocarbon
30.00220.4787.712743.84Higher hydrocarbon
40.00220.4787.712743.84Higher hydrocarbon
50.00220.4787.712743.84Higher hydrocarbon
60.00220.4787.712743.84Higher hydrocarbon
70.00220.4787.712743.84Higher hydrocarbon
80.00220.4787.712743.84Higher hydrocarbon
90.00180.4381.31785.36Diesel
100.00180.4381.31785.36Diesel
110.00180.4381.31785.36Diesel
120.00220.4787.712743.84Higher hydrocarbon
130.00220.4787.712743.84Higher hydrocarbon
140.00220.4787.712743.84Higher hydrocarbon
150.00220.4787.712743.84Higher hydrocarbon
160.00180.4381.317743.84Diesel
170.00180.4381.31785.36Diesel
180.00180.4381.31785.36Diesel
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Nikolaidis, P. Variational Bayes to Accelerate the Lagrange Multipliers towards the Dual Optimization of Reliability and Cost in Renewable Energy Systems. Algorithms 2023, 16, 20. https://doi.org/10.3390/a16010020

AMA Style

Nikolaidis P. Variational Bayes to Accelerate the Lagrange Multipliers towards the Dual Optimization of Reliability and Cost in Renewable Energy Systems. Algorithms. 2023; 16(1):20. https://doi.org/10.3390/a16010020

Chicago/Turabian Style

Nikolaidis, Pavlos. 2023. "Variational Bayes to Accelerate the Lagrange Multipliers towards the Dual Optimization of Reliability and Cost in Renewable Energy Systems" Algorithms 16, no. 1: 20. https://doi.org/10.3390/a16010020

APA Style

Nikolaidis, P. (2023). Variational Bayes to Accelerate the Lagrange Multipliers towards the Dual Optimization of Reliability and Cost in Renewable Energy Systems. Algorithms, 16(1), 20. https://doi.org/10.3390/a16010020

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop