1. Introduction
The periodic table consists of elements from nature that can be decomposed into atoms that possess several chemical properties. The isotopes are referred to as a collection of atoms that have the same chemical properties and the same name, but with different masses. There are the following two types of isotopes to be found in nature: stable ones that do not disintegrate over time, and radioactive ones that are affected by the disintegration process that makes them radioactive. In nature, carbon [
1] has fifteen known isotopes (
8C—being radioactive, to
22C), amongst which there are two stable isotopes:
12C (98.9%),
13C (1.1%) and one longest-lived radioactive isotope:
14C (<0.0001%).
In nature, there is a small concentration of stable isotopes that are necessary for applications [
2,
3,
4], so the necessity of increasing the concentrations is justified. The interest in the separation methods of the stable isotopes [
5,
6] (for example, as follows: carbon, oxygen, lithium, nitrogen) has shown growth in the last few years, whilst the subject has been known to be taken into consideration since the beginning of the 1960s, because of the usage of nuclear energy on an industrial scale and the need for new nuclear fuels. Along with the main fields in which the isotopes are used can be remembered as medicine (the isotopes of
13C and
14C are used for respiratory tests), chemistry, agriculture (efficiency in the usage of chemical fertiliser is reached by isotopes of
13C,
15N and
18O as tracer agents), biology or engineering (for example, hydrogen with the stable isotope deuterium with applications in the moderation of nuclear reactors with natural uranium and determining groundwater flow). Some information regarding the age of the rocks or the circuit of water in nature can be found by studying the natural abundance of isotopes.
The commonly used procedure in the case of the separation of the stable isotopes [
7,
8,
9,
10] is a distillation that implies that the isotopes of the compound make an exchange in the columns with packing [
11]; the isotopes can be found in columns in the gaseous or liquid phase. The procedure implies a piece of specific equipment and operation. Although there are few papers in the literature that presents the modelling and control problems for the isotopic separation [
12,
13], the process of the
13C isotope separation is proposed to be improved in this paper. The separation column’s working principle is based on the refluxing system, as follows: at the bottom of the column, the isotope is found in a liquid phase, where it is converted into a gaseous phase and re-entered into the column; at the top of the column, the isotope is converted from gaseous to liquid and re-entered into the column. The main setback of this process represents its nonlinearity, being a distributed parameter process with multiple inputs and multiple outputs, which poses a real challenge in the automation field when speaking of process modelling and control. The isotopic separation process is a consistently slow one, implying higher costs when the energy consumption of the plants may need to meet an improvement [
14,
15]. In the technical literature, there are some papers proposing mathematical models for the separation processes using constant parameters [
16,
17,
18], where there is no necessity to implement artificial intelligence (AI) learning methods since there are no variable parameters.
The methods of artificial intelligence process modelling emphasise the efficiency of obtaining an accurate model for the separation process that can be used for controller tuning or as a reference model in the structure of automatic control systems for the concentration of the
13C isotope; a main property of the model is the fact that it is designed to highlight the fractional-order behaviour [
19,
20,
21] of the real process. Moreover, the technical process associated with the separation column is a distributed parameter process because its dynamics depend both on time and on the position of the elements in relation to the columns’ height. On the other hand [
22,
23], implement solutions for learning the behaviour of some separation processes, but in their linearised form. The main approach of this research is to avoid the problem of simplification through linearisation and to consider in the proposed model the entire domains of signal variation. This aspect allows benefiting at the maximum potential from the performances of the future design of the
13C isotope automatic control system, based on the proposed model. The complexity of the
13C isotopic separation process results in the impossibility of learning its behaviour by only one neural network (regardless of its type), reaching the solution of interconnecting more neural networks.
There are some papers in the technical literature explaining the necessity of the implementation of fractional-order systems. Ref. [
24] presents the method for obtaining stable systems for those that vary in time and that are non-linear using Caputo’s definition of fractional-order derivatives, but only when the fractional differentiation order has a constant value and it is enclosed in the
domain. The stability of the fractional-order systems was studied and solved using the linear feedback control in [
25,
26], whilst [
27] presents the method of investigating the effects of fractional-order perturbation on the robust stability of linear time-invariant systems with interval uncertainty. The author of [
28] states the possibility of implementing a state feedback
controller for the commensurate linear and time-invariant fractional-order systems. Moreover, in [
29], the reduction problem of the
model is studied, aiming at its applicability only for positive fractional-order systems.
In practice, the fractional-order controllers, especially of the PID type (proportional-integral-derivative), have many applications. For example, an optimised method for auto-tuning procedures of PID fractional-order controllers, with application in flight control, is presented in [
30]. Precise models of fractional-order processes are necessary for the tuning of fractional-order PID controllers. In this context, in [
31], an example of proving the empiricism of the usage of the fractional-order systems is given based on the process of charging the circuit of a supercapacitor.
The analysis of the above-mentioned papers is concluded by offering simulation and control solutions only in those cases in which the fractional-order models of the considered lumped parameter processes are simplified and linearised. One of the main aims of this paper is to propose an original solution for the approximation of the separation column’s model in order to be robust in the variation of the separation process fractional differentiation order. In the case of the fractional-order models that have the fractional differentiation order , the actual existing methods are not allowing the model adaptation according to the variation of this parameter; more exactly, all the existent methods for the approximation of fractional-order systems with integer-order systems are valid only for constant values of . This disadvantage is eliminated by using the original approximation method proposed by this research.
As a result of the technical literature, the finite-dimensional integer-order transfer functions are considered to be a feasible alternative for the implementation of the fractional-order transfer function. It can be stated that the integer-order transfer function has an infinite-dimensional representation of the operator (fractional-order operator), where is a real number; various approximations are proposed for a single term . Consequently, the fractional-order systems are simulated or implemented by having the transfer functions replaced by the integer-order ones, which has the closest behaviour to the one that is desired, but is by far the easiest to handle.
There are different approximation solutions for the fractional-order operators, namely, for the continuous-time implementation, the Oustaloup filter (generalized, also known as a recursive approximation, or the modified version [
32,
33]), which is a good choice in most of the cases, the design of the FIR filter [
34], and the Tustin discretisation method [
35] for the discrete-time implementations, along with the methods of the retaining invariants for the impulse and step response; by selecting a frequency range of suitable interest, it is possible to easily approximate any fractional-order system with one of the above-mentioned methods.
The adaptability of the model to the actual solutions when the fractional differentiation order presents variations in relation to time, is only possible by reidentifying the structure parameters of the models, which is known to be a complex, time-consuming and laborious procedure. Using the actual approximation methods, the online identification of the process is impossible due to the impossibility of modifying the fractional differentiation.
In conclusion, there are not any elaborate methods in the technical literature that use fractional-order systems with variable fractional differentiation orders. The present research is justified due to the fact that the separation process presents in the practical operation variations of the fractional differentiation order, this aspect being highlighted in the model only if a new original approximation method is used.
Due to the complexity of the problem, the implementation of such an approximation method and implicitly a model is based on applying methods belonging to the AI (artificial intelligence) domain, namely, the neural networks. The AI methods in the last few years were applied in order to solve a lot of technical problems, as follows: predicting the evolution of the COVID-19 pandemic [
36], predictions related to marketing and management solutions [
37,
38], education matters [
39], cardiology matters [
40], in power electronic systems [
41], etc. The practical applicability of the proposed modelling method is proven by considering as a case study the isotopic separation process of
13C.
3. The Mathematical Modelling and the Numerical Simulation of the Separation Process
The
13C concentration that is obtained from the process is strongly dependent on the position inside the SC, in relation to its height. Moreover, the
13C concentration depends on time.
Figure 1b presents the 0
i axis, where the
variable highlights the position in relation to the columns’ height.
In the case of the 1 M concentration solution of monoethanolamine, the identification can be carried out through an experiment when the SC is working in the total reflux regime. The input signal of the process is considered to be the input flow of the monoethanolamine solution, and the output signal is the concentration of the
13C isotope at the lower part of the separation column. The experiment was made by applying at the input a step signal having a value of
h and using
T, the real-time experimental data (the real-time values of the output signal) were collected. The experimental data are presented in
Table 1.
Since there is a small amount of experimental data, the most probable curve that approximates the experimental curve has to be determined (this curve will describe the most probable separation process dynamics). The simulated curve is ought to approximate the dynamics of the time evolution of the output signal while eliminating the effect of the errors resulting from the measurement process. Due to the fact that the separation process is a fractional-order one, the most probable approximating response (curve) is obtained by using a fractional-order model.
The proposed fractional-order model that generates through simulations the most probable approximate response is represented by the following fractional-order transfer function:
where the proportionality constant
the time constant
(h) and the process fractional-order
.
The coefficients of the fractional-order transfer function from (1) are obtained using an iterative procedure, the corresponding simulations being made in the MATLAB Crone Toolbox. The graph that compares the separation process experimental curve (represented in blue) and the separation process simulated approximating response (represented in red) is presented in
Figure 2.
It can be remarked from
Figure 2 that the two curves are very close in values, meaning that the approximation’s accuracy is sufficient.
Using only the approximate response obtained in
Figure 2, the proof of the previously identified value of the processing time constant can be made using a classical identification method. It can be observed that the classic identification method is applicable in the case of a first-order process without dead time; the time constant of the process is determined using the tangent method [
43] (the considered classic identification method), and it is presented in
Figure 3.
It can be remarked from
Figure 3 that
represents the steady-state value for the response of the process (
. After applying the tangent method, the time constant
h is determined, the same value as it was previously determined through the procedure applied to identify the coefficients of (1).
The variation of the steady-state value of the
13C isotope concentration in relation to the variation of the input monoethanolamine solution flow can be modelled through the proportionality constant
that can be computed using the values of the input signals associated with two different experiments and the corresponding output signal steady-state values (for
h the experimentally obtained steady-state
13C isotope concentration is
(%) and for
h the experimentally obtained steady-state
13C isotope concentration is
(%); the notation
is used for the input flow of the monoethanolamine solution) as follows:
has the significance of the gradient of the approximation ramp that models the variation of the steady-state value of the 13C isotope concentration due to the variation of the input flow.
The mathematical model for the separation process [
44] is given by the equations below as follows:
The output signal of the open-loop process notated with
as follows:
where
is an increasing exponential function having the following form:
In which
is the Mittag-Leffler function in two parameters [
45] defined by
where
; this complex form of
is due to the fact that the separation process is a fractional-order one.
Moreover,
represents an equivalent step-type signal (depending on the process input signal—the input monoethanolamine solution flow
) in concentration as follows:
where the
13C concentration (the output) has an initial value
%, and its steady-state value (for
h)
%. The steady-state value of the
13C concentration varies in relation to the value of the solution flow (which is the input signal) according to
value; this procedure based on using the
constant allows to model a nonlinear process with modelling techniques that are used for linear ones.
The separation column can also be modelled using a more complex version that allows the highlighting of the influence of the position in relation to the column height. The equations for the complex version of the process model are presented below as follows:
The height equivalent to a theoretical plate (
HETP) for the separation column as follows:
where
h is the constant value of the monoethanolamine input flow and
is the instantaneous value of the monoethanolamine input flow (represented as a step input signal),
—proportionality constant (experimentally identified),
—the steady-state value of the
for the
. It can be remarked that the
is directly influenced by the monoethanolamine input flow
.
Which is responsible of the connection between the input flow of monoethanolamine and the HETP and where cm is the steady-state value of the for h.
The number of theoretical plates
as follows:
The separation
where the elementary separation factor for the
13C isotope regarding the procedure of chemical exchange is
.
The equivalent input signal of the separation process as follows:
where the natural abundance of the
13C isotope is
%.
The time constant
as follows:
where
is the process time constant when
and
it the process time constant when
. As it can be remarked, the complex form of the model also highlights the variation of the process time constant in relation to the position variation in the column height.
It is considered that the final position in the columns’ height is equal to the height of the column as follows:
The fractional-order differential equation [
45] that models the separation process dynamics as follows:
The function represents the solution of (13).
The dynamics of the concentration
in relation with
as follows:
where
is an equivalent length constant for SC and the proportionality constant
that is determined experimentally makes the mathematical connection between the input flow and the length constant of SC.
The
13C isotope concentration at any point of height in SC as follows:
and it depends on the input flow
of monoethanolamine. In (16), the
function is given by the following:
.
Using the mathematical model presented in (3), the process is simulated for different input signals of
mL/h. The comparative graph between the responses obtained by simulating the separation process is presented in
Figure 4.
The results for the simulations from
Figure 4 (more exactly the steady-state values of the five responses) are presented in
Table 2.
It can be concluded from
Table 2 and
Figure 4 that by decreasing the input flow
(also considered the input signal) results in an increase in the
13C isotope concentration (output signal). The phenomenon can be mathematically correlated to the negative value of the proportionality constant
from (2). On the other hand, from the physical point of view, the chemical exchange between the carbon dioxide and the carbamate has a lower intensity when the input flow of ethanolamine is higher; there is a smaller amount of time when the two reactants come into contact). However, the extreme values of the input flow that imply extreme operation regimes for the separation plant have to be avoided (the flooding phenomenon for high input flows and the dry-column phenomenon for low input flows).
The isotopic separation processes are considered extremely slow processes. Due to the fact that the separation plant operations are affected by different parametric perturbations (for example, the following technological parameters: temperature, insulation efficiency, or other disruptive parameters encountered due to the equipment in the structure of the isotopic separation installation); therefore, the structural parameters of the separation columns present variation with respect to time. Considering the results of the proceeded experiments and the previous explanation, it was concluded that the differentiation fractional-order of the separation process is strongly affected by the mentioned perturbations. The advantages of the proposed model that are likely to be considered are the following:
The possibility to implement an automated control strategy amongst with the associated controllers based on the developed model;
The implementation of the model as reference model in IMC (internal model control) structures;
Simulations can be performed by employees in order to highlight the behaviour of the isotopic separation installation in different operational scenarios.
The maximum efficiency of the proposed models, both on the technological and economical aspects, can be reached by obtaining a precision as good as possible; in this context, the online adaptation of the proposed model when the differentiation fractional-order presents variations (due to the mentioned parametric endogenous perturbations) is required.
4. The Proposed Solution for the Online Approximation and Adaptation of the Fractional-Order Models
In order to implement the first version of the separation process, the function with a complex structure in (4) should be approximated with high accuracy (being the representation in the time domain of a fractional-order process response).
There are more solutions proposed in [
45] in order to define the fractional-order derivatives. The Riemann–Liouville definition is presented below as follows:
where
is a fractional-order integral and
is an integer (
and
).
Caputo introduced an alternative method to define the following fractional-order derivative:
where
and
; the Caputo definition is more restrictive than the definition in (17), requiring the absolute integrability on the
th order derivative of the function
.
Supposing that
for the first
th order derivatives of
function and for
it results that
Consequently, the relationship between the definitions in (17) and (18) is the following:
The generalisation of backward difference underlies the following Grünwald–Letnikov definition:
where
is the usual notation for the binomial coefficients; there is also a possibility to define Grünwald–Letnikov definition alternatively in the following integral form:
where
.
By analysing the equations between (4) and (17)–(23), it is found that they imply consistent problems in terms of their numerical simulation (for example, the approximation of the Gamma function (), the integral computation or the limits approximation).
Moreover, due to the fact that, in the case of the separation process, the corresponding fractional differentiation order can present variations, the previously presented mathematical operations are not feasible for the implementation of its model.
In order to obtain and use a fractional-order transfer function, the Laplace transformation (for null initial conditions) is applied to Equation (3), resulting in the following:
where
is the following mentioned fractional-order transfer function:
In (25),
and
(h) are the structural parameters of the separation process. The mathematical form from (24) is due to the fact that
signal from (3) is a step-type one. In order to have the possibility to simulate the equation in (24), for the
transfer function, the Oustaloup approximation of fifth-order is applied. The comparison graph between the simulation of the most probable experimental curve and the simulation of the applied Oustaloup approximation is presented in
Figure 5.
After a complex analysis and comparation, it was concluded that by using the proposed fractional-order mathematical model, consistently better performances are obtained than the ones presented in the case of the sixth grade polynomial in [
46]. The considered quality indicator for the comparation is the mean squared error (computed based on the difference between the measured process output and the simulated process output).
The Oustaloup approximation is implemented using the MATLAB software, mainly by using the CRONE toolbox. As similar as in the case of the transfer function, the fractional-order function can be defined using “
”. The syntax of the
function [
47], which also allows the user to modify the order of the Oustaloup approximation, is presented below as follows:
where
—represents the numerator, being a cell, a scalar or an
object,
–represents the denominator having the same arguments as the numerator,
—is a scalar representing the order for the used Oustaloup approximation of fractional differentiator;
—a 1 × 2 matrix containing the lower waveband and the upper frequency for the Oustaloup approximation,
—Laplace variable corresponding character,
—the sampling time as a scalar and
—the string giving the method to simulate the fractional system (in this case,
).
The Oustaloup approximation can be rewritten as a ratio between two polynomials of the “s” complex variable. The two polynomials have the
coefficients at the denominator and the
coefficients at the following nominator:
where the coefficients
and
are depending on
(
and
) and
represents the order of the Oustaloup approximation.
There are some cases when the variation of leads to the coefficients or (for example, when takes an integer value). In order to highlight the variations of the parameter in the separation process model, an online identification mechanism that implements an adaptation procedure has to be used. This necessity is due to the fact that the classical identification can be applied only by retaking the experiments. More exactly, this procedure requires, in the first stage, the separation column to be turned off meaning that the so far obtained production is lost. Furthermore, the experiments are retraced each time the parameter presents variations. The main disadvantages of the classical identification are the time loss (the separation process being an extremely slow one (h)) and the product loss.
For the approached separation process, the fractional-order of the
transfer function is considered that
. As an example, the evolution of the transfer functions of both
and
coefficients in relation to
is presented in
Figure 6.
It can be remarked from
Figure 6a,b that the nominator coefficients are not monotonously varying (the same conclusion can be reached from
Figure 6c,d in the case of the denominator coefficients). The variation of the
parameter was highlighted using the step
. The two different considered domains for the
parameter variation
and
are necessary due to the fact that for
the Oustaloup approximation presents a pair of complex conjugated polls, an aspect which imposes differences in the mathematical model implementation. Because of this problem, it is also necessary to divide the fractional differentiation order of the system into the two mentioned intervals in order to store the resultant values for the Oustaloup approximation coefficients (for more efficient processing of the coefficients). Near the limit between the two considered domains, the monotony variation occurs, both for the
and
coefficients.
Due to the strong nonlinearity of the isotopic separation process (due to the high probability of the fractional differentiation order variation), the implementation of neural networks is required; the input-output datasets are to be obtained by sampling the signals that are used in order to train the four neural networks (the fractional-order coefficient (using the same step-size ) as the input signal and the coefficients of the integer-order transfer function resulted after applying the Oustaloup filter as output signals); the neural networks are able to learn all the Oustaloup approximation coefficients. Since there are two intervals determined for the fractional-order transfer function and since there is a major difference between the values of the denominator and the nominator coefficients, four neural networks are required in order to obtain the best performance when learning the Oustaloup approximation coefficients.
The neural architecture used in this paper is the feed-forward structure using the Bayesian regularization learning algorithm for training.
The feed-forward network consists of three or more layers. In the case of this application, the used neural networks each contain the input layer, only one hidden layer and an output layer. The input layer (the first layer) refers to the connections between the input signals and the neurons from Layer 2 (the hidden layer); it has no computational role; it is only taking over and dispatching the input signals. The neurons from the hidden layer have as input signals the input signals of the neural network weighted with the values of the weights that connect the input layer with the hidden layer; if the neural network had more than one hidden layer (which is not the case of the present application), the output signals of these neurons would represent the input signals for the neurons from the following hidden layer (through the weights that connect the mentioned consecutive hidden layers); the output signals from the neurons of the hidden layers of the proposed neural networks represent the input signals for the neurons of the output layer (through the weights that connect the hidden layer with the output layer). The output signals of the neurons from the output layer are the output signals generated by the proposed neural networks. However, the operation of a neural network relays on a simple principle, as follows: if a neuron is connected to another (following) neuron via a positively connected synapse (weight), it has an excitatory effect; on the other hand, if a neuron is connected to another neuron by a negative synapse (weight), it has an inhibitory effect. In the training procedure, pairs of values of the input-output signals are considered in matrix form. During the training procedure, the following two types of training signals can be highlighted: the functional signals computed by applying input reference vectors (the functional output signals are used for the computation of the errors between the desired values of the output signals and their instantaneous values); the adaptation signals, which are used for adapting the values of the neural network weights based on processing the errors resulting from using the functional signals.
The proposed feed-forward structure has the property of being a universal approximator, and the applied training algorithm is complex enough to learn the mathematical dependencies between the input signal and output signals. It can be remarked that the coefficients of the transfer functions obtained after applying the Oustaloup approximation are not recursive (their values corresponding to a certain do not depend on values of the same coefficients corresponding to other values of , more exactly, their instantaneous values are not dependent on their previous samples), this being the reason why recurrent neural networks are not necessary to be implemented.
Each neural structure was implemented by defining only one hidden layer. This was so to avoid increasing the complexity of the computations during the training procedures (the increase in the number of hidden layers implies a consistent increase in the computation complexity). The generated accuracy by increasing the number of hidden layers does not necessarily guarantee better performance, but as was previously mentioned, it consists of an increase in the complexity of the computations. Iteratively, it was possible to determine the number of neurons in the hidden layer by repeating the training procedure for different sizes of the hidden layer; starting with a number of four neurons in the hidden layer in each training, the number of neurons was increased by one; the iterative algorithm was stopped when, from one training to the next one, a performance decrease was remarked; using this procedure, the best training performances were obtained. The learning algorithm was stopped for each neural network when the MSEs (mean squared error) values between the approximated coefficients and their analytical values started to increase. Since the four neural networks must learn the behaviour of the parameters that are nonlinear, the activation functions for the neurons in the hidden layers are the hyperbolic tangent functions (bipolar sigmoid functions). The size of the output layer for all the four neural networks is five, each output giving a corresponding value for a denominator coefficient (in the case of the neural networks that approximate the denominator coefficients) or a nominator coefficient (in the case of the neural networks that approximate the nominator coefficients); the output signal is generally noted with (, both for denominator and nominator coefficients, and the output neurons are linear (having linear activation functions).
The dynamics of the Oustaloup approximation coefficients could also be implemented using only one more complex neural network, but this aspect would increase the complexity of the neural solution and the computation volume necessary to obtain it. Due to the fact that the Oustaloup approximation coefficients are highly variable, and have numerous decimals, both for denominator and nominator coefficients, the implementation of four neural networks is preferred (resulting in a more efficient and accurate mathematical model).
The general structure of the four used neural networks is presented in
Figure 7.
In
Figure 7,
represents the synaptic weight that connects the input signals with the
ith neuron of the hidden layer (
and
represents the synaptic weight that connects the
ith neuron of the hidden layer (
with the
jth neuron of the output layer (
.”
The hyperbolic sigmoid bipolar function used as an activation function for the neurons (the neurons from the hidden layer) is defined by , where is a constant parameter.
The linear function used as an activation function for the neurons (the neurons from the output layers) is defined by .
The algorithm Bayesian Regularization [
48,
49] is used in order to accomplish the training of the four networks and the allowed maximum number of epochs was set to 50,000, the minimum error gradient at
and the initial learning rate at
. For each learned coefficient, the MSE target value was set to
. The training was accomplished after 42,356 epochs when the imposed error was reached. The Levenberg–Marquardt algorithm was also implemented, but the obtained performances were significantly lower in comparison with the case of using the Bayesian Regularization. Other applied learning algorithms generated solutions that cannot be used due to their low accuracy for approximating the Oustaloup filter coefficient variation. Applying the previously presented iterative procedure, it was determined that in the hidden layer, the optimum number of neutrons is seven (in each case of all four neural networks). The implementation details of the four neural networks (their parameters) and their proposed structure are presented in
Figure 8.
The trained neural networks generate an output signal as it follows:
The high modelling accuracy generated by the proposed neural networks is proved in
Appendix A.
In
Figure 9, the comparison between the response of the Oustaloup approximation implemented using the first two neural networks (corresponding to
values lower than 1.02) and the response of the fractional-order transfer function in (25) is presented. As a case study, for the fractional-order transfer function, the following parameters are considered:
,
(h) and
. This example, which is not associated with the case of the separation process, is given only to prove the feasibility and the high accuracy of the proposed modelling method.
It can be remarked from
Figure 9 that the two neural networks are able to fully learn the coefficients of the Oustaloup approximation, the plots of the two functions being overlapped.
The second example is given only to prove the feasibility and high accuracy of the proposed modelling method for
values equal to or higher than 1.02. The comparison between the response of the Oustaloup approximation implemented using the second pair of neural networks and the response of the fractional-order system is presented in
Figure 10 (where the considered parameters of the fractional-order system are the following:
,
(h) and
).
From
Figure 10, it can be concluded that the neural networks (both for the denominator and nominator coefficients) are learning with very high accuracy the coefficients for the Oustaloup approximation. The examples from
Figure 9 and
Figure 10 demonstrate that the neural networks are able to learn and adapt to the desired output based on the selected input (the fractional differentiation order), and they can be used in the structure of the separation process mathematical model.
The main problem with modelling the separation process is the fact that it is a fractional-order process, and the associated differentiation order can present variations in relation to time. The proposed original solution is focused on approximating the fractional-order dynamics of the process, and it introduces the possibility to simulate the process in the case when its associated differentiation order is modified. In
Figure 9 and
Figure 10, the proposed solution for approximating the model of a fractional-order process with variable differentiation order is proven as feasibile. These examples are theoretical ones, and they are considered due to the fact that they have the same fractional-order structure as the fractional-order component as the considered separation process, but without considering the technological structure parameters of the separation process. These two examples are presented in order to sustain the feasibility of the theoretical part of the proposed solution with relevant simulations.
5. Simulation Results
Some of the advantages of including the neural networks in the process modelling for the dynamics of the 13C isotopic separation process include the higher accuracy obtained by implementing the neural models and the ability to design an online adaptation algorithm for the proposed model when some variations occur in the structural parameters of the separation process. Furthermore, a future approach to this system may include the intelligent control, using the same proposed procedure in the previous chapters for obtaining an adaptive fractional-order controller.
The mathematical model for the
13C isotopic separation process is implemented considering the Equations (1)–(5), (24), (25) presented previously, using the MATLAB/Simulink software [
47], and it runs in parallel with the proposed model implemented using the neural networks, having the same applied input signal
(the fractional-order system). The output from the separation process is the real (experimental)
13C isotope concentration, and the output signal from the proposed model is the simulated
13C isotope concentration curve. In order to implement the online procedure for the model adaptation, the error
is computed as the difference between the two signals (the
13C isotope experimental and simulated concentrations). It can be remarked that the obtained error signal is applied at the input of the adaptive mechanism, which consists of a PI controller generating at its output the input signal for the two neural networks (the two previously presented variation domains of
have to be separately approached). The adaptive mechanism processes the error value and further generates the adaptation signal.
The proposed adaptive structure of the isotopic separation process model using neural networks is presented in the following figure (
Figure 11).
The feasibility of the online adaptation of the proposed model is proved; the proposed model is run in parallel with the separation process, having applied the same input signal (the input flow of monoethanolamine) to both entities and considering the same fractional differentiation order
. The notation
refers to the real (experimental) concentration of the
13C isotope at the output of the separation column, whilst
refers to the simulated concentration obtained for the
13C isotope at the output of the process model; the error signal
is computed by the difference between the following two signals:
and
. When, in the case of the real process, the fractional differentiation order
presents variations, it implies the fact that the concentration of the
13C isotope also presents variations in relation to the time. Consequently, it results in the necessity to adapt the proposed fractional-order model using the adaptive mechanism from
Figure 11. In this case, a proportional-integral (PI) controller was chosen to implement the adaptive mechanism. Since the isotopic separation of the
13C isotope is a slow process, the steady-state value of the output signal (the
13C isotope concentration) is reached after long periods of time. The performance of the online identification of the process when the fractional differentiation order presents variations can be improved, for example, by using a full PID controller or a non-linear controller, more exactly by increasing the complexity of the adaptive mechanism structure.
As a future development direction, the proposed adaptive structure from
Figure 11 can be extended in order to have the possibility to learn, also, the variation of the process structure parameters (for example, in some particular and very rare operation scenarios, the time constant of the process presents some significant value deviations in relation to its nominal value). Practically, the future extended form of the proposed adaptive structure will be able to learn the possible variations of the process structure parameters by equivalenting their effects with the effect of modifying the value of the fractional differentiation order of the process.
5.1. Adaptation of Differentiation Order of a Fractional-Order System
In order to prove the feasibility of the proposed adaptation solution, as case study, the following fractional-order transfer function is considered:
The efficiency of the used adaptive mechanism combined with the proposed neural solutions is presented in
Figure 12 (where the value of the fractional differentiation order is
) and in
Figure 13 (where
). It can be remarked from
Figure 12 that at the time moment
(h) the value of the fractional differentiation order presented a step-type variation from
to
having as affecting the decrease in the
13C isotope concentration. Moreover, from
Figure 12, it results that using the adaptive mechanism, the mathematical model of the separation process based on using the neural networks is properly adapted, its output signal tracking with high precision the output signal from the real process (in this example, the fractional-order system).
By analysing
Figure 12, it can be remarked that the only visible difference between the two responses occurs after the moment when the
differentiation order varies until the adaptive mechanism accomplishes the online identification of this variation (the corresponding period being insignificant (approximatively 5 h) in relation to the process dynamics).
In
Figure 13, at the time moment
(h), the value of the fractional differentiation order presents a negative step-type variation from
to
. As in the previous case (case of
Figure 12), the same main conclusion results. More exactly, the proposed adaptive mechanism combined with the proposed mathematical model using neural networks can learn with accuracy the model dynamics variation at the variation of the fractional differentiation order of the real process (which is an essential structural parameter of the separation process).
Regarding the visible difference between the two responses from
Figure 13, the same conclusion as in the case of the responses from
Figure 12 can be drawn. However, immediately after the moment when the
fractional differentiation order varies for a short period of time (approximately 5 h as in the case of
Figure 12), the differences between the two responses are higher than the differences between the two responses from
Figure 12. This aspect is due to the fact that in the case of
Figure 13, the variation of the
fractional differentiation order for values higher than one is presented, a case in which the two output signals present faster variations than in the case when
has lower values than one. As it was mentioned before, these differences can be reduced by using a more complex form of the adaptive mechanism that can generate better online identification performances in a dynamic regime.
5.2. Adaptation of Differentiation Order of the Separation Process
The process model of the
13C isotopic separation system presented in (24) is simulated in
Figure 14 and
Figure 15. These simulations are made by considering the identified structure parameters of the process, and consequently, using the following:
Firstly, the efficiency of the proposed methods in approximating the
dynamics is proven, using as input signal the unit-step signal. It can be remarked from
Figure 14, that the initial value determined for
was modified to
at the time moment
(h). Furthermore, it results that the fractional-order model implemented using neural networks and using the adaptive mechanism follows with a high accuracy the dynamics implied by
.
In
Figure 15, the value of
was modified to
at the time moment
(h). Furthermore, the efficiency of the fractional-order model implemented using the artificial intelligence techniques (neural networks) is proven again since the accuracy of learning the behaviour of the fractional-order process is almost the same as in the case of the
Figure 14.
By analysing the differences between the two responses presented in
Figure 14, respectively, presented in
Figure 15, immediately after the variation of the
fractional differentiation order, it results in better performances in the case of
Figure 14. This aspect has the following two main causes: firstly, in the case of
Figure 15, the
fractional differentiation order presents a higher variation with 50% than in the case of
Figure 14; secondly, in the case of
Figure 14, the
fractional differentiation order presents an increasing variation from a value belonging to the neighbourhood of value 1 to a value belonging to the close neighbourhood of value 1 (this phenomenon of tending to an integer order process implies better performance for the adaptive mechanism).
5.3. Online Adaptation of the Separation Process Model
The evolution in time of the
13C isotope concentration is presented in
Figure 16, considering the input flow
h. The proposed neural model performs a close tracking over the real fractional-order process, being able to perform the adaptation at the variation of the fractional differentiation order value from
to
(at the moment of time
(h)). It can also be remarked that by increasing the differentiation order of the fractional transfer function, the
13C isotope concentration also increases.
The control signal (the fractional differentiation order
) applied by the adaptive mechanism to the NN1 and NN2 inputs in order to perform the online adaptation of the process model is presented in
Figure 17.
The control effort (
) generated by the adaptive mechanism in order to perform the adaptation is presented in
Figure 18; it follows from
Figure 17 and
Figure 18 that the positive control effort is generated only after the
parameter variation in order to learn this variation.
The efficiency in the adaptation of the isotopic separation process model when the decreasing variation of the fractional differentiation order value occurs is proven in
Figure 19. The initial value of
was decreased to the value of
at the time moment
(h). It can be remarked that by lowering the value of the fractional differentiation order, the obtained
13C isotope concentration is also lowered, and the dynamics of the proposed model output signal follows with accuracy the real separation process output signal.
The control signal (the fractional differentiation order
) applied by the adaptive mechanism to the NN1 and NN2 inputs in order to perform the online adaptation of the process model is presented in
Figure 20.
The control effort (
generated by the adaptive mechanism in order to perform the adaptation is presented in
Figure 21. It follows from
Figure 20 and
Figure 21 that the negative control effort is generated only after the
parameter variation in order to learn this variation.
It can be remarked by comparing the results presented in
Figure 16 and
Figure 19, which in the case of the
parameter increases, the online adaptation is visible more efficient than in the case when the
parameter decreases. This aspect is due to the fact that the tuning of the adaptive mechanism is made for the case when the
parameter increases. In order to obtain the same performance for the online adaptation when the
decreases the adaptive mechanism can be augmented with a control subsystem tuned in order to optimise this case.
By comparing the differences between the responses presented in
Figure 16 and
Figure 19, the same conclusions as in the case of
Figure 14 and
Figure 15 can be drawn. The better performances obtained in the cases of
Figure 14 and
Figure 16 are a consequence of the much faster evolution and stabilisation of the control signal presented in
Figure 17 than the evolution and stabilisation of the control signal presented in
Figure 20 (this control signal is associated with the simulation from
Figure 19, but it can be associated as a variation form to the simulation from
Figure 15, too).
These conclusions are proven through the values of the mean squared errors (MSE) presented in
Table 3.
The errors presented in
Table 3 are computed for each figure considering the 318 pairs of samples of the two corresponding responses.
5.4. The Effect of the Neural Networks in Processing the Experimental Data
In order to prove the efficiency of the proposed methods based on the usage of neural networks, another experiment was conducted on the considered separation column is approached.
The experimental curve for the 2 M (molar) input flow of monoethanolamine in methanol is presented in
Figure 22. The experiment consists of applying at the input of the process a step signal having a value of 700 mL/h. As an important remark is the fact that the previously presented experiment (
Figure 2) was made by considering the 1 M (molar) input flow of monoethanolamine in methanol. This is the reason why in the new experiment higher values of the input flow are used compared to in the first one.
The next step consists of the online identification of the response from
Figure 22 by using the adaptive structure (designed based on the proposed methods) from
Figure 11. In order to run the adaptive system, the searched fractional-order part of the model having the structure defined in (25) is initialised with the same value of the time constant as in the case of the first experiment (
(h)), with the proportionality constant (
) also being the same as in the previous case, and the fractional differentiation order
(a value lower than 1, randomly chosen). Moreover, the constant
was recomputed for the case of using 2 M of input monoethanolamine flow. Consequently, by running the adaptive system from
Figure 11, the appropriate value of the
fractional differentiation order has to be identified. The evolution in relation to time of the
parameter during the running of the adaptive structure is presented in
Figure 23.
From
Figure 23, it results that
varies from the value of 0.57 (the initialisation value) to the value of 0.91 (obtained in the steady-state regime), which represents the final result of the identification. It can be remarked that the identified value of the
parameter is the same as in the case of the first experiment. This aspect is due to the fact that the same separation plant is considered and also the same separation process (in both experiments). The usage of the 2 M input monoethanolamine flow in the case of the second experiment does not change physically the order (fractional-order in this case) of the process and, obviously, not mathematically.
The comparative graph between the experimental response associated with the second experiment and the response of the identified mathematical model for this case is presented in
Figure 24.
By analysing
Figure 24, the high quality of the identification can be remarked. The approximating response follows the process dynamics with accuracy, and the steady-state value of the two curves from
Figure 24 is equal. Consequently, the efficiency of the proposed method based on neural networks is again proved. The use of neural networks allows the simulation of the fractional-order systems when their fractional differentiation order presents variations, and by having this possibility, the fractional-order systems can be identified online (also the fractional differentiation order can be identified online). Both these approaches are original ones.
6. Conclusions
The benefit of using the neural networks in order to learn the dynamics of the isotopic separation process structure parameters in relation to the input value of the fractional differentiation order is represented by the high accuracy of the proposed model; the proposed solution for modelling the fractional-order systems is an original one and introduces important advantages in the simulation of these types of systems.
Section 3 proves the feasibility of the implementation of the proposed mathematical model of the separation process as a fractional-order one, whilst in
Section 4 the approach based on neural networks is presented.
In this paper, the mathematical modelling [
50,
51,
52,
53], the simulation [
54,
55,
56,
57] and the online model adaptation of the
13C isotopic separation process are approached; the proposed solution can be implemented and adapted to the case of the other separation processes, such as the ones for obtaining the
15N,
18O,
10B isotopes [
58]. The adaptation of the developed methods is efficient for being implemented in the cases as follows:
The separation processes are distributed parameter ones;
The separation processes are strongly nonlinear;
The concentration of the isotope to be separated depends on time and on the “length” variable (the position in the separation column in relation to the columns height);
The processes are very slow, and the time constants are varying depending on the intensity of the operation of the separation system.
There are some differences to be mentioned in the procedures applied to obtain other isotope separations, which can imply complications in the model adaptation as follows: other isotope production requires different chemical substances to be used, different equipment or even different structures of the separation plants.
The isotopic separation process operation is improved by implementing an adaptive mechanism in order to obtain the proposed model adaptation when the variation of the fractional differentiation order of the real process presents variations.
The proposed mathematical model for the separation process uses neural networks (which belong to the artificial intelligence domain) to generate at the output each value of the coefficients of the Oustaloup approximation of the fractional-order system. The efficiency of the neural networks is proven since the fractional differentiation order can vary between any value from 0 to 2, resulting in 200 Oustaloup approximation functions, each of them consisting of five coefficients for the nominator and five or six (in the case of the pairs of complex conjugated polls) coefficients for the denominator.
The developed system is improved by the implementation of the adaptive mechanism, which is able to adapt the proposed model during the evolution of the process (online) when the separation process fractional differentiation order presents variations.
An important future development possibility is to apply the proposed solution for approximating the dynamics of fractional-order systems in relation to the fractional differentiation order in the case of fractional-order controllers and to implement, based on this idea, fractional-order adaptive controllers. The implementation in practice of a future fractional-order adaptive controller is feasible from the perspective of processing power vs. accuracies due to two important aspects. Firstly, for a certain practical application, the training of the neural networks that are used for approximating the variation of the Oustaloup filter coefficients in relation to the fractional differentiation order is made, for example, in MATLAB, on a computer that is not integrated into the control loop. Consequently, the implementation of the practical control system does not need much computation processing power in order to train the neural solutions. Secondly, the fractional-order adaptive controller implementation, for example on a micro-controller, consists of the implementation of the recurrence relations associated with the neural solution’s operation. These recurrence relations that describe the neural solution’s operation (previously obtained after applying the training procedures) contain only basic mathematical operations, and they do not imply an increase in the computation processing power. Consequently, the necessary accuracy can be obtained by using acceptable computation processing power, and it can be improved by increasing the number of decimals of the coefficients that occur in the recurrence relations that describe the neural solution’s operation.