1. Introduction
With the development and progress of artificial intelligence, avionics, inertial navigation system, and control technology, coupled with the characteristics of low cost, flexible operation, high stability, and strong adaptability of the micro rotorcraft. References [
1,
2] use unmanned aerial vehicle(UAV) in the military and civilian fields, but a single UAV has problems such as insufficient load, limited resources, and low efficiency in the face of complex conditions. It is difficult to ensure the smooth execution of diversified tasks in complex environments. The most reliable and effective solution to the above problems is to use multiple UAVs to form a coordinated formation [
3], and it is used for fixed-wing aircraft. Compared to fixed-wing aircraft, the quadrotor has the advantage of vertical take-off and landing, hovering, and maneuvering flying, so it occupies a very important position in UAV systems [
4,
5]. Therefore, this paper uses multiple quadrotors to achieve formation control.
The coordinated formation control of multiple UAVs is an important technology in the autonomous collaborative control method of multiple UAVs. Multiple UAVs can be used to complete some complex tasks. Formation control strategies mainly include leader-follower method [
6,
7], behavior-based method [
8], virtual structure method [
9,
10], consistency-based method [
11], and so on. Among them, the leader-follower method control system is simple and easy to implement. For specific algorithms, reference [
12] uses the backstepping control algorithm to realize UAV formation control well, but it depends on the accuracy of the mathematical model. References [
13,
14] use the intelligent learning control method to avoid this problem, but it has a large amount of calculation and poor anti-interference ability. Compared to the above method, References [
15,
16] using sliding mode control (SMC) can make the UAV system sliding on the sliding surface, which can reduce the system’s dependence on the accuracy of the mathematical model and enhance the system’s anti-interference ability. Therefore, it is widely used. However, its controller design still depends on the system model and the effect of SMC is not ideal under large disturbances. In addition, the sign function introduced in the design of SMC will cause chattering when the system tracks the target signal. Therefore, this paper introduces adaptive update law and saturation function to improve SMC, using the leader-follower method to realize formation control.
Trajectory tracking control is the basis for UAVs to achieve coordinated formation control. However, quadrotor UAVs are a complex system with strong coupling, strong nonlinearity, underdrive, and time-varying [
17]. In addition, environmental disturbances, quadrotor under conditions such as abrasion and changes in payload, it is difficult to obtain or establish an accurate mathematical model of the UAV. Traditional model-based control methods are difficult to achieve effective control of the system. For quadrotor trajectory tracking control, reference [
18,
19] proposed a backstepping control method, but it has no processing mechanism for model uncertainty and lacks the ability to suppress external interference. References [
20,
21] proposed a linear quadratic control method, but it has poor portability and requires high precision for each parameter of the quadrotor. References [
22,
23] proposed an adaptive control method, but it is lacking effective processing capabilities for large external disturbances, such as wind disturbances. Reference [
24] proposed a neural network control method, it has a large amount of calculation and cannot meet the requirements of real-time control of quadrotors. Therefore, this paper proposes the robust integral of the signum of the error (RISE) method to eliminate interference and this method only uses the input and output data of the UAV system, and does not rely on any UAV dynamics kinematics model.
Data-driven control, referring to the controller design, does not explicit or implicit contain the mathematical model information of the control process, and only uses the online or offline I/O data of the control system. It designs the controller through data processing and knowledge obtained, and it has convergence, stability, and robustness properties under certain assumptions, such as proportion integral derivative(PID) control [
25], model-free adaptive control [
26], and virtual reference feedback tuning control [
27], etc. Current data-driven control technology is widely used in machinery manufacturing [
28], motor control [
29], transportation [
30], and chemical production control [
31], etc. In the field of unmanned aerial vehicles control, it is still less; reference [
32] proposed a novel robust model-free adaptive control (Ro-MFAC) algorithm for quadrotor control with a class of unknown multiple-input multiple-output (MIMO) systems with measurement noise, but it is only for quadrotor attitude control. Reference [
33] designed an iterative learning method, using a double-layer formation control system, and applied it to UAV formation, but it has a large amount of calculation and cannot meet the requirements of real-time performance.
Therefore, this paper adopts the inner and outer loop control strategy for the trajectory tracking control of the leader, and establishes the connection between inner and outer loop by designing the inverter and differentiator. The outer loop position control provides the required reference attitude angle for the inner loop, and the inner loop attitude control ensures the rapid convergence of the attitude angle. Both the inner and outer loop control adopt the RISE algorithm. The design of the controller does not depend on the mathematical model of the UAV and can compensate for external interference and modeling uncertainty. Aiming at the formation control of the leader and follower, this paper introduces an adaptive update law and saturation function to improve the SMC. The improved algorithm does not rely on the mathematical model of the system at all, and solves the chattering problem of the SMC. Using the above algorithm, this paper successfully realized the data-driven model-free adaptive trajectory tracking control of the quadrotor formation. The main contributions are as follows: (1) For the UAV trajectory tracking control, this paper designs the control system structure, adding the inverter and differentiator, using the inner and outer loops to use the RISE algorithm, introducing saturation function tracks the desired trajectory of the quadrotor to achieve trajectory tracking control, which can compensate for external interference and modeling uncertainty; (2) For the coordinated control of the leader and follower formations, leader performs the trajectory tracking control and the followers obtain the desired position according to the information of the leader after trajectory tracking. This paper also introduces an adaptive updated law and saturation function. The SMC eliminates the dependence of SMC on the system model and the chattering problem of SMC; (3) The trajectory tracking control and formation cooperative control algorithms in this paper only use the I/O data of the UAV and the UAV formation without any model information of UAVs and UAV formations, so it is a completely model-free method for coordinated trajectory tracking control of quadrotor formations. This paper also proves the stability of the system by the Lyapunov method, and verifies the effectiveness of the algorithm and the feasibility of the scheme by numerical simulation.
2. Data-Driven Model-Free Adaptive Trajectory Tracking Control Method of Leader Based on Rise
First of all, this chapter introduces the structure of the quadrotor control system. Secondly, in order to facilitate the understanding of the method proposed in the article and the need for simulation, this chapter introduces the kinematics and dynamics model of the quadrotor. Finally, you need to pay attention to the point that this chapter does not need the model information of the UAV when designing the data-driven model-free adaptive trajectory tracking control method of the leader.
2.1. Control System Structure and Mathematical Model
The design of the leader trajectory tracking control system mainly includes two closed loops. The outer loop position control is designed according to the position tracking error of the quadrotor, and the inverter and tracking differentiator provide the required reference attitude Euler angle for the inner loop attitude control. The inner loop attitude control is designed according to the error of the outer loop input reference attitude Euler angle and the system output Euler angle. The inner and outer loops all use the RISE method to finally realize the trajectory tracking control of the leader. The control system structure block diagram is shown in
Figure 1.
The schematic diagram of the quadrotor is shown in
Figure 2. It has six degrees of freedom but only four actuators. It is a multi-input, multi-output, strong coupling, and under-drive system. Define
as the world coordinate system,
as the body coordinate system, x, y, z are three position coordinates respectively,
,
,
are three Euler angles respectively, the rotation matrix is show as Equations (1)–(3):
Therefore, the coordinate conversion matrix from the linear and angular velocity body coordinate system of the quadrotor UAV to the world coordinate system is shown in Equations (4) and (5):
Remark 1. The attitude angles and are bounded as and .
Among them, , , represent , , respectively, and , are the coordinate transformation matrix from the linear velocity and angular velocity body coordinate system to the world coordinate system.
Define ω
1, ω
2, ω
3, ω
4 to be the angular velocity of the four rotors, f
1, f
2, f
3, and f
4 are the thrusts of the four rotors respectively. The dynamics and kinematics model of the quadrotor are shown in Equations (6)–(9):
Assumption 1. The unknown time-varying disturbances and are bounded and the derivative of is also bounded.
Assumption 2. The state variables and and their derivatives and are measurable.
Where is the thrust coefficient depending on the characteristics of the rotor blade. is the total thrust, , , are the roll, pitch, and yaw moments respectively, is the distance from the rotor center to the center of mass, and is the force-torque ratio factor. is the mass of the quadrotor, is the movement position in three directions, is the position aerodynamic damping matrix, is the virtual reference input, is a constant matrix, is the position disturbance. is the moment of inertia matrix, is the three attitude Euler angles, is the attitude rotation aerodynamic damping matrix, is the rotation input torque, and is the unknown disturbance.
Considering Remark 1, according to [
34,
35], the design of virtual control input
is shown in Equation (10):
Define
,
as the reference attitude Euler angles, then the design of inverter is as (11):
when
is equal to 0, Equation (11) has singularities, This is a disadvantage of the algorithm proposed in this paper, at this time we have to avoid it by tuning parameters.
In addition, in order to obtain the values of
,
,
,
in
Figure 1, the tracking differentiator is designed in Equation (12):
Remark 2. In order to avoid sudden changes in the motion of the quadrotor, the reference trajectory , are designed to meet , where represent the order differentials of time, .
Where
is the differential input signal,
tracks
,
tracks
,
tracks
, and
is a constant that determines the tracking speed. Bring
or
into Equation (12) to get
,
,
,
as shown in Equations (13) and (14):
Remark 3. Equations (13) and (14) make the and become continuous.
2.2. Outer Loop Position Tracking Control
The description of the outer loop control system of the quadrotor is shown in Equation (8). Let the position tracking error
and the filtered error signals
,
be defined as follows [
36,
37]:
where
,
and
, which is determined by the error of input and output data of the system.
,
are positive definite diagonal matrices, and
. In the text, the input data are
and output data are
.
Combine the Equations (15)–(17) and (8) obtain Equation (18):
Define the auxiliary equations
,
,
as Equations (19)–(21):
According to Equations (19)–(21), Equation (18) can be written as Equation (22):
According to Remark 2, we know that
, and
is continuously differentiable. According to the mean-value theorem in [
36], so
is bounded as in Equation (23):
where
represents the Euclidean norm,
is the error vector, and
is a positive constant. According to references [
37,
38], the RISE position controller is designed as follows:
Among them, , are positive definite gain control matrices, and is an identity matrix.
Remark 4. Equation (24) contains a sign function , which has chattering problems. The saturation Equation (25) is introduced to replace the sign function . The final RISE controller design is as shown in Equation (26): Remark 5. Equation (26) is only related to the system error data and its filtered error signals , , but not rely on the system model. Therefore, the proposed outer loop position RISE algorithm is strictly a data-driven model-free control method.
To prove the stability, define the auxiliary Equation as follows:
If the control matrix
satisfies:
where
represents the infinite norm. Then:
The positive constant
is defined as:
Combine Equation (17) into Equation (27), we get:
Then, an upper bound is obtained as follows:
If
is selected according to Equation (28). Then:
Define the Lyapunov function as follows:
where
is defined as follows:
It can be seen from Equation (34) that
, therefore the Lyapunov function Equation (35) is positive definite, and the differential of
with respect to time is as follows:
Putting Equation (19) into Equation (21) and Equation (26) into Equation (8) can obtain the closed-loop subsystem of
as follows:
Putting Equation (15) into Equation (16), Equation (38) into Equation (37), we get:
Combine Equations (23), (27) and (39), and
, an upper bound of Equation (38) is obtained as follows:
The positive constants , are defined as and .
Therefore:
where
is a positive constant. According to the Lyapunov method, the proposed outer loop control method is stable and the tracking error converges to zero.
2.3. Inner Loop Attitude Tracking Control
The description of the inner loop control system of the quadrotor is shown in Equation (9). Let the attitude tracking error
and the filtered error signals
,
be defined as follows [
36,
37]:
where
,
and
, which is determined by the error of input and output data of the system.
,
are positive definite diagonal matrices, and
.
Combine the Equations (42)–(44) and (9) obtain Equation (45):
Define the auxiliary equations
,
,
as Equations (46)–(48):
According to Equations (46)–(48), Equation (45) can be written as (49):
According to Remark 2, we know that
, and
is continuously differentiable. According to the mean-value theorem in [
36], so
is bounded as in Equation (50):
where
represents the Euclidean norm,
is the error vector, and
is a positive constant.
The same as
Section 2, the saturation function (25) is introduced to replace the sign function. The final RISE attitude controller is designed as follows:
Equation (51) is only related to the system error data and its filtered error signals , but does not rely on the system model. Therefore, the proposed inner loop attitude RISE algorithm is also a strictly data-driven model-free control method.
The stability proof is the same as in
Section 2. According to the Lyapunov method, the proposed inner loop attitude control method is stable and the tracking error converges to zero.
3. Data-Driven Model-Free Adaptive Control Method of Quadrotor Formation Based on ISMC
In the
Section 2, the method of single quadrotor trajectory tracking including outer loop position control and inner loop attitude control is introduced in detail. Therefore, formation control in this paper only concerns the control of position and velocity. According to literature [
39,
40], the UAV is regarded as a point-mass system at the formation control level in this paper, and the double integrator model is shown in Equation (52):
where
,
,
are the position, velocity, and control input of the followers.
Consider a formation
composed of n UAVs, using a leader-follower formation strategy, where L represents the leader and N represents the number of follower. The height in the Z direction can be the same or different when the followers track the leader. In the X-Y plane, the distance between the follower and the leader is
and the angle is
.
Figure 3 is a schematic diagram of the quadrotor formation world coordinate system distance,
is the distance value of
projected on the
axis of the world coordinate system, then the value of
in the body coordinate system
is shown in Equations (52) and (53):
The leader-follower performs formation control. Leader performs the trajectory tracking control in the
Section 2. The followers obtain the desired position according to the information of the leader after trajectory tracking and the desired deviations from leader. The expected position is input to the formation controller to realize the cooperative control of the formation. The control system structure diagram is shown in
Figure 4, and the formation control error satisfies the Equation (55):
where
,
,
are the expected distances of the body coordinate system X, Y, and Z. The SMC balance control is adopted for the system (55), and the design sliding surface is (56):
where
is the sliding surface,
is the position error data of follower,
is outer loop sliding mode surface control parameters.
From Equations (55) and (56), the exponential approach law (57) is used, and formation control disturbance
is added, then the control quantity
is obtained as shown in Equation (58):
where
is the exponential approach law parameter;
is symbolic function parameter.
where
is 2th derivative of the position with respect to time after trajectory tracking of the leader;
is symbolic function adjustment parameter.
Equation (58) uses the system error data
, but contains the symbolic function
and the model-related quantity
, which still depends on the mathematical model of the UAV and has a chattering problem. Therefore, let
adopt the adaptive update law (59) and saturation function (25) to obtain the ISMC algorithm as shown in Equation (60):
Equation (60) is only related to the system error data , , and it does not depend on the system model. Therefore, the proposed quadrotor formation cooperative control ISMC algorithm is strictly a data-driven model-free control method.
To prove the stability of the proposed method, define the Lyapunov function:
Therefore, according to the Lyapunov method, the proposed UAV formation cooperative control method is stable and the tracking error converges to zero.
4. Simulation
A model-free adaptive trajectory tracking control method based on the RISE and ISMC algorithm using quadrotor formation data is adopted. With quadrotor as the control object, the leader performs trajectory tracking control, and the leader-follower performs formation collaborative control is verified by simulation experiment. In the simulation, the parameters of the quadrotor are taken as , , , , , , , .
In the simulation, the yaw angle is fixed to zero during the entire trajectory tracking process, the reference trajectory
of the leader is shown in Equation (64), the follower and the leader maintain the expected deviation, and the initial state of the followers is shown in Equations (65) and (66):
Set the control parameters as follow:
,
,
,
,
,
,
,
,
,
,
,
,
,
adding disturbance as shown in Equation (67):
The simulation results of quadrotor formation cooperative trajectory tracking, including formation cooperative trajectory tracking, virtual control input, trajectory tracking error, and control input are shown in
Figure 5a–d, respectively.
From
Figure 5a, it can be seen that in the presence of position step disturbance and attitude periodic disturbance, the model-free adaptive control method of quadrotor trajectory tracking data-driven based on RISE algorithm perfectly realizes the trajectory tracking control of quadrotor. It can be seen from
Figure 5b that the virtual control input changes rapidly at zero time and after the step disturbance is added to regulate the stability of the system. After the system is stable, the virtual control input is almost unchanged. From
Figure 5c, it can be seen that the system error changes significantly at the zero time and after the step disturbance is added, and then the tracking error quickly converges to zero to achieve stable tracking.
Figure 5d shows the actual control input, including total lift and rotational torque, which manifests as step changes and periodic changes. This is due to the step disturbance in the position and the periodic disturbance in the attitude Euler angle.
The tracking error of Follower1–Follower6 is shown in
Figure 6.
It can be seen from
Figure 5a that when the leader has position step disturbance, attitude periodic disturbance, and the followers has exponential decay disturbance, the leader and the follower maintain the expected position deviation, the data-driven model-free adaptive trajectory tracking control method based on RISE and ISMC perfectly realizes the coordinated trajectory tracking control of the quadrotor formation. It can be seen from
Figure 6 that at zero time, after adding step disturbance time and exponential disturbance time, the position error of the followers suddenly converges to zero after a sudden change. From
Figure 6d, it can be seen that due to different expected position errors of different followers, the position deviation changes can be quite different from other UAVs. However, careful observation reveals that the mutation point is still at zero moment, the step disturbance is added, and where the sudden change of exponential disturbance.
5. Discussion
Increasing the disturbance in this paper is shown in Equation (68). The simulation results of quadrotor formation coordinated trajectory tracking, including formation coordinated trajectory tracking, virtual control input, trajectory tracking error, and control input are shown in
Figure 7a–d:
It can be seen from
Figure 7 that when the position step disturbance and the attitude periodic disturbance are added, the virtual control input and the control input change accordingly to provide the amount of control required after the disturbance increases, and the trajectory tracking error does not change significantly. It can still achieve better trajectory tracking control.
The tracking error of Follower1-Follower6 is shown in
Figure 8.
It can be seen from
Figure 8 that after increasing the disturbance of the formation cooperative control, the tracking error at the disturbance of the followers do not increase significantly, and it quickly converges to zero. It can also be seen from
Figure 7a that the disturbance increases. The method proposed in this paper can still perfectly realize the coordinated trajectory tracking control of the formation, and the result of the coordinated formation trajectory tracking hardly changes. Therefore, the method proposed in this paper has good stability and robustness.
In addition, the RISE+RISE+ISMC method used in this paper is compared with the PD+PD+PD method. In the simulation, the parameters of the quadrotor remain unchanged, and the controller parameters are set to: PD+PD+PD trajectory tracking inner and outer loops and formation coordination control parameters are all set to , .
The simulation results of quadrotor formation cooperative trajectory tracking, including formation cooperative trajectory tracking, virtual control input, trajectory tracking error and control input are shown in
Figure 9a–d, respectively.
It can be seen from
Figure 5 and
Figure 9 that compared with the RISE method proposed in this paper, the virtual control input and control input provided by the general PD control cannot better offset the disturbance interference, the leader trajectory tracking steady-state error is not zero, the stability and robustness are poor, and the leader trajectory tracking control cannot be achieved well.
The tracking error of Follower1-Follower6 is shown in
Figure 10.
It can be seen from
Figure 6 and
Figure 10 that compared with the ISMC method proposed in this paper, the general PD control formation coordinated control steady-state error can still converge to zero, but the formation tracking error at the disturbance is significantly increased. Combined with
Figure 9a, it can be seen that the general PD control can hardly realize the coordinated trajectory tracking control of the quadrotor formation.