1. Introduction
The rotorcraft is a special aircraft which can perform hovering, vertical takeoff and landing as well as low speed maneuvers, and it has already been widely used in civil and military domain. However, the flying quality of a helicopter is poor due to many reasons, such as a helicopter is highly coupled, it is quite unstable and the vibration and noise levels are very high. The poor flying quality brings many problems in actual flight, for example, the pilot needs to make compensation controls to eliminate undesirable cross coupling responses at any time during flight which means the workload is very high. Moreover, in some severe condition, such as during aggressive maneuver procedure, the poor flying quality will cause safety problems. Therefore, the operational capability and the mission effectiveness of a helicopter are limited for these reasons. In order to solve these problems, the flying quality of a helicopter must be improved. A proper flying quality specification is required for flying quality design. However, since the dynamic characteristics of a helicopter are very complex, the helicopter flying quality specification is also experienced a long time of evolution [
1]. In the first helicopter flying quality specification, the MIL-H-8501 and its revised version (the MIL-H-8501A), the primary requirements only consisted of simple time domain parameters. However, in the current specification, the ADS-33E-PRF [
2], the coverage of design requirements is expanded significantly. When we have the specification on hand, the rest problem is how to improve the flying quality of a helicopter based on certain specification. Basically, there are two different ways to deal with this problem. The first way is to optimize some of the design parameters of a helicopter such as rotor diameter, rotor height, rotor flapping hinge offset, position and area of vertical tail or horizontal tail etc. However, since the helicopter is highly coupled and the dynamic behavior of a helicopter is very complex, adjusts one certain design parameter may increase the flying quality level of some requirements defined in the specification but decrease the others. Therefore, the optimization results of all design parameters will always be a compromised solution. The second way is to design a proper flight control system with high performance, and it has already been proven that this kind of approach is much more efficient and effective than the first way.
However, the complexity of a helicopter also brings many difficulties in flight control system design [
3,
4]. Although most of the current controllers used in helicopters are designed based on classical PID (Proportional-Integral-Derivative) control method, the disadvantages of PID controllers in helicopter flight control are also very obvious. For example, a helicopter has strong nonlinearities, which means the dynamic characteristics of a helicopter have large differences in different flight states. If a PID controller is designed in one flight state (such as hover), the performance of the controller will be decreased considerably in other flight states (forward flight for instance). Although different values of PID coefficients are usually used in different flight states, the nonlinear control ability in moderate to aggressive maneuvers is still not satisfactory. On the other hand, a PID controller is usually sensitive to disturbances. Therefore, the overall performance of a PID controller is limited. In order to overcome the shortages of PID controllers, there are lots of research concentrated on development of advanced flight control design tools based on modern control theory. Optimal control and model-following control method have already been used to design the flight control laws for helicopters that are equipped with fly-by-wire or flight-by-light control system for decades [
5,
6,
7]. Flight test results indicate the performance of such controllers is increased significantly compared with PID controllers. Robust control is another advanced tool for helicopter flight control law design [
8,
9]. In this kind of method, the influences of model uncertainties caused by nonlinearity, measurement noise and environment disturbances etc. are considered during the design process, so the controllers designed by this approach will be much more robust than PID controllers. Adaptive control, which can modify its behavior in response to changes in dynamics and the character of the disturbances, is a perfect tool for flight control law design of complex aircraft including helicopters. There are plenty of papers addressed their achievements in adaptive control research, and these studies proposed many excellent ideas in neural adaptive control and model reference adaptive control for fixed wings and helicopters [
10,
11,
12,
13,
14,
15,
16]. New theoretical achievements for adaptive control design were also well developed [
17]. However, there still remain difficulties in designing an adaptive controller for helicopters. It is difficult to obtain accurate flight dynamics models by online system identification due to the complicated model structure and the existence of high level of measurement noise. The unstable and high nonlinear characteristics of helicopters cause the coefficients of the feedback matrix in an adaptive controller change at very high frequency. Therefore, the stability and efficiency of the controller are reduced.
In order to solve the above problems, a hybrid adaptive control design method which is composed of dynamic inversion and adaptive pole placement is developed in this paper for improving flying qualities of a helicopter. An improved online system identification algorithm is also established which is able to consider the influence of measurement noise. An optimization method is developed to help selecting idea poles for pole placement controller design. The adaptive strategy is selected to ensure the controller keeps high performance from hover to high-speed forward flight state while the feedback coefficients have minimum changing frequency. Application of the developed method to a UH-60A helicopter shows the proposed adaptive control design method is effective, efficient and robust.
3. Inner Loop Decoupling Controller
In order to decouple a helicopter, an inner loop controller is designed based on dynamic inversion technique. Because the poles of a helicopter will be used to design outer loop controller, and these poles can be represented by the eigenvalues of stability matrix in linear state space model. Therefore, a linear dynamic inversion solver is applied in this paper, while a linear state space flight dynamics model is used in dynamic inversion calculation.
Figure 2 shows the basic principle of dynamic inversion controller. A linear state space flight dynamics model of a helicopter is represented as Equation (1). The feedback matrix
Kinv and feedforward matrix
Linv can be determined according to current stability matrix
A and control matrix
B of a helicopter.
A closed-loop model is easily obtained according to
Figure 2, which can be written as Equation (2). It is obviously that the closed-loop model can be decoupled by selecting proper
Kinv and
Linv matrix. In order to obtain the solution, matrix inverse calculation is required. However, the control matrix
B is not a square matrix, which means the normal inverse matrix does not exist.
Considering there are both fast and slow state variables in
x, the whole system will be stable if the fast state is stabilized. Therefore, Equation (2) can be replaced by Equation (3) for solving the dynamic inversion problem.
in which,
,
,
,
is a 4 × 9 matrix,
is a 4 × 4matrix.
The next step is to define ideal decoupled model structure. Weak decoupled stability matrix
Aexp and control matrix
Bexp are shown in Equations (4) and (5), respectively. The reason for not using fully decoupled model is to keep lateral-directional oscillation modes in the model. In the ADS-33E-PRF, special requirements are defined for these modes such as Dutch roll. Therefore, these modes should be maintained and optimized in the pole placement module.
The solution for the
Kinv and
Linv matrix can be easily obtained by combining Equations (3)–(5), as shown in Equations (6) and (7).
A decoupling controller is designed for a UH-60A helicopter in the hover condition, based on the preceding method. The solutions, which can be found in Equations (8) and (9), are obtained by using Equations (6) and (7); the stability matrix
Ainv and control matrix
Binv are determined based on the theoretical flight dynamics model of the UH-60A helicopter [
18] in the hover condition.
Starting from the stable hover condition, step inputs with an amplitude of 5% for the longitudinal cyclic, lateral cyclic, collective, and pedal are applied to the decoupled model, respectively. The simulation results are shown in
Figure 3,
Figure 4,
Figure 5 and
Figure 6. It is obvious that the longitudinal channel and vertical channel are fully decoupled, while the lateral channel and directional channel are weakly coupled. Moreover, the performance of the controller is maintained well in different flight speeds.
4. Online System Identification
Online system identification is a very important module in an adaptive controller, since the accuracy of the identified model has large influences on controller’s performance. However, the identification problem of a helicopter is very complex. Nearly five decades have passed since the first attempt to apply system identification into helicopter flight dynamics modeling, and plenty of methods have been developed both in the time domain and frequency domain [
20,
21,
22,
23,
24]. However, most of these methods are used for offline identification purposes, and it is not possible to integrate these comprehensive methods into an adaptive controller. The most frequently used identification algorithm in an adaptive controller is currently the recursive least squares (RLS) method. This kind of method is easy to implement and efficient, but it is not robust to noise. A helicopter has high levels of vibration and measurement noise during flight, which means that the measured responses are contaminated. Although there are low-pass filters in flight control systems, the influence of measurement noise on measured data still exists. Theoretically speaking, the least squares estimator is unbiased and consistent only when there is white noise or no noise in the measured data. Therefore, in most of the current online identification methods, measurement noise is neglected or simplified to white noise. Unfortunately, the measurement noise of a helicopter will always be colored, and the white noise assumption brings additional identification errors.
In this paper, a recursive extended least squares algorithm is established. Because the helicopter is decoupled before identification, the full-coupled flight dynamics model identification problem can be replaced by identifying three decoupled and weakly coupled models, as shown in Equations (10)–(12).
In order to consider the influences of unideal measurement noise, a second-order noise model is established, as shown in Equation (13).
In which e is the unideal noise vector, t is the time variable, Δt is the sampling time interval, d1 and d2 are the noise model parameter vectors, and ξ is the noise description vector which can be approximated by the model prediction error.
Substituting Equation (13) into Equations (10)–(12), and after some mathematical manipulation, a standard discrete least squares identification model can be obtained, as shown in Equation (14). The detailed structure of each component in Equation (14) can be found in Equations (15)–(17) for the different models.
- ➢
Longitudinal model:
- ➢
Vertical model:
- ➢
Lateral-directional model:
A numeric iteration algorithm, as shown in Equation (18), can be applied directly to the above extended models.
Q is the model structure weighting matrix. Matrix
Q is a diagonal matrix, and the values of the diagonal elements in
Q can be determined by Equations (19)–(21).
In Equation (20),
CR is the Cramer–Rao bound of the identified parameters, and the critical value of the Cramer–Rao bound can be set according to the guidelines provided by Ref. [
23]. The online calculation of the Cramer–Rao bound can be implemented by using Equation (21).
In which v is the model prediction error, and the data saturation problem in Equation (21) is avoided by adding a window with length L in the identification process; when the number of data used in identification reaches L, the covariance matrix P will be reset according to current states.
The identification results of a UH-60A helicopter in the hover condition are shown in
Table 1,
Table 2 and
Table 3 and
Figure 7 and
Figure 8, while a comparative study between the developed method in this paper with the standard RLS algorithm was also conducted. A 3–2–1–1 input signal, which is different to the sweep excitation used in the identification procedure, was applied to verify the identified models. The verification results are shown in
Figure 9,
Figure 10,
Figure 11 and
Figure 12. The true values of all the derivatives in
Table 1,
Table 2 and
Table 3 were calculated based on the theoretical model used in this paper. It is apparent that the identification accuracy of the developed method is increased significantly compared to the standard RLS method, and this is especially true when the signal to noise ratio is low (
Figure 11 and
Figure 12). This is because in the standard RLS algorithm, noise is treated as white random signal, which has zero mean value and constant variance. However, real noise is colored, and it has a non-zero mean value and time variant variance. So there exists a bias term between the ideal noise and the real noise, and a biased estimation of the model parameters is obtained. In the method developed in this paper, the bias term is represented as a colored noise model. Therefore, the bias in the helicopter model parameter identification is eliminated.
Figure 13 shows the noise prediction error, and the good prediction capability of the noise model is also proven.
5. Adaptive Pole Placement
Pole placement is a powerful tool in modern control theory, and it is very suitable for flying quality design. This is because in ADS-33E-PRF, many of the flying quality requirements can be represented by poles or eigenvalues. It is very convenient to use ideal poles or eigenvalues to implement flying quality design. If the closed loop model of a helicopter has the designed poles or eigenvalues, then this helicopter will reach the expected flying quality level. Since different requirements are defined for hover/low-speed flight and forward flight in ADS-33E-PRF, the ideal poles should also be designed separately in different flight states. In this paper, the ideal poles in hover and low-speed flight states are designed based on small-amplitude attitude change (short-term and mid-term responses to control inputs) and the response to collective controller. In a forward flight state, besides the above requirements, the lateral-directional stability is also used in ideal poles design.
The flight dynamics model used in adaptive pole placement is the 6-degrees-of-freedom state space model, the same as in Equation (1). However, since the model is decoupled, stability matrix
A and control matrix
B in Equation (1) now have very simple structures, as shown in Equations (22) and (23).
Since Equations (22) and (23) are nearly decoupled, the inter-axis coupling of a helicopter may now reach flying quality Level 1, and this can be proven by using
Figure 3,
Figure 4,
Figure 5 and
Figure 6. However, the other flying quality requirements such as stability and control bandwidth are still not improved. Therefore, the ideal poles should be designed according to these flying quality requirements. In this paper, the ideal poles in hover and low-speed flight states are designed based on small-amplitude attitude change (short-term and mid-term responses to control inputs) and the response to the collective controller. In the forward flight state, besides the above requirements, lateral-directional stability is also considered in the ideal poles’ design.
The designed ideal poles in longitudinal channel include 1 negative real pole and 2 conjugate complex poles. The negative real pole represents longitudinal damping, and the complex poles represent the longitudinal dynamic mode of a helicopter, such as hover oscillation or phugoid in forward flight. The values of ideal poles can be determined by the numeric optimization method. The original longitudinal damping of a helicopter can be used as the initial value of the negative real pole, and an initial guess of the complex poles can be determined easily according to
Figure 14 [
2] by selecting an arbitrary point in the Level 1 area. Then these poles can be optimized according to the cost function defined in Equation (24).
where
Tfh(s) is the helicopter longitudinal transfer function, which has a form as shown in Equation (25);
TfAc(s) is the actuator transfer function, which is known for a certain type of helicopter (the actuator model for the UH-60A helicopter used in this paper can be found in reference [
19]);
fpha(·) is a function to calculate the phase delay of longitudinal control, while
fband(·) is a function to calculate the control bandwidth in the longitudinal channel.
Z(s) in Equation (25) is the numerator polynomial of a real longitudinal transfer function of a certain type of helicopter, which can be obtained from theoretical model or offline system identification in advance. Therefore,
Z(s) will remain unchanged during the optimization procedure, and the optimization problem can be defined as follows:
Optimize T, ζ,ω in Equation (25) to minimize J in Equation (24)
s.t. all poles in Equation (25) still drop in Level 1 area in Figure 14 The above constrained optimization can be replaced by a non-constrained problem:
Optimize T, ζ,ω in Equation (25) to minimize J1 in Equation (26)
where g(·) is a punishment function. If the poles in Equation (25) drop in the Level 1 area in
Figure 14, the value of this function will be 0, otherwise, the function will have a positive value. In this paper, the positive value of the punishment function is calculated using the normalized distances of the poles to the Level 1 boundary. If Equation (26) is minimized, the obtained ideal poles will ensure that the dynamic system has the minimum phase delay and maximum bandwidth. The above non-constrained optimization problem can be solved by a quasi-Newton method. The partial derivatives in the Newton iteration can also be calculated numerically.
The ideal poles in the lateral-directional channel include 3 negative real poles and 2 conjugate complex poles. The negative real poles represent lateral damping, yaw damping, and spiral mode, and the complex poles represent lateral hover oscillation or Dutch roll mode in forward flight. The values of the lateral ideal poles can be determined using the same method as in the longitudinal channel. An initial guess of complex poles can be determined according to
Figure 14 in hover/low-speed flight and according to
Figure 15 [
2] in forward flight state.
A vertical idea pole can be set based on the height response characteristics requirement. In ADS-33E-PRF, this requirement only needs vertical rate response have a qualitative first-order appearance for at least 5 s following a step collective input. Therefore, vertical ideal pole can be set as a proper negative real number directly.
When all the ideal poles are determined, the next step is to solve the pole placement problem, as defined in Equation (27). Fully controllable of (
A,
B) is a sufficient and necessary condition to guarantee Equation (27) has a solution. It is obvious that all the state variables of a helicopter can be controlled by a pilot, i.e., (
A,
B) is fully controllable. There are many comprehensive solvers used to calculate the feedback control matrix
Kpole. In this paper, the solution of Equation (27) is obtained according to the algorithm introduced in Ref. [
25].
The closed-loop poles in Equation (27) have exactly the same value as the desired ideal poles. Moreover, if the open-loop poles of the
A matrix in Equation (27) show small changes, the closed-loop poles will be very close to the desired ideal poles when using the same feedback matrix
Kpole. This indicates that the performance of the controller will maintain well when using one constant
Kpole matrix in a reasonable flight state range. Therefore, there is no need to perform pole placement calculation at each sampling time. In this paper, an adaptive strategy for pole placement is developed, as is illustrated in
Figure 16.
The cost function
J in
Figure 16 can be determined by Equations (28) and (29).
In which λcurrent indicates the current eigenvalue, λbaseline indicates the baseline eigenvalue, Im(·) is the imaginary part of complex number while Re(·) is the real part of complex number, and W is a weighting coefficient. In this paper, if the eigenvalue is real, the value of this coefficient will be 0.1, otherwise, the value will be 0.2. If the pole placement is carried out, then the baseline eigenvalues will be updated by the current open loop eigenvalues of the A matrix.
Based on the developed adaptive pole placement controller, the Attitude Command Attitude Hold (ACAH), Height Hold (HH) and Translational Rate Command (TRC) response types defined in ADS-33E-PRF were implemented for a UH-60A helicopter. All simulations were started from a stable hover condition. In the ACAH simulation, 0°, −3°, and −6° pitch angle commands were applied in sequence. In the HH simulation, an altitude command of 100 m was applied while the helicopter accelerated from hover to 60 m/s. In the TRC simulation, 30 m/s, 50 m/s, and 70 m/s flight speed commands were applied in sequence.
Figure 17 shows the basic controller structure for implementing ACAH/HH/TRC response types. In the simulation, the primary actuator of a UH-60A helicopter [
19] was used, and the rate limit of the actuator was set to be 20%/s.
Figure 18,
Figure 19 and
Figure 20 show the verification of these three response types. It can be found that all three response types meet the requirements in the flying quality specification. Moreover, the performance of the controller was maintained well from the hover to high-speed forward flight state. This indicates that the adaptive control law designed in this paper is effective.