1. Introduction
Foreign object debris (FOD) refers to any object located in the airport environment that can injure or harm the aircraft. Typical examples of FOD include aircraft parts, twisted metal strips, ramp garbage, plastic products, and so on [
1]. FOD poses a safety risk to aircraft and a significant economic loss to airlines. The estimated value of FOD damage reaches several billion USD per year for airlines in terms of structural damage and maintenance costs [
2,
3]. After the accident of a Concorde airplane due to a metal strip on the runway, FOD detection has become an exciting research area and gained significant attention [
4].
At present, the outstanding FOD detection systems are the Tarsier system by QinetiQ, FODFinder system by Trex, iFerret system by Stratech, and FODetect system by Xsight [
5,
6,
7,
8]. These systems mainly realize FOD detection through radar or electro-optical technologies [
9]. They follow the standards of an advisory circular issued by the Federal Aviation Administration (FAA), and the performance of these systems has been tested. For example, as a monitoring system relying only on video image processing, the iFerret system can detect targets with a height of 4 cm, and a target with a height of 2 cm can be detected under good weather conditions. However, this system is highly vulnerable to haze weather [
5]. The FODFinder system adopts millimeter-wave radar and video image processing to detect FOD targets, but it can only detect targets as small as 2.5 cm × 2.5 cm (diameter × height) [
7]. Thus, these systems only satisfy the demands of civil airports. For military airports, it is highly desirable to detect much smaller FOD targets, such as a 2 cm diameter metal ball, though this is extremely difficult. For FOD detection systems that rely on millimeter-wave radar, they are generally able to detect targets with a radar cross-section (RCS) of not less than −30 dBsm. However, for a 2 cm diameter metal ball, the RCS is as low as −35 dBsm, which is very difficult to detect. As the FOD target becomes smaller, its RCS will decrease to a very small value, resulting in the target echo being close to the ground clutter. Therefore, the signal-to-clutter ratio (SCR) is greatly reduced, which makes the detection difficulty increase sharply. This paper mainly aims to solve the difficult problem of small FOD detection in military airports.
There are several studies have been published in recent years, which mainly focus on image processing and radar signal processing. Different from the traditional image processing methods, novel algorithms based on a convolutional neural network (CNN) are proposed in References [
10,
11] to detect FOD based on optical images, which achieve a high recall rate for small FOD, such as small screws. However, the images obtained at night or in hazy weather are not ideal due to the influence of light and brightness. Yigit et al. detected a 1.2 cm × 3.5 cm (diameter × height) screw at a distance of 2 m from the radar by using millimeter-wave, ground-based synthetic aperture radar imaging, while the detection capability of remote small FODs has not been verified [
12]. In radar signal processing methods, the constant false alarm rate (CFAR) detection algorithm is commonly utilized for FOD detection. Cell average (CA) and ordered statistics (OS) CFAR methods have good detection performance with a homogeneous background, while the detection effect for small FOD targets is reduced with non-homogeneous backgrounds [
13,
14]. The clutter map (CM) CFAR algorithm can estimate the average clutter power through multiple iterations but the “self-shielding” is inevitable, leading to a reduction in detection performance [
15]. Leonardi et al. proposed the fusion of raw signal level data for the echo data received by multiple radars, which improved the detection rate of small FOD targets [
16]. However, for a small target whose SCR is equal to 4 dB, the detection rate of the method only reaches 35%, which is still a very low value. Therefore, the principle of radar automatic target recognition was applied in this study to transform the target detection into classification, and then implement FOD detection through a classifier [
17]. To verify the practical effect of this method, we collected data at a military airport in Jiangsu, China. Based on the measured data, we compared the methods proposed in this paper with the traditional CA-CFAR and CM-CFAR algorithms. For a 2 cm diameter metal ball, the results showed that the detection rate of the CM-CFAR algorithm was slightly higher than that of the CA-CFAR algorithm, but the false alarm rate of the CA-CFAR algorithm was lower. However, the methods proposed in this paper not only achieved a higher detection rate than the CM-CFAR algorithm, but also obtained a lower false alarm rate than the CA-CFAR algorithm. Therefore, it is helpful to realize the difficulty of detecting small FOD targets in military airfields.
This paper is arranged as follows:
Section 2 introduces the signal model of the linear frequency modulated continuous wave (LFMCW) radar used in this study and outlines the principle of the traditional CFAR algorithms for FOD detection. In
Section 3, the principle of the classifier is introduced, and it is applied for FOD detection. The feature extraction is carried out on the data first, then the theory of the feature-based SVDD classifier is expounded. Finally, we describe the process of optimizing the classifier parameters using the particle swarm optimization (PSO) algorithm.
Section 4 gives the detection results and analysis of comparing traditional FOD detection with classifier-based FOD detection. Some conclusions are collected in
Section 5.
Notations: In this paper, the bold uppercase letters are matrices, the bold lowercase letters are vectors, and the italic letters show scalar variables.
4. Detection Results and Analysis
In this section, the simulations that were conducted to compare the PSO-SVDD classification method with the classical CA-CFAR and CM-CFAR algorithms are described. To obtain the measured data, a millimeter-wave radar was used to collect data at a military airport in Jiangsu, China, where the airport runways were paved with asphalt. The operation and the signal processing parameters of the radar system were as follows: the operation frequency was , the bandwidth of the sweep was , the duration of a single frequency sweep was , the transmitting power was 20 dBm, and the vertical and horizontal beamwidth of the antenna was 8° and 2°, respectively. The sampling frequency was and the number of points for the FFT was . The radar sensor was placed at 1.5 m above the ground. Additionally, during the feature extraction, the number of the intercepted cells was set to . For the CA-CFAR detector, there were two guard cells and four reference cells on either side. According to the principle of CA-CFAR, the threshold coefficient was set to in this paper.
Before collecting the data, the experimental scene was manually checked first to ensure that there were no FOD targets. Then, the millimeter-wave radar scanned the experimental scene and recorded the echo data of the ground clutter. After that, FOD targets were manually placed on the airport runway. Taking the detection of a 2 cm diameter metal ball as an example, we placed the target at a distance of 42 m from the radar. Then, the echoes of it were acquired using radar scanning.
Figure 4a shows the amplitude spectrum when the metal ball was present and
Figure 4b depicts the amplitude spectrum of the ground clutter (without the metal ball). It can be seen from
Figure 4 that in the area closer to the radar, since the energy of the echo entered the radar from the sidelobe, the energy of the ground clutter echo was relatively strong. However, in the area far from the radar, the target echo received by the radar was weaker, which further increased the difficulty of detecting small FOD targets. According to the local magnified image near 42 m in
Figure 4a, the SCR of the target was only 4 dB, which was almost submerged in the ground clutter. Since the ground clutter echo and the target echo were difficult to distinguish, it was very difficult to detect the target via the CA-CFAR and CM-CFAR algorithms. Therefore, we extracted the implicit internal features of the ground clutter echo and target echo to further enlarge the distinction between them, and then the classification method could be applied for the FOD detection.
Based on the method proposed in this paper, the two power spectrum features were extracted.
Figure 5a,b shows the distribution of the two features when the FOD was present and absent. The second-order central moment describes the distribution of the power spectrum energy relative to its geometric centroid. The more dispersed the energy distribution, the smaller the second-order central moment. From
Figure 5a, when the FOD was present, the second-order central moment was smaller than that when it was absent. For the average power spectrum, the greater the energy, the greater the average. From
Figure 5b, it was obvious that the average power spectrum in the presence of the FOD was greater than that in the absence of FOD. Compared with
Figure 4, by extracting these two features, the discriminability between FOD present and FOD absent was significantly improved. Then, the extracted features could be used to train the classifier or test the performance of it.
To verify the FOD detection performance of the PSO-SVDD detector, we counted 300 samples of ground clutter data and 150 samples of data containing FOD. In the training stage, 80% of the FOD absent samples were randomly selected to train the PSO-SVDD classifier, and the rest were taken as the testing data. Based on the analysis in
Section 3.3, the parameters were first set to
,
,
,
,
,
, and
. Then, the PSO algorithm was used to optimize the parameters of the SVDD model. The optimization process is shown in
Figure 6, where the minimum classification error rate was 25.71% after 11 iterations, and the optimal decision boundary could be obtained with parameters
and
. In the classification process, the test samples inside the decision boundary were judged FOD absent; otherwise, they were judged as FOD present.
The classification results of the PSO-SVDD are depicted in
Figure 7. In
Figure 7a, the red circle markers denote the feature vectors of the samples without FOD, which were utilized to train the PSO-SVDD classifier. In
Figure 7a,b, the green circle markers represent the support vectors, and the decision boundary is denoted by the purple line. The decision boundary distinguished the FOD present samples from FOD absent samples in the testing procedure. It can be seen from
Figure 7b that there were two FOD absent samples that were classified outside the decision boundary, that is, they were judged as FOD present, resulting in false alarms. Furthermore, the remaining samples with FOD absent were all divided into the interior of the decision boundary, indicating that the judgment was correct. Meanwhile, most of the FOD present samples were correctly divided outside the decision boundary, while a small part of them were wrongly classified inside as FOD absent.
Since only the FOD absent samples were utilized to train the classifier in the training procedure, overfitting inevitably occurred. To improve the performance further, 10% of the samples containing FOD were randomly added to train a PSO-NSVDD (NSVDD: SVDD with negative examples) classifier. The principle of the NSVDD model is similar to that of the SVDD model [
25], while the parameters that need to be optimized are
,
, and
, where
and
are the penalty parameters for the FOD absent and FOD present samples, respectively, and
is the kernel width of the NSVDD model. After 23 iterations, the optimal parameters of the model were
,
, and
. The final detection results of the PSO-NSVDD classifier are shown in
Figure 8, where the yellow circles in
Figure 8a indicate the newly added FOD present samples. Furthermore, it can be seen from
Figure 8b that, due to the addition of samples with FOD present in the training stage, the decision boundary was described more accurately and the overfitting was avoided. Therefore, compared with the results of the PSO-SVDD detector in
Figure 7b, more samples with FOD present were classified outside the decision boundary and the FOD detection performance was further improved. Meanwhile, almost all the FOD absent samples were correctly classified within the decision boundary, which further reduced the false alarm rate.
To detect a target that exists at any distance from the radar, according to the method proposed in this paper, we first divided the collected ground clutter data into several small blocks in the range dimension. Similarly, we also divided the data containing the minimum FOD target to be detected into small blocks. Then, the feature extraction was performed on each block, and finally, the optimal PSO-SVDD and PSO-NSVDD classifiers were trained in these blocks. Within each block, there was little variation of ground clutter echo and the PSO-NSVDD classifier trained by the data containing the minimum FOD target could also be used to detect larger targets. Therefore, the parameters of these classifiers could be fixed. In the later detection process, there was no need to retrain new classifiers, which meant that these trained classifiers could be directly utilized to detect the FOD targets that existed at any distance. Therefore, we placed a 2 cm diameter metal ball and a 4.3 cm diameter golf ball at a distance of 10 m from the radar, and placed another golf ball with the same size at a distance of 42 m to verify the detection effect. We also counted 150 samples containing these FOD targets for testing.
Table 1 shows the detection results of these targets using four detection methods. For the metal ball and golf ball, SCR = 19 dB and 30 dB at 10m and SCR = 4 dB and 13 dB at 42 m, respectively. According to the detection rate
and the false alarm rate
of the metal ball at different ranges, compared with the CA-CFAR algorithm, the detection rate of the CM-CFAR algorithm was slightly higher, but the false alarm rate was also higher, which was not what we expected. For the CA-CFAR and CM-CFAR algorithms, the golf ball was detected much easier than the metal ball, suggesting that it was difficult for the conventional CFAR methods to detect such small-volume FOD targets. However, for the metal ball at two ranges, the
of the PSO-SVDD classifier was significantly higher, reaching 87.33% at 10 m and 64.67% at 42 m, and the
was significantly lower for both. Additionally, after adding the samples with FOD present, the
of the PSO-NSVDD was further increased to 92.61% at 10 m and 78.18% at 42 m. Meanwhile, for both the golf ball and metal ball, the PSO-NSVDD classifier produced a much lower false alarm rate. Based on the analysis above, we have reason to believe that the methods proposed in this paper not only showed a higher detection rate, but also a lower false alarm rate for the target with the low SCR. For the target with the high SCR, the detection rate was the same and the false alarm rate was even lower. Thus, these proposed methods were effective for a wide SCR range.
Finally, the two methods proposed in this paper were comprehensively analyzed as follows. For the PSO-SVDD classifier, only the ground clutter (with FOD absent) data needed to be utilized in the training stage. In an actual airport environment, a mass of ground clutter data can be collected to train the classifier; therefore, this method is easily implemented. For the PSO-NSVDD classifier, a small number of samples with FOD present needed to be added during the training stage, meaning that the data containing the minimum FOD target needed to be collected in advance, while it is unrealistic to collect such data in practical applications. However, the detection performance of the latter was further improved. Furthermore, compared with the traditional CA-CFAR and CM-CFAR methods, the detection performance of these two methods for small FOD targets was much higher.