1. Introduction
Recently, in many countries which have direct access to the sea, great importance has been attached to the monitoring of the Exclusive Economic Zone (EEZ), which is defined in accordance with the United Nations Convention on the Law of the Sea. This is very important because many illegal activities can be carried out beyond the horizon, which are under the jurisdiction of the EEZ of a particular country. In this regard, High Frequency Surface Wave Radars (HFSWR) are widely used in the past for maritime surveillance of ships at ranges up to 200 nautical miles [
1,
2,
3].
Various theoretical as well as practical implementation aspects of HFSWR radars are highlighted in numerous published works [
4,
5,
6,
7,
8,
9,
10,
11,
12].
Despite the fact that the principles of HFSWR radars are theoretically well studied and clarified, and practically implemented and verified [
13,
14,
15,
16], HFSWR radars are still the subject of intensive research and development with the aim to improve detectability and resolution performance of targets with small radar cross-section (small boats, UAV, drones, etc.). The motivation for those research and development efforts are related to the application of HFSWR radars for monitoring of illegal crime activities, drug trafficking, attack on petrol platforms and strategic objects, etc. Therefore, the focus of this paper is to develop and propose new high resolution algorithm and new detection scheme in order to improve detection and resolution performance of HFSWR radars based on FMCW principle.
We have shown here that multidimensional signal at the output of dechirper of FMCW HFSWR radar (with neglected coupling between domains) can be modeled as superposition of ionospheric interference, sea clutter, additive noise and attenuated sinusoids (cissoids) in 3D space (fast time domain, slow time domain and spatial domain), each of them correspond to the range, Doppler/radial velocity and azimuth of one target in multi-target scenario, typical for HFSWR radars. Therefore, the task of signal processing in FMCW HFSWR radar is to solve detection/estimation problem:
to detect the number of superposed cisoids, what is equivalent to the detection targets number in multi-target scenario;
to estimate frequencies of those cisoids in fast time, slow time and spatial domain, what is equivalent to the estimation of their parameters (range, Doppler/radial velocity and azimuth).
If the receiving antenna array is linear and uniform, the estimation problem is usually solved by 3D Fourier transform. Such solution is applied in many practical implementations of FMCW HFSWR radars. As a result, so called range/Doppler/azimuth (RDA map) is provided. It is usually followed by CFAR detection of targets in RDA map. That is conventional approach of the signal processing in FMCW HFSWR radar.
It is well known that the target detection performance of HFSWR radars are basically limited by the presence of sea clutter, ionospheric and external interference and additive noise. Two main groups for target detection methods in FMCW HFSWR radars are proposed so far: Constant False Alarm Ratio (CFAR) based methods and image processing based methods. CFAR detection methods with its various variants are usually used in FMCW HFSWR radars [
17,
18,
19,
20]. However, some other detection methods like [
21,
22,
23,
24,
25,
26] are proposed. In this paper, we proposed new detection algorithm based on [
27] which is primarily used in Image Processing, not in HFSWR.
The key problem of detection process is how to mitigate external interference. Various schemes for interference mitigation as a preprocessing step are proposed so far. In regard of this, target detection is still a challenging research problem, especially in the context of the application of high-resolution methods for range/Doppler/azimuth estimation, as presented in [
28,
29,
30,
31,
32,
33,
34,
35,
36,
37,
38,
39,
40,
41,
42,
43,
44,
45].
If RDA map is estimated by classical 3D FFT, resolution in Range, Doppler/Radial velocity and Azimuth domain are limited by system parameters such as chirp signal bandwidth (range), the period of integration (Doppler/radial velocity) and the number of antennas in the receiving antenna arrays. Increasing of these parameters leads to better detectability and better resolution properties of radar in each domain. Increasing the integration period improves the resolution of the Doppler estimate, but this increase is limited by the Coherent integration time related to the physics of wave propagation. The integration period must be shorter than the Coherent integration time. On the other hand, it is implicitly assumed that the target within the integration period does not change the radial velocity, which is not a valid assumption for large integration periods. Increasing the number of antennas in the antenna array improves the resolution properties, but this results in an increase in the physical space for placing the antenna array.
The RD-HR map is the key to the high-resolution method proposed. In that case, criterion functions are calculated on all antennas for a set of discrete values of normalized Doppler frequencies, for the range of Doppler frequencies of interest, and with a grid resolution that is many times better than the FFT Doppler resolution, thus obtaining a zoomed high-resolution RD-HR map. The high-resolution properties of the obtained RD-HR maps and better detectability and contrast of targets in the RD-HR map in relation to the RD-FFT map are clearly observed in rest of the paper. MUSIC-type high-resolution algorithm is used to form the covariance matrix that is the basis for the application of most high-resolution methods.
The main contributions of this paper are as follows. The high-resolution method for estimating the RD-HR map (uniform and more computationally efficient non-uniform variant) is proposed. Then the Doppler shift was compensated before high-resolution azimuth estimation, which is also newly proposed. The contribution is also in a novel detection algorithm that comes from the field of Image processing whose kernel function is more convenient to the morphologies of peaks of criterion functions of high-resolution methods than the classic CFAR, which is more suitable for use in 3D FFT RDA map estimation.
The rest of this paper is organized as follows.
Section 2 introduces the system and signal model used to generate results and to test the proposed method. In
Section 3, we presented detailed algorithm description. Here, we explained 2 variants of the algorithm: High-resolution Range–Doppler map estimation (both for uniform and non-uniform in slow time domain). We explained also the detection of targets on the Range–Doppler map, and a novel method for azimuth detection with improved accuracy and numerical complexity. We discuss some of the experimental results in
Section 4 and provide concluding remarks in
Section 5. The derivation of dechirped signal was presented in the
Appendix A.
3. Detailed Algorithm Description
A three-dimensional matrix with acquired complex time samples of IQ branch signals at the receiving channels is denoted by
, whose elements are
for
,
,
. In practical situations,
P and
N are predefined values and
M is the value to be chosen and it should correspond to the integration period in which signal coherence is preserved. The developed algorithms were tested for the length of the segment of
, where the successive segments overlap in 128 frames. This ensures that the results are ejected every 128 frames. RAW data were recorded with 2048 frames per file. In the analysis, the acquired frames are divided into 15 overlapping segments, each with 256 overlapping frames. A vector with
P complex signal samples at the
n-th antenna in the
m-th frame is defined as
, where
denotes the
p-th complex signal sample at the
n-th antenna in the
m-th frame (segment).
Figure 3 shows
matrix.
The first step in classical processing in many radars, such is WERA radar, is the implementation of FFT algorithm of vectors
for all frames
and all antennas
, and thus obtaining a three-dimensional matrix
with complex samples of the spectrum whose rows
represent vectors with the spectrum samples in the
m-th frame and at the
n-th antenna, which are obtained as:
where
denotes the vector with the samples of the applied Blackman–Harris window function, the operator
denotes Hadamard’s (Shur’s) product and
denotes the Fourier matrix of
dimensions. The second step in the classic primary processing of many radars is the implementation of the FFT algorithm per matrix
columns
for all antennas
and all samples
per frame as follows:
where
denotes samples of the applied Blackman–Harris window function, and
is transpose operation. The vectors
are calculated for
, where
R corresponds to the maximum projected radar range. The matrix
denotes the Fourier matrix of
dimensions.
Figure 4 shows
matrix with selected vectors used in the previous analysis.
A matrix
is then formed as follows:
The matrix represents the Range–Doppler matrix at the n-th antenna. This matrix is obtained using the FFT algorithm and we’ll call it the RD-FFT map. A further procedure of primary signal processing in some existing OTHR radars, such is WERA, is CFAR detection of targets in the RD-FFT map, followed by the estimation of signal arrival direction for detected targets using classical single snapshot beamforming.
3.1. High-Resolution Range–Doppler (RD-HR) Map Estimation (Uniform Sampling Method in Slow Time Domain)
The high-resolution algorithm for creating the RD-HR map starts from the formation of the matrix
using Fourier transform. By adding zeros to the vectors with signal samples, better computational (but not actual) resolution can be achieved when applying FFT. Thus, the proposed algorithm for creating the RD-HR map is computationally high-resolution in the range domain and essentially computationally high-resolution in the Doppler domain. From the original matrix
we form an extended matrix
by adding
additional frames. Then new matrices
are formed for
and
, whose columns are vectors
,
. A total of
frames are used to form this matrix. The index
r denotes the number of frames that do not overlap in adjacent vectors
. The developed algorithm was tested for
. The reason for this is a better estimate of the covariance matrix later.
Figure 5 shows the creation of
matrix from
matrix.
Then the covariance matrices
are formed for
and
as follows:
The matrix
is a complex square Hermitian (conjugate symmetric) positive definite matrix, which means that the eigenvalues of that matrix are positive quantities. The formation of the covariance matrix
is a key step in the formulation of the high-resolution algorithm for the creation of the RD-HR map. Based on the covariance matrix, it is possible to formulate several criterion functions of high-resolution algorithms for creating an RD-HR map. In this case, we use MUSIC-based algorithm, as follows:
The matrix
is a matrix of noise subspace of the covariance matrix
whose columns are eigenvectors of the covariance matrix
which correspond to
of the smallest eigenvalues of the covariance matrix
, where
K represents a parameter of the MUSIC-based algorithm. As is well known, the MUSIC algorithm requires the knowledge of the dimensionality of the signal subspace (parameter
K). There are several algorithms in the literature that can be used to estimate
K, such as the Minimum Description Length algorithm (MDL) [
41] or the Akaike Information Criteria (AIC) [
46]. Those algorithms work well in controlable signal scenario, such as a simulation. However, from our previous experience, we know that in real coherent systems (such as direction finder we developped) these algorithms tend to overestimate the value of
K. It is known from the theory of subspace algorithms, that when the eigenvalues are sorted in descending order, there is an inflection point in the curve whose position indicates the dimensionality of the signal and the complementary noise subspace. The eigenvalues of the covariance matrix, whose values are approximately equal to the variance of the noise on receiving channels, determine the dimensionality of the noise subspace. So, we analyzed empirically the position of that inflection point and observed that the
K values 5 and 10 produce satisfactory results compared with AIS. However, an adaptive algorithm should be applied for the estimation of
K. Also, the term coherence we use in two contexts. The first is related to a multipath environment where multiple delayed replicas of the same signal are superposed on the antenna array. This is known to be a problem for most algorithms in array processing. The second is related to the period of integration. The choice of the integration period implicitly assumes that in this period of time the Doppler shift of the signal due to the movement of the target is constant.
The vector
is an equivalent steering vector formulated in the normalized Doppler domain as:
where the parameter
denotes the normalized Doppler frequency in radians per frame. The criterion functions are calculated for a set of discrete values of normalized Doppler frequencies, for the range of Doppler frequencies of interest and with a resolution that is many times better than FFT resolution per Doppler, thus obtaining a zoomed high-resolution RD-HR map. With RD-HR maps obtained by MUSIC method, the high-resolution properties and better detectability and contrast of targets in the RD-HR map in relation to the RD-FFT map are clearly observed. Range and Doppler frequencies are estimated by detecting peaks in the RD-HR map. The arguments of the maxima of these peaks are
, where
,
is the total number of detected peaks and
and
correspond to Doppler and range domain, respectively. For each of the detected
peaks, the direction (azimuth) of the target is then estimated. For high-resolution azimuth estimation, the same type of criterion function is used as for RD-HR map estimation, with the difference that steering vectors and covariance matrices are formed in the spatial domain by
n and for the detected indexes
and
in Doppler and range domain, respectively.
3.2. High-Resolution Range–Doppler (RD-HR) Map Estimation (Non-Uniform Sampling Method in Slow Time Domain)
It was found that the covariance matrix . For all n and p has a conditional number of order which means that it is close to the singular matrix which can in some cases result in problems of numerical instability during inversion and eigenvalue decomposition of the matrix. Known procedures for reducing the conditional number are analyzed (such as adding a small scalar value on the diagonal of the matrix . The motivation for formulating a high-resolution algorithm for estimating the RD-HR map with non-uniform sampling is related to reducing the numerical complexity of the matrix algorithm and to reducing the conditional number of the matrix of that matrix. In uniform sampling method, the dimensionality of the covariance matrix is . The idea of non-uniform sampling is that dimensionality of the covariance matrix be smaller () where . The problem of non-uniform sampling method in this case is analogous to the problem formulated in the field of antenna arrays - how to replace a linear uniform antenna array with a non-uniform antenna array with the same aperture and a smaller number of antennas without significant degradation of the antenna array factor? This problem in antenna array theory is known as the problem of minimally redundant linear antenna arrays. High-resolution algorithm for the RD-HR matrix creation therefore has its theoretical foundation in the theory of antenna arrays or array processing.
The idea is to select a subset of
J rows of the matrix
by choosing an appropriate mapping
,
. We then form
as
where
denotes the
-th element of
. Thus we form a new matrix
on the principle of non-uniform selection of the elements of the column vector of the matrix
. The same mapping
ℓ is used to form the steering vector
by non-uniform selection of the elements of the vector
. Thus, we get a much smaller covariance matrix. Covariance matrices
are formed for
and
as follows:
The criterion function of the high-resolution MUSIC-type algorithm for creating RD-HR map with non-uniform sampling has the same form as the criterion function for the variant with uniform sampling (with the noise subspace matrix and steering vector in the Doppler domain being formed as described above) and defined as:
is obtained from in the same way is obtained from in the uniform sampling method by selecting the elements according to the same mapping ℓ.
The procedure for detection and high-resolution estimation of direction (azimuth) is further identical as in the case of the variant of the algorithm with uniform sampling.
3.3. Detection of Targets on the RD-HR Map
The complete procedure, presented in the previous part of this chapter, is used to evaluate the high-resolution RD-HR (Range–Doppler High Resolution) map. The Range–Doppler map in this document is defined as a numerical two-dimensional image consisting of a finite number of points, which provide accurate information on activity at sea. It is formed at all antennas and for all data segments. The high-resolution properties of the algorithm contribute to better ship detectability, as well as the ability to detect some ships, which are not visible at all using the currently used primary signal processing algorithms. So, the precondition for detection is the formation of RD-HR map, which is the most computationally demanding part of this algorithm.
Comparing the RD-FFT and the RD-HR map clearly shows the advantages of the RD-HR map in terms of resolution properties, map contrast and the ability to detect targets, which fully justifies the use of the algorithm. It was also noticed that successive detections of ships of interest are chained, passing through all segments, and that there is an overlap of contours of criterion functions of successive detections, which is the basis for formulating criteria for detection consistency and a step towards an improved version of tracking.
In this regard, we will describe the procedure for detecting targets (ships) from the RD-HR map using a newly developed algorithm for Image Processing [
27]. The algorithm is innovative and adapted to the specifics of this type of Range–Doppler maps (characteristics of peaks in their criterion functions). Therefore, a joint estimation of the ship’s distance and its Doppler frequency is performed, based on finding peaks at the RD-HR map according to a precisely defined criterion. At the beginning of the detection process, we have to determine arithmetic mean of RD-HR maps at all antennas. Thus, we’ll have only one RD-HR map (criterion function) that is used to find detections:
where
can be uniform or non-uniform criterion function obtained by choosing appropriate mapping
ℓ. From the criterion function
we form the matrix
which consists of elements of interest (
).
and
R are lengths of RD-HR map by Doppler and range dimension, respectively. The grid resolution is 4 times better for range and 2 times better for Doppler than in the case of FFT map.
The next step in the detection procedure is to analyze the RD-HR map (data matrix) and numerically present it using 16 bits. This actually means that the RD-HR map (2D image) is represented by different values, and that the minimum value of the RD-HR map criterion function is zero and the maximum value is 65,535. The reason for this conversion is the higher speed of ship detection, during the practical implementation of this algorithm, without losing the image quality at all in terms of poorer detection.
The next procedure is to remove unwanted noise from the image (RD-HR map) which is presented as a relatively high value in the vicinity of which are relatively low values. This type of noise would manifest itself in the picture as a single point (of course, unwanted in this case). In practice, this would mean that this point would represent a peak in the criterion function, and later also the detection, which we already know in advance is not a real detection, but a false alarm. In the literature, this type of forest is known as “Salt and Pepper” and its elimination is required. The reason why these values not be considered as detection lies in the analysis of peaks at the RD-HR map. It has been experimentally observed that the peaks are not point values, but that they have some shape everywhere, whose width is smaller or larger, and their values of the criterion function cannot drastically fall at all neighboring points around one peak.
The elimination of unwanted values is done by Median Filtering algorithm used in Image Processing. This filtering method is executed for each element of the input matrix (each pixel of the input map), analyzes its 8 adjacent values, and calculates the median of these nine values. The procedure is as follows:
A window (matrix) of size points is placed around the observed image element (at the beginning it starts from the upper leftmost point in the image, ie the first row and the first column);
Then all the elements in the window are placed in an array;
The array is sorted in ascending order;
Select the mean element (5-th element in the array);
The corresponding image element, which has been filtered, is written to the appropriate element of the output matrix (the pixel of the output map);
The procedure steps 1–5 are repeated for each element of the output matrix.
It is necessary to emphasize that the filtering window can be of different lengths, but in this particular case it is necessary to remove only unwanted single-point peaks from the image, because we know for sure that they do not represent detection. Setting up a larger window would not be practical, as there is a possibility that the criterion function of the Range–Doppler map would be very narrow, and in that case it would be unreasonably rejected, which would lead to poorer detection results. Also, it should be emphasized that the algorithm is applied to points located on the edges of the image, and all points of the window function, which can not include the nearest neighbors of the filtered point, are simply supplemented by zeros and the median is sought, as which has been explained before. There are several cases when zeros are filled in the window function, and they are: first row, first column, last row and last column of the Range–Doppler map. Because of this, there will certainly be zeros at all ends of the filtered image. In
Figure 6, the procedure of the Median Filtering algorithm was shown.
In other words, for a given map
, we select a
submatrix
centered at
as
where each edge of the map is padded with zeros, or more formally,
, for all
where
or
.
can be
in this case.
and
R are lengths of RD-HR map by range and Doppler dimension, respectively.
Then the submatrix is rearranged into a vector, , the vector is sorted which produces the vector , and the resulting pixel is .
These steps are executed for each pixel (i,j) of the RD-HR map in order to eliminate spurious single-pixel peaks.
Next, the value of the threshold above which detections are taken is defined. So, the threshold value is a parameter that determines whether some peaks in the criterion function will be considered as detections or noise (such detections are rejected). The selection of the threshold value is an important procedure during detection and it is necessary to pay special attention to it. Its value can vary depending on whether the detection of close or distant ships is desired, and it can also be an adaptive threshold value depending on the distance.
Figure 7 shows the ship detection procedure, whose values of the criterion function are above the threshold.
From a numerical point of view, we wonder what that threshold value is. If a low threshold is chosen, the number of detections will be higher, and all ships will be detected, both those that are close, but also those that are very far from the radar. In that case, the number of detections will be large, but this increases the complexity of the calculation later, when we are detecting the azimuth. It has been noticed that there are a large number of false alarms among these detections, so the question is how the threshold can be set. To choose the appropriate value for the threshold, the amplitude of the targets have to be taken into account. The greater the amplitude (on average), the higher the threshold value should be, otherwise the false alarm rate would be increased. If, on the other hand, the amplitude is low and we do not decrease the threshold adequately, the probability of misdetection would increase. The amplitude of the signal generally decreases with the range. Additionally, it increases with the increase of the target RCS. All in all, an adaptive threshold strategy should be implemented, so that the threshold value is nonuniform along the range dimension. Also, the threshold value should be increased in the immediate vicinity of a target with a large RCS, to keep the false alarm rate down. Based on experimental tests of data obtained from radar in operational work, it was concluded that the threshold value should be in the range of and , while the number of successful detections should be maximum. In the implementation process of the algorithm, the values 0.1 and 0.2 are used, thinking about the previously defined values and . In this study, the threshold values were chosen according to a large set of real radar data (large statistical sample) and applied within the algorithm to obtain the target detections. In this paper we present a small subset of these results. Of course, it should be noted that not all points that exceed the threshold value will be detections, but they will become candidates to be detections, which will be discussed later.
The next step is the 2D convolution procedure. Here, the RD-HR map (2D image) is additionally filtered, but there must be another 2D filter matrix of smaller dimensions (the so-called kernel matrix).The main goal is to obtain a smooth image Range–Doppler map. The filter matrix in this case is a Gaussian 2D filter whose dimensions are
. The dimensions of this filter can be different, but it would be best to choose them based on the characteristics of the RD-HR map peaks. The center of the filter matrix must be positioned on the pixel to be filtered. This operation in which we summarize the products of the elements of two 2D functions, where it is allowed for one of the two functions to move over the elements of the other function is actually a convolution. The 2D convolution operation is quite computationally demanding, so it is not very fast to execute unless small kernel filters are used. Their dimension should be odd, so that they have a center, for example
,
and
. In
Figure 8 it is shown a Gaussian 2D filter measuring
, as well as its criterion function.
Figure 9 illustrates the 2D convolution procedure with a
kernel matrix for one pixel at the RD-HR map. As explained earlier, the same is true here if the dot is found on the edges of the RD-HR map, then the corresponding values of the kernel matrix are filled with zeros.
Figure 10 illustrates the 2D convolution procedure with a kernel matrix, which clearly shows how to process one pixel at a time from the image.
The last step is to determine the actual detections, based on the matrix obtained after the procedure of all the above filtering and with a defined value of the detection threshold. It should be noticed that not all values obtained in this way. First, non-zero elements are determined (which are significantly smaller than in the original image), and they represent candidates for detection. Then, around each point, a criterion function is observed with 2 points on all sides.
In other words, we want to apply a 2D linear FIR (Finite Impulse Response) filter to the map
to obtain
. Its impulse response (or kernel) can be thought of as a
matrix and is given by
The result is the convolution
where the edges of the map
are appropriately padded with zeros, i.e.,
, for all
where
or
. Kernels of different sizes, such as
,
, or
, can be used instead, but filtering with large kernels can be computationally demanding.
Figure 11 shows the layout of different kernel functions.
There are 2 ways to search for the appropriate detection. The first way is the method of local maximum of the criterion function, more precisely, if the point, which is located in the center of the part of the criterion function of dimensions , has a maximum value in that window, then it represents detection. The second way involves the analysis of the same part of the criterion function, but also the sigma by distance and Doppler frequency. Sigma, as it was defined in WERA radar, means 2nd moments of the distance and Doppler estimation, while the distance and Doppler estimates are centroids (centers of mass) of this part of the criterion function. The result of the execution of the algorithm are detections, whose x and y coordinates represent estimates of the distance and Doppler frequency.
Figure 12 shows all steps in detection process.
Finally, we obtain detections on Range–Doppler map and we can continue with the last step in the detecion process which is azimuth detection.
Figure 13 shows detections on RD-HR map.
3.4. Azimuth Detection of Targets Detected in RD-HR Map
The idea is to first evaluate the high-resolution RD-HR map, to detect targets on it using a newly developed algorithm for Image Processing, and to estimate the azimuth, using another algorithm. Azimuth detection performs only for distances and Doppler frequencies of such detected targets. In this way, the numerical complexity is significantly reduced and the execution process of the algorithm is accelerated. For the calculation of azimuth, a similar procedure will be used as before. For detected distances, a criterion function will be required, but only for detected Doppler frequencies. The MUSIC method will give an accurate azimuth estimation.
We will assume that the number of detections found on the Range–Doppler map is equal to
. Therefore it is necessary to determine the unknown parameters
and
or the unknown vessel Doppler frequencies (radial velocities), ranges and directions of arrival (azimuths) for each of
targets, respectively. Unlike the RD-FFT map, when RD-HR map is formed, the phase data is lost and therefore we have to return to the matrix
. The first step in azimuth detection is to select column vectors
for
,
and for
-th FFT sample. These columns correspond to the detected range from the RD-HR map. Thus, for each of
q detections we find the appropriate column vectors
, as shown in
Figure 14.
To compensate for the Doppler effect in matrix
for all antennas
, we use the steering vector
and we get:
Then we form appropriate matrix
We get the covariance matrix by averaging over the
L shifts as follows
The same snapshots/frames (
from
Figure 5) that are used for the estimation of the covariance matrix (
18) of the RD-HR map are also used for the estimation of the covariance matrix in (
30), after pre-processing according to (
28). When selecting the parameter
L, a compromise must be made here because on one hand, to allow a more statistically stable estimate of the covariance matrix, a large enough number of snapshots should be taken, but on the other hand it increases the numerical complexity, so the signal processing cannot be performed in real-time. Another negative effect of increasing
L too much is that it can become longer than the coherence interval and, so, will blur the RD-HR map. In the practical implementation,
is the value that satisfies all the above requirements.
The steering vector in this case is
for a ULA, where
,
is the azimuth, and
d is the distance between adjacent antennas. The criterion function for the azimuth is
where
is the noise subspace matrix calculated for the
q-th detected target. The matrix
is a matrix of noise subspace of the covariance matrix
whose columns are eigenvectors of the covariance matrix
which correspond to
of the smallest eigenvalues of the covariance matrix.
represents a parameter of MUSIC-based algorithm.
The final estimate of the azimuth is determined by:
4. Experimental Results
The results presented in this section are based on the measured radar data, and their verification was made using AIS data. A set of real signals (RAW data) acquired on April 19, 2020 from the OTHR radar located on Ibeju Lekki, Nigeria, in a time interval of 5 h was used for testing. The section is divided in 2 parts.
The first part of this section shows Range–Doppler maps obtained by the proposed HR algorithm, and one example of azimuth estimation based on detections from RD-HR maps. In this part, the basic system parameters are explained too. The second part analyzes the performance of the proposed algorithm. Because we have real data and also AIS data, we can made one experiment to see the numerical results of detecting vessels.
P = 1536 and N = 16 are predefined values and M is the value to be selected and it should correspond to the integration period in which the coherence of the signal is preserved. The developed algorithm was tested for the length of the segment M = 256, where the successive segments overlap with 128 frames, which ensures the results are ejected every 128 frames.
First step in the proposed algorithm is forming of High Resolution Range–Doppler map. We used uniform sampling method. Here, we can see properties of Range–Doppler maps and their main advantages and differences. In
Figure 15 a comparative view of the RD-FFT map, obtained by the FFT algorithm, and a high-resolution RD-HR map, obtained by the new high-resolution algorithm, was presented. Both maps were calculated for an integration period of 256 frames with a duration of 0.260022 s each (integration interval of 66.5656 s). At this point, it is worth noting the difference between two notions related to the performance of a position estimation algorithm. The first one is the
target resolvability, which quantifies the ability of the algorithm to perceive two targets close to each other as separate targets and not a single larger target, depending on the distance between them. The second notion is the
grid resolution, which represents the density of the points at which the criterion function of the algorithm is calculated. Even though it can be chosen arbitrarily, care must be taken not to make it too coarse, otherwise the accuracy and target resolvability of the algorithm would be degraded. On the other hand, choosing the grid resolution to be too fine directly increases the computational complexity of the algorithm. The resolution of the RD-FFT map according to Doppler is basically determined by the resolution properties of the Fourier transform and in this case it is 0.0150 Hz. The range of Doppler frequencies obtained by the FFT algorithm is from −1.9229 Hz to +1.9229 Hz. The RD-HR map is calculated using a new high-resolution algorithm when, and unlike the FFT algorithm, there is a possibility to choose the bandwidth and grid resolution with which the RD-HR map is calculated. In this particular case, the RD-HR map for the integration period of 256 frames was calculated in the range −0.4804 Hz to +0.4804 Hz with a grid resolution of 0.0019 Hz (RD-HR map is calculated in 513 points as opposed to RD-FFT map calculated in 256 points). It follows from the above that the grid resolution of the RD-HR Doppler map is 7.8947 times better than Doppler resolution of the RD-FFT map. The range in which the RD-HR map is calculated from −0.4804 Hz to +0.4804 Hz is chosen so that in this case it includes the Doppler frequencies of ships of interest, including Bragg’s lines. This range can be set arbitrarily. The calculation of the RD-HR map was performed with a range grid resolution of 375 m. It is 4 times better than the range resolution used in the calculation of the RD-FFT map (1.5 km).
Comparing the RD-FFT and the new RD-HR map clearly shows the advantages of the RD-HR map in terms of target resolvability in Doppler domain, map contrast and the ability to detect targets. It was also noticed that successive detections of ships of interest are chained and that there is an overlap of contours of criterion functions of successive detections, which is the basis for formulating criteria for detection consistency.
RD-HR maps are formed for each antenna individually and independently. Target detection is performed on an averaged RD-HR map. A Gaussian kernel function was chosen based on the analysis of the shape of the lobes of the RD-HR map in order to improve detection performance. In the second step, the azimuth is estimated using a high-resolution MUSIC type algorithm that is executed only for all detections in the RD-HR map. Because of that, numerical complexity and the time of algorithm execution is reduced. Angle grid resolution had chosen to be 0.2 degrees, and it is much better resolution then the resolution used in many algorithms which are currently in use (typically 1 degree). In monostatic radars of this type, the accuracy in the azimuth dimension is usually the lowest of all the three dimensions. Because of this, it is significant to improve the azimuth estimation accuracy, if the estimator and the useful information embedded in the received signals allow, as long as this increase in the accuracy does not increase the numerical complexity so much that the algorithm can no longer run in real-time. In this particular case, the increase in the numerical complexity of the entire algorithm when the azimuth grid is refined from to is negligible. There are a few more reasons why it is important to choose a finer azimuth resolution. Firstly, the lobes in the MUSIC-based criterion function are very narrow, so the grid resolution should be chosen such that there are enough points on each lobe to enable us to recover the location of its maximum correctly. Furthermore, the MUSIC-based algorithm has high target resolvability, which is better than the FFT resolution cell. This allows us to detect vessels at the same range and radial speed, but at slightly different azimuths (within one FFT resolution cell), but this can be done only if the azimuth grid resolution is fine enough.Also, refining the grid without bound will not improve the performance of the estimator arbitrarily, but, instead, the performance improvement would experience a saturation effect. This is because the amount of useful information in the raw signals is limited, and thus determines the performance bound. However, by refining the resolution in this case from to does increase the performance noticeably (the saturation still does not occur).
As mentioned earlier, in a time interval of approximately 5 h, we want to detect vessels using the proposed algorithm, and then compare the results with AIS data. Because of that, we made an experiment by randomly selected 10 vessels and monitored the detections throughout the time interval. The complete AIS data in a time interval of approximately 5 h is plotted in
Figure 17.
First, a contour is formed around the AIS data, where the width of the contour is equal to the size of the initial resolution cell of 1.5 km. Then the criterion was made so that the detections and AIS data are monitored for one hour, hour by hour. According to this criterion, if the detection is within the contour we will consider that the real detection and not a false alarm.
Figure 18 illustrate the forming of the criterion contour.
We made an experiment by randomly selected 10 vessels whose basic information is available on websites (accessed date: 10 January 2022):
www.vesseltracker.com,
https://www.myshiptracking.com,
https://www.marinetraffic.com and
https://maritimeoptima.com. We will monitor the vessels by MMSI (A Maritime Mobile Service Identity) number. MMSI is a nine-digit number that uniquely identify vessel stations and it is sent over a radio frequency channel.
Figure 19 shows all vessel’s detections in a time interval of 5 h for different detection parameters of the proposed algorithm. It can be clearly seen that as the order of the model
K increases, the number of detections increases too, which is an expected result. Also with increasing the value of the normalized detection threshold, the number of detections decreases, which is a consequence of poorer detection of peaks in the Range–Doppler map.
Figure 19a also shows the markings of some individual tracks because we want to explain the nature of these tracks. Note that a small part of the area in
Figure 16 was zoomed in and shown in
Figure 19 so that the details, especially the categorization of the detections, could be clearly seen. Tracks marked by 1 indicate the traces for which AIS data exists. Light blue tracks represent the AIS data and we use this as the benchmark (as real vessel trajectories), where available. Note that AIS tracks are partially visible because they are overlayed (covered) by the target detections (yellow markers). The tracks marked by 2 indicate traces for which there is no AIS data, but from the aspect of the detection algorithm, this vessel can be considered as detectable. We know that these tracks correspond to real vessels, because this was confirmed by the tracker that was executed after the proposed detection algorithm (the tracker is outside the scope of the paper). The track marked with the number 3 is a consequence of ionospheric interference. Other scattered detections, marked with the number 5, are a consequence of the sea clutter. Note that the first-order Bragg’s lines in
Figure 12 were suppressed in preprocessing, so that they do not appear in
Figure 19. Additionally, even though Bragg’s lines are (more or less) concentrated in two regions on an RD-HR map, they appear dispersed on a geographical map. What can be noticed is that in all cases the detections match the AIS data very well, and in the next step an accuracy analysis will be made depending on the selected algorithm parameters (K and threshold).
Since we observe detections hour by hour,
Figure 20 shows an example of the appearance of detections on a geographic map from 17 pm to 18 pm for different values of algorithm parameters. Graphs of this type are very useful and can be used to monitor changes by the hour, for example if there is a change in climatic conditions, or if there is a change from day to night, etc.
Note that the detections in
Figure 20 were intentionally shown only for the interval 17:33–18:00, whereas the AIS data was shown for the entire hour (17:00–18:00), so that the beginnings (roughly the first 50%) of the AIS tracks would be visible (not overlayed by detections).
In the following analyses, the results of the detection of arbitrarily selected vessels will be presented in order to see the impact of certain parameters.
Figure 21 shows detections for a vessel with MMSI = 636014619 in a time interval of 1 h (18–19 h) for different detection parameters of the proposed algorithm. Note that there is only one vessel in the selected area—the one inside the vessel contour (this was verified by the tracker). Tracks can be clearly seen and detections successfully follow the AIS data.
The highest number of detections is in the case when the model number is higher and the detection threshold is lower. This certainly increases the detectability of vessels, but also increases the number of false alarms.
Figure 22 shows detections for a vessel with MMSI = 657,199,400 in a time interval of 1 h (18–19 h) for different detection parameters of the proposed algorithm when ionospheric interference is present. It interferes with the detection process but the tracks are still visible and the vessel is detectable for the whole period of time. Similarly, there is only one vessel in the selected area (verified by the tracker) and there is also strong ionospheric interference.
The following example which is shown in
Figure 23 will show how stationary targets are detected. One of the stationary targets, which is also shown on the map, will be taken. This target is labeled as G-132km. The model number and the choice of the detection threshold do not significantly affect the detectability of such a target and it is detectable in all cases.
The following analyses will provide numerical data of the proposed algorithm for different parameters
K and threshold in order to obtain their optimal values.
Figure 24 shows the total number of detections inside the selected contour for all vessels. From this picture, you can clearly see which ships are detectable and in what period of time.
Based on all previous analyses, the assessment of vessel detectability was made.
Table 1 and
Table 2 show the final results.
As can be seen from the previous figure, the detection success is high in all cases. In order to determine the optimal value of the algorithm parameters, in practical situations it is necessary to determine the percentage of detection success.
Figure 25 shows the percentage of detection success of the proposed algorithm for different parameters
K and threshold. In this case, the best performance is 76.67% for chosen algorithm parameters
K = 10 and threshold 0.1. This clearly shows that the order of the model must be higher and the detection threshold lower in order for this percentage to be higher. But in addition to this, an important parameter can be the ratio of true detections and total number of detections, and it is desirable that this number be as small as possible so that there are not too many false alarms.
The ratio of total number of detections and number of detections within contours for all vessels and for all algorithm parameters is shown in
Table 3.
To provide more useful information about the performance of the algorithm than the cumulative number of detections and false alarms inside vessel contours (
Table 3), we approximately determined the probability of detection and the probability of a false alarm (
and
). In order to determine
and
, we made a criterion.
Suppose there is a single vessel in an area of interest in a given time interval. Let
be the set of points in the search grid (finite set). Also define
, as the set of timestamps in the given interval,
as the selected area of interest,
,
as the ball centered at the benchmark location of the vessel at time
t, and
as the set of locations of the detections obtained by the algorithm from the segment with timestamp
t. Then, we can define the area inside the contour around the vessel’s trajectory as
One possible estimate of the false alarm rate (FAR) is then
where
denotes the number of elements of a set. Another way of defining the FAR estimate, which also counts the detections inside the contour, but outside the ball for a given
t (it includes an extended area), is
We also estimate the probability of detection, , as the ratio of the number of timestamps t in which there is at least one detection inside the ball around the vessel, i.e., , and the total number of timestamps in which the vessel is present (in the given interval).
The ball is centered at the AIS location of the vessel at the given timestamp (the timestamp of the given signal segment) and its radius is equal to the size of the initial resolution cell of 1.5 km. Total number of time stamps in the selected period of time (18–19 h) is 105.
Figure 26 shows the proposed criteria used to determine the probability of detection and the probability of false alarm.
Table 4 and
Table 5 show the numerical results for two vessels presented in the paper. We have chosen these two vessels so that the detection of one is quite bothered by ionospheric interference, and the other is not. The results for the same vessels are presented in the previous part of the paper. The selected estimation area is the same as the area shown in the paper. In the cases in which the sample was too small to have at least 100 events of each of the two types (presence/absence of detection), we gave the estimate of the probability in the form of the ratio of the number of events of the given type and the total number of events (the sample size). In those cases, the probability estimate is not considered stable enough, but still provides some useful information about the behavior of the algorithm.
Increasing
K from 5 to 10 for the vessel in
Table 4 increases
by 0.1143 and 0.0286 for threshold values of 0.1 and 0.2, respectively, while the FAR remains very low (in the order of
). Similarly, for the vessel in
Table 5 the increase in
is 0.0762 and 0.1143.
In addition, one of the most important advantages of the high-resolution algorithm presented in this paper is target resolvability.
As it is well known, target resolvability in HFSWR is limited by the size of Range–Doppler-azimuth cells in 3D RDA map. The size of Range–Doppler-azimuth cell provided by DFT based primary signal processing (usually applied in HFSWR) is primarily limited by the resolution properties of DFT (the number of samples in range and Doppler domain and the number of antennas in linear antenna array). In the paper we proposed MUSIC-based methods for high-resolution Doppler and azimuth estimation. It is also known that high-resolution methods can resolve signal targets which are inside Rayleigh resolution bandwidth (in this case in Doppler and azimuth domain). So, it is clear that the size of Range–Doppler-azimuth cells provided by high-resolution methods are smaller then those provided by DFT methods. It means that the application of high-resolution methods in HFSWR can improve its target resolvability. Practically, it means, for example, that two targets at the same range and Doppler (this scenario is possible in practice) can be resolved in spatial (azimuth) domain.
In the presented signal scenario, we did not have two close targets representative for the illustration of better resolvability. So, we found a representative close target scenario from many other scenarios for which we have acquired signals.
In
Figure 27, we show an example with two vessels that were very close to each other. According to the detections shown in the figure, the algorithm has a high target resolvability rate, even for vessels at the same range and Doppler shift.
And what is very important, the proposed high-resolution algorithm presented in the paper achieves real-time processing. The selected chirp duration is 0.260022 s, and since we want to output the results after every 128 frames, the real-time requirement is 33.28 s. Thus, the processing time of one segment must be shorter than 33.28 s. Also, the parallelization of the program was made, so that it is executed on several CPU cores and runs on on a PC computer with i7 CPU, and on a better CPU (AMD Ryzen) in real time. It should be emphasized that the parallelization was done for the most complex part of the algorithm (calculation of the RD-HR map) where CPU utilization is 100%, while in other less computationally demanding parts it is not.
Table 6 shows the average segment processing time for a sample of 200 segments.
Figure 28 shows logical processors usage in the multithread software.
5. Conclusions
In this paper, we presented new developed algorithm for FFT-based range and MUSIC-based high-resolution Doppler and Azimuth estimation in HFSWRs. The performance of the proposed algorithm based on experimental study are also presented. We analyzed numerical results of the proposed algorithm for different parameters K and threshold values in order to obtain their optimal values. Based on the analyses, the assessment of vessel detectability was made. We improved the detectability in the selected time interval.The highest number of detections is in the case when the model number is higher and the detection threshold is lower, and what is more important, the ratio of total number of detections and true detections is not too high, and the percentage of detection success is high. Based on the experimental results, the assessment of vessel detectability was made. The properties of RD-HR maps are presented and also their main advantages and differences, related to RD-FFT maps, in order to have better target detectability. An RD-HR map has a higher contrast and it is more suitable for use in HFSWRs then RD-FFT maps. The contribution is also the compensation of the Doppler shift before high-resolution azimuth estimation which is performed using a high-resolution MUSIC-type algorithm, that is executed for each detection in the RD-HR map. Because of that, numerical complexity and the algorithm execution time are reduced. We do not need to process all the points from the RD-HR map, but only detections. We also form the criterion to compare detections and AIS data. It can be noticed that in all cases the detections match the AIS data very well, and this comparison can be very useful to verify empirically obtained results. Tracks can be clearly seen and detections successfully follow the AIS data.
We have also made rough estimates of the probability of detection and the probability of a false alarm, which show the advantages of the proposed algorithm.
In HFSWRs, CFAR detectors are usually used. The detection algorithm that we proposed, which comes from the field of Image processing, eliminates spurious single-pixel peaks in the criterion function and it can improve detectability by adapting the shape of the kernel to the shape of the lobes in the RD-HR map.
The high-resolution MUSIC-based algorithm was proposed for both the RD-HR map and the azimuth estimation. It increases the target resolvability of the radar both in Doppler and azimuth domain, as well as the detectability of the targets. The MUSIC-based algorithm was improved by using non-uniform sampling across the signal frames (in Doppler domain), to drastically reduce numerical complexity, while sacrificing little performance.
These results are obtained in a real environment within an experimental study. Therefore, the algorithm may have practical application in the future and have great potential because the surveillance with HFSWR radar can be done continuously, 24 h a day, 7 days a week at the significantly lower costs. It is also possible to define potentially suspicious activities and immediately warn the user about it. An extremely large detection range is therefore possible without the so-called “Blind zones”. Also, high reliability is enabled and possible integration with an automatic identification system (AIS) that provides the information about ships that are currently in a zone of interest. Therefore, all of the above represent a challenge to many researchers around the world to further develop and define HFSWR radar algorithms.
A special challenge is to compare the performance of new algorithms with existing algorithms for primary signal processing, as well as to define mathematical models that will lead to better ship detectability and better radar resolution properties, as well as the ability to detect some ships that are not detectable or separable by distance/azimuth using the currently used algorithms for primary signal processing.
The algorithm is potentially applicable for other purposes, for example for surveillance and other targets of interest, such as detection of sea currents, sea winds, icebergs, and can also be used to search and rescue people in the case the ship is lost from AIS and if an accident occurs, in the fishing, in the exploitation of marine resources, as well as tsunami detection, which can lead to saving many human lives, etc.
As for the future research directions, it will be important to explore a few key points that could improve the proposed method in practical situations further:
Mathematical modeling and the simulation of the whole system, which includes the setting of all the parameters of the multi-target signal scenario (such as interference, propagation, see clutter and signal parameters, such as SNR and RCS). That way we would also be able to estimate the false alarm rate and the probability of detection in a fully controlable scenario.
Automatic selection of detection thresholds dependent of the distance or weather conditions, sea clutter and external interference, that is better than the experimentally obtained threshold in terms of detection results;
Suitable algorithm used to estimate parameter K, such as an adaptive determination method, or some custom variant. As we noticed, AIC and MDL give a higher value of K than the actual value;
Automatic segment length selection;
Algorithmic optimization for obtaining non-uniform frame selection based on which the RD map is calculated, which leads to a lower numerical complexity.
Most known technical radar solutions such as WERA, ONERA, OSMAR use the same type of primary signal processing based on Fourier spectral analysis. In all the listed HFSWRs, in the first step, by applying the Fourier transform, an RD map is formed. Target detection is performed on an RD map using one or more CFAR detector variants. In the second step, the direction estimate is determined for the targets detected in the RD map using the classic single snapshot beamformer.
High-resolution methods represent a new solution in relation to the state-of-the-art in the field of signal processing in HFSWRs and certainly lead to the improved detection and separability of close targets.