Next Article in Journal
Inferring Static Hand Poses from a Low-Cost Non-Intrusive sEMG Sensor
Next Article in Special Issue
Motion Plan of Maritime Autonomous Surface Ships by Dynamic Programming for Collision Avoidance and Speed Optimization
Previous Article in Journal
Design and Application of Toxic and Harmful Gas Monitoring System in Fire Fighting
Previous Article in Special Issue
Real-Time Underwater Image Recognition with FPGA Embedded System for Convolutional Neural Network
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Clustering Cloud-Like Model-Based Targets Underwater Tracking for AUVs

Science and Technology on Underwater Vehicle Laboratory, Harbin Engineering University, Nantong Street 145, Harbin 150001, China
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(2), 370; https://doi.org/10.3390/s19020370
Submission received: 23 December 2018 / Revised: 15 January 2019 / Accepted: 15 January 2019 / Published: 17 January 2019

Abstract

:
Autonomous underwater vehicles (AUVs) rely on a mechanically scanned imaging sonar that is fixedly mounted on AUVs for underwater target barrier-avoiding and tracking. When underwater targets cross or approach each other, AUVs sometimes fail to track, or follow the wrong target because of the incorrect association of the multi-target. Therefore, a tracking method adopting the cloud-like model data association algorithm is presented in order to track underwater multiple targets. The clustering cloud-like model (CCM) not only combines the fuzziness and randomness of the qualitative concept, but also achieves the conversion of the quantitative values. Additionally, the nearest neighbor algorithm is also involved in finding the cluster center paired to each target trajectory, and the hardware architecture of AUVs is proposed. A sea trial adopting a mechanically scanned imaging sonar fixedly mounted on an AUV is carried out in order to verify the effectiveness of the proposed algorithm. Experiment results demonstrate that compared with the joint probabilistic data association (JPDA) and near neighbor data association (NNDA) algorithms, the new algorithm has the characteristic of more accurate clustering.

1. Introduction

Most research concerning automatic detection and tracking technology is focused on ground objects. However, underwater multi-target detection and tracking are in great demand. The past decade has witnessed the fast development of ocean observation, which has been a success in the application of subaqueous robots for underwater detection and salvage, target recognition, and location tracking [1,2,3,4]. Underwater multi-target detection relies on underwater multiple sensors [5]. Based on the mechanically scanned imaging sonar, the multi-target detection and tracking technique can extract information from one or several specific moving objects in the intricate background area through a series of sonar sequence images, which can automatically track the targets [6,7].
The special underwater operation environment has been a hindrance to the development of marine resources, requiring professional underwater tools. On account of the limitation of human underwater activities, it is necessary to develop an unmanned vehicle that can replace divers and work under deeper water in order to develop marine resources. Various underwater robots have emerged as the times have required [8]. As a sort of subaqueous operation device, autonomous underwater vehicles (AUVs) can complete underwater operations under the condition of unmanned operation, and can fulfill the tasks of environmental detection, target recognition, and so on [9,10,11]. With the continuous development of related technologies and theories in recent decades, AUV technology is constantly upgrading, and its application to complete underwater detection is low-cost and highly-efficient. As a result, the utilization of AUVs is more extensive in tasks such as marine resources exploration and marine environment survey [12,13,14].
When the relative position of the object’s acoustic reflection surface varies, the intensity of the emission echo received by the sonar weakens and the target may disappear. Because the mechanically scanned imaging sonar is two-dimensional, the sonar image of the target area will overlap [15,16,17] when the two targets are in the same sphere as the sonar beam, making it hard to track the target based on the mechanically scanned imaging sonar. Especially in the dense multi-target tracking, the target density and the overlapping of the target regions in the sonar image will make the target tracking rather difficult. The basic principle of data association is to settle the problem of mutual matching between the trace points based on logic judgment or probability statistics calculation.
The common data association algorithms include the nearest neighbor data association [18], the probability data association [19], the joint probability data association [20], the multiple hypothesis tracking algorithm [21], and the clustering method [22]. L. Zhang [23] proposed an optimization method on the basis of network flow for data association in a multi-target tracking process. The maximum a posteriori (MAP) problem is mapped to the cost flow network with trajectories and non-overlapping constraints. Moreover, the optimal data association is figured out using the minimum cost flow algorithm in the network. J. Neira and J.D. Tardos [24] from Zaragoza University raised a new set of measurement systems with joint compatibility, which refuse to be misaligned, and the measurement systems employ a restrictive standard to search for the best solution for data association efficiently.
Although some approaches have been currently presented, problems still exist. The object-tracking method based on the extended Kalman filter (EKF) [25,26] has a higher computational efficiency, and the perfect track results can be gained under the condition of linearity motion. An alternative algorithm applying the Sequential Monte Carlo method has the advantage over solving the nonlinearity problems in the measurement model. However, the large numbers of particles lead to a higher computational cost than EKF [27,28].
The rest of the study is organized as follows: Section 2 presents the hardware architecture of the multiple targets tracking system of AUVs. The CCM algorithm is applied to cluster the effective echoes to the targets, and the cluster center is taken as the final observed value. Furthermore, the nearest neighbor method is involved in associating the cluster center with the track and state estimation to form a new multi-target data association algorithm. The proposed multi-target data association algorithm based on the C-means clustering cloud-like model is outlined in Section 3. The sea trial of the mechanically scanned imaging sonar equipped on “Orange Shark” AUV is implemented so as to verify the effectiveness of the proposed algorithm, and the experimental results and a brief discussion are shown in Section 4. Finally, conclusions and future works are presented in Section 5.

2. Hardware Architecture

In the targets underwater tracking system of AUVs, mechanically scanned imaging sonar is mounted on an “Orange Shark” AUV (Figure 1a) in order to track the multi-target in real marine environment. The parameters of the Super SeaKing DST forward-looking sonar (Figure 1b [29]) are shown in Table 1, which hosts two mechanically scanned imaging sonars in a single subsea pressure housing; a 325 kHz CHIRP sonar with a true operational range of up to 300 m for long range target recognition, and a 650 kHz CHIRP sonar for ultra-high definition images. Low frequency mode is chosen for a faster scan speed of multiple targets tracking.
The block diagram of underwater targets tracking for AUV is presented in Figure 2. The sonar image grabbing and processing unit mainly consists of three parts, a PC104 sonar image processing computer, a PC104 main control computer of the AUV, and the mechanically scanned imaging sonar. The PC104 sonar image processing computer transfers serial data via the RS-232 serial port. The serial data is saved in local hard disks and is transmitted to sonar images in the PC104 sonar image processing computer. When the multi-target positions are predicted by adopting the data association algorithm, the positions are transferred to the PC104 main control computer of the AUV via the User Datagram Protocol (UDP). The AUV launches to track multi-targets according to the trajectory planning as soon as receiving the multi-target positions. The near neighbor data association (NNDA) algorithm is used to conduct an online multi-target tracking test in the AUV, and the test data is recorded in PC104. The mechanically scanned imaging sonar data is exported from the AUV and the target tracking data processing is performed by the joint probabilistic data association (JPDA) and clustering cloud-like model (CCM) algorithm offline. The test results are compared so as to verify the underwater target tracking accuracy.
During the sea trail experiments, two targets were planted in the sea, and the selected targets with different underwater acoustics reflectivity are shown in Figure 3 and Figure 4.

3. Methodology

Data association is a significant process for underwater multiple targets tracking. To settle the issue of data association in the multi-target tracking, a data association algorithm in line with the clustering cloud-like model is proposed.

3.1. The Clustering Algorithm Based on the Cloud-Like Model

The cloud-like model combines the fuzziness and randomness of the qualitative concept, which can achieve the conversion of the qualitative linguistic values and quantitative values. Moreover, the model can change the qualitative language value into the quantitative value, which is the cloud-like droplet of the model. During the transformation, the cloud-like droplet generation is a random event, and thus it can be described by the probability distribution.
The traditional C-means clustering issue can be described as follows: P-dimension samples {x1, x2, …, xn} can be divide into c classes, and each class is represented by a clustering center vi (i = 1, 2, …, c). The degree of membership of the sample in each category can be represented by a classification matrix U = [uik]cn (where uik represents the degree of membership of the k-th sample for class I and 0 u i k 1 ). The clustering aims to find the optimal U and V = [ v i ] for minimizing the objectives function J ( U , V ) . In the fuzzy C-means clustering method (FCM), we computed the membership function as follows:
μ i ( x k ) = u i k = | | x k v i | | 2 m 1 j = 1 c | | x k v j | | 2 m 1
where | |   .   | | is the suitable norm and m is the fuzzy weighted index.
In the C-means clustering method based on the model, each class is represented by a cloud-like model. The cloud-like expectation is regarded as its clustering center. The classification matrix is calculated by the mean of the certainty degree of the samples in the cloud-like model. During the transformation, the cloud-like droplet generation is a random event. Therefore, it can be described by the probability distribution. The cloud-like model principally contains the following three digital features: expected value (Ex), entropy (En), and hyper entropy (He). The expected value (Ex) refers to the expected value of a cloud-like droplet on the spatial distribution of the domain, which remains the most representative value of the qualitative concept. Generally, the greater the entropy (En) is, the more macroscopic the concept will be in the cloud-like model. Additionally, it is determined by the randomness and fuzziness of the concept. En is the measurement of the qualitative concepts of randomness, reflecting the dispersion degree of the cloud-like droplets that represent this qualitative concept. Furthermore, it is the measure of the qualitative concepts of fuzziness, which signifies the value range of the cloud-like droplets accepted in the domain. The measurement of the hyper entropy’s (He) uncertainty, which is the entropy of the entropy, is jointly decided by the randomness and fuzziness of the entropy, reflecting the condensation degree of the cloud-like droplets.
Supposing (Ex, En, and He) is the i-th class P-dimension cloud-like model, and Ex, En, and He is a P-dimension vector, respectively. The clustering center is v i = E e i and the elements of the classification matrix are Equation (2).
u i l = i = 1 p exp [ ( x i l E x i l ) 2 E n i l 2 ]
where x i l , E x i l , and E n i l are the l-dimension elements of x i , E x i , and E n i , respectively.
The clustering objective function of CCM is similar to FCM, and the clustering objective function is as follows:
J ( U , V ) = i = 1 c k = 1 n u i k m x k v i 2
Under a constraint condition (the normalization condition i = 1 c u j k = 1 ), FCM gets the iterative formula adopting the iterative solution through the Lagrange multiplier method. Without the above constraints, the objective function of CCM is computed using the iteration of the forward and reverse cloud-like transformation. Considering that the sample set for clustering here is the underwater target sonar image data, there is the random uncertainty (each sample is subject to some unknown probability distribution) and fuzzy uncertainty (each sample is a small sample set). The cloud-like model can depict fuzziness and randomness simultaneously, and thus the C-means clustering on the basis of the cloud-like model is involved in the data association so as to avoid the dependence of the clustering algorithm on the normalization conditions.

3.2. Multi-Target Data Association Algorithm Based on the C-Means Clustering Cloud-Like Model

Based on the above section, this section will cluster all of the valid echoes (targets in the sonar image) by the clustering algorithm using the cloud-like model. Then, the nearest neighbor method is involved to associate the targets. The cluster centers of the multiple targets are regarded as the final measurement for the given target for the state estimation. Supposing there are m echoes and t targets, the procedure is as follows:
(1) At the beginning of the track update cycle, the basic information concerning the prediction state vector X j ( k + 1 | k ) , the prediction measurement vector Z j ( k + 1 ) , the innovation covariance S j ( k + 1 ) , and the gain K j of the target j   ( j = 1 , 2 , , t ) can be computed by Equations (4) to (8).
X j ( k + 1 | k ) = F j X j ( k | k )
Z j ( k + 1 | k ) = H j X j ( k + 1 | k )
P j ( k + 1 | k ) = F j P j ( k | k ) F j + Q j ( k )
S j ( k + 1 ) = H j P j ( k + 1 | k ) H j + R j ( k + 1 )
K j = P j ( k + 1 ) H j S j 1 ( k + 1 )
where F j is the state transition matrix, H j is the measurement matrix, P j ( k + 1 | k ) is the prediction covariance, Q j ( k ) is the process noise covariance matrix, and R j ( k ) is the measurement noise covariance matrix.
(2) Before performing the multiple targets data association calculation, we should check if all of the measurements fall into the tracking wave gate. If v i j ( k + 1 ) S j 1 ( k + 1 ) v i j ( k + 1 ) < γ , it is regarded as a valid target, where γ is the threshold value of tracking the wave gate. v i j ( k + 1 ) is the measuring information about measurement i to target j, as given in Equation (9), as follows:
v i j ( k + 1 ) = Z j ( k + 1 ) Z j ( k + 1 | k )
where Z j ( k + 1 | k ) ( i = 1 , 2 , , m k ) is the measurement acquired from the sonar.
(3) The CCM algorithm is presented to cluster the effective targets, which fall into the tracking wave gate in order to obtain the center of the cluster V i ( k + 1 ) . The calculation process is as follows:
① We initialize U(0) and U ( 0 ) = | u i j 0 | t × m k , where
u i j 0 = e v i j ( k + 1 ) S j 1 ( k + 1 ) v i j ( k + 1 )
② According to the rule of maximum degree of membership, U(b) is utilized to classify the target effective targets {Z1(k + 1), Z2(k + 1),…, Zmq(k + 1)} into t classes. For each class of measurement targets, the cloud-like model ( E x j l ( b ) , E n j l ( b ) , H e j l ( b ) ) in the b-th dimension is calculated by a non-deterministic inverse cloud-like generator, where j = 1, 2, …, t and l = 1, 2, …, p.
③ A new classification matrix U ( b + 1 ) = | u i j ( b + 1 ) i | is calculated in accordance with each cluster of the cloud-like model, as shown in Equation (11), as follows:
u i j b + 1 = Λ l = 1 p { exp [ ( Z i l ( k + 1 ) E x j l ( b ) ) 2 2 ( E n j l ( b ) ) 2 ] }
where Zil(k + 1)(l = 1, 2, …, p) is the l-th dimension of the i-th measurement information; E x j l ( b ) is the l-th dimension of the mean of the j-th cloud-like model, and it is a random number generated from the l-th dimension’s the entropy E n j l ( b ) and the super-entropy H e j l ( b ) of the j-th cloud-like model.
④ We have the clustering objective function as follows:
J ( U ( b + 1 ) , V ( b + 1 ) ) = j = 1 t i = 1 m k ( u j i ( b + 1 ) ) m Z i ( k + 1 ) E x j ( b )
where V ( b + 1 ) = | E x j ( b ) | is a matrix composed of each of the cloud-like model’s mean vectors.
⑤ If | J ( U ( b + 1 ) , V ( b + 1 ) ) J ( U ( b ) , V ( b ) ) | < ε ( ε is a predetermined threshold), then the clustering is achieved and V j ( k + 1 ) = E x j ( b ) . Otherwise, suppose b = b + 1 and return to step ①.
(4) The nearest neighbor algorithm is involved to find the cluster center paired to each target trajectory, and the cluster center is regarded as the final measurement of the corresponding target at time k + 1 (final stage of the track up-date cycle).
(5) The state and covariance of each target can be filtered and updated as follows:
N j ( k + 1 ) = V j ( k + 1 ) Z ( k + 1 | k )
X j ( k + 1 | k + 1 ) = X j ( k + 1 | k ) + K j N j
P j ( k + 1 | k + 1 ) = P j ( k + 1 | k ) + K j H j P j ( k + 1 | k )

4. Sea Trail Experiment Results and Discussion

In order to verify the feasibility of the proposed algorithm based on the clustering cloud-like model in the actual underwater mission, a series of sea trail experiments have been implemented. The experiments were conducted in coast of the Yellow Sea. Two reflectors were located 3 m underwater, and the distance of the targets to the seabed was nearly 10 m. The mechanically scanned imaging sonar was fixedly mounted on an “Orange Shark” AUV. The sonar scanning distance of the mechanically scanned imaging sonar was set to be 50 m. In order to shorten the scanning time of the sonar, the scanning angle was set to 120 degrees forward. Several ropes attached to the associated targets were heaved to drive the targets moving in the horizontal and vertical directions. The AUV and experiment scenario are shown in Figure 5, Figure 6 and Figure 7.
The online tracking experiments using the NNDA of this paper were developed in Tornado 2.2 using C++, and were conducted on a PC104 with an Intel Pentium M 2 GHz CPU and 512 MB RAM; the operating system was Vxworks5.0. The computational power of the embedded PC104 bus system was a real limitation for using more complex algorithms, so offline tracking experiments adopting CCM and JPDA were developed in visual studio 2010 using C++, and were conducted on a PC with Intel Xeon 3.4 GHz and 8.00 GB RAM.
This section selects two sets of representative AUV sea trail experiment data to verify the tracking effect of the CCM algorithm, and compares it with the conventional nearest neighbor data association algorithm (NNDA) and the joint probabilistic data association (JPDA).

4.1. Results and Analysis of Non-Cross-Moving Experiment of Multiple Targets Experiment Using AUV

The above-mentioned three kinds of data association algorithms are implemented to two non-cross-moving targets tracking correspondingly. The trajectory tracking results obtained from the three algorithms are listed in Figure 8. The comparison of results between the actual and the predicted positions of target 1 and 2 acquired from the three algorithms are shown in Figure 9, Figure 10 and Figure 11. Furthermore, the moving direction of target 1 and 2 is from left to right.
Through comparing the multiple targets trajectory tracking diagram and the actual-forecast comparison diagram obtained by three different correlation algorithms in Figure 8, we find that three algorithms can accomplish the tracking of the targets roughly when the two targets are non-cross-moving. The comparison results show that the CCM algorithm is more stable and the tracking error is less for the target 1 tracking. However, the JPDA algorithm deviates slightly from the actual trajectory of target 1 in the region at x [ 5 , 10 ] , and the NNDA algorithm also diverges slightly in the region at x [ 27 , 30 ] . Therefore, the CCM algorithm can track the two targets accurately in the whole intervals with a better tracking performance.
As shown in Figure 9a, when comparing the targets trajectory tracking diagram obtained from the three different correlation algorithms, the actual and predicted trajectory comparison diagram shows that the above-mentioned algorithms can mainly complete the tracking of the two non-cross-moving targets. Nevertheless, for the CCM, the tracking of target 1 is more stable, and its error is less. The tracking of target 1 by JPDA in the region at x [ 5 , 10 ] is a little less than the target’s actual trajectory in the region at x [ 27 , 30 ] , and the tracking of target 1 by NNDA deviates slightly from the actual trajectory. Meanwhile, as shown in Figure 9b, the tracking trajectory of target 2 for the CCM is closer to the actual trajectory than the other algorithms. The tracking of target 2 by JPDA in the region at x [ 15 , 19 ] and x [ 29 , 32 ] deviates from the actual trajectory, and the tracking of target 2 by NNDA deviates slightly from the actual trajectory in the first half of the region, and the whole tracking process is unstable. Compared with the above algorithms, the CCM algorithm can trace the targets more accurately during the whole tracking period.
As shown in Figure 10a, comparing the X-direction errors of non-cross-moving target 1 obtained from three different correlation algorithms, the tracking target 1 for the CCM is more stable and its error is less. Nevertheless, the error of the tracking of target 1 by NNDA in 24 steps is higher in general, and its tracking is unstable. The error of the tracking of target 1 by JPDA is slightly higher than CCM. As shown in Figure 10b, comparing the Y-direction errors of non-cross-moving target 1 obtained from the three different correlation algorithms, the tracking of target 1 for the CCM is more stable and its error is still less in 24 steps. The error of the tracking of target 1 by NNDA in 24 steps is higher than CCM, but better than JPDA. Therefore, the CCM algorithm can trace target 1 more accurately, and the error in X- and Y- direction is less than the other algorithms.
As shown in Figure 11a, comparing the X-direction errors of non-cross-moving target 2 obtained from the three different correlation algorithms, the tracking of target 2 for the CCM is more stable and its error is less. Nevertheless, the error of the tracking of target 2 by NNDA and JPDA in 24 steps is the same in general, and still higher than CCM. As shown in Figure 11b, comparing the Y-direction errors of non-cross-moving target 2 obtained from the three different correlation algorithms, the tracking of target 2 for the CCM is more stable, and its error is still less in 24 steps. The error of the tracking of target 2 by JPDA in 3–7 steps is higher. The error of the tracking of target 2 by NNDA in 24 steps is higher than JPDA, and its tracking is unstable in general. Therefore, the error of the CCM algorithm in the X and Y direction is less, and it can trace target 2 more accurately than the other algorithms.

4.2. Results and Analysis of Cross-Moving Experiment of Multiple Targets Experiment Using AUV

The above-mentioned three kinds of data association algorithms were applied to two cross-moving targets tracking. The trajectory tracking results obtained from the three algorithms are shown in Figure 12. The comparison results between the actual and predicted trajectory of targets 1 and 2 acquired by the three algorithms are demonstrated in Figure 13, Figure 14 and Figure 15. The trajectory of target 1 is moving from the lower left direction to the upper right direction. Furthermore, the trajectory of target 2 is moving from the upper left direction to the lower right direction, slowly approaching the trajectory of target 1.
Comparing the multiple targets tracking diagram and the actual and predicted trajectory comparison diagram obtained from the three disparate correlation algorithms, we found that the JPDA and NNDA algorithm can nearly accomplish the tracking of target 1 when the two targets are cross-moving. The CCM algorithm, compared with the above algorithms, is more stable and the tracking error is less than that of target 1. Target 2 enters from the upper right, which approaches and intersects with target 1 in the region at y [ 25 , 30 ] . As illustrated in Figure 12a, the track loss of the NNDA algorithm occurs as a result of the error association with target 2 in the vicinity of the cross-over area. As shown in Figure 12b, the JPDA algorithm tracks the wrong target because of the error association in the vicinity of the cross-over area, and target 2 is mistaken as target 1 for tracking.
As shown in Figure 13a, the actual and predicted trajectory comparison diagram of target 1 shows that the above-mentioned algorithms can mainly complete the tracking of the two non-cross-moving targets. For the CCM, the tracking trajectory of target 1 is more stable and closer to the actual trajectory among the three algorithms. Nevertheless, the tracking of target 1 by JPDA in the region of y [ 14 , 33 ] failed, and the tracking of target 1 by NNDA deviates slightly from the actual trajectory during the whole tracking period. Meanwhile, the actual and predicted trajectory comparison diagram of target 2 in Figure 13b shows that the above-mentioned algorithms can mainly complete the tracking of the two non-cross-moving targets. The tracking trajectory of target 2 of CCM and JPDA is close to the actual trajectory, and the whole tracking process is very stable. However, the tracking of target 2 by NNDA in the region at x [ 4 , 9 ] succeeded, but failed in another region. We can see that the CCM algorithm is capable of better performing the multi-target correlation and tracking the targets accurately during the whole period.
As shown in Figure 14a, comparing the X-direction errors of non-cross-moving target 1 obtained from three different correlation algorithms, the tracking of target 1 for the CCM is more stable and its error is less. The error of the tracking of target 1 by NNDA is slightly higher than CCM. Nevertheless, the error of the tracking of target 1 by JPDA in 13 steps is close to CCM, but the error in steps 14–24 is extremely high, so the tracking of JPDA in steps 14–24 failed. As shown in Figure 14b, when comparing the Y-direction errors of non-cross-moving target 1 obtained from the three different correlation algorithms, the tracking of target 1 for the CCM is more stable and its error is still less in 24 steps. The error of the tracking of target 1 by NNDA is slightly higher than CCM. The error of the tracking of target 1 by NNDA in 24 steps is slightly higher than CCM, but better than JPDA. The error of the tracking of target 1 by JPDA in steps 12–24 extremely high, so the tracking of JPDA in steps 12–24 failed. Therefore, the CCM algorithm can trace target 1 more accurately.
As shown in Figure 15a, comparing the X-direction errors of non-cross-moving target 2 obtained from the three different correlation algorithms, the tracking of target 2 for the CCM is more stable and its error is less. The error of the tracking of target 2 by JPDA in 24 steps is close to CCM in general. Nevertheless, the error of the tracking of target 2 by NNDA in 24 steps is extremely high, so the tracking of NNDA failed. As shown in Figure 15b, comparing the Y-direction errors of non-cross-moving target 2 obtained from the three different correlation algorithms, the tracking of target 2 for the CCM is more stable and its error is still less. The error of the tracking of target 2 by JPDA in 24 steps is close to CCM in general. Nevertheless, the error of the tracking of target 2 by NNDA in 24 steps is extremely high. Therefore, the error of the CCM algorithm in the X and Y direction is less and the CCM algorithm can trace target 2 more accurately in the three correlation algorithms.

5. Conclusions

To conclude, underwater multi-target tracking is an important issue of AUV trajectory planning during the period of detection and in barrier-avoiding. The mechanically scanned imaging sonar is fixedly mounted on AUVs for underwater targets tracking. Data association of underwater multiple targets is a very significant process in the advance of AUV tracking. However, conventional association algorithms of underwater multiple targets tracking data still have some shortcomings, including wrong tracking and tracking failure, especially during multiple targets that are in crosswise movement. Considering that the sample set for clustering here is the underwater target sonar image data, there is some random and fuzzy uncertainty. The cloud-like model is combined with the nearest neighbor algorithm to form a multi-target data association algorithm based on the clustering cloud-like model (CCM). AUV sea trial experiments were carried out to verify the effectiveness of the proposed algorithm. Experimental results indicate that both the NNDA and JPDA association occur as a result of the error association with other targets in the vicinity of the cross-over area, which is due to the error association in the neighborhood of the cross-over area. The proposed CCM algorithm leads to the right association results in both the non-crossover and crossover multi-target tracking experiments. Therefore, for future work, it is necessary to improve the real-time performance of the CCM algorithm for underwater targets tracking using the embedded system of AUVs.

Author Contributions

M.S.: implementation of algorithm and experiment analysis, and writing of the paper. S.T.: the experimental analysis of the paper. H.Q.: architecture design and experiment guide. The paper was revised by L.W.

Funding

This work was funded in part by the National Natural Science Foundation of China, under Grant (51609050, U1713205, 51809062); in part by the Research Fund from Science and Technology on Underwater Vehicle Technology (6142215190209); and in part by the Stable Supporting Fund of the Major National Science and Technology Project of China (2015ZX01041101).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Xiang, X.; Yu, G.; Lapierre, L. Survey on fuzzy-logic-based guidance and control of marine surface vehicles and underwater vehicles. Int. J. Syst. 2018, 20, 572–586. [Google Scholar] [CrossRef]
  2. Guillaume, A.; Hua, M.; Szymon, K. Pipeline following by visual servoing for Autonomous Underwater Vehicles. Control Eng. Pract. 2019, 82, 151–160. [Google Scholar]
  3. Xiang, X.; Lapierre, L. Robust magnetic tracking of subsea cable by AUV in the presence of sensor noise and ocean currents. IEEE J. Ocean. Eng. 2018, 43, 311–322. [Google Scholar]
  4. Huo, G.Y.; Wu, Z.Y.; Li, S.B. Underwater target detection and 3D reconstruction system based on binocular vision. Sensors 2018, 18, 3570. [Google Scholar] [CrossRef] [PubMed]
  5. Shkurti, F.; Chang, W.D.; Henderson, P. Underwater threat detection and tracking using multiple sensors and advanced processing. In Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vancouver, BC, Canada, 24–28 September 2017; pp. 4189–4196. [Google Scholar]
  6. Meecham, A.; Acker, T. Underwater threat detection and tracking using multiple sensors and advanced processing. In Proceedings of the 2016 IEEE International Carnahan Conference on Security Technology, Orlando, FL, USA, 24–27 October 2016; pp. 443–450. [Google Scholar]
  7. Mandic, F.; Rendulic, I.; Miskovic, N.; Nadj, Đ. Underwater object tracking using sonar and USBL measurements. J. Sens. 2016, 2016, 1–10. [Google Scholar] [CrossRef]
  8. Juhwan, K.; Cheol, Y.S. Convolutional neural network-based real-time ROV detection using mechanically scanned imaging sonar image. Auton. Underw. Veh. 2016, 10, 396–400. [Google Scholar]
  9. Yoshida, S.; Tanomura, M.; Hama, Y. Underwater wireless power transfer for non-fixed unmanned underwater vehicle in the ocean. Auton. Underw. Veh. 2016, 5, 177–180. [Google Scholar]
  10. Wang, F.Q.; Zhang, X.; Xing, X.F. The research of underwater acoustic detection system for small AUV. In Proceedings of the 5th International Conference on Instrumentation and Measurement, Computer, Communication, and Control, Shenzhen, China, 17–18 September 2016; pp. 1828–1831. [Google Scholar]
  11. Alexandri, T.; Diamant, R. A reverse bearing only target motion analysis (BO-TMA) for improving AUV navigation accuracy. In Proceedings of the 2016 13th Workshop on Positioning, Navigation and Communication, Bremen, Germany, 19–20 October 2016; pp. 416–422. [Google Scholar]
  12. Petillot, Y.; Pailhas, Y.; Sawas, J. Target recognition in synthetic aperture sonar and high resolution side scan sonar using AUVs. In Proceedings of the 2010 International Conference on Synthetic Aperture Sonar and Synthetic Aperture Radar, Lerici, Italy, 13–14 September 2010; pp. 193–201. [Google Scholar]
  13. Georgy, J.; Noureldin, A.; Mellema, G. Clustered mixture particle filter for underwater multitarget tracking in multistatic active sonobuoy systems. IEEE Trans. Syst. Man Cybern. 2011, 42, 547–560. [Google Scholar] [CrossRef]
  14. Breivik, G.M.; Fjerdingen, S.A.; Skotheim, O. Robust pipeline localization for an autonomous underwater vehicle using stereo vision and echo sounder data. Int. Soc. Opt. Eng. 2010, 12, 7539–7545. [Google Scholar]
  15. Chen, J.B.; Gong, Z.B.; Li, H.Y. A detection method based on sonar image for underwater pipeline tracker. In Proceedings of the 2011 2nd International Conference on Mechanic Automation and Control Engineering, Inner Mongolia, China, 15–17 July 2011; pp. 3766–3769. [Google Scholar]
  16. Akira, A.; Tamaki, U.; Fumitaka, M. Sub-bottom synthetic aperture imaging sonar system using an AUV and an autonomous surface tracking vehicle for searching for buried shells of toxic chemicals. In Proceedings of the 2010 International WaterSide Security, Carrara, Italy, 3–5 November 2010; pp. 193–196. [Google Scholar]
  17. Kim, J.; Yu, S. Convolutional neural network-based real-time ROV detection using forward-looking sonar image. In Proceedings of the 2016 IEEE/OES Autonomous Underwater Vehicles, Tokyo, Japan, 6–9 November 2016; pp. 396–400. [Google Scholar]
  18. Chen, Q.; Yan, Y.; Dai, Y. Joint nearest neighbor data association based on interacting multiple model Kalman filtering. In Proceedings of the 2016 2nd IEEE International Conference on Computer and Communications, Chengdu, China, 14–17 October 2016; IEEE: New York, NY, USA, 2016; pp. 75–79. [Google Scholar]
  19. Clark, D. Multiple Target Tracking with the Probability Hypothesis Density Filter. Ph.D. Thesis, Heriot-Watt University, Edinburgh, UK, 2006. [Google Scholar]
  20. Luom, J. Data association for AUV localization and map building. In Proceedings of the 2010 International Conference on Measuring Technology and Mechatronics Automation, Changsha, China, 13–14 March 2010; pp. 2231–2240. [Google Scholar]
  21. Haanju, Y.; Kikyung, K.; Moonsub, B. Online scheme for multiple camera multiple target tracking based on multiple hypothesis tracking. IEEE Trans. Circuits Syst. Video Technol. 2017, 27, 454–469. [Google Scholar]
  22. Hardalac, F.; Kutbay, U.; Sahin, l. A novel method for robust object tracking with K-means clustering using histogram back-projection technique. Multimed. Tools Appl. 2018, 78, 24059–24072. [Google Scholar] [CrossRef]
  23. Zhang, L.; Li, Y.; Nevatia, R. Global data association for multi-object tracking using network flows. In Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA, 23–28 June 2008. [Google Scholar]
  24. Neira, J.; Tardos, J.D. Data association in stochastic mapping using the joint compatibility experiment. IEEE Trans. Robot. Autom. 2001, 17, 890–897. [Google Scholar] [CrossRef]
  25. Yang, S.; Marcus, B. Extended Kalman filter for extended object tracking. In Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing, New Orleans, LA, USA, 5–9 March 2017; pp. 4386–4390. [Google Scholar]
  26. Zhou, J. EKF based object detect and tracking for UAV by using visual-attention-model. In Proceedings of the 2014 IEEE International Conference on Progress in Informatics and Computing, Shanghai, China, 16–18 May 2014; pp. 168–172. [Google Scholar]
  27. Du, Y.M.; Yu, L.; Gai, L.N. Analysis of nonlinear processing ability of sequential Monte Carlo filter. In Proceedings of the 2018 4th International Conference on Control, Automation and Robotics, Auckland, New Zealand, 20–23 April 2018; pp. 305–309. [Google Scholar]
  28. Doucet, A.; Godsill, S.; Andrieu, C. On sequential Monte Carlo sampling methods for Bayesian filtering. Stat. Comput. 2000, 10, 197–208. [Google Scholar] [CrossRef]
  29. Super SeaKing Sonar—Mechanical Scanning (Work-Class ROV). Available online: https://www.tritech.co.uk/product/mechanical-scanning-sonar-tritech-super-seaking (accessed on 11 January 2019).
Figure 1. “Orange Shark” autonomous underwater vehicle (AUV) with its mechanically scanned imaging sonar. (a) “Orange Shark” AUV, (b) Mechanically scanned imaging sonar.
Figure 1. “Orange Shark” autonomous underwater vehicle (AUV) with its mechanically scanned imaging sonar. (a) “Orange Shark” AUV, (b) Mechanically scanned imaging sonar.
Sensors 19 00370 g001
Figure 2. Block diagram of underwater targets tracking for AUVs.
Figure 2. Block diagram of underwater targets tracking for AUVs.
Sensors 19 00370 g002
Figure 3. Target 1: a corner reflector (50 mm × 50 mm × 50 mm).
Figure 3. Target 1: a corner reflector (50 mm × 50 mm × 50 mm).
Sensors 19 00370 g003
Figure 4. Target 2: a cylinder reflector (diameter: 50 mm; height: 80 mm).
Figure 4. Target 2: a cylinder reflector (diameter: 50 mm; height: 80 mm).
Sensors 19 00370 g004
Figure 5. “Orange Shark” AUV.
Figure 5. “Orange Shark” AUV.
Sensors 19 00370 g005
Figure 6. A target is dragging by a boat.
Figure 6. A target is dragging by a boat.
Sensors 19 00370 g006
Figure 7. AUV tracking experiment scenario.
Figure 7. AUV tracking experiment scenario.
Sensors 19 00370 g007
Figure 8. Non-cross-moving tracking diagram of multiple targets: (a) near neighbor data association (NNDA); (b) joint probabilistic data association (JPDA); (c) clustering cloud-like model (CCM).
Figure 8. Non-cross-moving tracking diagram of multiple targets: (a) near neighbor data association (NNDA); (b) joint probabilistic data association (JPDA); (c) clustering cloud-like model (CCM).
Sensors 19 00370 g008
Figure 9. Actual-forecast comparison diagram of non-cross-moving targets: (a) target 1; (b) target 2.
Figure 9. Actual-forecast comparison diagram of non-cross-moving targets: (a) target 1; (b) target 2.
Sensors 19 00370 g009
Figure 10. Errors comparison diagram of non-cross-moving target 1: (a) X-direction; (b) Y-direction.
Figure 10. Errors comparison diagram of non-cross-moving target 1: (a) X-direction; (b) Y-direction.
Sensors 19 00370 g010
Figure 11. Errors comparison diagram of non-cross-moving target 2: (a) X-direction; (b) Y-direction.
Figure 11. Errors comparison diagram of non-cross-moving target 2: (a) X-direction; (b) Y-direction.
Sensors 19 00370 g011
Figure 12. Cross-moving tracking diagram of multiple targets: (a) NNDA; (b) JPDA; (c) CCM.
Figure 12. Cross-moving tracking diagram of multiple targets: (a) NNDA; (b) JPDA; (c) CCM.
Sensors 19 00370 g012aSensors 19 00370 g012b
Figure 13. Actual-forecast comparison diagram of cross-moving targets: (a) target 1; (b) target 2.
Figure 13. Actual-forecast comparison diagram of cross-moving targets: (a) target 1; (b) target 2.
Sensors 19 00370 g013
Figure 14. Errors comparison diagram of cross-moving target 1: (a) X-direction; (b) Y-direction.
Figure 14. Errors comparison diagram of cross-moving target 1: (a) X-direction; (b) Y-direction.
Sensors 19 00370 g014
Figure 15. Errors comparison diagram of cross-moving target 2: (a) X-direction; (b) Y-direction.
Figure 15. Errors comparison diagram of cross-moving target 2: (a) X-direction; (b) Y-direction.
Sensors 19 00370 g015
Table 1. Parameters of the Super SeaKing DST forward-looking sonar.
Table 1. Parameters of the Super SeaKing DST forward-looking sonar.
PropertyLow FrequencyHigh Frequency
FrequencyCHIRP centered on 325 kHzCHIRP centered on 650 kHz
Beam width20° vertical, 3.0° horizontal40° vertical, 1.5° horizontal
Pulse length400 μs200 μs
Maximum range300 m100 m
Minimum range0.4 m
Range resolutionapproximately 15 mm (minimum)
Source level210 dB re 1 μPa at 1 m
Mechanical resolutions0.45°, 0.9°, 1.8°, and 3.6°
Scanned sectorVariable up to 360°

Share and Cite

MDPI and ACS Style

Sheng, M.; Tang, S.; Qin, H.; Wan, L. Clustering Cloud-Like Model-Based Targets Underwater Tracking for AUVs. Sensors 2019, 19, 370. https://doi.org/10.3390/s19020370

AMA Style

Sheng M, Tang S, Qin H, Wan L. Clustering Cloud-Like Model-Based Targets Underwater Tracking for AUVs. Sensors. 2019; 19(2):370. https://doi.org/10.3390/s19020370

Chicago/Turabian Style

Sheng, Mingwei, Songqi Tang, Hongde Qin, and Lei Wan. 2019. "Clustering Cloud-Like Model-Based Targets Underwater Tracking for AUVs" Sensors 19, no. 2: 370. https://doi.org/10.3390/s19020370

APA Style

Sheng, M., Tang, S., Qin, H., & Wan, L. (2019). Clustering Cloud-Like Model-Based Targets Underwater Tracking for AUVs. Sensors, 19(2), 370. https://doi.org/10.3390/s19020370

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop