Autonomous Underwater Vehicle Navigation Enhancement by Optimized Side-Scan Sonar Registration and Improved Post-Processing Model Based on Factor Graph Optimization
Abstract
:1. Introduction
- To acquire reliable relative position measurement, an improved Fourier-based image registration technique has been proposed to address the lack of features in SSS seafloor images. This method builds upon traditional registration by incorporating a Gaussian prior to eliminating outliers, and employs bandpass filtering to enhance the accuracy after outlier removal. This approach not only significantly improves the stability of the registration process, but also requires minimal computational resources since both enhancements are applied to the normalized cross-correlation function.
- A post-processing method based on Factor Graph Optimization (FGO) is proposed that facilitates the simultaneous estimation of the varying AUV’s navigation information and constant error parameters, such as DVL scale factors and installation errors. With position measurements, this method not only allows for the optimization of trajectory information in the same manner as traditional post-processing methods, but also enables an effective optimization of heading information.
2. Overview
- (1)
- Registration of SSS images
- (2)
- Factor graph optimization
- (3)
- Information output
3. Fourier-Based SSS Image Registration
3.1. Standard Fourier-Based SSS Registration
3.1.1. Pre-Process of SSS Images
3.1.2. Fourier-Based SSS Registration
3.2. The Optimization of SSS Registration
3.2.1. Gaussian Prior-Enhanced SSS Registration
3.2.2. Bandpass Filter-Aided SSS Registration
3.3. Evaluation of Optimized Fourier-Based SSS Registration
- Classic Fourier-based image registration method;
- Fourier-based registration method optimized with Gaussian prior;
- Fourier-based registration method optimized with bandpass filter;
- Fourier-based registration method optimized with both Gaussian prior and bandpass filter.
3.3.1. Fourier-Based Image Registration
3.3.2. Gaussian Prior-Optimized Registration
3.3.3. Bandpass Filter-Optimized Registration
3.3.4. Gaussian Prior- and Bandpass Filter-Integrated Registration
4. SSS-Integrated Navigation Method Based on FGO
4.1. Formulation of FGO
4.2. DVL Measurement Model
4.3. Definition of Residuals
- (1).
- Residuals of pre-integration factors
- (2).
- Residual of the DVL measurement factor
- (3).
- Residual of SSS measurement factor
- (4).
- Surface GNSS measurement factor
4.4. Jacobian Matrix
- (1).
- Jacobian matrix of IMU pre-integration
- (2).
- Jacobian matrix of DVL measurement
- (3).
- Jacobian matrix of SSS measurement
- (4).
- Jacobian matrix related to the surface GNSS measurements
5. Simulation and Result Analysis
5.1. Setup of Simulation
- EKF: SINS+DVL. This method represents the traditional EKF-based SINS/DVL-integrated navigation approach. It is used to illustrate the effectiveness of the most widely applied filtering methods for AUV navigation.
- FGO: SINS+DVL. This method is based on FGO for SINS/DVL-integrated navigation, allowing for the batch optimization of the entire trajectory using all available SINS and DVL measurement data. It is used to demonstrate the effectiveness of batch processing methods in AUV navigation.
- FGO: SINS+DVL+SSS. This method incorporates relative position measurements from the SSS into method 2. It serves to assess the auxiliary role of the proposed SSS relative position measurements in AUV navigation.
- FGO: SINS+DVL+Position Constraint. This method integrates GNSS position constraints, obtained before descent and after surfacing, into the FGO-based SINS/DVL-integrated navigation model. It is used to demonstrate the effectiveness of post-processing navigation data using a traditional measurement source.
- FGO: SINS+DVL+Position Constraint+SSS. This method incorporates relative position measurements from the SSS into method 4. It serves as a comparison to method 4, assessing the auxiliary role of the proposed SSS relative position measurements in post-processing navigation data.
- FGO: The Proposed Method, or FGO: SINS+DVL+Position Constraint+SSS+ Improved Model. This method builds upon method 5 by incorporating the model with DVL installation errors proposed in this paper. It is used to compare with method 5, assessing the improvements in DVL installation error calibration and heading estimation brought about by the proposed model.
5.2. Results of Simulation
- Compared to filtering methods, batch processing methods can optimize past navigation data, significantly improving the positioning accuracy of the AUV during surveying tasks.
- The relative position measurements provided by SSS can enhance the positioning and heading accuracy of the AUV, with a more pronounced effect when position measurements are otherwise lacking.
- Methods that do not incorporate DVL error modeling result in GNSS position measurements improving the system’s positioning accuracy at the expense of its heading accuracy. However, this issue does not occur with the model proposed in this paper, as both positioning and heading exhibit higher accuracy.
6. AUV Marine Experiments and Result Analysis
6.1. Setup for AUV’s Marine Experiments
- Position trajectory comparison and position error comparison
- 2.
- Heading error comparison
- EKF: SINS+DVL.
- FGO: SINS+DVL.
- FGO: SINS+DVL+SSS.
- FGO: SINS+DVL+Position Constraint.
- FGO: SINS+DVL+Position Constraint+SSS.
- FGO: The Proposed Method, or FGO: SINS+DVL+Position Constraint+SSS+ Improved Model.
6.2. Results of Marine Experiments
- The proposed method of incorporating SSS relative position measurements as a position reference into the SINS/DVL navigation system significantly improves the positioning accuracy of the integrated navigation system, particularly in the absence of position measurements.
- The introduction of GNSS measurements before diving and after surfacing to optimize the underwater trajectory of the AUV greatly enhances positioning accuracy, especially when the accuracy of the inertial devices is slightly lower.
- In methods utilizing the traditional model, although the addition of GNSS position constraints improves positioning accuracy, it does not enhance heading accuracy. However, the proposed method with the improved model raises both positioning and heading accuracy. Under the traditional model, residuals are incorrectly fed back into the heading; with a more robust model, these residuals are instead directed towards the DVL calibration angle and scale factor, resulting in improved heading accuracy.
7. Conclusions
- The introduction of relative position measurements from SSS and GNSS measurements significantly enhances the position and heading accuracy of the AUV navigation system, particularly in scenarios lacking position measurements.
- While the traditional model improves positioning accuracy with the inclusion of GNSS position constraints, it does not enhance heading accuracy. In contrast, the proposed improved model effectively mitigates the negative impact of residual errors on heading, resulting in improved accuracy for both position and heading.
- Compared to the Kalman filter method, the batch processing approach optimizes past navigation data, leading to significant improvements in the position accuracy of AUV during survey tasks, especially under the traditional model.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Hansen, R.E.; Saebo, T.O.; Callow, H.J.; Hagen, P.E.; Hammerstad, E. Synthetic Aperture Sonar Processing for the HUGIN AUV. In Proceedings of the Europe Oceans 2005, Brest, France, 20–23 June 2005; Volume 2, pp. 1090–1094. [Google Scholar]
- Naus, K.; Piskur, P. Applying the Geodetic Adjustment Method for Positioning in Relation to the Swarm Leader of Underwater Vehicles Based on Course, Speed, and Distance Measurements. Energies 2022, 15, 8472. [Google Scholar] [CrossRef]
- Jaffre, F.; Littlefield, R.; Grund, M.; Purcell, M. Development of a New Version of the REMUS 6000 Autonomous Underwater Vehicle. In Proceedings of the OCEANS 2019—Marseille, Marseille, France, 17–20 June 2019; pp. 1–7. [Google Scholar]
- Wang, J.; Tang, Y.; Li, S.; Lu, Y.; Li, J.; Liu, T.; Jiang, Z.; Chen, C.; Cheng, Y.; Yu, D.; et al. The Haidou-1 Hybrid Underwater Vehicle for the Mariana Trench Science Exploration to 10,908 m Depth. J. Field Robot. 2024, 41, 1054–1079. [Google Scholar] [CrossRef]
- Wåhlin, A.; Alley, K.E.; Begeman, C.; Hegrenæs, Ø.; Yuan, X.; Graham, A.G.C.; Hogan, K.; Davis, P.E.D.; Dotto, T.S.; Eayrs, C.; et al. Swirls and Scoops: Ice Base Melt Revealed by Multibeam Imagery of an Antarctic Ice Shelf. Sci. Adv. 2024, 10, eadn9188. [Google Scholar] [CrossRef] [PubMed]
- Xu, B.; Wang, L.; Li, S.; Zhang, J. A Novel Calibration Method of SINS/DVL Integration Navigation System Based on Quaternion. IEEE Sens. J. 2020, 20, 9567–9580. [Google Scholar] [CrossRef]
- Yan, M.; Wang, Z.; Zhang, J. Online Calibration of Installation Errors of SINS/OD Integrated Navigation System Based on Improved NHC. IEEE Sens. J. 2022, 22, 12602–12612. [Google Scholar] [CrossRef]
- Gade, K. NavLab, a Generic Simulation and Post-Processing Tool for Navigation. MIC 2005, 26, 135–150. [Google Scholar] [CrossRef]
- Yao, Y.; Shen, Y.; Xu, X.; Deng, K.; Xu, X. A Modified Smoothing Scheme for Water Current-Aided SINS/DVL Integration System. IEEE Sens. J. 2023, 23, 26366–26374. [Google Scholar] [CrossRef]
- Franchi, M.; Ridolfi, A.; Pagliai, M. A Forward-Looking SONAR and Dynamic Model-Based AUV Navigation Strategy: Preliminary Validation with FeelHippo AUV. Ocean Eng. 2020, 196, 106770. [Google Scholar] [CrossRef]
- Hurtós, N.; Ribas, D.; Cufí, X.; Petillot, Y.; Salvi, J. Fourier-based Registration for Robust Forward-looking Sonar Mosaicing in Low-visibility Underwater Environments. J. Field Robot. 2015, 32, 123–151. [Google Scholar] [CrossRef]
- Song, Y.; He, B.; Zhang, L.; Yan, T. Side-Scan Sonar Image Registration Based on Modified Phase Correlation for AUV Navigation. In Proceedings of the OCEANS 2016—Shanghai, Shanghai, China, 10–13 April 2016; pp. 1–4. [Google Scholar]
- Hover, F.S.; Eustice, R.M.; Kim, A.; Englot, B.; Johannsson, H.; Kaess, M.; Leonard, J.J. Advanced Perception, Navigation and Planning for Autonomous in-Water Ship Hull Inspection. Int. J. Robot. Res. 2012, 31, 1445–1464. [Google Scholar] [CrossRef]
- Zhang, L.; Zhou, H.; Gao, Y. An In-Motion Alignment Method of AUV SINS/DVL Navigation System Based on FGO. Measurement 2023, 222, 113578. [Google Scholar] [CrossRef]
- Xu, B.; Guo, Y. A Novel DVL Calibration Method Based on Robust Invariant Extended Kalman Filter. IEEE Trans. Veh. Technol. 2022, 71, 9422–9434. [Google Scholar] [CrossRef]
- Barfoot, T.D. State Estimation for Robotics, 1st ed.; Cambridge University Press: Cambridge, UK, 2017; ISBN 978-1-107-15939-6. [Google Scholar]
- Cao, S.; Lu, X.; Shen, S. GVINS: Tightly Coupled GNSS–Visual–Inertial Fusion for Smooth and Consistent State Estimation. IEEE Trans. Robot. 2022, 38, 2004–2021. [Google Scholar] [CrossRef]
- Qin, T.; Li, P.; Shen, S. VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator. IEEE Trans. Robot. 2018, 34, 1004–1020. [Google Scholar] [CrossRef]
- Zhang, L.; Wen, W.; Hsu, L.-T.; Zhang, T. An Improved Inertial Preintegration Model in Factor Graph Optimization for High Accuracy Positioning of Intelligent Vehicles. IEEE Trans. Intell. Veh. 2023, 9, 1641–1653. [Google Scholar] [CrossRef]
Registration Method | Precision |
---|---|
Classic Fourier-based image registration | 16.2 m |
Registration optimized with Gaussian prior | 0.9 m |
Registration optimized with bandpass filter | 60.7 m |
Registration optimized with both Gaussian prior and bandpass filter | 0.2 m |
Symbol | Description |
---|---|
Ideal local-level navigation frame | |
Body frame | |
Earth frame | |
Nonrotating inertial frame |
Method | Positioning Error (m) | Heading Error (deg) |
---|---|---|
KF: SINS+DVL | 47.638 | 1.601 |
FGO: SINS+DVL | 35.777 | 0.227 |
FGO: SINS+DVL+SSS | 31.637 | 0.090 |
FGO: SINS+DVL+Position constraint | 17.256 | 0.486 |
FGO: SINS+DVL+Position constraint+SSS | 15.853 | 0.471 |
FGO: SINS+DVL+Position constraint+SSS +Improved model (The proposed method) | 2.234 | 0.039 |
Methods | Gyro X Axis Bias (deg/h) | Gyro Y Axis Bias (deg/h) | Gyro Z Axis Bias (deg/h) | Acc X Axis Bias Error (mg) | Acc Y Axis Bias Error (mg) | Acc Z Axis Bias Error (mg) |
---|---|---|---|---|---|---|
KF: SINS+DVL | 0.598 | 0.553 | 1.100 | 0.088 | 0.152 | 0.017 |
FGO: SINS+DVL | 0.081 | 0.026 | 1.215 | 0.017 | 0.032 | 0.002 |
FGO: SINS+DVL+SSS | 0.081 | 0.035 | 0.555 | 0.018 | 0.0337 | 0.023 |
FGO: SINS+DVL+Position constraint | 0.083 | 0.055 | 0.572 | 0.023 | 0.403 | 0.003 |
FGO: SINS+DVL+SSS+Position constraint | 0.083 | 0.058 | 0.323 | 0.013 | 0.047 | 0.003 |
FGO: SINS+DVL+SSS+Position constraint +Improved model (The proposed method) | 0.008 | 0.083 | 0.272 | 0.037 | 0.021 | 0.003 |
Parameters | Value |
---|---|
Gyro bias stability | 0.02°/h |
Angle random walk | ≤0.015°/√h |
Rate bias over temperature | ≤1°/h (over life) |
Gyro factor error | <100 ppm |
Acc bias stability | <0.1 mg |
Velocity random walk | <30 μg√Hz |
Acc bias over Temp | <2 mg (over life) |
Parameters | Value |
---|---|
Range | 75 m (900 kHz) |
Resolution | 0.17 m |
Parameters | Value |
---|---|
Ping rate | 2–15 Hz |
Velocity resolution | 0.1 mm/s |
Long-term accuracy | ±1.01% |
Parameters | Value |
---|---|
Position accuracy | 15 mm+ (baseline length (KM)/1,000,000) mm |
Update rate | 20Hz |
Method | Average Positioning Error (m) | Average Heading Error (deg) |
---|---|---|
KF: SINS+DVL | 42.333 | 1.946 |
FGO: SINS+DVL | 40.509 | 0.477 |
FGO: SINS+DVL+SSS | 29.267 | 0.554 |
FGO: SINS+DVL+Position constraint | 28.656 | 0.488 |
FGO: SINS+DVL+Position constraint+SSS | 16.120 | 0.421 |
FGO: SINS+DVL+Position Constraint+SSS+Improved Model (The proposed method) | 11.548 | 0.133 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Zhang, L.; Guan, L.; Zeng, J.; Gao, Y. Autonomous Underwater Vehicle Navigation Enhancement by Optimized Side-Scan Sonar Registration and Improved Post-Processing Model Based on Factor Graph Optimization. J. Mar. Sci. Eng. 2024, 12, 1769. https://doi.org/10.3390/jmse12101769
Zhang L, Guan L, Zeng J, Gao Y. Autonomous Underwater Vehicle Navigation Enhancement by Optimized Side-Scan Sonar Registration and Improved Post-Processing Model Based on Factor Graph Optimization. Journal of Marine Science and Engineering. 2024; 12(10):1769. https://doi.org/10.3390/jmse12101769
Chicago/Turabian StyleZhang, Lin, Lianwu Guan, Jianhui Zeng, and Yanbin Gao. 2024. "Autonomous Underwater Vehicle Navigation Enhancement by Optimized Side-Scan Sonar Registration and Improved Post-Processing Model Based on Factor Graph Optimization" Journal of Marine Science and Engineering 12, no. 10: 1769. https://doi.org/10.3390/jmse12101769
APA StyleZhang, L., Guan, L., Zeng, J., & Gao, Y. (2024). Autonomous Underwater Vehicle Navigation Enhancement by Optimized Side-Scan Sonar Registration and Improved Post-Processing Model Based on Factor Graph Optimization. Journal of Marine Science and Engineering, 12(10), 1769. https://doi.org/10.3390/jmse12101769