Machine Vision-Based Real-Time Monitoring of Bridge Incremental Launching Method
Abstract
:1. Introduction
2. Principles of Machine Vision Measurement
2.1. Camera Models
2.2. Camera Calibration
3. Bridge Incremental Launch Construction Displacement Monitoring System
3.1. Based on YOLOv5 Target Detection
3.2. Based on DeepSORT Target Continuous Tracking
3.3. Precise Positioning of the Center-Point Coordinates of the Cross Target
4. Experimental Validation and Results
4.1. Simulation Experiment
4.2. Real Bridge Test
5. Conclusions
- (1)
- The feasibility of the proposed method for real-time monitoring of bridge launching construction has been demonstrated through simulation tests and real bridge verification, confirming the reliability of the detection accuracy. By integrating YOLOv5 and DeepSORT with geometric matching, it enables the monitoring of forward displacement and lateral deflection of the bridge launching process with a straight bottom surface line shape. Since the proposed method can measure both longitudinal and lateral displacements at the bridge’s base, its application is feasible for curved bridges or skewed bridges.
- (2)
- In this paper, we construct a special target dataset for bridge launching scenarios and further process the image features of the target ROI. We combine the algorithms of edge contour line extraction, convex packet detection, and K-means clustering to achieve the localization of geometric centroid of the crosshatched target. YOLOv5n was applied for target detection on the test dataset and achieved the best performance, with an mAP of 91%, a precision of 99.2%, and a recall of 94.2%.
- (3)
- In the simulation test, the visual measurement results are compared with the total station measurement results, with the maximum NRMSE of the forward displacement being 0.545% and the maximum NRMSE of the lateral offset being 1.73%. In the real bridge test, the initial pixel coordinate system was established with the girder launching position to compare the measurement results of the launching displacement during launching, in which the NRMSE of the jacking forward displacement was 1.83%, while the NRMSE of the lateral offset was 3.09%. Due to the site having more disturbing factors, the system error increases obviously, but the trend of the monitoring results of this method is basically consistent with the total station, which has better monitoring results.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Hu, Z.; Wu, D.; Sun, L.Z. Integrated investigation of an incremental launching method for the construction of long-span bridges. J. Constr. Steel Res. 2015, 112, 130–137. [Google Scholar] [CrossRef]
- Kotpalliwar, M.; Kushwaha, N. Incremental Launching of the Steel Girders for Bridges. Int. J. Trend Sci. Res. Dev. 2020, 4, 664–669. [Google Scholar]
- LaViolette, M.; Wipf, T.; Lee, Y.-S.; Bigelow, J.; Phares, B. Bridge Construction Practices Using Incremental Launching, NCHRP Project 20-07/Task 229. Available online: https://intrans.iastate.edu/research/completed/bridge-construction-practices-using-incremental-launching-nchrp-project-20-07-task-229/ (accessed on 14 November 2024).
- Duc, D.V.; Nai, D.G. A comprehensive review of incremental launching method in the construction of prestressed reinforced concrete bridges in Vietnam. IOP Conf. Ser. Mater. Sci. Eng. 2023, 1289, 012013. [Google Scholar]
- Ding, S.h.; Fang, J.; Zhang, S.l.; Liang, C.s. A Construction Technique of Incremental Launching for a Continuous Steel Truss Girder Bridge with Suspension Cable Stiffening Chords. Struct. Eng. Int. 2021, 31, 93–98. [Google Scholar]
- Wipf, T.; Phares, B.; Abendroth, R.; Wood, D.; Chang, B.; Abraham, S. Monitoring of the Launched Girder Bridge over the Iowa River on US 20; The National Academies of Sciences, Engineering, and Medicine: Washington, DC, USA, 2004. [Google Scholar]
- Gale, R. Incremental Launching of Steel Girders in British Columbia—Two Case Studies. Struct. Eng. Int. 2011, 21, 443–449. [Google Scholar] [CrossRef]
- Perez, V.P.; Gonzalez, L.P.; Peireti, H.C.; Alfonso, F.T. The Launching of the Pavilion Bridge, Zaragoza, Spain. Struct. Eng. Int. 2018, 21, 437–442. [Google Scholar] [CrossRef]
- Chacón, R.; Zorrilla, R. Structural Health Monitoring in Incrementally Launched Steel Bridges: Patch Loading Phenomena Modeling. Autom. Constr. 2015, 58, 60–73. [Google Scholar] [CrossRef]
- Zhao, J.; Kang, L.; Zhang, H. The Key Technology of Multi-span Steel Plate Bridge Incremental Launching Construction. IOP Conf. Ser. Earth Environ. Sci. 2021, 714, 022003. [Google Scholar] [CrossRef]
- Im, S.B.; Hurlebaus, S.; Kang, Y.J. Summary review of GPS technology for structural health monitoring. J. Struct. Eng. 2013, 139, 1653–1664. [Google Scholar] [CrossRef]
- Yi, T.; Li, H.; Gu, M. Recent research and applications of GPS based technology for bridge health monitoring. Sci. China Technol. Sci. 2010, 53, 2597–2610. [Google Scholar] [CrossRef]
- Yu, J.; Meng, X.; Yan, B.; Xu, B.; Fan, Q.; Xie, Y. Global Navigation Satellite System-based positioning technology for structural health monitoring: A review. Struct. Control Health Monit. 2020, 27, e2467. [Google Scholar] [CrossRef]
- Kashima, S.; Yanaka, Y.; Suzuki, S.; Mori, K. Monitoring the Akashi Kaikyo bridge: First experiences. Struct. Eng. Int. 2001, 11, 120–123. [Google Scholar] [CrossRef]
- Yu, J.; Meng, X.; Shao, X.; Yan, B.; Yang, L. Identification of dynamic displacements and modal frequencies of a medium-span suspension bridge using multimode GNSS processing. Eng. Struct. 2014, 81, 432–443. [Google Scholar] [CrossRef]
- Luo, K.; Kong, X.; Zhang, J.; Hu, J.; Li, J.; Tang, H. Computer Vision-Based Bridge Inspection and Monitoring: A Review. Sensors 2023, 23, 7863. [Google Scholar] [CrossRef]
- Tian, Y.; Zhang, C.; Jiang, S.; Zhang, J.; Duan, W. Noncontact cable force estimation with unmanned aerial vehicle and computer vision. Comput.-Aided Civ. Infrastruct. Eng. 2020, 36, 73–88. [Google Scholar] [CrossRef]
- Cheng, Y.; Lin, F.; Wang, W.; Zhang, J. Vision-based trajectory monitoring for assembly alignment of precast concrete bridge components. Autom. Constr. 2022, 140, 104350. [Google Scholar] [CrossRef]
- Jiang, S.; Zhang, J. Real-time crack assessment using deep neural networks with wall-climbing unmanned aerial system. Comput.-Aided Civ. Infrastruct. Eng. 2020, 35, 549–564. [Google Scholar] [CrossRef]
- Xing, L.; Dai, W.; Zhang, Y. Scheimpflug Camera-Based Technique for Multi-Point Displacement Monitoring of Bridges. Sensors 2022, 22, 4093. [Google Scholar] [CrossRef]
- Duan, X.; Chu, X.; Zhu, W.; Zhou, Z.; Luo, R.; Meng, J. Novel Method for Bridge Structural Full-Field Displacement Monitoring and Damage Identification. Appl. Sci. 2023, 13, 1756. [Google Scholar] [CrossRef]
- Bao, Y.; Tang, Z.; Li, H.; Zhang, Y. Computer vision and deep learning–based data anomaly detection method for structural health monitoring. Struct. Health Monit. 2019, 18, 401–421. [Google Scholar] [CrossRef]
- Marchewka, A.; Ziółkowski, P.; Aguilar-Vidal, V. Framework for Structural Health Monitoring of Steel Bridges by Computer Vision. Sensors 2020, 20, 700. [Google Scholar] [CrossRef] [PubMed]
- Spencer, B.F.; Hoskere, V.; Narazaki, Y. Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring. Engineering 2019, 5, 199–222. [Google Scholar] [CrossRef]
- Xu, Y.; Brownjohn, J.M.W. Review of machine-vision based methodologies for displacement measurement in civil structures. J. Civ. Struct. Health Monit. 2018, 8, 91–110. [Google Scholar] [CrossRef]
- Conde, B.; Drosopoulos, G.A.; Stavroulakis, G.E.; Riveiro, B.; Stavroulaki, M.E. Inverse analysis of masonry arch bridges for damaged condition investigation: Application on Kakodiki bridge. Eng. Struct. 2016, 127, 388–401. [Google Scholar] [CrossRef]
- Garbowski, T.; Cornaggia, A.; Zaborowicz, M.; Sowa, S. Computer-Aided Structural Diagnosis of Bridges Using Combinations of Static and Dynamic Tests: A Preliminary Investigation. Materials 2023, 16, 7512. [Google Scholar] [CrossRef]
- Xi, L.; Fei, K.; Pina, L.M. Multi-zone parametric inverse analysis of super high arch dams using deep learning networks based on measured displacements. Adv. Eng. Inform. 2023, 56, 102002. [Google Scholar]
- Hussain, M. YOLO-v1 to YOLO-v8, the Rise of YOLO and Its Complementary Nature toward Digital Manufacturing and Industrial Defect Detection. Machines 2023, 11, 677. [Google Scholar] [CrossRef]
- Wojke, N.; Bewley, A.; Paulus, D. Simple online and realtime tracking with a deep association metric. In Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China, 17–20 September 2017; pp. 3645–3649. [Google Scholar]
- Zhang, Z. Flexible camera calibration by viewing a plane from unknown orientations. In Proceedings of the Seventh IEEE International Conference on Computer Vision, Corfu, Greece, 20–27 September 1999; pp. 666–673. [Google Scholar]
- Busca, G.; Cigada, A.; Mazzoleni, P.; Zappa, E. Vibration Monitoring of Multiple Bridge Points by Means of a Unique Vision-Based Measuring System. Exp. Mech. 2014, 54, 255–271. [Google Scholar] [CrossRef]
- Feng, D.; Feng, M.Q.; Ozer, E.; Fukuda, Y. A Vision-Based Sensor for Noncontact Structural Displacement Measurement. Sensors 2015, 15, 16557–16575. [Google Scholar] [CrossRef]
- Zhou, K.; Yang, Y.; Cavallaro, A.; Xiang, T. Omni-scale feature learning for person re-identification. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea, 27 October–2 November 2019; pp. 3702–3712. [Google Scholar]
- Xie, H.; Liao, Q.; Yang, S.X.; Zhu, J. Non-Contact Bolt Detection Based on YOLOv5-Ganomaly Algorithm and UAV. In Proceedings of the 2023 5th International Conference on Hydraulic, Civil and Construction Engineering (HCCE 2023), Hangzhou, China, 25–27 August 2023. [Google Scholar]
Models | Accuracy/% | Recall Rate/% | mAP/% | Quantity | Speed/ms | GPU |
---|---|---|---|---|---|---|
YOLOv5s | 98.7 | 95.2 | 92 | 7.01 × 106 | 34.7 | NVIDIA GeForce RTX 4060 by NVIDIA in Santa Clara, California |
YOLOv5s6 | 99.1 | 96.9 | 94.2 | 1.23 × 107 | 103.2 | |
YOLOv5n | 99.2 | 94.2 | 91 | 1.76 × 106 | 13.3 | |
YOLOv5n6 | 99.2 | 95.2 | 93.2 | 3.09 × 106 | 40.5 |
Time | Total Station | Our Method | ||
---|---|---|---|---|
Lateral Offset/(mm) | Forward Displacement/(mm) | Lateral Offset/(mm) | Forward Displacement/(mm) | |
0 | 0.91379 | 43.9803 | 43.99269 | 1.28755 |
1 | 3.10069 | 105.511 | 104.97863 | 3.6862 |
2 | 4.19259 | 162.935 | 162.97744 | 4.06527 |
3 | 0.96848 | 233.14 | 233.9952 | 1.52938 |
4 | 0.36514 | 275.647 | 275.99434 | 1.80388 |
Points | NRMSE/% | |
---|---|---|
Forward Displacement | Lateral Offset | |
1 | 1.42 | 0.349 |
2 | 1.73 | 0.545 |
3 | 1.49 | 0.512 |
4 | 1.55 | 0.455 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Xie, H.; Liao, Q.; Liao, L.; Qiu, Y. Machine Vision-Based Real-Time Monitoring of Bridge Incremental Launching Method. Sensors 2024, 24, 7385. https://doi.org/10.3390/s24227385
Xie H, Liao Q, Liao L, Qiu Y. Machine Vision-Based Real-Time Monitoring of Bridge Incremental Launching Method. Sensors. 2024; 24(22):7385. https://doi.org/10.3390/s24227385
Chicago/Turabian StyleXie, Haibo, Qianyu Liao, Lei Liao, and Yanghang Qiu. 2024. "Machine Vision-Based Real-Time Monitoring of Bridge Incremental Launching Method" Sensors 24, no. 22: 7385. https://doi.org/10.3390/s24227385
APA StyleXie, H., Liao, Q., Liao, L., & Qiu, Y. (2024). Machine Vision-Based Real-Time Monitoring of Bridge Incremental Launching Method. Sensors, 24(22), 7385. https://doi.org/10.3390/s24227385