Research on a Dynamic Calibration Method for Photogrammetry Based on Rotary Motion
Abstract
:1. Introduction
- (a)
- Based on the circular trajectory standard device, we propose a dynamic parameter calibration method, which can effectively realize the calibration of dynamic length measurement errors and other parameters.
- (b)
- The design error of the calibration system is analyzed based on the motion characteristic of the circular trajectory device.
- (c)
- The proposed method can provide a solution for the dynamic measurement performance evaluation of photogrammetry systems.
2. The Calibration Principle
3. Calibration System Design Error Analysis
- (1)
- n = 25 rpm
- (2)
- n = 50 rpm
- (3)
- n = 100 rpm
- (4)
- n = 200 rpm
4. Experiment and Analysis
4.1. The Main Use Method of the Circumference Dynamic Calibration Device
- (a)
- Measuring and controlling the field layout. The marking points suitable for calibrating the photogrammetry system are pasted on the device disc -LRB-; usually, the coding points are used for a quick tracking of the measuring system, and the marking points are the shooting objects of the measured digital photogrammetry system, which provides the location criteria through prior static calibration. The number of marks is two or more. The marks are pasted on the surface of the turntable with circular motion. When the turntable moves, the marks also maintains a corresponding movement. A sufficient number of marking points and control points are arranged around the turntable as the measuring control field, and at least one datum ruler is placed as the length datum.
- (b)
- Measurement preparation of the photogrammetry system. Connect and arrange the camera, the controller, and the light source according to the system instruction. Additionally, according to the system operating instructions, the camera distance (recommended camera distance for the calibration device references a distance of 3 M), the camera distribution, and the rendezvous angle are selected. The system installation, layout, connection, and parameter setting are included. The field of view of the two cameras is aligned and held fixed at the middle position of the upper surface of the disc of the calibrated device. When the calibration device rotates, the photographic target is within the effective measuring range of the photogrammetry system.
- (c)
- Dynamic calibration. Set the running speed of the dynamic calibration device, control the movement of the turntable, and use the calibrated photogrammetry system to take continuous photographs of the moving photographic target. The position measurement results of the photogrammetry system at the corresponding velocity are obtained by processing and calculating the measurement using the software provided by the calibrated system.
- (d)
- Result analysis. The measured results are compared with the standard values to verify the dynamic measurement performance of the digital photogrammetry system, including its length measurement error, motion trajectory, and velocity in a dynamic environment.
4.2. Circular Dynamic Parameter Calibration Test of Dual-Camera System
4.3. Test Procedure
- (a)
- Connect the test equipment including the circular trajectory generator and the dual-camera real-time photogrammetry system.
- (b)
- Camera calibration and control field calibration. Connect two cameras and calibrate them one by one. Turn on the laser indication of the camera. The operator, while holding the camera, stands about 3 m in front of the calibration field and points the camera at the center position of the calibration field at different positions at above and below, as well as left and right, of the calibration field (the camera pointing can be adjusted according to the laser indication) to take the calibration images. The number of images taken should not be less than 30; the position distribution in front of the calibration field should be basically even; and the images should be obtained from nine directions, and each direction is generally rotated four times around the optical axis of the camera, at 90° each time. After shooting, multiple images are used to solve the parameters in the camera and complete the camera calibration, as shown in Figure 8. Simultaneously, the control field is photographed with a camera to obtain the coordinates of each control point in the control field, as shown in Figure 9. The external parameter and the control field calibration data are then solved.
- (c)
- Control field orientation. Install the two cameras on the tripod head, respectively; turn on the laser pointer, adjust the tripod or head; and adjust the pointing laser of the camera to the circular track generator. Use the measurement software to complete the control field orientation and determine the position of the two cameras.
- (d)
- Dynamic measurement. Using the continuous measurement and deformation monitoring functions of the measuring system, two coding points on the rotating rod of the circular track are selected as the monitoring objects. The circular trajectory generator’s controller controls the rotational speed, so that after the rotation rod rotates at a certain speed, the dual-camera photogrammetry system tracks and measures the two coding points and records the coordinate changes of the two points.
4.4. Test Data
- (1)
- Speed R = 0 (static)
- (2)
- Speed R = 0.5 r/s
- (3)
- Speed R = 1.0 r/s
- (4)
- Speed R = 2.0 r/s
- (5)
- Speed R = 3.0 r/s
- (6)
- Speed R = 4.0 r/s
- (7)
- (1)
- The amount of angle change represents the angle of rotation of the marker point relative to the previous position, and at the same time, the linear velocity and angular velocity in the table are all converted from this motion angle to time.
- (2)
- The deviation in the Z direction can be understood as the amount of change in the direction of the motor axis of the target at the end of the swing arm during the rotation, and the change in this direction is perpendicular to the linear velocity direction at the end, so there is almost no effect.
- (a)
- The radius of the circular trajectory of the target movement has no obvious relationship with the movement speed, and the difference does not exceed 10 μm. The experimental data are consistent with the relative position of the target point in the design of the device, and the error is mainly caused by the change in the verticality introduced by the rotating shaft system.
- (b)
- The experimental data show that with an increase in the rotational speed, the RMS value of the circular trajectory fitting error increases to a certain extent, which indicates that the rotating motor selected for the calibration system has a certain rotary centrifugal error under high-speed motion. At the same time, the structure of the circular trajectory-generating device needs to be further strengthened to support its rigidity.
- (c)
- When the two targets are in motion, the distance between the two points is calculated by the photogrammetry system, that is, the length decreases, and the decrease is about 0.2 mm. The decrease has no obvious relationship with the rotational speed, which is a system error. It is found that the reason for this phenomenon may be the shooting synchronization error between the two cameras of the binocular photogrammetry system, that is, there is a certain time difference in the shooting time of the two cameras for a dynamic target. In addition, when the target is in motion, the standard deviation of the distance between two points calculated by the photogrammetry system increases relative to the static state.
- (d)
- When the rotational speed is less than 4.0 r/s, the speed value calculated by the photogrammetry system is consistent with the standard value, and the speed fluctuation is within 8%. However, when the rotational speed is greater than 4.0 r/s, the real-time measurement frame rate of the photogrammetry system is about 4 frames/s, and there is a certain deviation in the interval time between two adjacent frames. Therefore, when the rotational angle of a target and the image acquisition time correspond to each other, errors are prone to occur, resulting in an error in the speed calculation, and the resulting error value is large. It shows that when the real-time measurement frame rate of the photogrammetry system is 4 frames/s, the maximum rotational speed of a target that can be accurately measured cannot exceed 4.0 r/s.
5. Calibration System Uncertainty Analysis
- (1)
- Uncertainty introduced by rotational consistency
- (2)
- Uncertainty introduced by measurement repeatability
- (3)
- The change in the length perpendicular to the direction of rotation introduced by the rotating shaft system
- (4)
- Relative standard uncertainty of synthesis
- (5)
- Relative expansion uncertainty
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Van der Sluijs, J.; Kokelj, S.V.; Fraser, R.H.; Tunnicliffe, J.; Lacelle, D. Permafrost Terrain Dynamics and Infrastructure Impacts Revealed by UAV Photogrammetry and Thermal Imaging. Remote Sens. 2018, 10, 1734. [Google Scholar] [CrossRef] [Green Version]
- Havaran, A.; Mahmoudi, M. Extracting structural dynamic properties utilizing close photogrammetry method. Measurement 2019, 150, 107092. [Google Scholar] [CrossRef]
- Tang, H.Y.; Foo, H.C.Y.; Tan, I.S.; Lam, M.K. Photogrammetry based computational fluid dynamics of erosion of sand particles in water pipeline: Dynamic shape factors of 3D particles and minimization of erosion activity-ScienceDirect. J. Pet. Sci. Eng. 2021, 205, 108794. [Google Scholar] [CrossRef]
- Wang, W.; Pan, W.; Hu, D.; Tang, G. Configuration optimization of photogrammetry system based on spectral radius for on-orbit measurement. Trans. Inst. Meas. Control. 2021, 43, 2483–2499. [Google Scholar] [CrossRef]
- Zhao, G.; Zhang, C.; Jing, X.; Ling, X.; Chen, S. Study on the Technologies of Close Range Photogrammetry and Applications in the Manufacture of Aviation. In Proceedings of the 2018 8th International Conference on Manufacturing Science and Engineering (ICMSE 2018), Shenzhen, China, 30–31 March 2018. [Google Scholar]
- Bish, J.; Caplinger, J.; Friedman, D.; Jordan, A.; Nash, C. Repeatability of a dynamic rollover test system. Traffic Inj. Prev. 2016, 17, 638–643. [Google Scholar]
- Liu, J.W.; Liang, J.; Liang, X.H.; Tang, Z.Z. Videogrammetric system for dynamic deformation measurement during metal sheet welding processes. Opt. Eng. 2010, 49, 033601. [Google Scholar] [CrossRef]
- Mcnamee, L.P. Photogrammetric Calibration of Mobile Robot Kinematics. Ph.D. Thesis, University of Ottawa, Ottawa, ON, Canada, 2003. [Google Scholar]
- Blume, K.; Röger, M.; Schlichting, T.; Macke, A.; Pitz-Paal, R. Dynamic photogrammetry applied to a real scale heliostat: Insights into the wind-induced behavior and effects on the optical performance—ScienceDirect. Sol. Energy 2020, 212, 297–308. [Google Scholar] [CrossRef]
- Kováts Jr, F.; Kiss, P.; Naszlady, A.; Nemeskéri, I. Morphometry of the Breathing Movements of the Trunk: A Dynamic, Double-view Photogrammetry Technic. In Respiration; Pergamon: Oxford, UK, 1981; pp. 55–56. [Google Scholar]
- Alzahrani, F.; Hobiny, A.; Abbas, I.; Marin, M. An eigenvalues approach for a two-dimensional porous medium based upon weak, normal and strong thermal conductivities. Symmetry 2020, 12, 848. [Google Scholar] [CrossRef]
- Scutaru, M.L.; Vlase, S.; Marin, M.; Modrea, A. New analytical method based on dynamic response of planar mechanical elastic systems. Bound. Value Probl. 2020, 2020, 1–16. [Google Scholar] [CrossRef]
- El Ghazouali, S.; Vissiere, A.; Lafon, L.F.; Bouazizi, M.L.; Nouira, H. Optimised calibration of machine vision system for close range photogrammetry based on machine learning. J. King Saud Univ. Comput. Inf. Sci. 2022, 34, 7406–7418. [Google Scholar] [CrossRef]
- Liu, X.; Li, A. An integrated calibration technique for variable-boresight three-dimensional imaging system. Opt. Lasers Eng. 2022, 153, 107005. [Google Scholar] [CrossRef]
- Wan, A.; Song, L.; Xu, J.; Liu, S.; Chen, K. Calibration and compensation of machine tool volumetric error using a laser tracker. Int. J. Mach. Tools Manuf. 2018, 124, 126–133. [Google Scholar] [CrossRef]
- Zhang, X.; Xu, Y.; Li, H.; Zhu, L.; Wang, X.; Li, W. Flexible method for accurate calibration of large-scale vision metrology system based on virtual 3-D targets and laser tracker. Int. J. Adv. Robot. Syst. 2019, 16, 172988141989351. [Google Scholar] [CrossRef]
- Xu, P.; Cheung, B.C.; Li, B. A complete, continuous and minimal POE-based model for five-axis machine tools calibration with a single laser tracker, a R-test or a double ball-bar. J. Manuf. Sci. Eng. 2019, 141, 1. [Google Scholar] [CrossRef]
- Morais, J.V.; Custódio, A.L.; Marques, G.M. Calibration of parameters in Dynamic Energy Budget models using Direct-Search methods. J. Math. Biol. 2019, 78, 1439–1458. [Google Scholar] [CrossRef] [PubMed]
- González-Vera, A.S.; Wilting, T.J.S.; Holten, A.P.C.; van Heijst, G.J.F.; Duran-Matute, M. High-resolution single-camera photogrammetry: Incorporation of refraction at a fluid interface. Exp. Fluids 2020, 61, 1–19. [Google Scholar] [CrossRef] [Green Version]
- Yusoff, I.N.; Ismail, M.A.M.; Tobe, H.; Miyoshi, T.; Date, K.; Yokota, Y. Discontinuity pattern detection and orientation measurement for tunnel faces by using structure from motion photogrammetry. Displays 2023, 76, 102356. [Google Scholar] [CrossRef]
- Chen, Z.; Lai, J.; Liu, J.; Li, R.; Ji, G. A Parameter Self-Calibration Method for GNSS/INS Deeply Coupled Navigation Systems in Highly Dynamic Environments. Sensors 2018, 18, 2341. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Mendikute, A.; Yagüe-Fabra, J.A.; Zatarain, M.; Bertelsen, Á.; Leizea, I. Self-Calibrated In-Process Photogrammetry for Large Raw Part Measurement and Alignment before Machining. Sensors 2017, 17, 2066. [Google Scholar] [CrossRef] [Green Version]
- Wang, S.; Diao, R.; Xu, C.; Shi, D.; Wang, Z. On Multi-Event Co-Calibration of Dynamic Model Parameters Using Soft Actor-Critic. IEEE Trans. Power Syst. 2021, 36, 521–524. [Google Scholar] [CrossRef]
- Brizuela-Mendoza, J.A.; Sorcia-Vázquez, F.D.; Rumbo-Morales, J.Y.; Lozoya-Ponce, R.E.; Rodríguez-Cerda, J.C. Active fault tolerant control based on eigenstructure assignment applied to a 3-DOF helicopter. Asian J. Control. 2021, 23, 673–684. [Google Scholar] [CrossRef]
- Ortiz-Torres, G.; Castillo, P.; Sorcia-Vazquez, F.D.; Rumbo-Morales, J.Y.; Brizuela-Mendoza, J.A.; De La Cruz-Soto, J.; Martínez-García, M. Fault estimation and fault tolerant control strategies applied to VTOL aerial vehicles with soft and aggressive actuator faults. IEEE Access 2020, 8, 10649–10661. [Google Scholar] [CrossRef]
n = 25 rpm | n = 50 rpm | n = 100 rpm | n = 200 rpm | |
---|---|---|---|---|
ω | 24.99 rpm | 49.98 rpm | 100.10 rpm | 200.80 rpm |
δ | 0.04% | 0.04% | 0.10% | 0.40% |
Technical Index | MPS/M10 |
---|---|
Resolution ratio | 8 M |
Measuring accuracy | 12 μm + 12 ppm·L 0.05 mm@3 m |
Measurement accuracy of displacement and profile | 0.03 mm@3 m |
Field angle | 70.6° |
Measuring speed | Real-time processing of 5 frames/SEC; Post-processing of 10 frames per second |
Measuring range | ~15 m |
Speed (r/s) | Distance | |
---|---|---|
Mean Value (mm) | Standard Deviation (mm) | |
0 | 242.039 | 0.004 |
0.5 | 241.712 | 0.037 |
1.0 | 241.720 | 0.038 |
2.0 | 241.723 | 0.036 |
3.0 | 241.727 | 0.035 |
4.0 | 241.725 | 0.035 |
Rotate Speed (r/s) | Fitting Radius (mm) | Z to the Deviation (mm) | Angular Variation (°) | Linear Speed (mm/s) | Angular Speed (°/s) | ||
---|---|---|---|---|---|---|---|
0.5 | Target point 1 | mean value | 167.970 | 0.000 | 45.837 | 524.420 | 178.883 |
standard deviation | 0.018 | 0.053 | 6.377 | 24.805 | 8.462 | ||
Target point 2 | mean value | 73.745 | 0.000 | 45.837 | 230.238 | 178.883 | |
standard deviation | 0.017 | 0.038 | 6.378 | 10.881 | 8.455 | ||
1.0 | Target point 1 | mean value | 167.973 | 0.000 | 90.918 | 1053.511 | 359.355 |
standard deviation | 0.019 | 0.056 | 11.766 | 51.128 | 17.438 | ||
Target point 2 | mean value | 73.751 | 0.000 | 90.918 | 462.558 | 359.354 | |
standard deviation | 0.019 | 0.042 | 11.766 | 22.439 | 17.432 | ||
2.0 | Target point 1 | mean value | 167.978 | 0.000 | 205.670 | 2112.440 | 720.536 |
standard deviation | 0.016 | 0.066 | 29.469 | 127.005 | 43.322 | ||
Target point 2 | mean value | 73.749 | 0.000 | 203.754 | 924.852 | 718.518 | |
standard deviation | 0.018 | 0.040 | 33.717 | 72.341 | 56.197 | ||
3.0 | Target point 1 | mean value | 167.979 | 0.002 | 299.341 | 3167.066 | 1080.255 |
standard deviation | 0.017 | 0.075 | 49.143 | 163.237 | 55.691 | ||
Target point 2 | mean value | 73.749 | 0.001 | 299.341 | 1390.462 | 1080.255 | |
standard deviation | 0.017 | 0.047 | 49.142 | 71.676 | 55.691 | ||
4.0 | Target point 1 | mean value | 167.981 | 0.000 | 313.244 | 3990.063 | 1360.949 |
standard deviation | 0.015 | 0.089 | 235.571 | 720.142 | 245.634 | ||
Target point 2 | mean value | 73.747 | 0.000 | 308.932 | 1751.876 | 1361.078 | |
standard deviation | 0.016 | 0.053 | 241.094 | 403.235 | 313.297 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Ou, J.; Xu, T.; Gan, X.; He, X.; Li, Y.; Qu, J.; Zhang, W. Research on a Dynamic Calibration Method for Photogrammetry Based on Rotary Motion. Appl. Sci. 2023, 13, 3317. https://doi.org/10.3390/app13053317
Ou J, Xu T, Gan X, He X, Li Y, Qu J, Zhang W. Research on a Dynamic Calibration Method for Photogrammetry Based on Rotary Motion. Applied Sciences. 2023; 13(5):3317. https://doi.org/10.3390/app13053317
Chicago/Turabian StyleOu, Jia, Tingfa Xu, Xiaochuan Gan, Xuejun He, Yan Li, Jiansu Qu, and Wei Zhang. 2023. "Research on a Dynamic Calibration Method for Photogrammetry Based on Rotary Motion" Applied Sciences 13, no. 5: 3317. https://doi.org/10.3390/app13053317
APA StyleOu, J., Xu, T., Gan, X., He, X., Li, Y., Qu, J., & Zhang, W. (2023). Research on a Dynamic Calibration Method for Photogrammetry Based on Rotary Motion. Applied Sciences, 13(5), 3317. https://doi.org/10.3390/app13053317