An Improved Shape from Focus Method for Measurement of Three-Dimensional Features of Fuel Nozzles
Abstract
:1. Introduction
2. Methodology
2.1. Shape from Focus
2.2. Sensitivity Analysis
2.3. Determination of the Approximate Focus Measure Interval
2.4. Dimension Extraction
2.4.1. Semi-Vertical Angle of the Cone
2.4.2. Dimensions of the Swirl Slot
3. Experimental Verification
3.1. Experimental Setup
3.2. Results from Sensitivity Analysis
3.3. Approximate Focus Measure Intervals
3.4. Fuel Nozzle Measurement
4. Conclusions
- The experimental results show that the improved SFF method can perform three-dimensional measurements of fuel nozzles with high precision. Compared with the measurement results of the laser scanning microscope, the proposed method gives a measurement error less than 0.1° for the semi-vertical angle, 10 μm for the swirl slot depth and width, and 0.15° for the swirl slot helix angle.
- The dispersion of the measured points from a standard flat plane is used to assess the performance of different focus measure operators, window sizes and sampling step sizes. The BREN focus measure operator with a 21 × 21 (pixels) window size and a sampling step size of 20 μm is chosen for our experimental setup. The results show that the chosen parameters can balance the measurement time and accuracy.
- An approximate method for the focus measure interval is proposed, which uses the peak region of the central pixel to replace the peak region of other pixels. The experimental results show that the proposed method has decreased the average computation time of the focus measure at each pixel position by 79.19% for the cone section and by 38.30% for the swirl slot without using extra hardware.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Fan, X.; Liu, C.; Mu, Y.; Wang, Y.; Wang, K.; Xu, G. Experimental investigations on atomization characteristics of dual-orifice atomizers part I: Optimization method formation. Proc. Inst. Mech. Eng. Part A J. Power Energy 2020, 235, 807–822. [Google Scholar] [CrossRef]
- Xue, J.; Jog, M.A.; Jeng, S.M.; Steinthorsson, E.; Benjamin, M.A. Effect of Geometric Parameters on Simplex Atomizer Performance. AIAA J. 2004, 42, 2408–2415. [Google Scholar] [CrossRef]
- Amini, G. Liquid flow in a simplex swirl nozzle. Int. J. Multiph. Flow 2016, 79, 225–235. [Google Scholar] [CrossRef]
- Cheng, Z.; Qin, S.; Fang, Z. Numerical Modeling and Experimental Study on the Material Removal Process Using Ultrasonic Vibration-Assisted Abrasive Water Jet. Front. Mater. 2022, 9, 895271. [Google Scholar] [CrossRef]
- Li, L.; Cheng, F.; Wu, S. An LSTM-based measurement method of 3D weld pool surface in GTAW. Measurement 2021, 171, 108809. [Google Scholar] [CrossRef]
- Wang, L.; Xuan, Z. Study on 3D ultrasound imaging technology for measuring bladder tumour health care and information sensing. Measurement 2020, 163, 107926. [Google Scholar] [CrossRef]
- Billiot, B.; Cointault, F.; Journaux, L.; Simon, J.-C.; Gouton, P. 3D Image Acquisition System Based on Shape from Focus Technique. Sensors 2013, 13, 5040–5053. [Google Scholar] [CrossRef]
- Qi, H.; Wang, Y.; Qi, Z.; Shi, L.; Fang, Z.; Zhang, L.; Riemer, O.; Karpuschewski, B. A Novel Grain-Based DEM Model for Evaluating Surface Integrity in Scratching of RB-SiC Ceramics. Materials 2022, 15, 8486. [Google Scholar] [CrossRef]
- Gapinski, B.; Wieczorowski, M.; Marciniak-Podsadna, L.; Dybala, B.; Ziolkowski, G. Comparison of Different Method of Measurement Geometry Using CMM, Optical Scanner and Computed Tomography 3D. Procedia Eng. 2014, 69, 255–262. [Google Scholar] [CrossRef] [Green Version]
- Mazur, T.; Cepova, L.; Szymanski, T.; Rucki, M. Analysis of the Planar Point Identification Accuracy in CMM Measurements. Sensors 2022, 22, 7005. [Google Scholar] [CrossRef]
- Park, D.-W.; Oh, G.-H.; Kim, D.-J.; Kim, H.-S. In-situ thickness measurement of epoxy molding compound in semiconductor package products using a Terahertz-Time of Flight System. NDT E Int. 2019, 105, 11–18. [Google Scholar] [CrossRef]
- Solís, S.M.; Santoyo, F.M.; Hernández-Montes, M.d.S. 3D displacement measurements of the tympanic membrane with digital holographic interferometry. Opt. Express 2012, 20, 5613. [Google Scholar] [CrossRef] [PubMed]
- Zhong, C.; Gao, Z.; Wang, X.; Shao, S.; Gao, C. Structured Light Three-Dimensional Measurement Based on Machine Learning. Sensors 2019, 19, 3229. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Shang, H.; Liu, C.; Wang, R. Measurement methods of 3D shape of large-scale complex surfaces based on computer vision: A review. Measurement 2022, 197, 111302. [Google Scholar] [CrossRef]
- Nayar, S.K.; Nakagawa, Y. Shape from focus. IEEE Trans. Pattern Anal. Mach. Intell. 1994, 16, 824–831. [Google Scholar] [CrossRef] [Green Version]
- Zhang, Z.; Liu, F.; Zhou, Z.; He, Y.; Fang, H. Roughness measurement of leaf surface based on shape from focus. Plant Methods 2021, 17, 72. [Google Scholar] [CrossRef]
- Niederoest, M.; Niederoest, J.; Ščučka, J. Automatic 3D reconstruction and visualization of microscopic objects from a monoscopic multifocus image sequence. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2003, XXXIV-5/W10. [Google Scholar] [CrossRef]
- Tang, J.; Qiu, Z.; Li, T. A novel measurement method and application for grinding wheel surface topography based on shape from focus. Measurement 2019, 133, 495–507. [Google Scholar] [CrossRef]
- Thelen, A.; Frey, S.; Hirsch, S.; Hering, P. Improvements in Shape-From-Focus for Holographic Reconstructions With Regard to Focus Operators, Neighborhood-Size, and Height Value Interpolation. IEEE Trans. Image Process. 2009, 18, 151–157. [Google Scholar] [CrossRef]
- Pertuz, S.; Puig, D.; Garcia, M.A. Analysis of focus measure operators for shape-from-focus. Pattern Recognit. 2013, 46, 1415–1432. [Google Scholar] [CrossRef]
- Mahmood, M.T.; Tae-Sun, C. Nonlinear Approach for Enhancement of Image Focus Volume in Shape From Focus. IEEE Trans. Image Process. 2012, 21, 2866–2873. [Google Scholar] [CrossRef] [PubMed]
- Ma, Z.; Kim, D.; Shin, Y.-G. Shape-from-focus reconstruction using nonlocal matting Laplacian prior followed by MRF-based refinement. Pattern Recognit. 2020, 103, 107302. [Google Scholar] [CrossRef]
- Onogi, S.; Kawase, T.; Sugino, T.; Nakajima, Y. Investigation of Shape-from-Focus Precision by Texture Frequency Analysis. Electronics 2021, 10, 1870. [Google Scholar] [CrossRef]
- Malik, A.S.; Choi, T.-S. Consideration of illumination effects and optimization of window size for accurate calculation of depth map for 3D shape recovery. Pattern Recognit. 2007, 40, 154–170. [Google Scholar] [CrossRef]
- Li, L.; Pan, Z.; Cui, H.; Liu, J.; Yang, S.; Liu, L.; Tian, Y.; Wang, W. Adaptive window iteration algorithm for enhancing 3D shape recovery from image focus. Chin. Opt. Lett. 2019, 17, 061001. [Google Scholar] [CrossRef]
- Muhammad, M.S.; Mutahira, H.; Choi, K.-W.; Kim, W.-Y.; Ayaz, Y. Calculating Accurate Window Size for Shape-From-Focus. In Proceedings of the 2014 International Conference on Information Science & Applications (ICISA), Seoul, Republic of Korea, 6–9 May 2014; pp. 1–4. [Google Scholar]
- Muhammad, M.; Choi, T.-S. Sampling for Shape from Focus in Optical Microscopy. IEEE Trans. Pattern Anal. Mach. Intell. 2012, 34, 564–573. [Google Scholar] [CrossRef] [PubMed]
- Mutahira, H.; Muhammad, M.S.; Li, M.; Shin, D.R. A simplified approach using deep neural network for fast and accurate shape from focus. Microsc. Res. Tech. 2020, 84, 656–667. [Google Scholar] [CrossRef]
- Ali, U.; Mahmood, M.T. Depth Hypotheses Fusion through 3D Weighted Least Squares in Shape from Focus. Microsc. Microanal. 2021, 27, 344–356. [Google Scholar] [CrossRef]
- Lee, S.-A.; Lee, B.-G. Three-dimensional Shape Recovery from Image Focus Using Polynomial Regression Analysis in Optical Microscopy. Curr. Opt. Photonics 2020, 4, 411–420. [Google Scholar] [CrossRef]
- Chen, X.; Qiu, Y.; Yi, H. Implementation and performance of image filtering on GPU. In Proceedings of the 2013 Fourth International Conference on Intelligent Control and Information Processing (ICICIP), Beijing, China, 9–11 June 2013; pp. 514–517. [Google Scholar]
- Gladines, J.; Sels, S.; Blom, J.; Vanlanduit, S. A Fast Shape-from-Focus-Based Surface Topography Measurement Method. Sensors 2021, 21, 2574. [Google Scholar] [CrossRef]
- Shim, S.-O.; Choi, T.-S. A novel iterative shape from focus algorithm based on combinatorial optimization. Pattern Recognit. 2010, 43, 3338–3347. [Google Scholar] [CrossRef]
- Pertuz, S.; Garcia, M.A.; Puig, D.; Arguello, H. A Closed-Form Focus Profile Model for Conventional Digital Cameras. Int. J. Comput. Vis. 2017, 124, 273–286. [Google Scholar] [CrossRef]
- Mutahira, H.; Shin, V.; Muhammad, M.S.; Shin, D.R. Sampling-Noise Modeling & Removal in Shape From Focus Systems Through Kalman Filter. IEEE Access 2021, 9, 102520–102541. [Google Scholar] [CrossRef]
- Subbarao, M.; Tao, C. Accurate recovery of three-dimensional shape from image focus. IEEE Trans. Pattern Anal. Mach. Intell. 1995, 17, 266–274. [Google Scholar] [CrossRef] [Green Version]
- Fan, T.; Yu, H. A novel shape from focus method based on 3D steerable filters for improved performance on treating textureless region. Opt. Commun. 2018, 410, 254–261. [Google Scholar] [CrossRef]
- Chang, H.-C.; Shih, T.-M.; Chen, N.Z.; Pu, N.-W. A microscope system based on bevel-axial method auto-focus. Opt. Lasers Eng. 2009, 47, 547–551. [Google Scholar] [CrossRef]
- Tsai, D.-C.; Chen, H.H. Focus Profile Modeling. IEEE Trans. Image Process. 2016, 25, 818–828. [Google Scholar] [CrossRef]
- Wen, X.; Huang, J.; Sheng, D.; Wang, F. Conicity and cylindricity error evaluation using particle swarm optimization. Precis. Eng. 2010, 34, 338–344. [Google Scholar] [CrossRef]
- Yu, G.; Ding, N.; Zhang, W. Research on the NURBS unrolling&rolling of the columned entity design. In Proceedings of the Workshop on Intelligent Information Technology Application (IITA 2007), Zhangjiajie, China, 2–3 December 2007; pp. 227–230. [Google Scholar]
Focus Measure Operator | Abbr. | Expression |
---|---|---|
Brenner’s focus measure | BREN | |
Variance of Laplacian | LAPV | |
Gray-level local variance | GLVN | |
Squared gradient | GRAS | |
Spatial frequency measure | SFRQ | |
Tenengrad variance | TENV |
Parameter | Value |
---|---|
Image size (pixel) | 4024 × 3036 |
Pixel Size (μm) | 1.85 |
Lens magnification | ×1 |
Numerical aperture of lens | 0.045 |
Repeated positioning error of motion platform (μm) | <1 |
Measuring ranges in the z direction (μm) | 6000 |
Atomizer Case | Measured by SFF (°) | Measured by Keyence (°) | Absolute Deviation (°) |
---|---|---|---|
A | 71.9886 | 72.0203 | 0.0317 |
B | 72.1016 | 72.1800 | 0.0784 |
C | 72.3479 | 72.3889 | 0.0410 |
D | 71.8998 | 71.8353 | 0.0645 |
Atomizer Case | Parameter Type | Measured by SFF | Measured by Keyence | Absolute Deviation |
---|---|---|---|---|
A | Depth of swirl slot d (μm) | 854.2300 | 852.9883 | 1.2417 |
Width of swirl slot w (μm) | 909.7891 | 915.1784 | 5.3893 | |
Helical angle β (°) | 22.9541 | 22.8403 | 0.1138 | |
B | Depth of swirl slot d (μm) | 854.9141 | 859.2065 | 4.2924 |
Width of swirl slot w (μm) | 952.5697 | 955.2558 | 2.6861 | |
Helical angle β (°) | 22.8172 | 22.7169 | 0.1003 | |
C | Depth of swirl slot d (μm) | 882.4282 | 884.9443 | 2.5161 |
Width of swirl slot w (μm) | 919.0835 | 912.3630 | 6.7205 | |
Helical angle β (°) | 22.9648 | 23.0911 | 0.1263 | |
D | Depth of swirl slot d (μm) | 857.7256 | 863.4785 | 5.7529 |
Width of swirl slot w (μm) | 910.1041 | 904.2358 | 5.8683 | |
Helical angle β (°) | 23.3675 | 23.2531 | 0.1144 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Hou, L.; Zou, J.; Zhang, W.; Chen, Y.; Shao, W.; Li, Y.; Chen, S. An Improved Shape from Focus Method for Measurement of Three-Dimensional Features of Fuel Nozzles. Sensors 2023, 23, 265. https://doi.org/10.3390/s23010265
Hou L, Zou J, Zhang W, Chen Y, Shao W, Li Y, Chen S. An Improved Shape from Focus Method for Measurement of Three-Dimensional Features of Fuel Nozzles. Sensors. 2023; 23(1):265. https://doi.org/10.3390/s23010265
Chicago/Turabian StyleHou, Liang, Jiahao Zou, Wei Zhang, Yun Chen, Wen Shao, Yuan Li, and Shuyuan Chen. 2023. "An Improved Shape from Focus Method for Measurement of Three-Dimensional Features of Fuel Nozzles" Sensors 23, no. 1: 265. https://doi.org/10.3390/s23010265
APA StyleHou, L., Zou, J., Zhang, W., Chen, Y., Shao, W., Li, Y., & Chen, S. (2023). An Improved Shape from Focus Method for Measurement of Three-Dimensional Features of Fuel Nozzles. Sensors, 23(1), 265. https://doi.org/10.3390/s23010265