An Algorithm for Real-Time Aluminum Profile Surface Defects Detection Based on Lightweight Network Structure
Abstract
:1. Introduction
- (1)
- A lightweight model based on YOLOv5s is proposed. Compared with the YOLOv5s algorithm, the proposed model greatly improves the speed and accuracy, while the model size is greatly reduced to facilitate the deployment of edge devices.
- (2)
- GCANet is constructed by combining a Ghost module and attention mechanism, which significantly improves the model detection speed, reduces memory consumption, and ensures model accuracy. Moreover, the Attention mechanism module is embedded in the backbone network, which mainly enhances the ability of the backbone network to focus on the channel information.
- (3)
- In the neck network of the lightweight model, the regular convolution is replaced by the depthwise separable convolution, which greatly compresses the model size and further improves the detection speed.
2. Image Preprocessing and Datasets
3. Description of Methodology
3.1. Network Architecture
3.2. GCANet Backbone Structure
3.3. AC3Ghost Structure
3.4. DwConv Module
4. Experiments and Discussion
4.1. Experimental Environment
4.2. Evaluation of Model Performance
4.3. Test Result of Defect Detection
4.4. Comparison of the Effect of Different Defect Detection Algorithms
4.5. Ablation Study
4.6. Edge Testing
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Thomas, S.S.; Gupta, S.; Subramanian, V.K. Smart surveillance based on video summarization. In Proceedings of the IEEE Region 10 Symposium (TENSYMP), Cochin, India, 14–16 July 2017; pp. 1–5. [Google Scholar]
- Yu, H.; Liang, Y.; Liang, H.; Zhang, Y. Recognition of wood surface defects with near infrared spectroscopy and machine vision. J. For. Res. 2019, 30, 2379–2386. [Google Scholar] [CrossRef]
- Hu, H.; Xu, D.; Zheng, X.; Zhang, B. Pit defect detection on steel shell end face based on machine vision. In Proceedings of the 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chongqing, China, 12–14 June 2020. [Google Scholar]
- You, Y.; Xiao, Z.; Chun-Guang, X.U.; Xiao, D.G.; Yi-Xin, H.U.; Pei-Lu, L.I.; Guo, C.Z. Robotic NDT for Turbine Blades Based on the Transverse Waves. In Proceedings of the 2017 Far East NDT New Technology & Application Forum (FENDT), Xi’an, China, 22–24 June 2017; pp. 18–22. [Google Scholar]
- Ciecielag, K.; Kecik, K.; Skoczylas, A.; Matuszak, J.; Korzec, I.; Zaleski, R. Non-Destructive Detection of Real Defects in Polymer Composites by Ultrasonic Testing and Recurrence Analysis. Materials 2022, 15, 7335. [Google Scholar] [CrossRef] [PubMed]
- Chen, N.; Sun, J.; Wang, X.; Huang, Y.; Li, Y.; Guo, C. Research on surface defect detection and grinding path planning of steel plate based on machine vision. In Proceedings of the 2019 14th IEEE Conference on Industrial Electronics and Applications (ICIEA), Xi’an, China, 19–21 June 2019; pp. 1748–1753. [Google Scholar]
- Hui, W.; Chunhua, G.; Xiangxu, X.; Yongfa, L.; Yuji, W. Study on Edge Detection Method of Aluminum Foil Image. In Proceedings of the 2017 International Conference on Computer Systems, Electronics and Control (ICCSEC), Dalian, China, 25–27 December 2017; pp. 1008–1010. [Google Scholar]
- Indolia, S.; Goswami, A.; Mishra, S.; Asopa, P. Conceptual understanding of convolutional neural network-a deep learning approach. Proc. Comput. Sci. 2018, 132, 679–688. [Google Scholar] [CrossRef]
- Girshick, R.; Donahue, J.; Darrell, T.; Malik, J. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 23–28 June 2014; pp. 580–587. [Google Scholar]
- Girshick, R. Fast R-CNN. In Proceedings of the IEEE International Conference on Computer Vision, Washington, DC, USA, 7–13 December 2015; pp. 1440–1448. [Google Scholar]
- Ren, S.; He, K.; Girshick, R.; Sun, J. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 39, 1137–1149. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Liu, W.; Anguelov, D.; Erhan, D.; Szegedy, C.; Reed, S.; Fu, C.; Berg, A.C. SSD: Single shot multibox detector. In Proceedings of the Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, 11–14 October 2016; pp. 21–37. [Google Scholar]
- Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 26 June–1 July 2016; pp. 779–788. [Google Scholar]
- Redmon, J.; Farhadi, A. YOLO9000: Better faster stronger. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA, 17–19 June 2017; pp. 7263–7271. [Google Scholar]
- Redmon, J.; Farhadi, A. YOLOv3: An incremental improvement. arXiv 2018, arXiv:1804.02767. [Google Scholar]
- Bochkovskiy, A.; Wang, C.-Y.; Liao, H.-Y.M. YOLOv4: Optimal speed and accuracy of object detection. arXiv 2020, arXiv:2004.10934. [Google Scholar]
- Duan, K.; Bai, S.; Xie, L.; Qi, H.; Huang, Q.; Tian, Q. CenterNet: Keypoint triplets for object detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea, 28 October 2019; pp. 6569–6578. [Google Scholar]
- Lin, T.Y.; Goyal, P.; Girshick, R.; He, K.; Dollár, P. Focal loss fordense object detection. In Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 22–29 October 2017; pp. 2980–2988. [Google Scholar]
- Cheng, X.; Yu, J. RetinaNet with difference channel attention and adaptively spatial feature fusion for steel surface defect detection. IEEE Trans. Instrum. Meas. 2021, 70, 2503911. [Google Scholar] [CrossRef]
- Fu, G.; Sun, P.; Zhu, W.; Yang, J.; Cao, Y.; Yang, M.Y.; Cao, Y. A deep-learning-based approach for fast and robust steel surface defects classification. Opt. Lasers Eng. 2019, 121, 397–405. [Google Scholar] [CrossRef]
- Li, J.; Su, Z.; Geng, J.; Yin, Y. Real-time detection of steel strip surface defects based on improved YOLO detection network. IFAC-PapersOnLine 2018, 51, 76–81. [Google Scholar] [CrossRef]
- Yang, Z.; Zhang, M.; Li, C.; Meng, Z.; Li, Y.; Chen, Y.; Liu, L. Image Classification for Automobile Pipe Joints Surface Defect Detection Using Wavelet Decomposition and Convolutional Neural Network. IEEE Access 2022, 10, 77191–77204. [Google Scholar] [CrossRef]
- Amin, D.; Akhter, S. Deep Learning-Based Defect Detection System in Steel Sheet Surfaces. In 2020 IEEE Region 10 Symposium (TENSYMP); IEEE: Piscataway, NJ, USA, 2020; pp. 444–448. [Google Scholar]
- Ronneberger, O.; Fischer, P.; Brox, T. U-NET: Convolutional networks for biomedical image segmentation. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany, 5–9 October 2015; Volume 2, pp. 234–241. [Google Scholar]
- Zhang, H.; Song, Y.; Chen, Y.; Zhong, H.; Liu, L.; Wang, Y.; Wu, Q.J. MRSDI-CNN: Multi-Model Rail Surface Defect Inspection System Based on Convolutional Neural Networks. In IEEE Transactions on Intelligent Transportation Systems; IEEE: Piscataway, NJ, USA, 2022; Volume 23, pp. 11162–11177. [Google Scholar]
- Chen, X.; Zhang, H. Rail Surface Defects Detection Based on Faster R-CNN. In Proceedings of the 2020 International Conference on Artificial Intelligence and Electromechanical Automation (AIEA), Tianjin, China, 26–28 June 2020; pp. 819–822. [Google Scholar]
- Guo, Y.; Xiao, Z.; Geng, L.; Wu, J.; Zhang, F.; Liu, Y.; Wang, W. Fully Convolutional Neural Network With GRU for 3D Braided Composite Material Flaw Detection. IEEE Access 2019, 7, 151180–151188. [Google Scholar] [CrossRef]
- Zhou, N.; Liu, Z.; Zhou, J. Yolov5-based defect detection for wafer surface micropipe. In Proceedings of the 3rd International Conference on Information Science, Parallel and Distributed Systems, ISPDS, Guangzhou, China, 22–24 July 2022; pp. 165–169. [Google Scholar]
- Ma, Z.; Li, Y.; Huang, M.; Huang, Q.; Cheng, J.; Tang, S. Automated real-time detection of surface defects in manufacturing processes of aluminum alloy strip using a lightweight network architecture. J. Intell. Manuf. 2022. [Google Scholar] [CrossRef]
- Wang, T.; Su, J.; Xu, C.; Zhang, Y. An Intelligent Method for Detecting Surface Defects in Aluminium Profiles Based on the Improved YOLOv5 Algorithm. Electronics 2022, 11, 2304. [Google Scholar] [CrossRef]
- Yang, Y.; Sun, Q.; Zhang, D.; Shao, L.; Song, X.; Li, X. Improved Method Based on Faster R-CNN Network Optimization for Small Target Surface Defects Detection of Aluminum Profile. In Proceedings of the 2021 IEEE 15th International Conference on Electronic Measurement & Instruments (ICEMI), Nanjing, China, 29–31 October 2021; pp. 465–470. [Google Scholar]
- Li, B.; Ren, F.; Ni, H.; Kang, X.; Lv, S.; Hao, Z. Classification Method of Surface Defects of Aluminum Profile Based on Transfer Learning. In Proceedings of the 2022 International Conference on Machine Learning and Intelligent Systems Engineering (MLISE), Guangzhou, China, 5–7 August 2022; pp. 1–5. [Google Scholar]
- Wu, D.; Shen, X.; Chen, L. Detection of Defects on Aluminum Profile Surface Based on Improved YOLO. In Proceedings of the 2022 Prognostics and Health Management Conference (PHM-2022 London), London, UK, 27–29 May 2022; pp. 468–472. [Google Scholar]
- Mushtaq, Z.; Su, S. Environmental sound classification using a regularized deep convolutional neural network with data augmentation. Appl. Acoust. 2020, 167, 107389–107401. [Google Scholar] [CrossRef]
- Kisantal, M.; Wojna, Z.; Murawski, J.; Naruniec, J.; Cho, K. Augmentation for small object detection. arXiv 2019, arXiv:1902.07296. [Google Scholar]
- Lin, L. An effective denoising method for images contaminated with mixed noise based on adaptive median filtering and wavelet threshold denoising. J. Inf. Process. Syst. 2018, 14, 539–551. [Google Scholar]
- Simonyan, K.K.C.; Vedaldi, A.; Zisserman, A. Return of the devil in the details: Delving deep into convolutional nets. arXiv 2014, arXiv:1405.3531. [Google Scholar]
- Hu, J.; Shen, L.; Sun, G. Squeeze-and-excitation networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018. [Google Scholar]
- Hou, Q.; Zhou, D.; Feng, J. Coordinate attention for efficient mobile network design. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 20–25 June 2021. [Google Scholar]
- Woo, S.; Park, J.; Lee, J.Y.; Kweon, I.S. Cbam: Convolutional block attention module. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018. [Google Scholar]
Pinhole | Scratch | Dirt | Fold | |
---|---|---|---|---|
Precision | 83.24 | 98.86 | 99.11 | 99.45 |
Recall | 77.21 | 99.39 | 99.22 | 100.00 |
[email protected]:0.95 | 51.94 | 79.80 | 81.10 | 80.60 |
[email protected] | 82.45 | 98.77 | 98.80 | 99.37 |
[email protected]:0.95 | 73.36 | |||
[email protected] | 94.85 |
Algorithm | [email protected]% | [email protected]:0.95% | Model Size (MB) | Detection Speed (FPS) |
---|---|---|---|---|
SSD | 67.86 | 42.76 | 91.09 | 39 |
YOLOv3-tiny | 85.82 | 65.89 | 33.19 | 66 |
YOLOv4-tiny | 89.31 | 67.86 | 23.09 | 86 |
YOLOv5s | 93.09 | 72.58 | 14.40 | 75 |
YOLOv5-Mobilenetv3 | 89.71 | 67.78 | 5.96 | 158 |
YOLOv5-Shufflenetv2 | 89.65 | 66.86 | 3.30 | 176 |
Ours | 94.85 | 73.36 | 7.80 | 136 |
Description | Model Size (MB) | [email protected] (%) | Change (%) |
---|---|---|---|
YOLOv5s | 14.40 | 90.32 | -- |
Baseline | 14.40 | 93.09 | +2.77 |
+GCANet Backbone Network Structure | 7.90 | 93.90 | +0.81 |
+AC3Ghost Structural | 8.20 | 94.96 | +1.06 |
+DwConv Module | 7.80 | 94.84 | −0.12 |
Number | Component Name |
---|---|
1 | Conveyor belt |
2 | Encoder |
3 | Power supply |
4 | Nvidia Jeston Nano |
5 | Touch screen |
6 | CCD |
7 | LED light source |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Tang, J.; Liu, S.; Zhao, D.; Tang, L.; Zou, W.; Zheng, B. An Algorithm for Real-Time Aluminum Profile Surface Defects Detection Based on Lightweight Network Structure. Metals 2023, 13, 507. https://doi.org/10.3390/met13030507
Tang J, Liu S, Zhao D, Tang L, Zou W, Zheng B. An Algorithm for Real-Time Aluminum Profile Surface Defects Detection Based on Lightweight Network Structure. Metals. 2023; 13(3):507. https://doi.org/10.3390/met13030507
Chicago/Turabian StyleTang, Junlong, Shenbo Liu, Dongxue Zhao, Lijun Tang, Wanghui Zou, and Bin Zheng. 2023. "An Algorithm for Real-Time Aluminum Profile Surface Defects Detection Based on Lightweight Network Structure" Metals 13, no. 3: 507. https://doi.org/10.3390/met13030507
APA StyleTang, J., Liu, S., Zhao, D., Tang, L., Zou, W., & Zheng, B. (2023). An Algorithm for Real-Time Aluminum Profile Surface Defects Detection Based on Lightweight Network Structure. Metals, 13(3), 507. https://doi.org/10.3390/met13030507