Progressive Transmission Line Image Transmission and Recovery Algorithm Based on Hybrid Attention and Feature Fusion for Signal-Free Regions of Transmission Lines
Abstract
:1. Introduction
- (1)
- A progressive image transmission and recovery algorithm based on the hybrid attention mechanism is proposed, which achieves a balance between image quality and transmission efficiency in low bandwidth environments and is particularly suitable for transmission line monitoring in signal-free regions.
- (2)
- The wavelet transform is innovatively combined with Swin Transformer, hybrid attention module, and pixel rearrangement upsampling mechanism to optimize the feature extraction and image recovery process, which significantly improves the clarity and detail retention of the recovered images.
- (3)
- Experimental results show that the algorithm performs superiorly in terms of image quality (PSNR, SSIM), transmission efficiency, and bandwidth utilization compared with mainstream methods, demonstrating its excellent adaptability and stability in extreme environment monitoring scenarios.
2. Related Work
2.1. Approaches Based on Attention Mechanisms
2.2. Image Restoration Technology
3. The Structure of the Model Architecture
3.1. Wavelet Transform
3.2. Hybrid Attention Module
3.3. Swin Transformer Module
3.4. Pixel Shuffle Upsampling Module
3.5. Network Infrastructure
4. Experimental Results and Analysis
4.1. Data Sets and Parameter Settings
4.2. Evaluation Indicators
4.3. Ablation Experiment
4.4. Comparison Experiment
4.5. Image Target Detection
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Himeur, Y.; Boukabou, A. Robust image transmission over powerline channel with impulse noise. Multimed. Tools Appl. 2017, 76, 2813–2835. [Google Scholar] [CrossRef]
- Wang, Q.; Wu, B.; Zhu, P.; Li, P.; Zuo, W.; Hu, Q. ECA-Net: Efficient channel attention for deep convolutional neural networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 13–19 June 2020. [Google Scholar]
- Pattichis, C.S.; Kyriacou, E.; Voskarides, S.; Pattichis, M.S.; Istepanian, R.; Schizas, C.N. Wireless telemedicine systems: An overview. IEEE Antennas Propag. Mag. 2002, 44, 143–153. [Google Scholar] [CrossRef]
- Zhang, Y.; Li, K.; Li, K.; Wang, L.; Zhong, B.; Fu, Y. Image super-resolution using very deep residual channel attention networks. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8–14 September 2018. [Google Scholar]
- Dubovik, O.; Schuster, G.L.; Xu, F.; Hu, Y.; Bösch, H.; Landgraf, J.; Li, Z. Grand challenges in satellite remote sensing. Front. Remote Sens. 2021, 2, 619818. [Google Scholar] [CrossRef]
- Chen, L.; Zhang, H.; Xiao, J.; Nie, L.; Shao, J.; Liu, W.; Chua, T.-S. SCA-CNN: Spatial and channel-wise attention in convolutional networks for image captioning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017. [Google Scholar]
- Kose, S.; Koytak, E.; Hascicek, Y.S. An overview on the use of satellite communications for disaster management and emergency response. Int. J. Emerg. Manag. 2012, 8, 350–382. [Google Scholar] [CrossRef]
- Zhao, H.; Kong, X.; He, J.; Qiao, Y.; Dong, C. Efficient image super-resolution using pixel attention. In Computer Vision–ECCV 2020 Workshops: Glasgow, UK, 23–28 August 2020, Proceedings, Part III 16; Springer International Publishing: Berlin, Germany, 2020. [Google Scholar]
- Alam, A.; Sheeba, P. A review of automatic driving system by recognizing road signs using digital image processing. J. Inform. Electr. Electron. Eng. (JIEEE) 2021, 2, 1–9. [Google Scholar] [CrossRef]
- Xiao, J.; Guo, H.; Yao, Y.; Zhang, S.; Zhou, J.; Jiang, Z. Multi-scale object detection with the pixel attention mechanism in a complex background. Remote Sens. 2022, 14, 3969. [Google Scholar] [CrossRef]
- Liang, J.; Cao, J.; Sun, G.; Zhang, K.; Van Gool, L.; Timofte, R. Swinir: Image restoration using swin transformer. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada, 10–17 October 2021. [Google Scholar]
- Li, B.; Li, X.; Lu, Y.; Liu, S.; Feng, R.; Chen, Z. Hst: Hierarchical swin transformer for compressed image super-resolution. In Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel, 23–27 October 2022; Springer Nature: Cham, Switzerland, 2022. [Google Scholar]
- Nascimento, V.; Laroca, R.; Lambert, J.d.A.; Schwartz, W.R.; Menotti, D. Combining attention module and pixel shuffle for license plate super-resolution. In Proceedings of the 2022 35th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Natal, Brazil, 24–27 October 2022; IEEE: Piscataway, NJ, USA, 2022; Volume 1. [Google Scholar]
- Zhang, D.; Zhang, D. Wavelet transform. In Fundamentals of Image Data Mining: Analysis, Features, Classification and Retrieval; Springer: Berlin, Germany, 2019; pp. 35–44. [Google Scholar]
- Munson, D.C. A note on Lena. IEEE Trans. Image Process. 1996, 5, 3. [Google Scholar] [CrossRef]
- Islam, A.; Amin, R.; Sharan, M.H.; Ushno, J.A.; Islam, K.M.T.; Hossen, D.; Hossain, M.S.; Alam, M.S. Designing an autonomous framework to detect and classify the fabric defects using wavelet transform and neural network. In AIP Conference Proceedings; AIP Publishing: Melville, NY, USA, 2023; Volume 2788. [Google Scholar]
- Hua, Q.; Chen, L.; Li, P.; Zhao, S.; Li, Y. A pixel–channel hybrid attention model for image processing. Tsinghua Sci. Technol. 2022, 27, 804–816. [Google Scholar] [CrossRef]
- Liu, N.; Han, J.; Yang, M.-H. PiCANet: Pixel-wise contextual attention learning for accurate saliency detection. IEEE Trans. Image Process. 2020, 29, 6438–6451. [Google Scholar] [CrossRef] [PubMed]
- Hu, J.; Li, S.; Gang, S. Squeeze-and-excitation networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18–23 June 2018. [Google Scholar]
- Islam, A.; Amin, R.; Sharan, M.H.; Ushno, J.A.; Islam, K.M.T.; Hossen, D.; Hossain, M.S.; Alam, M.S. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada, 11–17 October 2021. [Google Scholar]
- Li, Z.; Liu, F.; Yang, W.; Peng, S.; Zhou, J. A survey of convolutional neural networks: Analysis, applications, and prospects. IEEE Trans. Neural Netw. Learn. Syst. 2021, 33, 6999–7019. [Google Scholar] [CrossRef] [PubMed]
- Anderson, P.G. Linear pixel shuffling for image processing: An introduction. J. Electron. Imaging 1993, 2, 147–154. [Google Scholar] [CrossRef]
- Odena, A.; Dumoulin, V.; Olah, C. Deconvolution and checkerboard artifacts. Distill 2016, 1, e3. [Google Scholar] [CrossRef]
- Sunil, C.K.; Jaidhar, C.D.; Patil, N. Tomato plant disease classification using multilevel feature fusion with adaptive channel spatial and pixel attention mechanism. Expert Syst. Appl. 2023, 228, 120381. [Google Scholar]
- Mehri, A.; Ardakani, P.B.; Sappa, A.D. MPRNet: Multi-path residual network for lightweight image super resolution. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Virtual, 5–9 January 2021. [Google Scholar]
- Feng, Y.; Hou, S.; Lin, H.; Zhu, Y.; Wu, P.; Dong, W.; Sun, J.; Yan, Q.; Zhang, Y. DiffLight: Integrating Content and Detail for Low-light Image Enhancement. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 16–22 June 2024. [Google Scholar]
- Ouyang, X.; Chen, Y.; Zhu, K.; Agam, G. Image restoration refinement with Uformer GAN. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 16–22 June 2024. [Google Scholar]
- Nehete, H.; Monga, A.; Kaushik, P.; Kaushik, B.K. Fourier Prior-Based Two-Stage Architecture for Image Restoration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 16–22 June 2024. [Google Scholar]
- Liu, G.; Yue, H.; Yang, J. Efficient Light Field Image Super-Resolution via Progressive Disentangling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 16–22 June 2024. [Google Scholar]
Resolution Levels | Wavelet Sub-Band ub-Band | Energy Ratio (%) | The Sub-Band Energy Ratio is the Sum of the Total |
---|---|---|---|
low frequency | LL4 | 91.6367 | 91.6367 |
Layer 4 HF (LH4+HL4+HH4) | LH4 | 0.7001 | 3.896 |
HL4 | 2.5976 | ||
HH4 | 0.3913 | ||
Layer 3 HF (LH3+HL3+HH3) | LH3 | 0.5021 | 2.3257 |
HL3 | 1.5530 | ||
HH3 | 0.2706 | ||
Layer 2 HF (LH2+HL2+HH2) | LH2 | 0.3473 | 1.4489 |
HL2 | 0.9484 | ||
HH2 | 0.1532 | ||
Layer 1 HF (LH1+HL1+HH1) | LH1 | 0.2302 | 0.8998 |
HL1 | 0.5696 | ||
HH1 | 0.1001 |
Experiment | Wavelet Transform | Hybrid Attention Mechanism | Swin Transformer Module | Pixel Shuffle Upsampling Module | PSNR/dB | SSIM |
---|---|---|---|---|---|---|
Experiment I | √ | 27.032 | 0.813 | |||
Experiment II | √ | √ | 29.913 | 0.854 | ||
Experiment III | √ | √ | √ | 33.174 | 0.916 | |
Experiment IV | √ | √ | √ | √ | 40.2 | 0.982 |
Method | PSNR (dB) | SSIM | Bandwidth Consumption (KB) | Transmission Time (s) |
---|---|---|---|---|
MPRNet | 39.7 | 0.970 | 400 | 3.5 |
DiffLight | 37.5 | 0.945 | 450 | 3.9 |
Uformer GAN | 38.8 | 0.955 | 420 | 4.0 |
Fourier Prior Architecture | 38.2 | 0.950 | 430 | 3.8 |
Progressive Disentangling | 36.9 | 0.940 | 460 | 4.2 |
Methodology of this paper | 40.2 | 0.982 | 300 | 2.8 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Ji, X.; Yang, X.; Yue, Z.; Yang, H.; Guo, H. Progressive Transmission Line Image Transmission and Recovery Algorithm Based on Hybrid Attention and Feature Fusion for Signal-Free Regions of Transmission Lines. Electronics 2024, 13, 4605. https://doi.org/10.3390/electronics13234605
Ji X, Yang X, Yue Z, Yang H, Guo H. Progressive Transmission Line Image Transmission and Recovery Algorithm Based on Hybrid Attention and Feature Fusion for Signal-Free Regions of Transmission Lines. Electronics. 2024; 13(23):4605. https://doi.org/10.3390/electronics13234605
Chicago/Turabian StyleJi, Xiu, Xiao Yang, Zheyu Yue, Hongliu Yang, and Haiyang Guo. 2024. "Progressive Transmission Line Image Transmission and Recovery Algorithm Based on Hybrid Attention and Feature Fusion for Signal-Free Regions of Transmission Lines" Electronics 13, no. 23: 4605. https://doi.org/10.3390/electronics13234605
APA StyleJi, X., Yang, X., Yue, Z., Yang, H., & Guo, H. (2024). Progressive Transmission Line Image Transmission and Recovery Algorithm Based on Hybrid Attention and Feature Fusion for Signal-Free Regions of Transmission Lines. Electronics, 13(23), 4605. https://doi.org/10.3390/electronics13234605