Image Denoising Using Hybrid Deep Learning Approach and Self-Improved Orca Predation Algorithm
Abstract
:1. Introduction
- Approach: Hybrid deep learning combining Bi-LSTM and optimized CNN.
- Objective: Improve image denoising performance.
- Bi-LSTM captures temporal dependencies, while the optimized CNN focuses on spatial features.
- CNN weights are optimized using SI-OPA, a nature-inspired algorithm mimicking orca hunting behavior.
- Extensive comparisons against state-of-the-art methods.
- Various image denoising methods: traditional algorithms and deep learning-based techniques.
- Approach: Diverse algorithms with different denoising strategies.
- Evaluation: Various performance metrics and visual assessments.
- Baseline for comparison against the proposed hybrid approach.
- A hybrid deep learning approach is proposed, combining Bi-LSTM and an optimized CNN, for the task of image denoising. Bi-LSTM is utilized to capture temporal dependencies in the image data, while the optimized CNN focuses on extracting spatial features. This combination aims to leverage the strengths of both architectures for improved denoising performance.
- The weights of the CNN model are optimized using SI-OPA. OPA is a nature-inspired optimization algorithm that mimics the hunting behavior of orcas. By applying OPA to the CNN training process, the algorithm aims to enhance the performance and convergence of the network. The OPA algorithm adapts the positions of the orcas, representing the CNN weights, based on a fitness function that evaluates the denoising performance.
- The performance of the proposed approach is compared against state-of-the-art image denoising methods. Various existing methods for image denoising, including traditional algorithms and deep learning-based techniques, are considered baselines. Through comprehensive evaluation metrics and visual assessments, the proposed hybrid approach is assessed in terms of denoising effectiveness, computational efficiency, and its ability to preserve image details and textures. The comparison aims to highlight the advantages and improvements offered by the proposed approach over existing methods.
2. Literature Review
3. Proposed Methodology
3.1. Data Collection
3.1.1. Pre-Processing
3.1.2. Skull Stripping
3.1.3. Gaussian Filtering
3.1.4. Histogram Equalization
3.2. Denoising
3.3. Bi-LSTM
3.4. Optimized CNN
- (a)
- Convolutional Layer
- (b)
- Activation Function
- (c)
- Pooling layer
3.5. Self-Improved Orca Predation Algorithm (SI-OPA)
3.5.1. Driving Phase
- Acceleration
- Memory And Learning
- Social Interactions
3.5.2. Encircling Phase
- Bubble net Formation
- Bubblenet Position Changes
- Adaptive Attack Speed
Algorithm 1: SI-OPA |
Input: population size, maximum number of iterations Output: best solution Begin Initialize SI-OPA parameters • Driving phase Acceleration: navigate the search space for better exploration and exploitation, velocity updated as per Equations (13) and (14) Memory and learning enable orcas to remain successful solutions, inform decisions and enhance algorithm performance as per Equation (15) Social interaction in SI-OPA enable orcas to share information, co-operate and enhance search space exploration. • Encircling phase Update the position using Equations (17) and (18) with bubblenet formation for efficient collective hunting in SI-OPA. Fitness updation using Equation (19) Velocity update during attacking phase with adaptive attack speed based on proximity to prey and iteration using Equations (21) and (22). Update the new position as per Equation (23). End |
4. Result and Discussion
4.1. Dataset Description
4.2. Overall Performance Analysis
4.3. Overall Graphical Representation
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Bayhaqi, Y.A.; Hamidi, A.; Canbaz, F.; Navarini, A.A.; Cattin, P.C.; Zam, A. Deep-Learning-Based Fast Optical Coherence Tomography (OCT) Image Denoising for Smart Laser Osteotomy. IEEE Trans. Med. Imaging 2022, 41, 2615–2628. [Google Scholar] [CrossRef]
- Liu, H.; Yousefi, H.; Mirian, N.; Lin, M.; Menard, D.; Gregory, M.; Aboian, M.; Boustani, A.; Chen, M.K.; Saperstein, L.; et al. PET Image Denoising Using a Deep-Learning Method for Extremely Obese Patients. IEEE Trans. Radiat. Plasma Med. Sci. 2022, 6, 766–770. [Google Scholar] [CrossRef]
- Wu, Q.; Tang, H.; Liu, H.; Chen, Y. Masked Joint Bilateral Filtering via Deep Image Prior for Digital X-Ray Image Denoising. IEEE J. Biomed. Health Inform. 2022, 26, 4008–4019. [Google Scholar] [CrossRef] [PubMed]
- Yang, Q.; Yan, P.; Zhang, Y.; Yu, H.; Shi, Y.; Mou, X.; Kalra, M.K.; Zhang, Y.; Sun, L.; Wang, G. Low-Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Loss. IEEE Trans. Med. Imaging 2018, 37, 1348–1357. [Google Scholar] [CrossRef]
- Lee, K.; Jeong, W.-K. ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising. IEEE Trans. Med. Imaging 2021, 40, 3238–3248. [Google Scholar] [CrossRef]
- Geng, M.; Meng, X.; Yu, J.; Zhu, L.; Jin, L.; Jiang, Z.; Qiu, B.; Li, H.; Kong, H.; Yuan, J.; et al. Content-Noise Complementary Learning for Medical Image Denoising. IEEE Trans. Med. Imaging 2022, 41, 407–419. [Google Scholar] [CrossRef] [PubMed]
- Li, Y.; Zhang, K.; Shi, W.; Miao, Y.; Jiang, Z. A novel medical image denoising method based on conditional generative adversarial network. Comput. Math. Methods Med. 2021, 2021, 9974017. [Google Scholar] [CrossRef] [PubMed]
- Sun, H.; Peng, L.; Zhang, H.; He, Y.; Cao, S.; Lu, L. Dynamic PET Image Denoising Using Deep Image Prior Combined with Regularization by Denoising. IEEE Access 2021, 9, 52378–52392. [Google Scholar] [CrossRef]
- Diwakar, M.; Singh, P. CT image denoising using multivariate model and its method noise thresholding in non-subsampled shearlet domain. Biomed. Signal Process. Control 2020, 57, 101754. [Google Scholar] [CrossRef]
- Tian, C.; Xu, Y.; Li, Z.; Zuo, W.; Fei, L.; Liu, H. Attention-guided CNN for image denoising. Neural Netw. 2020, 124, 117–129. [Google Scholar] [CrossRef] [PubMed]
- Dehner, C.; Olefir, I.; Chowdhury, K.B.; Jüstel, D.; Ntziachristos, V. Deep-Learning-Based Electrical Noise Removal Enables High Spectral Optoacoustic Contrast in Deep Tissue. IEEE Trans. Med. Imaging 2022, 41, 3182–3193. [Google Scholar] [CrossRef]
- Liu, N.; Wang, J.; Gao, J.; Chang, S.; Lou, Y. Similarity-informed self-learning and its application on seismic image denoising. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5921113. [Google Scholar] [CrossRef]
- Prakash, M.; Krull, A.; Jug, F. Fully unsupervised diversity denoising with convolutional variational autoencoders. arXiv 2020, arXiv:2006.06072. [Google Scholar]
- El Helou, M.; Süsstrunk, S. Blind universal Bayesian image denoising with Gaussian noise level learning. IEEE Trans. Image Process. 2020, 29, 4885–4897. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Quan, Y.; Chen, Y.; Shao, Y.; Teng, H.; Xu, Y.; Ji, H. Image denoising using complex-valued deep CNN. Pattern Recognit. 2021, 111, 107639. [Google Scholar] [CrossRef]
- Tian, C.; Zheng, M.; Zuo, W.; Zhang, B.; Zhang, Y.; Zhang, D. Multi-stage image denoising with the wavelet transform. Pattern Recognit. 2023, 134, 109050. [Google Scholar] [CrossRef]
- Thanh, D.N.H.; Engínoğlu, S. An iterative mean filter for image denoising. IEEE Access 2019, 7, 167847–167859. [Google Scholar]
- Tian, C.; Xu, Y.; Zuo, W. Image denoising using deep CNN with batch renormalization. Neural Netw. 2020, 121, 461–473. [Google Scholar] [CrossRef]
- Geng, M.; Meng, X.; Zhu, L.; Jiang, Z.; Gao, M.; Huang, Z.; Qiu, B.; Hu, Y.; Zhang, Y.; Ren, Q.; et al. Triplet Cross-Fusion Learning for Unpaired Image Denoising in Optical Coherence Tomography. IEEE Trans. Med. Imaging 2022, 41, 3357–3372. [Google Scholar] [CrossRef] [PubMed]
- Tirer, T.; Giryes, R. Super-Resolution via Image-Adapted Denoising CNNs: Incorporating External and Internal Learning. IEEE Signal Process. Lett. 2019, 26, 1080–1084. [Google Scholar] [CrossRef] [Green Version]
- Dong, W.; Wang, H.; Wu, F.; Shi, G.; Li, X. Deep Spatial–Spectral Representation Learning for Hyperspectral Image Denoising. IEEE Trans. Comput. Imaging 2019, 5, 635–648. [Google Scholar] [CrossRef]
- Hashimoto, F.; Ohba, H.; Ote, K.; Teramoto, A.; Tsukada, H. Dynamic PET Image Denoising Using Deep Convolutional Neural Networks without Prior Training Datasets. IEEE Access 2019, 7, 96594–96603. [Google Scholar] [CrossRef]
- Kokkinos, F.; Lefkimmiatis, S. Iterative Joint Image Demosaicking and Denoising Using a Residual Denoising Network. IEEE Trans. Image Process. 2019, 28, 4177–4188. [Google Scholar] [CrossRef] [Green Version]
- Liu, D.; Wen, B.; Jiao, J.; Liu, X.; Wang, Z.; Huang, T.S. Connecting Image Denoising and High-Level Vision Tasks via Deep Learning. IEEE Trans. Image Process. 2020, 29, 3695–3706. [Google Scholar] [CrossRef] [Green Version]
- Wu, D.; Ren, H.; Li, Q. Self-Supervised Dynamic CT Perfusion Image Denoising with Deep Neural Networks. IEEE Trans. Radiat. Plasma Med. Sci. 2021, 5, 350–361. [Google Scholar] [CrossRef]
- Li, K.; Zhou, W.; Li, H.; Anastasio, M.A. Assessing the Impact of Deep Neural Network-Based Image Denoising on Binary Signal Detection Tasks. IEEE Trans. Med. Imaging 2021, 40, 2295–2305. [Google Scholar] [CrossRef] [PubMed]
- Ma, J.; Peng, C.; Tian, X.; Jiang, J. DBDnet: A Deep Boosting Strategy for Image Denoising. IEEE Trans. Multimed. 2022, 24, 3157–3168. [Google Scholar] [CrossRef]
- Chen, K.; Pu, X.; Ren, Y.; Qiu, H.; Lin, F.; Zhang, S. TEMDnet: A Novel Deep Denoising Network for Transient Electromagnetic Signal with Signal-to-Image Transformation. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5900318. [Google Scholar] [CrossRef]
- Bahnemiri, S.G.; Ponomarenko, M.; Egiazarian, K. Learning-Based Noise Component Map Estimation for Image Denoising. IEEE Signal Process. Lett. 2022, 29, 1407–1411. [Google Scholar] [CrossRef]
- Wang, Z.; Ng, M.K.; Zhuang, L.; Gao, L.; Zhang, B. Non-local Self-Similarity-Based Hyperspectral Remote Sensing Image Denoising with 3-D Convolutional Neural Network. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5531617. [Google Scholar]
- Le, T.; Vo, M.T.; Vo, B.; Hwang, E.; Rho, S.; Baik, S.W. Improving electric energy consumption prediction using CNN and Bi-LSTM. Appl. Sci. 2019, 9, 4237. [Google Scholar] [CrossRef] [Green Version]
- Albawi, S.; Bayat, O.; Al-Azawi, S.; Ucan, O.N. Social touch gesture recognition using convolutional neural network. Comput. Intell. Neurosci. 2018, 2018, 973103. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Emam, M.M.; El-Sattar, H.A.; Houssein, E.H.; Kamel, S. Modified orca predation algorithm: Developments and perspectives on global optimization and hybrid energy systems. Neural Comput. Appl. 2023, 35, 15051–15073. [Google Scholar] [CrossRef]
- Myntra Fashion Product Dataset. Available online: https://www.kaggle.com/datasets/hiteshsuthar101/myntra-fashion-product-dataset (accessed on 25 May 2023).
Author | Aim | Methods | Advantage | Disadvantage |
---|---|---|---|---|
Wu et al. [25] | Develop self-supervised deep learning for CTP denoising without high-dose reference images, improving acute ischemic stroke diagnosis. | Train network to map CTP frames, removing noise independently in the source and target, validated on real and simulated datasets. | Eliminates need for high-dose images, facilitates adaptation to different protocols and improves image quality, spatial resolution, and contrast-to-noise ratio. | Performance reliant on dataset quality and size, potentially limited effectiveness if dataset is limited or biased. |
Ma et al. [27] | Introduce DBDnet, a deep boosting denoising net, to improve image denoising by eliminating noise of the noise map. | Utilize residual learning to generate a noise map and progressively reduce noise of the noise map via boosting function. | Effective denoising, theoretical analysis, NoN-eliminating module outperforms state-of-the-art methods in Gaussian and real image denoising. | Performance subject to noise levels, potential sensitivity to input variations and computational complexity not discussed in detail. |
Bahnemiri et al. [29] | Propose a deep CNN-based method for estimating sigma-map to address non-stationary noise in image denoising. | Use deep CNN to estimate a local patch-wise standard deviation map (sigma-map) for non-stationary noise removal. | Achieves state-of-the-art accuracy in sigma-map estimation for non-stationary noise and outperforms other methods in denoising flexibility and PSNR. | Still requires noise estimation, performance may vary based on noise levels, CNN-based approach may have computational overhead. |
Li et al. [26] | Evaluate DNN-based denoising methods for medical images using task-based IQ measures to assess their impact on signal detection tasks. | Employ task-based IQ measures for binary signal detection tasks under SKE with BKS conditions to quantify denoising impact. | Provides objective evaluation of DNN-based denoising methods and assesses denoising network depth’s impact on task performance. | Task-specific evaluation may not cover all aspects of denoising, limited to binary signal detection tasks in specific conditions. |
Hashimoto et al. [22] | Propose dynamic PET image denoising using a deep image prior (DIP) approach without pre-training or large datasets. | Employ DIP method with static PET data as input and dynamic PET images as labels for denoising. | Doesn’t require large datasets or pre-training, produces less noisy and more accurate dynamic PET images and is applicable to low-dose PET imaging. | Limited to PET image denoising, may not fully generalize to other medical imaging tasks or modalities. |
PSNR | OPA | Bi-LSTM | CNN | ISCL | Proposed |
---|---|---|---|---|---|
Image 1 | 20.746605 | 25.309635 | 26.057357 | 29.670801 | 33.970612 |
Image 2 | 22.015400 | 24.291343 | 27.803250 | 29.935921 | 32.459123 |
Image 3 | 23.906961 | 27.426644 | 28.677967 | 29.453383 | 31.565056 |
Image 4 | 22.167478 | 25.754681 | 27.452890 | 30.045432 | 31.476256 |
Image 5 | 20.177721 | 24.068178 | 24.278986 | 29.264613 | 29.340515 |
SSIM | OPA | Bi-LSTM | CNN | ISCL | Proposed |
---|---|---|---|---|---|
Image 1 | 0.785890 | 0.813365 | 0.753839 | 0.840116 | 0.841548 |
Image 2 | 0.840124 | 0.834619 | 0.702283 | 0.849532 | 0.890331 |
Image 3 | 0.704974 | 0.614622 | 0.644379 | 0.742919 | 0.799917 |
Image 4 | 0.827343 | 0.755377 | 0.762549 | 0.927048 | 0.942487 |
Image 5 | 0.799414 | 0.689810 | 0.711497 | 0.753433 | 0.877609 |
Metrics | CGAN—JSRT Datasets [7] | SURE-LET [9], σ = 20 | Proposed |
---|---|---|---|
PSNR | 33.264 | 23.5677 | 33.9706 |
SSIM | 0.9206 | 0.8234 | 0.8415 |
Statistical Analysis | OPA | Bi-LSTM | CNN | ISCL [5] | Proposed |
---|---|---|---|---|---|
Image 1 | 0.791549 | 0.741559 | 0.714910 | 0.822610 | 0.870378 |
Image 2 | 0.799414 | 0.755377 | 0.711497 | 0.840116 | 0.877609 |
Image 3 | 0.052985 | 0.090551 | 0.047251 | 0.075952 | 0.053493 |
Image 4 | 0.704974 | 0.614622 | 0.644379 | 0.742919 | 0.799917 |
Image 5 | 0.840124 | 0.834619 | 0.762549 | 0.927048 | 0.942487 |
Ablation | D = 3 | D = 5 | D = 10 | D = 15 | D = 20 |
---|---|---|---|---|---|
Image 1 | 0.829547 | 0.824112 | 0.693441 | 0.838836 | 0.879122 |
Image 2 | 0.696099 | 0.606884 | 0.636266 | 0.733566 | 0.789846 |
Image 3 | 0.775995 | 0.803125 | 0.744348 | 0.829539 | 0.830953 |
Image 4 | 0.789349 | 0.681125 | 0.702540 | 0.743947 | 0.866560 |
Image 5 | 0.816927 | 0.745867 | 0.752949 | 0.915377 | 0.930621 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Jebur, R.S.; Zabil, M.H.B.M.; Hammood, D.A.; Cheng, L.K.; Al-Naji, A. Image Denoising Using Hybrid Deep Learning Approach and Self-Improved Orca Predation Algorithm. Technologies 2023, 11, 111. https://doi.org/10.3390/technologies11040111
Jebur RS, Zabil MHBM, Hammood DA, Cheng LK, Al-Naji A. Image Denoising Using Hybrid Deep Learning Approach and Self-Improved Orca Predation Algorithm. Technologies. 2023; 11(4):111. https://doi.org/10.3390/technologies11040111
Chicago/Turabian StyleJebur, Rusul Sabah, Mohd Hazli Bin Mohamed Zabil, Dalal Abdulmohsin Hammood, Lim Kok Cheng, and Ali Al-Naji. 2023. "Image Denoising Using Hybrid Deep Learning Approach and Self-Improved Orca Predation Algorithm" Technologies 11, no. 4: 111. https://doi.org/10.3390/technologies11040111
APA StyleJebur, R. S., Zabil, M. H. B. M., Hammood, D. A., Cheng, L. K., & Al-Naji, A. (2023). Image Denoising Using Hybrid Deep Learning Approach and Self-Improved Orca Predation Algorithm. Technologies, 11(4), 111. https://doi.org/10.3390/technologies11040111