SCDet: A Robust Approach for the Detection of Skin Lesions
Abstract
:1. Introduction
- To propose an automated robust method to detect skin cancer from skin images with high accuracy;
- The technique is based on a novel architecture of a convolutional neural network (CNN). We have utilized 32 layers including image input as the first layer, and 30 layers in between including an output layer. This model makes possible an effective detection of benign and malignant skin lesions through these layers;
- The utilization of a dropout layer has regularization properties that help the SCDet to minimize overfitting;
- We performed a comparative analysis with existing deep learning models, i.e., SqueezeNet, AlexNet, and VGG16. The results show that SCDet outperformed the existing techniques;
- We assessed the performance using the Dermis Dataset containing 1000 samples of skin lesions, distributed into validation, training, and testing sets. The model provides 99.6% accuracy for skin lesion detection and we noticed that the results are remarkable for tiny tumours as well;
- We analysed that the proposed model utilized less computational cost than existing methods;
- We also compared the performance of SCDet with the existing techniques of machine learning (ML), segmentation, and deep learning (DL) models. We observed that our proposed model provides high performance in terms of accuracy and precision.
2. Related Work
3. Materials and Methods
3.1. Input Layer
3.2. Convolutional Layer
3.3. Batch Normalization Layer
- The batch-normalization layer is inserted to increase the convergence of training after the convolutional layer [39]. The input of activation function is normalized with additional scaling and shifting by inserting the batch normalization layer to overcome vanishing gradient before the sigmoid/ReLU/tanh hidden layer [40]. Two channel-wise sequential operations are performed with batch normalization; the first one is normalization and the second is an affine transformation. Normalization operation includes mean and variance of batch B of data consisting of n features. Equation (1) presents the formula to calculate the mean, Equation (2) shows variance, and Equation (3) calculates the normalization.
3.4. ReLU Layer
3.5. Max Pooling Layer
3.6. Fully Connected Layer
3.7. Softmax Layer
4. Experimentation Methods
4.1. Dataset Used
4.2. Environmental Setup
4.3. Validation
4.4. Comparison with Existing Pre-Trained Models
4.4.1. Alex Net
4.4.2. SqueezeNet
4.4.3. VGG16
4.5. Comparison with Machine Learning Techniques
4.6. Comparison with Segmentation-Based Techniques
4.7. Comparison with Existing DL-Based Skin Cancer Detectors
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Latif, J.; Xiao, C.; Imran, A.; Tu, S. Medical Imaging using Machine Learning and Deep Learning Algorithms: A Review. In Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Sukkur, Pakistan, 30–31 January 2019; pp. 1–5. [Google Scholar] [CrossRef]
- Zemouri, R.; Zerhouni, N.; Racoceanu, D. Deep Learning in the Biomedical Applications: Recent and Future Status. Appl. Sci. 2019, 9, 1526. [Google Scholar] [CrossRef]
- Ravishankar, S.; Ye, J.C.; Fessler, J.A. Image Reconstruction: From Sparsity to Data-Adaptive Methods and Machine Learning. Proc. IEEE 2019, 108, 86–109. [Google Scholar] [CrossRef] [PubMed]
- Qiu, L.; Kantekure, K.; Vitkin, E.; Itzkan, I.; Perelman, L.T.; Zhang, L.; Turzhitsky, V.; Khan, U.; Zakharov, Y.; Pleskow, D.K.; et al. Multispectral Endoscopy With Light Gating for Early Cancer Detection. IEEE J. Sel. Top. Quantum Electron. 2018, 25, 1–9. [Google Scholar] [CrossRef] [PubMed]
- Pardo, A.; Streeter, S.S.; Maloney, B.W.; Gutierrez-Gutierrez, J.A.; McClatchy, D.M.; Wells, W.A.; Paulsen, K.D.; Lopez-Higuera, J.M.; Pogue, B.W.; Conde, O.M. Modeling and Synthesis of Breast Cancer Optical Property Signatures With Generative Models. IEEE Trans. Med. Imaging 2021, 40, 1687–1701. [Google Scholar] [CrossRef]
- Song, H.; Sasada, S.; Masumoto, N.; Kadoya, T.; Okada, M.; Arihiro, K.; Xiao, X.; Kikkawa, T. A Two-Stage Rotational Surface Clutter Suppression Method for Microwave Breast Imaging With Multistatic Impulse-Radar Detector. IEEE Trans. Instrum. Meas. 2020, 69, 9586–9598. [Google Scholar] [CrossRef]
- Song, H.; Sasada, S.; Masumoto, N.; Kadoya, T.; Shiroma, N.; Orita, M.; Arihiro, K.; Okada, M.; Kikkawa, T. Detectability of Breast Tumors in Excised Breast Tissues of Total Mastectomy by IR-UWB-Radar-Based Breast Cancer Detector. IEEE Trans. Biomed. Eng. 2018, 66, 2296–2305. [Google Scholar] [CrossRef] [PubMed]
- Wang, W.; Ye, C.; Zhang, S.; Xu, Y.; Wang, K. Improving Whole-Heart CT Image Segmentation by Attention Mechanism. IEEE Access 2019, 8, 14579–14587. [Google Scholar] [CrossRef]
- Han, Y.; Kim, J.; Ye, J.C. Differentiated Backprojection Domain Deep Learning for Conebeam Artifact Removal. IEEE Trans. Med. Imaging 2020, 39, 3571–3582. [Google Scholar] [CrossRef]
- Haris, M.H.M.; Mahum, R.; Nafees, M.; Aitaza, M.; Irtaza, A. An Automated Framework for Corona Virus Severity Detection using Combination of AlexNet and Faster RCNN. Int. J. Innov. Sci. Technol. 2021, 3, 197–209. [Google Scholar] [CrossRef]
- Mahum, R.; Rehman, S.U.; Okon, O.D.; Alabrah, A.; Meraj, T.; Rauf, H.T. A Novel Hybrid Approach Based on Deep CNN to Detect Glaucoma Using Fundus Imaging. Electronics 2021, 11, 26. [Google Scholar] [CrossRef]
- Phan, T.-D.-T.; Kim, S.H. Skin Lesion Segmentation by U-Net with Adaptive Skip Connection and Structural Awareness. Appl. Sci. 2021, 11, 4528. [Google Scholar] [CrossRef]
- Marosán-Vilimszky, P.; Szalai, K.; Horváth, A.; Csabai, D.; Füzesi, K.; Csány, G.; Gyöngy, M. Automated skin lesion classification on ultrasound images. Diagnostics 2021, 11, 1207. [Google Scholar] [CrossRef] [PubMed]
- Khamparia, A.; Singh, P.K.; Rani, P.; Samanta, D.; Khanna, A.; Bhushan, B. An internet of health things-driven deep learning framework for detection and classification of skin cancer using transfer learning. Trans. Emerg. Telecommun. Technol. 2020, 32, 7. [Google Scholar] [CrossRef]
- Vidya, M.; Karki, M.V. Skin Cancer Detection using Machine Learning Techniques. In Proceedings of the 2020 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), Bangalore, India, 2–4 July 2020; pp. 1–5. [Google Scholar] [CrossRef]
- Jasil, S.G.; Ulagamuthalvi, V. Skin Lesion Classification Using Pre-Trained DenseNet201 Deep Neural Network. In Proceedings of the 3rd International Conference on Signal Processing and Communication (ICPSC), Tamil Nadu, India, 4 May 2021. [Google Scholar]
- Setiawan, A.W. Image Segmentation Metrics in Skin Lesion: Accuracy, Sensitivity, Specificity, Dice Coefficient, Jaccard Index, and Matthews Correlation Coefficient. In Proceedings of the 2020 International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM), Online, 17–18 November 2020. [Google Scholar]
- Goyal, M.; Oakley, A.; Bansal, P.; Dancey, D.; Yap, M.H. Skin Lesion Segmentation in Dermoscopic Images With Ensemble Deep Learning Methods. IEEE Access 2019, 8, 4171–4181. [Google Scholar] [CrossRef]
- Wei, L.; Ding, K.; Hu, H. Automatic Skin Cancer Detection in Dermoscopy Images Based on Ensemble Lightweight Deep Learning Network. IEEE Access 2020, 8, 99633–99647. [Google Scholar] [CrossRef]
- Hasan, H.A.; Ibrahim, A.A. Hybrid Detection Techniques for Skin Cancer Images. In Proceedings of the 4th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), Ankara, Turkey, 26–28 October 2020. [Google Scholar]
- Ansari, U.B.; Sarode, T. Skin cancer detection using image processing. Int. Res. J. Eng. Technol. 2017, 4, 2875–2881. [Google Scholar]
- Ibraheem, M.R.; Elmogy, M. A Non-invasive Automatic Skin Cancer Detection System for Characterizing Malignant Melanoma from Seborrheic Keratosis. In Proceedings of the 2nd International Conference on Computer and Information Sciences (ICCIS), Sakaka, Saudi Arabia, 13–15 October 2020; pp. 1–5. [Google Scholar] [CrossRef]
- Rahajeng, A.C.D.; Nuh, M.; Hikmah, N.F. An Evaluation Performance of Kernel on Support Vector Machine to Classify The Skin Tumors in Dermoscopy Image. In Proceedings of the International Conference on Computer Engineering, Network, and Intelligent Multimedia (CENIM), Online, 17–18 November 2020; pp. 76–81. [Google Scholar] [CrossRef]
- Jayalakshmi, G.; Kumar, V.S. Performance analysis of Convolutional Neural Network (CNN) based Cancerous Skin Lesion Detection System. In Proceedings of the International Conference on Computational Intelligence in Data Science (ICCIDS), Gurgaon, India, 6–7 September 2019. [Google Scholar] [CrossRef]
- Rehman, M.U.; Khan, S.H.; Rizvi, S.M.D.; Abbas, Z.; Zafar, A. Classification of Skin Lesion by Interference of Segmentation and Convolotion Neural Network. In Proceedings of the 2nd International Conference on Engineering Innovation (ICEI), Bangkok, Thailand, 5–6 July 2018; pp. 81–85. [Google Scholar] [CrossRef]
- Filali, Y.; El Khoukhi, H.; Sabri, M.A.; Yahyaouy, A.; Aarab, A. Texture Classification of skin lesion using convolutional neural network. In Proceedings of the International Conference on Wireless Technologies, Embedded and Intelligent Systems (WITS), Fez, Morocco, 3–4 April 2019; pp. 1–5. [Google Scholar] [CrossRef]
- Rezaoana, N.; Hossain, M.S.; Andersson, K. Detection and classification of skin cancer by using a parallel CNN model. In Proceedings of the IEEE International Women in Engineering (WIE) Conference on Electrical and Computer Engineering (WIECON-ECE), Bhubaneswar, India, 15–16 November 2020. [Google Scholar]
- Adegun, A.A.; Viriri, S. Deep Learning-Based System for Automatic Melanoma Detection. IEEE Access 2019, 8, 7160–7172. [Google Scholar] [CrossRef]
- Razzak, I.; Shoukat, G.; Naz, S.; Khan, T.M. Skin Lesion Analysis Toward Accurate Detection of Melanoma using Multistage Fully Connected Residual Network. In Proceedings of the 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK, 19–24 July 2020; pp. 1–8. [Google Scholar] [CrossRef]
- Raut, G.; Raut, A.; Bhagade, J.; Bhagade, J.; Gavhane, S. Deep Learning Approach for Brain Tumor Detection and Segmentation. In Proceedings of the International Conference on Convergence to Digital World-Quo Vadis (ICCDW), Mumbai, India, 18–20 February 2020. [Google Scholar]
- Alkarakatly, T.; Eidhah, S.; Al-Sarawani, M.; Al-Sobhi, A.; Bilal, M. Skin lesions identification using deep convolutional neural network. In Proceedings of the International Conference on Advances in the Emerging Computing Technologies (AECT), Al Madinah Al Munawwarah, Saudi Arabia, 10 February 2020. [Google Scholar]
- Kondaveeti, H.K.; Edupuganti, P. Skin Cancer Classification using Transfer Learning. In Proceedings of the IEEE International Conference on Advent Trends in Multidisciplinary Research and Innovation (ICATMRI), Buldhana, India, 30 December 2020. [Google Scholar]
- Islam, K.; Ali, S.; Ali, M.; Haque, M.F.; Das, A.A.; Hossain, M.; Duranta, D.S.; Rahman, A. Melanoma Skin Lesions Classification using Deep Convolutional Neural Network with Transfer Learning. In Proceedings of the 2021 1st International Conference on Artificial Intelligence and Data Analytics (CAIDA), Riyadh, Saudi Arabia, 6–7 April 2021; pp. 48–53. [Google Scholar] [CrossRef]
- Dhar, P.; Guha, S. Skin lesion detection using fuzzy approach and classification with CNN. Int. J. Eng. Manuf. 2021, 11, 11–18. [Google Scholar] [CrossRef]
- Afza, F.; Sharif, M.; Mittal, M.; Khan, M.A.; Jude Hemanth, D. A hierarchical three-step superpixels and deep learning framework for skin lesion classification. Methods 2021, 202, 88–102. [Google Scholar] [CrossRef]
- Albawi, S.; Mohammed, T.A.; Al-Zawi, S. Understanding of a convolutional neural network. In Proceedings of the International Conference on Engineering and Technology (ICET), Antalya, Turkey, 21–23 August 2017. [Google Scholar]
- Iranpoor, R.; Mahboob, A.S.; Shahbandegan, S.; Baniasadi, N. Skin lesion segmentation using convolutional neural networks with improved U-Net architecture. In Proceedings of the 6th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS), Mashhad, Iran, 23–24 December 2020; pp. 1–5. [Google Scholar] [CrossRef]
- Sarıgül, M.; Ozyildirim, B.; Avci, M. Differential convolutional neural network. Neural Netw. 2019, 116, 279–287. [Google Scholar] [CrossRef]
- Ting, Y.-S.; Teng, Y.-F.; Chiueh, T.-D. Batch Normalization Processor Design for Convolution Neural Network Training and Inference. In Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS), Daegu, Republic of Korea, 22–28 May 2021; pp. 1–4. [Google Scholar] [CrossRef]
- Na, W.; Liu, K.; Zhang, W.; Xie, H.; Jin, D. Deep Neural Network with Batch Normalization for Automated Modeling of Microwave Components. In Proceedings of the IEEE MTT-S International Conference on Numerical Electromagnetic and Multiphysics Modeling and Optimization (NEMO), Hangzhou, China, 7–9 December 2020. [Google Scholar]
- Farhat Ullah. Skin Lesion Dermis Dataset. 2022. Available online: https://www.kaggle.com/datasets/farhatullah8398/skin-lesion-dermis-dataset (accessed on 15 July 2022).
- Mahum, R.; Munir, H.; Mughal, Z.-U.; Awais, M.; Khan, F.S.; Saqlain, M.; Mahamad, S.; Tlili, I. A novel framework for potato leaf disease detection using an efficient deep learning model. Hum. Ecol. Risk Assess. Int. J. 2022, 29, 303–326. [Google Scholar] [CrossRef]
- Tschandl, P.; Rosendahl, C.; Kittler, H. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. Sci. Data 2018, 5, 180161. [Google Scholar] [CrossRef] [PubMed]
- Krizhevsky, A.; Sutskever, I.; Hinton, G.E. Imagenet classification with deep convolutional neural networks. Commun. ACM 2017, 60, 84–90. [Google Scholar] [CrossRef]
- Sadhana, S.; Mallika, R. An intelligent technique for detection of diabetic retinopathy using improved alexnet model based convoluitonal neural network. J. Intell. Fuzzy Syst. 2021, 40, 7623–7634. [Google Scholar] [CrossRef]
- Iandola, F.N.; Han, S.; Moskewicz, M.W.; Ashraf, K.; Dally, W.J.; Keutzer, K. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv 2016, arXiv:1602.07360. [Google Scholar]
- Nakamichi, K.; Lu, H.; Kim, H.; Yoneda, K.; Tanaka, F. Classification of Circulating Tumor Cells in Fluorescence Microscopy Images Based on SqueezeNet. In Proceedings of the 19th International Conference on Control, Automation and Systems (ICCAS), Jeju, Republic of Korea, 15–18 October 2019; pp. 1042–1045. [Google Scholar]
- Akpinar, K.N.; Genc, S.; Karagol, S. Chest X-ray Abnormality Detection Based on SqueezeNet. In Proceedings of the International Conference on Electrical, Communication, and Computer Engineering (ICECCE), Istanbul, Turkey, 2–13 June 2020; pp. 1–5. [Google Scholar] [CrossRef]
- Simonyan, K.; Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv 2014, arXiv:1409.1556. [Google Scholar]
- Panthakkan, A.; Anzar, S.M.; Mansoori, S.A.; Ahmad, A. Accurate Prediction of COVID-19 (+) Using AI Deep VGG16 Model. In Proceedings of the 3rd International Conference on Signal Processing and Information Security (ICSPIS), Dubai, United Arab Emirates, 7–8 December 2020. [Google Scholar]
- Aung, H.; Bobkov, A.V.; Tun, N.L. Face Detection in Real Time Live Video Using Yolo Algorithm Based on Vgg16 Convolutional Neural Network. In Proceedings of the International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM), Sochi, Russia, 17–21 May 2021; pp. 697–702. [Google Scholar] [CrossRef]
- Waheed, Z.; Waheed, A.; Zafar, M.; Riaz, F. An efficient machine learning approach for the detection of melanoma using dermoscopic images. In Proceedings of the International Conference on Communication, Computing and Digital Systems (C-CODE), Islamabad, Pakistan, 8–9 March 2017; pp. 316–319. [Google Scholar] [CrossRef]
- Mhaske, H.R.; Phalke, D.A. Melanoma skin cancer detection and classification based on supervised and unsupervised learning. In Proceedings of the international conference on Circuits, Controls and Communications (CCUBE), Bengaluru, India, 27–28 December 2013; pp. 1–5. [Google Scholar] [CrossRef]
- Zghal, N.S.; Derbel, N. Melanoma skin cancer detection based on image processing. Curr. Med. Imaging 2020, 16, 50–58. [Google Scholar] [CrossRef] [PubMed]
- Araújo, R.L.; de Andrade, L.R.R.; Rodrigues, J.J.P.C.; Silva, R.R.V.E. Automatic segmentation of melanoma skin cancer using deep learning. In Proceedings of the IEEE International Conference on E-health Networking, Application & Services (HEALTHCOM), Shenzhen, China, 1–2 March 2021. [Google Scholar]
- Majumder, S.; Ullah, M.A.; Dhar, J.P. Melanoma diagnosis from dermoscopy images using artificial neural network. In Proceedings of the 5th International Conference on Advances in Electrical Engineering (ICAEE), Dhaka, Bangladesh, 26–28 September 2019. [Google Scholar]
- Varma, P.B.S.; Paturu, S.; Mishra, S.; Rao, B.S.; Kumar, P.M.; Krishna, N.V. SLDCNet: Skin lesion detection and classification using full resolution convolutional network-based deep learning CNN with transfer learning. Expert Syst. 2022, 39, e12944. [Google Scholar] [CrossRef]
Ref | Year | Classes of Skin Lesions | Model Type | Model | Activation Function | Dataset Used | Accuracy |
---|---|---|---|---|---|---|---|
[28] | 2019 | Melanoma, Non-Melanoma | supervised | CNN | ReLU | ISIC 2017, PH2 | 95% |
[29] | 2020 | NV, VASC, DF, BCC, MEL, AKIEC, BKL | supervised | CNN | ReLU | ISIC 2019 | 96% |
[30] | 2020 | Melanoma, Nevus, Seborrheic Keratosis | supervised | CNN | softmax | ISIC2018, HAM10000 | 86% |
[20] | 2020 | Binary | supervised | CNN | ReLU | ISIC | 80% |
[31] | 2020 | Melanoma, common Nevus, atypical Nevus, | supervised | CNN | softmax | PH2 | 95.0% |
[32] | 2020 | NV, DF, BKL VASC, MEL, BCC, AKIEC | supervised | CNN | ReLU | HAM1000 | 90% |
[33] | 2021 | Benign and malignant | supervised | CNN | SIGMOID | HAM10000 | 90.93% |
[34] | 2021 | Binary | supervised | CNN | - | Dermis | 95% |
[35] | 2022 | NV, DF, MEL, AKIEC, VASC, BCC, BKL | supervised | CNN | - | PH2 | 95% |
Type | Channel/Stride | Learnable | Activation |
---|---|---|---|
input | - | - | 227 × 227 × 3 |
4 × [Conv_1] | Stride [1 1] | Weights 3 × 3 × 3 × 32 | 227 × 227 × 32 |
Padding same | Bias 1 × 1 × 32 | ||
4 × [Conv_2] | Stride [1 1] | Weights 3 × 3 × 32 × 32 | 227 × 227 × 32 |
Padding same | |||
Bias 1 × 1 × 32 | |||
4 × [Batchnorm_1] | 32 channels | Scale 1 × 1 × 32 | 227 × 227 × 32 |
Offset 1 × 1 × 32 | |||
2 × [FC-1] | |||
4 × Relu_1 | - | - | 227 × 227 × 32 |
4 × [Maxpool_1] | Stride [1 1] | - | 227 × 227 × 32 |
Padding same | |||
5 × 5 max pooling | |||
4 × [Maxpool_2] | Stride [1 1] | - | 227 × 227 × 32 |
Padding same | |||
5 × 5 max pooling | |||
Fc_2 | - | Weights 2 × 10 | 1 × 1 × 2 |
Bias 2 × 1 | |||
Fc_3 | - | Weights 2 × 2 | 1 × 1 × 2 |
Bias 2 × 1 | |||
Fc_4 | - | Weights 2 × 2 | 1 × 1 × 2 |
Bias 2 × 1 | |||
softmax | - | - | 1 × 1 × 2 |
Class output | - | - | 1 × 1 × 2 |
Method | TP | FP | FN | TN | Recall | Specificity | Precision | Sensitivity | Accuracy |
---|---|---|---|---|---|---|---|---|---|
Proposed CNN | 49.6% | 0% | 0.4% | 50.0% | 100% | 99.2% | 99.2% | 100% | 99.6% |
Method | AlexNet | SqueezeNet | VGG16 | Proposed CNN on HAM1000 | Proposed CNN |
---|---|---|---|---|---|
Accuracy | 90% | 83% | 80% | 85% | 99% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Sikandar, S.; Mahum, R.; Ragab, A.E.; Yayilgan, S.Y.; Shaikh, S. SCDet: A Robust Approach for the Detection of Skin Lesions. Diagnostics 2023, 13, 1824. https://doi.org/10.3390/diagnostics13111824
Sikandar S, Mahum R, Ragab AE, Yayilgan SY, Shaikh S. SCDet: A Robust Approach for the Detection of Skin Lesions. Diagnostics. 2023; 13(11):1824. https://doi.org/10.3390/diagnostics13111824
Chicago/Turabian StyleSikandar, Shahbaz, Rabbia Mahum, Adham E. Ragab, Sule Yildirim Yayilgan, and Sarang Shaikh. 2023. "SCDet: A Robust Approach for the Detection of Skin Lesions" Diagnostics 13, no. 11: 1824. https://doi.org/10.3390/diagnostics13111824
APA StyleSikandar, S., Mahum, R., Ragab, A. E., Yayilgan, S. Y., & Shaikh, S. (2023). SCDet: A Robust Approach for the Detection of Skin Lesions. Diagnostics, 13(11), 1824. https://doi.org/10.3390/diagnostics13111824