Next Article in Journal
Validation of an RF Image System for Real-Time Tracking Neurosurgical Tools
Previous Article in Journal
Relationship between Tissue Gliding of the Lateral Thigh and Gait Parameters after Trochanteric Fractures
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reliable Sarcoidosis Detection Using Chest X-rays with EfficientNets and Stain-Normalization Techniques

1
Nursing Management and Education Department, College of Nursing, Princess Nourah Bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
2
Computer Science Department, College of Computer Science and Engineering in Yanbu, Taibah University, Medina 42353, Saudi Arabia
3
Information Systems Department, Faculty of Computers and Artificial Intelligence, Beni-Suef University, Beni-Suif 62521, Egypt
4
Department of Bioelectronics, Modern University of Technology and Information (MTI University), Cairo 12055, Egypt
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(10), 3846; https://doi.org/10.3390/s22103846
Submission received: 13 April 2022 / Revised: 5 May 2022 / Accepted: 17 May 2022 / Published: 19 May 2022
(This article belongs to the Topic Human–Machine Interaction)

Abstract

:
Sarcoidosis is frequently misdiagnosed as tuberculosis (TB) and consequently mistreated due to inherent limitations in radiological presentations. Clinically, to distinguish sarcoidosis from TB, physicians usually employ biopsy tissue diagnosis and blood tests; this approach is painful for patients, time-consuming, expensive, and relies on techniques prone to human error. This study proposes a computer-aided diagnosis method to address these issues. This method examines seven EfficientNet designs that were fine-tuned and compared for their abilities to categorize X-ray images into three categories: normal, TB-infected, and sarcoidosis-infected. Furthermore, the effects of stain normalization on performance were investigated using Reinhard’s and Macenko’s conventional stain normalization procedures. This procedure aids in improving diagnostic efficiency and accuracy while cutting diagnostic costs. A database of 231 sarcoidosis-infected, 563 TB-infected, and 1010 normal chest X-ray images was created using public databases and information from several national hospitals. The EfficientNet-B4 model attained accuracy, sensitivity, and precision rates of 98.56%, 98.36%, and 98.67%, respectively, when the training X-ray images were normalized by the Reinhard stain approach, and 97.21%, 96.9%, and 97.11%, respectively, when normalized by Macenko’s approach. Results demonstrate that Reinhard stain normalization can improve the performance of EfficientNet -B4 X-ray image classification. The proposed framework for identifying pulmonary sarcoidosis may prove valuable in clinical use.

1. Introduction

Tuberculosis (TB) is an infectious disease and one of the top 10 causes of death worldwide [1,2]. Despite major advances in tuberculosis control methods, such as improved vaccines and novel treatments, there are still difficulties in the development of quick and accurate TB testing procedures [3]. Multidrug-resistant tuberculosis (MDR TB) has emerged as the most difficult disease to treat, and it is spreading fast, demonstrating the pathogen’s adaptability [4]. Around 23% of the world’s population has latent tuberculosis [4,5]. In the developing world, tuberculosis is still a major, life-threatening disease, particularly in countries with high population density and poor sanitation. Tuberculosis elimination has become a major public health concern, and the urgency of the effort has been compounded by the advent of new tuberculosis bacillus strains that are resistant to standard medicines [6]. Extrapulmonary tuberculosis (EPTB) occurs when tuberculosis spreads outside of the lungs. Tuberculosis of the lungs (PTB) and EPTB may coexist. Asymptomatic people account for 15 to 20% of the population [7].
Sarcoidosis is a multisystemic granulomatous disease characterized by lumps in the lungs, skin, or lymph nodes produced by an abnormal inflammatory cell accumulation [8]. Sarcoidosis can often be cured without medication. Sarcoidosis is a clinically similar disease to tuberculosis with an unknown cause [9]. Sarcoidosis and PTB are both granulomatous diseases with comparable clinical-radiological presentations, making differentiation challenging in regions where they occur often [6].
These two diseases were long assumed to be the same because of their similar symptoms and histology. Although tuberculosis can be a side effect of sarcoidosis treatment, the two diseases rarely coexist. Despite this, there have been cases of tuberculosis and sarcoidosis coexisting, with symptoms ranging from pulmonary [10] to extrapulmonary [5] and presenting in a variety of ways. In several studies, MTB deoxyribonucleic acid (DNA) was associated with a large proportion of tissue and bronchoalveolar lavage samples from sarcoidosis patients. There have, however, been reports of deleterious consequences [2,11]. Differentiating tuberculosis and sarcoidosis can be difficult, especially in cases of mediastinal lymphadenopathy, because both diseases have similar clinical presentations and histopathologically identical granulomatous inflammation [12]. Tuberculosis diagnoses are now based mostly on microbiological confirmation, which is only attainable in 50% of cases [9]. As a result, better diagnostic approaches are needed to reduce morbidity as a result of delayed or inefficient treatment [13].
To diagnose and screen for pulmonary tuberculosis and sarcoidosis, chest X-rays (CXR) are widely employed [14,15,16]. Competent clinicians use chest radiography to diagnose tuberculosis and sarcoidosis in clinical practice. This is, however, a lengthy and subjective procedure. Low-resource countries (LRCs) also have a shortage of radiologists, especially in rural areas [17]. As a result, by analyzing chest X-ray images, computer-aided diagnostic tools can play an essential role in mass screening for pulmonary tuberculosis and sarcoidosis. Artificial intelligence-based solutions for a variety of medical applications, such as the identification of tumors, lung nodules, physiological monitoring, breast cancer, pneumonia, and social sensing, have recently been proposed [6,18].

2. Related Work

Convolutional neural networks (CNNs) are types of deep machine learning techniques that have shown a lot of promise in image classification and hence have a lot of support from the scientific community [6,19,20]. Deep learning techniques have become popular for diagnosing lung diseases based on chest radiographs since X-ray radiography is a low-cost imaging modality with many data for training machine learning algorithms. Traditional machine learning algorithms were used by several research groups [12,21,22] to distinguish normal patients from those with tuberculosis using CXR images. By adjusting CNN settings, deep machine learning techniques were applied to classify patients with tuberculosis [23,24,25]; using pre-trained models, transfer learning was used to detect patients with tuberculosis [26,27,28]. Hooda et al. [29] presented a deep learning method that properly identified CXR images as tuberculosis or normal cases with 82.09 % accuracy. Evalgelista et al. [26] reported an 88.76% accuracy rate for TB detection from chest X-ray images using CNNs. With an accuracy of 86.82%, Pasa et al. [27] suggested a deep network architecture for tuberculosis monitoring. A method for interactively monitoring TB instances was also mentioned. Nguyen et al. [28] used a DenseNet to categorize normal and TB images from the Montgomery County and Shenzhen datasets [30] and obtained AUC values of 0.82 and 0.94, respectively. Hernandez et al. [13] proposed an automated tuberculosis classification system based on X-ray images that used CNN and archival data (with an accuracy of 86%). Various pre-trained CNN architectures were used to classify chest radiographs into two categories, namely positive or negative for tuberculosis infection, according to Lopes et al. [31]. The system’s accuracy was determined to be 81% using two publicly available chest X-ray databases. Using four CNN models (GoogLeNet, RestNet50, VGG-16, and VGG-19), Meraj et al. [32] examined the accuracy limits for small- and large-scale CNN models in the classification of tuberculosis from chest X-rays. Ahsan et al. [33] presented a pre-trained CNN model for tuberculosis detection that had an 80% sensitivity. With an accuracy rate of 94.89%, Yadav et al. [34] used the transfer learning model to identify tuberculosis. Abbas et al. [35] presented a CNN model to improve the performance of ImageNet pre-trained CNN models and achieved high TB classification accuracy using the Japanese Society of Radiological Technology (JSRT) database. It should be mentioned that transfer learning techniques were also employed to classify TB culture test images. On labeled tuberculosis culture images, Chang et al. [12] employed the transfer learning method and achieved sensitivity and precision rates of 98 and 99%, respectively. Mahalakshmi et al. [11] used an Artificial Neural Network (ANN) to identify tuberculosis and sarcoidosis based on gene expression. Several machine learning algorithms were compared by Chen et al. [36]. They employed Decision Tree, Support Vector Machine, and Naive Bayes to classify TB and sarcoidosis. Kong et al. [37] established tuberculosis and sarcoidosis detection techniques based on Decision Trees.
Based on past literature reviews, a few different approaches to distinguishing between patients with sarcoidosis and those with tuberculosis have been presented. Furthermore, the number of research datasets is limited, making it difficult to employ machine learning models in the real world. To our knowledge, no other research using deep learning to distinguish pulmonary tuberculosis from sarcoidosis using chest X-ray images has been published. Using different deep learning algorithms, adjusting existing algorithms, or integrating several outperforming techniques into an ensemble model can improve classification performance. Because of the increasing availability of computational power, CNNs have become viable. Techniques for segmentation and feature extraction can be designed without expert topic knowledge; however, for a CNN to produce improved results, the dataset must be annotated. These networks can locate and extract critical information for image classification.
This research distinguishes between pulmonary tuberculosis and sarcoidosis using a CNN transfer-learning-based approach. Transfer learning allows pre-trained models to be reused for better diagnostic results. EfficientNet, AlexNet, ResNet50, VGG-16, and Inception V3 are some of the transfer learning models used in ensemble learning. The use of EfficientNets for X-ray image classification, according to the findings of this study, is a simple and basic technique that saves training time while keeping the same accuracy as previously proposed computationally expensive algorithms.

3. Research Contribution

The investigations pursued in this research study offer major contributions. To begin, seven EfficientNet models with transfer learning were examined for identifying chest X-ray images. The currently proposed method was successful in identifying and recognizing the overall features of an image. In the second step, the impact of the stain-normalization approach on image classification was evaluated. Finally, the EfficientNet models’ classification performance was compared to that of other CNN models, such as ResNet50, AlexNet, VGG16, and Inception V3. The goal of these comparisons was to see whether fine-tuned EfficientNets can categorize X-ray images as well as existing framework techniques. The paper is organized as follows: Section 1 is an introduction to the clinical differences between sarcoidosis and TB. The literature review in Section 2 delves in depth into prior effective techniques. Section 3 highlights the research contributions of the study. Section 4 offers a background description of training and transfer learning, as well as the methodology and approaches employed in this paper. The results and discussion thereof are found in Section 5. The findings of the study are summarized in Section 6.

4. Materials and Methods

4.1. Materials

To conduct this research, a combination of images from different sources was used. For TB and normal chest X-ray images, four publicly available datasets were examined. These datasets include Kaggle Chest X-rays and the accompanying lung mask dataset [38], the National Library of Medicine (NLM) dataset [39], the Belarus dataset [40], and the RSNA pneumonia detection challenge dataset [39]. For sarcoidosis, 231 datasets were obtained from six different national hospitals in Egypt. Table 1 shows the data collection sources for each class in tabular form. Figure 1 illustrates a selection of chest X-ray images and their classifications. In Figure 1b,c, it can be seen how difficult it is to visually distinguish sarcoidosis from TB.

4.2. Background

4.2.1. Training Convolutional Neural Networks (CNNs)

The input is routed across the network layers during the forward phase when training a CNN [19,41,42]. Gradients are back-propagated and neuron weights are updated during the backward phase. Layer l’s neuron I receives input from layer l-1’s neuron j in a forward pass computed as in Equation (1). The output is calculated using the ReLu function as in Equation (2).
I n i l = j = 1 n W i j l x j + b i
o u t i l = m ( 0 , I n i l )
A Conv layer, a max-pooling layer, and a SoftMax layer comprise the CNN’s three layers. The pooling layer slides the feature map (NN) into a square window (KK), and then picks the highest or average value of the features within the sliding. The classification probability of each class type is calculated in the final layer using the activation SoftMax function as in Equation (3).
o u t i l = e ln i l i e o u t k l
During the back-propagation phase, CNNs are trained by lowering the cost function in Equation (4).
C = 1 m j = i m ln p ( y j X j )
where:
  • m: the number of samples in the training dataset.
  • X j : the i t h sample with the label y j in the training dataset.
  • p ( y j X j ) : the probability of correct classification.
The cost function C is minimized using the stochastic gradient descent optimization technique, and the training cost is calculated using the mini-batch cost. Then, in the next iteration, weights are modified using the equations below:
γ t = γ t N m
V l t + 1 = μ V l t γ t α l C W l
W l t + 1 = W l t + V l t + 1
where:
  • W l t : the weights for layer l at iteration t
  • C: the cost of the mini-batch
  • α : the learning rate
  • α l : the layer l learning rate
  • γ : the rate of scheduling
  • μ : the impact of lastly updated weights of neurons in the recent iteration.

4.2.2. Transfer-Learning-Based Convolutional Neural Network

The neuronal weights of the CNN layers are updated using Equation (6) after each epoch during the training phase. For training and tuning, deep networks require a large dataset. However, for small datasets, locating the local minima for the cost function in Equation (5) is challenging, leading to the network being over-fitted. As a result, the pre-trained model was used to establish the weights. The pre-trained models used in this research are described below.

EfficientNet

By scaling down the model equally in all three dimensions, namely depth, width, and resolution, EfficientNet [43] achieves better results. There are seven models between B0 and B6 ; the number of parameters does not increase, but the model’s accuracy does. EfficientNet B0, the model from which all subsequent EfficientNet models are formed, is depicted schematically in Figure 2.
Depth, breadth, and resolution are the scaling dimensions of a Convolutional Neural Network (CNN). The number of layers within a network determines its depth, which is equivalent to its breadth. This is only a representation of the CNN’s network. The image resolution delivered to the CNN is referred to as resolution. EfficientNet uses a simple and effective scaling technique that utilizes a compound coefficient to equally scale network depth, breadth, and resolution, as Equations (8), (9) and (10) respectively.
depth d = α φ , α 1 ,
width w = β φ , β 1 ;
resolution r = γ φ , γ 1 ;
where α , β , and γ : are constants and determined using the aforementioned technique.
We use φ to denote a user-specified coefficient that determines how many resources are accessible, whereas α , β , and γ determine how these resources are allocated to network depth, width, and resolution, respectively. The compound scaling approach scales the baseline EfficientNet-B0 in two stages:
  • Set φ = 1, assuming that twice as many resources are available, and apply a grid search for α , β , and γ .
  • Set α , β , and γ as constants according to the values determined in the previous step and investigate with different values of φ . The different values of φ produce EfficientNets B0–B6. Table 2 shows the input sizes and the number of total parameters for each EfficientNet model.

VGG16

The VGG16 [44] design is based on the convolution and maximum pooling layers layout (Figure 3). There are three FC layers, with ReLU activating the first two and Softmax activating the third. The input layer may receive images with a size of 224 × 224 pixels, and the design contains 16 layers and 138 million parameters.

AlexNet

The AlexNet [45] model, which uses an 8-layer CNN architecture, has 61 million parameters. There are five convolutional layers in the AlexNet architecture (Figure 4), three fully connected layers, and finally, the Softmax layer, which requires an image with a resolution of 227 × 227 for input. The ReLU activation function is used in the convolutional and fully connected layers of this system. The fully connected layer (FC-8) of the AlexNet architecture is linked to the Softmax layer through 39 neurons. The output value of the Softmax layer is the ratio of the input image to the output, which is represented by the output.

ResNet50

The ResNet50 [46] architecture was designed to overcome difficulties such as non-linear layers, identity mappings that do not learn, and deterioration. A network made up of residual unit stacks is known as ResNet50 (Figure 5). Residual units are used as building components to construct the network. Convolution and pooling layers are used to create these units. The input images have a resolution of 224 × 224 pixels, and the design includes 3 × 3 filters.

Inception V3

The model includes symmetrical and asymmetrical building elements, such as convolutions, average pooling, maximum pooling, dropouts, and entirely connected layers (Figure 6). The Softmax function founded in the last layer of Inception is contained in V3 architecture [47]. This architecture comprises 42 layers, with the input layer receiving information at a resolution of 299 × 299 pixels.

4.3. Methods

4.3.1. Overview

Figure 7 is a schematic diagram of the overall methods used in this study. The approach is divided into three primary stages, including (1) chest X-ray image pre-processing, (2) classification, and (3) classifier performance analysis and evaluation. Each step is explained below.

4.3.2. Pre-Processing

To improve the classification results, some pre-processing steps were performed. The tasks completed during pre-processing are described below.
  • Image Resizing: The X-ray image datasets for this study were obtained from multiple sources; therefore, the images were of various sizes. Each network only accepts a specific size of image. Each image was reduced to the specific sizes required by the networks while keeping its important features. The images were resized according to the recommended input size of each EfficientNet architecture, as shown in Table 2.
  • Image Normalization: Different manufacturers of X-ray devices may provide different-looking X-ray images for the same patient. Overfitting to the device pixel distributions is quite a big problem in computer-aided diagnostic devices; therefore, it is standard practice to apply contrast normalization to minimize this problem. The general idea is to unify the distribution of pixels. This makes X-rays appear a little darker. This procedure generates a view that radiologists would not see in their standard workplace. Using the Reinhard and Macenko approaches, X-ray images were stain-normalized [43,48,49]. A reduction in the color discrepancies of X-ray images improves the classification accuracy of EfficientNet models.
  • Data Augmentation: The normalized X-ray images were augmented before introduction into the EfficientNet model for training. The process of increasing the number of original images in a collection is known as data augmentation [38,50]. This strategy helps to eliminate the overfitting problem that arises when a model learns enough from the training data but cannot classify images of undetected X-rays. Table 3 illustrates the augmentation settings used on the stain-normalized X-ray images. In this study, the number of normal images was 1010, which is twice as many as the number of TB- and sarcoidosis-infected images. Therefore, the TB-infected images were augmented from 563 to 1126, and the sarcoidosis-infected images were increased from 231 to 462.

4.3.3. Classification Stage

Seven EfficientNet architectures between B0 and B6 achieved a classification model for analyzing chest X-ray images to distinguish between normal, TB-infected and sarcoidosis-infected cases. The suggested EfficientNet architecture’s results were also compared to the state-of-the-art CNN architectures, such as AlexNet, ResNet50, VGG16, and Inception V3. All deep learning models were trained in Google Colab with GPU support. All code was written in Python 3.10.1 using Keras version 2.7.0. Keras is an open-source deep learning framework.

4.3.4. Evaluation of the Classification Performance of the Proposed Methodology

The proposed methodology was evaluated in two stages. The first stage employed sensitivity, precision, and accuracy measures to determine the optimum EfficientNet architecture. The formulas used in calculating these measures were as Equations (11), (12) and (13) respectively.
S e n s i t i v i t y = T P T P + F N × 100 %
P r e c i s i o n = T P T P + F P × 100 %
A c c u r a c y = T P + T N T P + T N + F P + F N × 100 %
where T P (true positive) and T N (true negative) represent the number of correctly classified chest images that belonged to the normal and infected classes, respectively. In addition, F N (false negative) and F P (false positive) represent the number of misclassified X-ray images in the normal and infected classes, respectively [51].
In the second stage, the results of the best EfficientNet model were compared to the consultant committees’ classification results. Three consultant committees were constituted from three separate Egyptian respiratory disease hospitals (Cairo University Hospital (Kasralainy Hospital), Kobry El-kobba Military Hospital, and El-Abaseya Hospital). Each team was comprised of three specialized physicians (one specialized in critical care units and two specialized in respiratory diseases and allergies). All physicians had at least 15 years of experience. Images of ten patients were selected randomly from our datasets: two normal, three infected with TB, and five sarcoidosis-infected cases. The ten X-ray images were presented to the consultant committees. The committees’ decisions were compared to the classifier results.

5. Results and Discussion

The primary goal of this study is to obtain the best classification technique that classifies normal, sarcoidosis-infected, and TB-infected images with the highest precision to help physicians distinguish sarcoidosis from TB using X-ray images. To achieve this goal, the classification abilities of the EfficientNet deep learning architecture were evaluated with respect to chest X-ray images, and we compared the EfficientNet architecture’s performance to that of the most recent CNN models in the literature. All deep learning architectures used in this study were trained via transfer learning, as stated in Section 4.2.2.
To acquire a better understanding of the impact of Reinhard’s and Macenko’s normalization approaches on the classification performance of the deep learning architecture, all X-ray images were stain-normalized by these algorithms in the first stage. In addition, investigations with non-normalized images were carried out. The outcomes of the stain-normalization approaches employed in this study are shown in Figure 8.
The second stage of this research involved data augmentation; there were 1010 normal samples in the datasets. This value was almost four times higher than the number of sarcoidosis-infected images and 1.5 times higher than the number of TB-infected images. As a result, it was essential to augment the dataset symmetry for the sarcoidosis- and TB-infected images. Furthermore, studies [48,50] reveal that data augmentation obtains new datasets and increases the classification accuracy of deep learning systems by enriching the original datasets. As illustrated in Figure 9, two image augmentation techniques (rotation and translation) were used to generate additional X-ray images of sarcoidosis- and TB-infected lungs. Augmentation techniques were adopted to ensure that X-ray images were not unduly distorted and to prevent the loss of important image features. Images were turned clockwise and counterclockwise to achieve image augmentation (images were rotated with an angle of 5 and 10 degrees in each direction). Images were translated by shifting them vertically (height shift), horizontally (width shift), or both vertically and horizontally (images were translated by 10% and 15%).
In the third stage, we investigated whether normalization approaches could help classification models be more accurate. For sarcoidosis, TB, and normal X-ray classification, seven EfficientNet architectures were trained on non-normalized and normalized X-ray images. With 10-fold cross-validation, the X-ray images were separated into two groups: 80% for training and 20% for testing. The hyper-parameter settings for the EfficientNet models during the training phase are as outlined in Table 4.
Figure 10 shows each EfficientNet architecture performance in terms of its accuracy using stain-normalization techniques and non-normalized images. In general, the EfficientNet models performed better on normalized X-ray images than on non-normalized images, according to the results of the experiments. It’s worth noting that the average gain in accuracy for EfficientNets-1, B2, B3, B4, B5, and B6 appears to have shifted slightly. While EfficientNet-B4 saw a consistent increase, the larger EfficientNet models 5 and B6 saw a slight decrease. The EfficientNet-B0 model has the smallest number of parameters, and it performs poorly and has the lowest accuracy. This may be due to the fact that EfficientNet-B0 uses a very small input size. The image structures may be affected by resizing the X-ray images to 224 × 224, preventing the model from extracting the features. This could be due to over-parameterization, as opposed to the larger dataset size for the larger EfficientNet models, which did not appear to perform as well. For EfficientNets-B4 and B5, the Reinhard approach outperforms the Macenko approach. For EfficientNet-B4, the Macenko method and non-normalized images scored best. The Macenko and Reinhard approaches had the same results for EfficientNets-B1, B3, and B6.
In comparison to the other six models, the EfficientNet-B4 model achieved outstanding results. This model’s accuracy (98.56%, 96.9%, and 94.56% for Reinhard, Macenko, and non-normalized images, respectively) is impressive. The results show that this approach was the most effective at learning and identifying important features from training data. This approach also has the advantage of being simpler and having fewer trainable parameters than previous EfficientNets B5 and B6, implying faster training.
Classification accuracy alone can be deceiving. The sensitivity and precision rates, which are shown in Table 5, were calculated as a consequence. The sensitivity of the EfficientNet-B4 model is consistently high across all models. The best sensitivity (98.36%) and precision (98.67%) for this model came from using images normalized with the Reinhard approach. The Macenko approach achieved close results with a sensitivity of 96.9% and a precision of 97.11%.
While training the images adjusted with the Reinhard and Macenko methods, the EfficientNets-B1 and B2 generated comparable results, with sensitivities and precisions of around 95.00% and 93.00%, respectively. Even though EfficientNets B1 and B2 have different numbers of parameters, they both accept the same input size. For extracting essential features from X-ray images in the database, input sizes of 240 × 240 and 260 × 260 are sufficient. This comparison clearly shows that EfficientNet-B4 outperforms all other EfficientNet models.
To further evaluate the performance of the EfficientNet models, the results were compared to similar deep learning approaches. The classification performance of pre-trained designs employed in earlier approaches is shown in Figure 11. This demonstrates that the EfficientNet-B4 model produces superior accuracy (98.56%), precision (98.67%), and sensitivity (98.56%) for distinguishing between chest X-ray images for normal, TB-infected and sarcoidosis-infected cases. Furthermore, when compared to all comparable models, EfficientNet-B4 has the fewest parameters (about 17.9 million) and hence is computationally cheaper than the others due to its lightweight nature. It also has the shortest training time per epoch.
For further evaluation of the proposed approach, it was compared to conventional diagnostic tests that are reported in several research studies [52,53,54,55,56,57,58,59,60,61,62,63], as shown in Table 6. From the table, it can be seen that sarcoidosis and tuberculosis are disorders that closely resemble each other. For distinguishing sarcoidosis from TB, physicians usually employ physical examinations, biopsy tissue, blood analysis, urine tests, and a tuberculin skin test; this approach is painful for patients, time-consuming, expensive, and uses techniques prone to human error. In contrast, the proposed approach requires only a chest X-ray image to differentiate between TB and sarcoidosis.
Finally, the results of the proposed system were compared to the assessments of the consultant committees for the same 10 patients categorized by the recommended system. The number of patients in each class (normal, tuberculosis-infected, and sarcoidosis-infected), as well as the number of accurate EfficientNet-B4 and consultant committee classifications, are shown in Table 7.
All normal chest X-ray images were correctly diagnosed by the EfficientNet-B4 and consultant committees. EfficientNet-B4 misclassified one TB image, resulting in a lower number of inaccurate predictions than the consultant committees, which were unable to diagnose two out of three TB cases. Although the consultant committees failed to diagnose all five cases of sarcoidosis (0% true prediction), the proposed method correctly identified three of the five cases of sarcoidosis. The advisory committees in our study attributed their inability to diagnose sarcoidosis using X-ray images alone to the fact that physicians can recognize anomalies from X-ray images, but they require further blood tests in addition to chest swabs to distinguish sarcoidosis from tuberculosis. It could be concluded that the proposed method has a considerable benefit in detecting sarcoidosis using X-ray images without requiring the patient to undertake costly laboratory tests or lung smears, which are often painful for the patient and take a long time to obtain results. The proposed framework to detect sarcoidosis in patients using chest X-ray images may be employed clinically after more examination.

6. Conclusions

In this study, seven EfficientNet versions with transfer learning were utilized to classify chest X-ray images into three categories: normal, TB-infected, and sarcoidosis-infected. The EfficientNet-B4 model, which has around 17106 parameters, was the best of the seven models and achieved remarkable results, with accuracy, sensitivity, and precision rates of 98.56%, 98.36%, and 98.67%, respectively. Experiments have shown that this architecture, using X-ray images of the chest, can extract and learn global information. Additionally, the impacts of two alternative stain-normalization procedures were evaluated and compared to images that were not normalized. The B4 model had better performance when using the Reinhard technique, according to the results of this study. When compared to existing deep learning architectures (AlexNet, ResNet50, VGG16, and Inception V3) utilized to analyze chest X-ray images in the literature, as well as three special advisory committees, the proposed EfficientNet-B4 model was more successful. The results demonstrate that the EfficientNet architecture’s B4 model delivered the best outcomes. The proposed method offers a competitive improvement in terms of detecting sarcoidosis utilizing X-rays without requiring the patient to undergo expensive laboratory tests or lung smears, which are typically painful for the patient and take a long time to produce results. Based on our proposed methodology, we expect that the medical community will accept our proposed framework for classifying patients with sarcoidosis and tuberculosis using chest X-ray images.
In the future, it would be impressive to augment the capacity of the EfficientNet-B4 architecture to detect stages of pulmonary sarcoidosis and to increase the number of cases diagnosed by consultant committees for comparison. In addition, the performance of the proposed model will be investigated using MRI images. This is a challenging path worth pursuing. Finally, the suitability of the proposed model for accumulative learning will be evaluated.

Author Contributions

Formulation, N.B. and M.A.D.; methodology, N.B. and M.A.D.; software, A.S.M., M.A.D. and A.M.; validation and investigation, M.A.D. and A.S.M.; formal analysis, A.S.M. and A.M.; resources, N.B. and A.M.; preparing original draft, M.A.D. and A.S.M.; review and editing of writing, N.B. and A.M.; supervision, A.S.M.; funding and visualization, N.B. All authors have read and agreed to the published version of the manuscript.

Funding

Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2022R293), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors express their appreciation to Princess Nourah bint Abdulrahman University for funding this research with Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2022R293), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Conflicts of Interest

The authors have no conflict of interest to disclose.

References

  1. Carbonelli, C.; Giuffreda, E.; Palmiotti, A.; Loizzi, D.; Lococo, F.; Carpagnano, E.; Lacedonia, D.; Sollitto, F.; Foschino, M.P. Coexistent sarcoidosis and tuberculosis: A case report. Respiration 2017, 93, 296–300. [Google Scholar] [CrossRef] [PubMed]
  2. World Health Organization. Global Tuberculosis Report 2013; World Health Organization: Geneve, Switzerland, 2013. [Google Scholar]
  3. Piotrowski, W.J.; Górski, P.; Duda-Szymańska, J.; Kwiatkowska, S. Mycobacterium tuberculosis as a sarcoid factor? A case report of family sarcoidosis. Am. J. Case Rep. 2014, 15, 216. [Google Scholar]
  4. Dubaniewicz, A.; Zimmermann, A.; Dudziak, M.; Typiak, M.; Skotarczak, M. Tuberculosis in the course of sarcoidosis treatment: Is genotyping necessary for personalized therapy? Expert Rev. Clin. Immunol. 2013, 9, 349–360. [Google Scholar] [CrossRef] [PubMed]
  5. Gupta, D.; Agarwal, R.; Aggarwal, A.N.; Jindal, S.K. Sarcoidosis and tuberculosis: The same disease with different manifestations or similar manifestations of different disorders. Curr. Opin. Pulm. Med. 2012, 18, 506–516. [Google Scholar] [CrossRef]
  6. Ma, J.; Yin, H.; Hao, X.; Sha, W.; Cui, H. Development of a random forest model to classify sarcoidosis and tuberculosis. Am. J. Transl. Res. 2021, 13, 6166. [Google Scholar]
  7. Starshinova, A.; Zinchenko, Y.; Filatov, M.; Denisova, N.; Istomina, E.; Landa, S.; Burdakov, V.; Churilov, L.; Sapozhnikova, N.; Pavlova, M.; et al. Specific features of immune complexes in patients with sarcoidosis and pulmonary tuberculosis. Immunol. Res. 2018, 66, 737–743. [Google Scholar] [CrossRef]
  8. Bernardinello, N.; Petrarulo, S.; Balestro, E.; Cocconcelli, E.; Veltkamp, M.; Spagnolo, P. Pulmonary Sarcoidosis: Diagnosis and Differential Diagnosis. Diagnostics 2021, 11, 1558. [Google Scholar] [CrossRef]
  9. Malkova, A.; Starshinova, A.; Zinchenko, Y.; Gavrilova, N.; Kudryavtsev, I.; Lapin, S.; Mazing, A.; Surkova, E.; Pavlova, M.; Belaeva, E.; et al. New laboratory criteria of the autoimmune inflammation in pulmonary sarcoidosis and tuberculosis. Clin. Immunol. 2021, 227, 108724. [Google Scholar] [CrossRef]
  10. Wilsher, M.L.; Young, L.M.; Hopkins, R.; Cornere, M. Characteristics of sarcoidosis in Maori and Pacific Islanders. Respirology 2017, 22, 360–363. [Google Scholar] [CrossRef]
  11. Vijayaraj, M.; Abhinand, P.; Venkatesan, P.; Ragunath, P. An ANN model for the differential diagnosis of tuberculosis and sarcoidosis. Bioinformation 2020, 16, 539. [Google Scholar] [CrossRef]
  12. Chang, R.I.; Chiu, Y.H.; Lin, J.W. Two-stage classification of tuberculosis culture diagnosis using convolutional neural network with transfer learning. J. Supercomput. 2020, 76, 8641–8656. [Google Scholar] [CrossRef]
  13. Hernández, A.; Panizo, Á.; Camacho, D. An ensemble algorithm based on deep learning for tuberculosis classification. In Proceedings of the International Conference on Intelligent Data Engineering and Automated Learning, Manchester, UK, 14–16 November 2019; Springer: Berlin/Heidelberg, Germany, 2019; pp. 145–154. [Google Scholar]
  14. Paravathaneni, M.; Thota, V.; Baralo, B.; Buragamadagu, B.; Hyder, S.; Konduru, S.; Iqbal, S.; Russell, S. A Diagnostically Challenging Case of Sarcoidosis Presenting as Unilateral Lymphadenopathy. In TP42. TP042 Varying Presentations of Patients with Sarcoidosis; American Thoracic Society: New York, NY, USA, 2021; p. A2324. [Google Scholar]
  15. Deif, M.A.; Solyman, A.A.; Alsharif, M.H.; Uthansakul, P. Automated Triage System for Intensive Care Admissions during the COVID-19 Pandemic Using Hybrid XGBoost-AHP Approach. Sensors 2021, 21, 6379. [Google Scholar] [CrossRef]
  16. Deif, M.A.; Solyman, A.A.; Hammam, R.E. ARIMA Model Estimation Based on Genetic Algorithm for COVID-19 Mortality Rates. Int. J. Inf. Technol. Decis. Mak. 2021, 20, 1775–1798. [Google Scholar] [CrossRef]
  17. Bansal, R.; Gupta, A.; Agarwal, R.; Dogra, M.; Bhutani, G.; Gupta, V.; Dogra, M.; Katoch, D.; Aggarwal, A.N.; Sharma, A.; et al. Role of CT chest and cytology in differentiating tuberculosis from presumed sarcoidosis in uveitis. Ocul. Immunol. Inflamm. 2019, 27, 1041–1048. [Google Scholar] [CrossRef]
  18. Chowdhury, M.H.; Shuzan, M.N.I.; Chowdhury, M.E.; Mahbub, Z.B.; Uddin, M.M.; Khandakar, A.; Reaz, M.B.I. Estimating blood pressure from the photoplethysmogram signal and demographic features using machine learning techniques. Sensors 2020, 20, 3127. [Google Scholar] [CrossRef]
  19. Deif, M.A.; Hammam, R.E. Skin lesions classification based on deep learning approach. J. Clin. Eng. 2020, 45, 155–161. [Google Scholar] [CrossRef]
  20. Rahman, T.; Chowdhury, M.E.; Khandakar, A.; Islam, K.R.; Islam, K.F.; Mahbub, Z.B.; Kadir, M.A.; Kashem, S. Transfer learning with deep convolutional neural network (CNN) for pneumonia detection using chest X-ray. Appl. Sci. 2020, 10, 3233. [Google Scholar] [CrossRef]
  21. Chhikara, P.; Singh, P.; Gupta, P.; Bhatia, T. Deep convolutional neural network with transfer learning for detecting pneumonia on chest X-rays. In Advances in Bioinformatics, Multimedia, and Electronics Circuits and Signals; Springer: Berlin/Heidelberg, Germany, 2020; pp. 155–168. [Google Scholar]
  22. Deif, M.; Hammam, R.; Solyman, A. Adaptive neuro-fuzzy inference system (ANFIS) for rapid diagnosis of COVID-19 cases based on routine blood tests. Int. J. Intell. Eng. Syst. 2021, 14, 178–189. [Google Scholar] [CrossRef]
  23. Singh, N.; Hamde, S. Tuberculosis detection using shape and texture features of chest X-rays. In Innovations in Electronics and Communication Engineering; Springer: Berlin/Heidelberg, Germany, 2019; pp. 43–50. [Google Scholar]
  24. Van Ginneken, B.; Katsuragawa, S.; ter Haar Romeny, B.M.; Doi, K.; Viergever, M.A. Automatic detection of abnormalities in chest radiographs using local texture analysis. IEEE Trans. Med. Imaging 2002, 21, 139–149. [Google Scholar] [CrossRef]
  25. Jaeger, S.; Karargyris, A.; Antani, S.; Thoma, G. Detecting tuberculosis in radiographs using combined lung masks. In Proceedings of the 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, USA, 28 August–1 September 2012; pp. 4978–4981. [Google Scholar]
  26. Evalgelista, L.G.C.; Guedes, E.B. Computer-aided tuberculosis detection from chest X-ray images with convolutional neural networks. In Proceedings of the Anais do XV Encontro Nacional de Inteligência Artificial e Computacional, Sao Paulo, Brazil, 22–25 October 2018; pp. 518–527. [Google Scholar]
  27. Pasa, F.; Golkov, V.; Pfeiffer, F.; Cremers, D.; Pfeiffer, D. Efficient deep network architectures for fast chest X-ray tuberculosis screening and visualization. Sci. Rep. 2019, 9, 6268. [Google Scholar] [CrossRef] [Green Version]
  28. Nguyen, Q.H.; Nguyen, B.P.; Dao, S.D.; Unnikrishnan, B.; Dhingra, R.; Ravichandran, S.R.; Satpathy, S.; Raja, P.N.; Chua, M.C. Deep learning models for tuberculosis detection from chest X-ray images. In Proceedings of the 2019 26th International Conference on Telecommunications (ICT), Hanoi, Vietnam, 8–10 April 2019; pp. 381–385. [Google Scholar]
  29. Hooda, R.; Sofat, S.; Kaur, S.; Mittal, A.; Meriaudeau, F. Deep-learning: A potential method for tuberculosis detection using chest radiography. In Proceedings of the 2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuching, Malaysia, 12–14 September 2017; pp. 497–502. [Google Scholar]
  30. Jaeger, S.; Candemir, S.; Antani, S.; Wáng, Y.X.J.; Lu, P.X.; Thoma, G. Two public chest X-ray datasets for computer-aided screening of pulmonary diseases. Quant. Imaging Med. Surg. 2014, 4, 475. [Google Scholar]
  31. Lopes, U.; Valiati, J.F. Pre-trained convolutional neural networks as feature extractors for tuberculosis detection. Comput. Biol. Med. 2017, 89, 135–143. [Google Scholar] [CrossRef]
  32. Meraj, S.S.; Yaakob, R.; Azman, A.; Rum, S.; Shahrel, A.; Nazri, A.; Zakaria, N.F. Detection of pulmonary tuberculosis manifestation in chest X-rays using different convolutional neural network (CNN) models. Int. J. Eng. Adv. Technol. 2019, 9, 2270–2275. [Google Scholar] [CrossRef]
  33. Ahsan, M.; Gomes, R.; Denton, A. Application of a convolutional neural network using transfer learning for tuberculosis detection. In Proceedings of the 2019 IEEE International Conference on Electro Information Technology (EIT), Brookings, SD, USA, 20–22 May 2019; pp. 427–433. [Google Scholar]
  34. Yadav, O.; Passi, K.; Jain, C.K. Using deep learning to classify X-ray images of potential tuberculosis patients. In Proceedings of the 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Madrid, Spain, 3–6 December 2018; pp. 2368–2375. [Google Scholar]
  35. Abbas, A.; Abdelsamea, M.M.; Gaber, M.M. Detrac: Transfer learning of class decomposed medical images in convolutional neural networks. IEEE Access 2020, 8, 74901–74913. [Google Scholar] [CrossRef]
  36. Aixiang, C.; Zhifeng, C. ADST: Approach of Automated Differentiating Sarcoidosis from Tuberculosis Based on Statistical Learning Theory. Comput. Sci. 2014, 41, 103–109. [Google Scholar]
  37. Wu, Y.; Wang, H.; Wu, F. Automatic classification of pulmonary tuberculosis and sarcoidosis based on random forest. In Proceedings of the 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Shanghai, China, 14–16 October 2017; pp. 1–5. [Google Scholar]
  38. Chest Xray Masks and Labels. Available online: https://www.kaggle.com/datasets/nikhilpandey360/chest-xray-masks-and-labels (accessed on 12 April 2022).
  39. Rosenthal, A.; Gabrielian, A.; Engle, E.; Hurt, D.E.; Alexandru, S.; Crudu, V.; Sergueev, E.; Kirichenko, V.; Lapitskii, V.; Snezhko, E.; et al. The TB portals: An open-access, web-based platform for global drug-resistant-tuberculosis data sharing and analysis. J. Clin. Microbiol. 2017, 55, 3267–3282. [Google Scholar] [CrossRef] [Green Version]
  40. Tuberculosis (TB) Chest X-ray Database. Available online: https://www.kaggle.com/datasets/a63331e1d74b8d4a3a62af6dbe3582cc5e6dbf4bc01ac22b7da41314b24250c8 (accessed on 12 April 2022).
  41. Munien, C.; Viriri, S. Classification of hematoxylin and eosin-stained breast cancer histology microscopy images using transfer learning with EfficientNets. Comput. Intell. Neurosci. 2021, 2021, 5580914. [Google Scholar] [CrossRef]
  42. Deif, M.A.; Solyman, A.A.; Kamarposhti, M.A.; Band, S.S.; Hammam, R.E. A deep bidirectional recurrent neural network for identification of SARS-CoV-2 from viral genome sequences. Math. Biosci. Eng. 2021, 18, 8933–8950. [Google Scholar] [CrossRef]
  43. Tan, M.; Le, Q. Efficientnet: Rethinking model scaling for convolutional neural networks. In Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA, 9–15 June 2019; pp. 6105–6114. [Google Scholar]
  44. Simonyan, K.; Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv 2014, arXiv:1409.1556. [Google Scholar]
  45. Krizhevsky, A.; Sutskever, I.; Hinton, G.E. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25 (NIPS 2012); Curran Associates, Inc.: Red Hook, NY, USA, 2012. [Google Scholar]
  46. He, K.; Zhang, X.; Ren, S.; Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 26 June–1 July 2016; pp. 770–778. [Google Scholar]
  47. Szegedy, C.; Vanhoucke, V.; Ioffe, S.; Shlens, J.; Wojna, Z. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 26 June–1 July 2016; pp. 2818–2826. [Google Scholar]
  48. Deif, M.A.; Solyman, A.A.; Alsharif, M.H.; Jung, S.; Hwang, E. A Hybrid Multi-Objective Optimizer-Based SVM Model for Enhancing Numerical Weather Prediction: A Study for the Seoul Metropolitan Area. Sustainability 2021, 14, 296. [Google Scholar] [CrossRef]
  49. Macenko, M.; Niethammer, M.; Marron, J.S.; Borland, D.; Woosley, J.T.; Guan, X.; Schmitt, C.; Thomas, N.E. A method for normalizing histology slides for quantitative analysis. In Proceedings of the 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, Boston, MA, USA, 28 June–1 July 2009; pp. 1107–1110. [Google Scholar]
  50. Deif, M.; Hammam, R.; Solyman, A. Gradient Boosting Machine Based on PSO for prediction of Leukemia after a Breast Cancer Diagnosis. Int. J. Adv. Sci. Eng. Inf. Technol. 2021, 11, 508–515. [Google Scholar] [CrossRef]
  51. Deif, M.A.; Eldosoky, M.A.; Gomma, H.W.; El-Garhy, A.M.; Ell-Azab, A.S. Adaptive Neuro-Fuzzy Inference System Controller Technique for Lower Urinary Tract System Disorders. J. Clin. Eng. 2015, 40, 135–143. [Google Scholar] [CrossRef]
  52. Valeyre, D.; Prasse, A.; Nunes, H.; Uzunhan, Y.; Brillet, P.; Müller-Quernheim, J. Sarcoidosis. Lancet 2014, 383, 398–402. [Google Scholar] [CrossRef]
  53. Jain, R.; Yadav, D.; Puranik, N.; Guleria, R.; Jin, J.O. Sarcoidosis: Causes, diagnosis, clinical features, and treatments. J. Clin. Med. 2020, 9, 1081. [Google Scholar] [CrossRef]
  54. Sweiss, N.J.; Salloum, R.; Ghandi, S.; Alegre, M.L.; Sawaqed, R.; Badaracco, M.; Pursell, K.; Pitrak, D.; Baughman, R.P.; Moller, D.R.; et al. Significant CD4, CD8, and CD19 lymphopenia in peripheral blood of sarcoidosis patients correlates with severe disease manifestations. PLoS ONE 2010, 5, e9088. [Google Scholar] [CrossRef]
  55. Shu, C.C.; Wei, Y.F.; Yeh, Y.C.; Lin, H.H.; Chen, C.Y.; Wang, P.H.; Cheng, S.L.; Wang, J.Y.; Yu, C.J. The impact on incident tuberculosis by kidney function impairment status: Analysis of severity relationship. Respir. Res. 2020, 21, 51. [Google Scholar] [CrossRef]
  56. Chopra, A.; Kalkanis, A.; Judson, M.A. Biomarkers in sarcoidosis. Expert Rev. Clin. Immunol. 2016, 12, 1191–1208. [Google Scholar] [CrossRef]
  57. Peter, J.; Green, C.; Hoelscher, M.; Mwaba, P.; Zumla, A.; Dheda, K. Urine for the diagnosis of tuberculosis: Current approaches, clinical applicability, and new developments. Curr. Opin. Pulm. Med. 2010, 16, 262. [Google Scholar] [CrossRef] [Green Version]
  58. Reisis, N.; Dendrinos, G.; Fragiadakis, E.; Trouli, H.; Hartofylakides, G. Value of tissue biopsy in bone and joint tuberculosis. Acta Orthop. Belg. 1989, 55, 12–16. [Google Scholar]
  59. Lai, R.; Lee, S.J.; Ting, Y.; Wang, H.; Lin, C.; Lu, J. Diagnostic value of transbronchial lung biopsy under fluoroscopic guidance in solitary pulmonary nodule in an endemic area of tuberculosis. Respir. Med. 1996, 90, 139–143. [Google Scholar] [CrossRef] [Green Version]
  60. Flynn, J.T. Tuberculin skin testing. Ann. Intern. Med. 1997, 127, 334. [Google Scholar] [CrossRef]
  61. Smedema, J.; Katjitae, I.; Reuter, H.; Burgess, L.; Louw, V.; Pretorius, M.; Doubell, A. Twelve-lead electrocardiography in tuberculous pericarditis. Cardiovasc. J. Afr. 2001, 12, 31–34. [Google Scholar]
  62. Thunell, M.; Bjerle, P.; Stjernberg, N. ECG abnormalities in patients with sarcoidosis. Acta Medica Scand. 1983, 213, 115–118. [Google Scholar] [CrossRef]
  63. Ansari, S.; Amanullah, M.F.; Ahmad, K.; Rauniyar, R.K. Pott’s spine: Diagnostic imaging modalities and technology advancements. N. Am. J. Med. Sci. 2013, 5, 404. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Different classes of chest X-ray images: (a) normal, (b) sarcoidosis-infected, (c) TB-infected.
Figure 1. Different classes of chest X-ray images: (a) normal, (b) sarcoidosis-infected, (c) TB-infected.
Sensors 22 03846 g001
Figure 2. Schematic illustration of EfficientNet-B0 architecture.
Figure 2. Schematic illustration of EfficientNet-B0 architecture.
Sensors 22 03846 g002
Figure 3. Schematic illustration of VGG16 architecture.
Figure 3. Schematic illustration of VGG16 architecture.
Sensors 22 03846 g003
Figure 4. Schematic illustration of the AlexNet architecture.
Figure 4. Schematic illustration of the AlexNet architecture.
Sensors 22 03846 g004
Figure 5. Schematic illustration of the ResNet50 architecture.
Figure 5. Schematic illustration of the ResNet50 architecture.
Sensors 22 03846 g005
Figure 6. Schematic illustration of the Inception V3 architecture.
Figure 6. Schematic illustration of the Inception V3 architecture.
Sensors 22 03846 g006
Figure 7. The general methodology for X-ray image classification employing a deep learning approach.
Figure 7. The general methodology for X-ray image classification employing a deep learning approach.
Sensors 22 03846 g007
Figure 8. Stain-normalization outcomes: (a) original image, (b) Reinhard approach, and (c) Macenko approach.
Figure 8. Stain-normalization outcomes: (a) original image, (b) Reinhard approach, and (c) Macenko approach.
Sensors 22 03846 g008
Figure 9. Images of chest X-rays after using random data augmentation techniques: (a) original, (b) after clockwise rotation by 10 degrees, (c) after anti-clockwise rotation by 10 degrees, and (d) after 10% translation.
Figure 9. Images of chest X-rays after using random data augmentation techniques: (a) original, (b) after clockwise rotation by 10 degrees, (c) after anti-clockwise rotation by 10 degrees, and (d) after 10% translation.
Sensors 22 03846 g009
Figure 10. Performance accuracy for the EfficientNet architectures with non-stain-normalized and stain-normalized images.
Figure 10. Performance accuracy for the EfficientNet architectures with non-stain-normalized and stain-normalized images.
Sensors 22 03846 g010
Figure 11. Comparison between the EfficientNet-B4 model and the state-of-the-art approaches.
Figure 11. Comparison between the EfficientNet-B4 model and the state-of-the-art approaches.
Sensors 22 03846 g011
Table 1. Image categories and their collection sources.
Table 1. Image categories and their collection sources.
ClassSourceNumber of Images
NormalKaggle360
NLM database400
RSNA CXR dataset250
TBBelarus database169
NLM database394
SarcoidosisSix national hospitals in Egypt231
Table 2. Number of parameters in each EfficientNet and its corresponding input image size.
Table 2. Number of parameters in each EfficientNet and its corresponding input image size.
EfficientNet ModelInput Image SizeNumber Parameters × 10 6
B0224 × 2244.3
B1240 × 2406.8
B2260 × 2608
B3300 × 30011
B4380 × 38017.9
B5456 × 45628.7
B6528 × 52841.1
Table 3. The settings of the data augmentation applied to the stain-normalized X-ray images.
Table 3. The settings of the data augmentation applied to the stain-normalized X-ray images.
Augmentation TypeValue
RescalingAccording to each EfficientNet model
Rotation range 5 and 10
Range of width shifts0.1
Range of height shift0.1
Table 4. The hyper-parameter setting for EfficientNet architectures.
Table 4. The hyper-parameter setting for EfficientNet architectures.
Hyper-ParameterSetting
Patience5
Learning rate0.001
Size of mini-batch32
OptimizerSGD
Activation functionSoftmax
Table 5. Precision sensitivity for the EfficientNet models with the stain-normalization method.
Table 5. Precision sensitivity for the EfficientNet models with the stain-normalization method.
EfficientNet
Architectures
PrecisionSensitivity
ReinhardMacenkoReinhardMacenko
B094.8892.994.5692.9
B195.1693.6995.8293.48
B295.1693.6995.8293.48
B393.4993.0592.7892.78
B498.6797.1198.3696.9
B590.7494.190.6393.97
B691.3491.1590.3690.21
Table 6. Comparison between conventional diagnostic tests for sarcoidosis, tuberculosis, and the proposed approach.
Table 6. Comparison between conventional diagnostic tests for sarcoidosis, tuberculosis, and the proposed approach.
Test TypeIndication for TuberculosisIndication for SarcoidosisProposed Approach
Physical examinationCoughing for three or more weeks, coughing up blood or mucus, chest pain, weight loss, fatigue and fever [52]Fatigue, fever, weight loss, and erythema nodosum [53]Not required
Peripheral blood countHigh lymphocyte count [54]
Renal function testsUnclear for tuberculosis diagnosis [55]High level of calcium, urea, and creatinine [56]
Urine analysisUrine analysis currently offers little utility for the diagnosis of tuberculosis [57]Hypercalciurea [53]
Pulmonary function testsJust used to indicate pulmonary involvement and disease severity, but not to determine whether TB or sarcoidosis is present [53]
Tissue biopsyThis method is probably the most useful one for the diagnosis of bone and joint tuberculosis [58]For the presence of granuloma (lungs, lymph node, skin, salivary gland, conjunctiva) [53]
Bronchial biopsyTransbronchial lung biopsy (TBLB) is a helpful examination for pulmonary tuberculosis [59]Flexible bronchoscopy has a very high diagnostic yield in all stages of suspected sarcoidosis [53]
Tuberculin skin test (Mantoux)Determining whether a person is infected with mycobacterium tuberculosis [60]Negative in most sarcoidosis patients [53]
Electrocardiogram (ECG)Patients with pulmonary tuberculosis often have a normal ECG [61]Repolarization disturbances, ectopic beats, and rhythm abnormalities [62]
MRIMRI is the most sensitive modality for early diagnosis and follow-up of spinal TB [63]Detect neurological involvement, spinal cord, meninges, skull vault, and pituitary lesions [53]Not investigated to improve diagnostic accuracy
Chest X-rayA posterior-anterior chest radiograph is used to detect chest abnormalities [53]Required
Table 7. Comparison between the proposed approach and conventional diagnostic tests for sarcoidosis and tuberculosis.
Table 7. Comparison between the proposed approach and conventional diagnostic tests for sarcoidosis and tuberculosis.
CasesNumber of Actual CasesEfficientNet-B4Committees of Consultants
Normal22 (100%)2 (100%)
Tuberculosis32 (67%)1 (33%)
Sarcoidosis53 (60%)0 (0%)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Baghdadi, N.; Maklad, A.S.; Malki, A.; Deif, M.A. Reliable Sarcoidosis Detection Using Chest X-rays with EfficientNets and Stain-Normalization Techniques. Sensors 2022, 22, 3846. https://doi.org/10.3390/s22103846

AMA Style

Baghdadi N, Maklad AS, Malki A, Deif MA. Reliable Sarcoidosis Detection Using Chest X-rays with EfficientNets and Stain-Normalization Techniques. Sensors. 2022; 22(10):3846. https://doi.org/10.3390/s22103846

Chicago/Turabian Style

Baghdadi, Nadiah, Ahmed S. Maklad, Amer Malki, and Mohanad A. Deif. 2022. "Reliable Sarcoidosis Detection Using Chest X-rays with EfficientNets and Stain-Normalization Techniques" Sensors 22, no. 10: 3846. https://doi.org/10.3390/s22103846

APA Style

Baghdadi, N., Maklad, A. S., Malki, A., & Deif, M. A. (2022). Reliable Sarcoidosis Detection Using Chest X-rays with EfficientNets and Stain-Normalization Techniques. Sensors, 22(10), 3846. https://doi.org/10.3390/s22103846

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop