Next Article in Journal
A Computational Text Mining-Guided Meta-Analysis Approach to Identify Potential Xerostomia Drug Targets
Previous Article in Journal
Expression of Macrophage Scavenger Receptor (MSR1) in Peripheral Blood Cells from Patients with Different Respiratory Diseases: Beyond Monocytes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Clinical Characteristics of COVID-19 Patients and Application to an Artificial Intelligence System for Disease Surveillance

1
Department of Family Medicine, Tri-Service General Hospital, National Defense Medical Center, Taipei 11499, Taiwan
2
Graduate Institute of Life Sciences, National Defense Medical Center, Taipei 11499, Taiwan
3
School of Public Health, National Defense Medical Center, Taipei 11499, Taiwan
4
Department of Microbiology and Immunology, National Defense Medical Center, Taipei 11499, Taiwan
5
National Defense Medical Center, Taipei 11499, Taiwan
6
Division of Infectious Diseases and Tropical Medicine, Department of Internal Medicine, Tri-Service General Hospital, National Defense Medical Center, Taipei 11499, Taiwan
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
J. Clin. Med. 2022, 11(5), 1437; https://doi.org/10.3390/jcm11051437
Submission received: 18 January 2022 / Revised: 28 February 2022 / Accepted: 3 March 2022 / Published: 5 March 2022
(This article belongs to the Section Infectious Diseases)

Abstract

:
During the coronavirus disease (COVID-19) pandemic, we admitted suspected or confirmed COVID-19 patients to our isolation wards between 2 March 2020 and 4 May 2020, following a well-designed and efficient assessment protocol. We included 217 patients suspected of COVID-19, of which 27 had confirmed COVID-19. The clinical characteristics of these patients were used to train artificial intelligence (AI) models such as support vector machine (SVM), decision tree, random forest, and artificial neural network for diagnosing COVID-19. When analyzing the performance of the models, SVM showed the highest sensitivity (SVM vs. decision tree vs. random forest vs. artificial neural network: 100% vs. 42.86% vs. 28.57% vs. 71.43%), while decision tree and random forest had the highest specificity (SVM vs. decision tree vs. random forest vs. artificial neural network: 88.37% vs. 100% vs. 100% vs. 94.74%) in the diagnosis of COVID-19. With the aid of AI models, physicians may identify COVID-19 patients earlier, even with few baseline data available, and segregate infected patients earlier to avoid hospital cluster infections and to ensure the safety of medical professionals and ordinary patients in the hospital.

1. Introduction

Coronavirus disease 2019 (COVID-19) is an ongoing global pandemic caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The clinical spectrum of COVID-19 appears to be broad, ranging from no symptoms to mild upper respiratory tract illness, severe pneumonia with respiratory failure, and death. The existence of asymptomatic patients and patients with non-specific symptoms may significantly delay the diagnosis of COVID-19 and present a serious threat to public health. The rising incidence and massive casualties of COVID-19 exert significant pressure on limited healthcare resources. The early diagnosis of asymptomatic or mild COVID-19 patients is essential to prevent the spread of the infection during the pandemic. However, the gold standard for COVID-19 diagnosis, the reverse transcriptase polymerase chain reaction (RT-PCR), takes a maximum of up to two days to give the result. There has also been a heavy shortage of RT-PCR test kits in many countries during the pandemic. Thus, effective tools are really needed to simplify the diagnosis and surveillance of COVID-19. Recently, researchers found that well-trained artificial intelligence (AI) can ensure accurate and rapid diagnosis or assist physicians to reduce manual labor. Some of these studies were conducted for AI-assisted COVID-19 diagnosis [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18], some were conducted for predicting the prognosis of patients [19,20,21,22,23,24,25,26,27,28], and others were conducted for predicting the epidemic trend of COVID-19 [29,30,31].
Taiwan was initially expected to be one of the most affected countries owing to its geographic proximity and close people-to-people exchanges with China [32]. However, as the disease continues to spread globally, Taiwan has been able to contain the pandemic and minimize its impact on the daily lives of its citizens. Since the first confirmed case in Taiwan on 21 February 2020 [33], less than 1100 cases were reported in Taiwan till 10 April 2021. This is attributed to the government’s rapid action including border control from the air and sea, adequate screening, quarantine of suspicious cases, identification of travelers’ infection risks, and comprehensive contact tracing. To coordinate the pandemic-prevention policies, our hospital set up two isolation wards to admit confirmed COVID-19 patients and suspected cases since 2 March 2020. Until 4 May 2020, 217 patients had been hospitalized into our isolation ward, of which 27 had a confirmed COVID-19 diagnosis. To facilitate diagnosing COVID-19, we tried to apply the clinical characteristics of these patients to different AI models and find the most effective one.
There are limited data on the clinical characteristics of COVID-19 patients in Taiwan. We aimed to delineate the epidemic prevention experience of our hospital under the guidance of Taiwan’s government, clarify the differences in clinical characteristics between confirmed cases and COVID-19-negative patients admitted to our hospital, and apply the clinical characteristics to AI models for diagnosing COVID-19.

2. Materials and Methods

2.1. Study Population

Our study included adult patients (age ≥ 20 years) with suspected or confirmed COVID-19 diagnosis, who were admitted to our isolation wards between 2 March 2020 and 4 May 2020. All patients with COVID-19 were confirmed by using real-time reverse-transcriptase polymerase chain reaction (RT-PCR) assays from oropharyngeal swab specimens. The patients included travelers entering Taiwan with a positive COVID-19 test performed at the airport, symptomatic patients with a contact or travel history who visited our emergency room and needed hospitalization, and people with close contact with confirmed cases and who needed hospitalization. The study was approved by the Institutional Review Board of Tri Service General Hospital, and informed consent was obtained from all patients.

2.2. COVID-19 Screening, Hospitalization, and Home Quarantine

Figure 1 shows a flow diagram of the protocols followed for COVID-19 screening, hospitalization, and home quarantine. All travelers entering Taiwan were required to stay at home or at a quarantine hotel and undergo home quarantine for two weeks. Among them, individuals with symptoms were tested at the airport for SARS-CoV-2 viral nucleic acid using RT-PCR assays from oropharyngeal swab specimens. They had to stay at home or at the quarantine hotel while awaiting the test results. Individuals with a positive result in the COVID-19 test were sent to the appointed hospital for isolation and treatment. People with a negative result continued the two-week home quarantine. Symptomatic patients who visited our hospital with a travel or contact history were referred to our emergency room (ER) and tested for COVID-19. Patients who needed hospitalization were admitted to our isolation ward while waiting for the test result. Among them, patients with a positive result remained hospitalized in the isolation ward, while patients with a negative result were transferred to an ordinary ward. Patients in the ER who did not need hospitalization were asked to stay at home until the test results. Among them, patients with a positive result were admitted to the isolation ward, while patients with a negative result home-quarantined for two weeks. Individuals with close contact with confirmed cases were sent to the appointed hospital for COVID-19 testing, and symptomatic people among them were isolated in the dedicated ward until the results arrived. People without symptoms stayed at home or at a quarantine hotel while waiting for the result. Among them, people with positive results were arranged hospitalization in the isolation ward, while COVID-19-negative patients continued the home quarantine for two weeks. All transportation between the airport, home, the quarantine hotel, and the hospital were made through appointed cars instead of public transportation.

2.3. Obtaining the Demographic Data, Clinical Symptoms, and Laboratory Data

Relevant clinical data of the enrolled people, including age, gender, underlying diseases, clinical symptoms, and laboratory data, were recorded. Laboratory data including white blood cell count, platelet count, neutrophil-to-lymphocyte ratio, renal function, liver function, levels of total bilirubin, C-reactive protein, D-dimer, and procalcitonin were examined and noted within 24 h after admission. Patients were diagnosed with pneumonia based on the lower respiratory tract symptom of cough, the systemic symptom of fever, and new onset radiology findings of infiltration [34,35].

2.4. Statistical Analysis

The patients were sub-grouped in confirmed COVID-19 patients and suspected cases with a negative result to compare their clinical characteristics, including demographic data, underlying diseases, symptoms, and laboratory data. All results were analyzed using a commercially available software package (SPSS, version 21.0; SPSS Inc., Chicago, IL, USA). Categorical variables were analyzed using the chi-square test, while continuous variables with categorical variables were analyzed with the independent two-samples t test for comparison. All p-values were 2-tailed, and p-values of less than 0.05 were considered to indicate statistical significance.

2.5. Applying the Clinical Characteristics and Routine Laboratory Data to Train AI Models

In order to obtain a confirmed COVID-19 predictive model (“Outcome” feature), we established four AI models including support vector machine (SVM), decision tree, random forest, and artificial neural network by inputting the above information comprising clinical characteristics (sex, age, temperature, SBP, DBP, PR, RR, fever, cough, headache, muscle ache, distorted sense of taste, distorted sense of smell, rhinorrhea, sore throat, chest tightness, dyspnea, diarrhea, eye illness, nausea and vomiting) and routine laboratory data (WBC/1000, PLT, Neu(%), ANC, Lym(%), ALC, Cr, CRP, AST, ALT). We created training and testing sets by splitting the sample randomly to assess the performance of the model. A classifier can only be trained using retrospective data in the real world, and it will be used to classify future data. The machine learning construction process was to split all data into training and test datasets using 80% and 20% of the data. The process is shown in Figure 2.

2.5.1. Support Vector Machines

Support vector machines (SVMs) are common classifiers in machine learning. They map all samples to a hyperplane and separate them with a clear space. In addition, core tips are used to extend this hyperplane. SVMs have been shown to perform better in classifying free-text medical literature than naive Bayesian classifiers, C4.5 decision trees, and adaptive amplification [36]. In this study, we used the four most common kernel tips: linear, polynomial (degree = 3), radial basis, and sigmoid. We used the e1071 package (R package version 1.7-4) as the SVM implementation and set all other parameters to their defaults [37].

2.5.2. Random Forest

A random forest (RF) generates multiple decision trees and uses information from each tree to make predictions. This is the best classification model in previous text classification research [38] compared with SVM, Bayes classifier, and k-nearest neighbor algorithm. We used the version package 4.6-14 [39] as the RF implementation and set all the parameters to their default values.

2.5.3. Decision Tree

A decision tree is a non-parametric method among the supervised learning methods. Supervised learning means automatically building predictive models via algorithms from a given set of observations (data) as a training dataset [40]. Test datasets are used to assess how good the algorithm predicts the outcome from unseen data, which is also known as model evaluation. For decision tree analysis, the variables do not need to be linear/normal or additive, and their possible interactions do not need to be pre-specified. Missing values of the covariates, multicollinearity, and outliers are automatically taken into account [41]. We used the party package (R package version 1.3-6) [42] as the decision tree implementation and set all other parameters to their default values.

2.5.4. Artificial Neural Network

An Artificial Neural Network is a computational model inspired by the functioning of the human brain. It is composed by a set of artificial neurons (known as processing units) that are interconnected with other neurons. Each connection has an associated weight that represents the influence of one neuron on another. The word network in Neural Network refers to the interconnection between neurons present in various layers of a system. Every system is basically a 3-layered system, and the layers are the Input layer, the Hidden Layer, and the Output Layer. The input layer has input neurons which transfer data via synapses to the hidden layer, and similarly the hidden layer transfers these data to the output layer via more synapses. The synapses store values called weights which help them to manipulate the input and output to various layers. An ANN can be defined based on the following three characteristics:
  • The architecture indicating the number of layers and the number of nodes in each layer.
  • The learning mechanism applied for updating the weights of the connections.
  • The activation functions used in various layers.
    We used the MXNet version 0.8.0 package [43] to implement the above architecture. The settings used for the training model were as follows: (1) the network architecture was 4 × 3 × 1, i.e., the input layer had 4 nodes, the hidden layer had 3 nodes, and the output layer had 1 node; (2) minibatch gradient descent with batch size of 20 for optimization; (3) learning rate = 0.013; (4) momentum coefficient = 0.9; (4) L2 regularization coefficient = 0.

3. Results

From 2 March 2020 to 4 May 2020, there were 217 cases suspected of COVID-19 who were admitted to our isolation ward at Tri Service General Hospital. The median patient age was 40.8 years (range, 1–92 years). Among them, 107 (49.3%) were male, 101 (46.5%) had pneumonia, while 27 (12.4%) were finally confirmed to have contracted COVID-19.

3.1. Demographic Data and Underlying Diseases of Confirmed COVID-19 Patients and COVID-19-Negative Patients

The demographic data and underlying diseases of confirmed COVID-19 patients and COVID-19-negative patients are listed in Table 1. There was no gender predominance in both the confirmed group (male vs. female; 51.9% vs. 48.1%) and the negative group (male vs. female; 48.9% vs. 51.1%). The median age of the confirmed patients was 41.7 ± 18.5 years, while that of the negative patients was 40.7 ± 20.4 years. The confirmed COVID-19 patients had a higher prevalence of hyperlipidemia than the COVID-19-negative patients (18.5% vs. 2.6%; p < 0.001). Between the two groups, there was no significant difference in the prevalence of hypertension, diabetes mellitus, hyperuricemia, chronic kidney disease, cerebrovascular accident, coronary artery disease, cardiac arrhythmia, valvular heart disease, congestive heart failure, bronchial asthma, chronic obstructive pulmonary disease, solid organ cancer, hematogenic disorder, human immunodeficiency virus infection, chronic hepatitis, auto-immune disease, chronic urticaria, or allergic rhinitis

3.2. Symptoms of Confirmed COVID-19 and COVID-19-Negative Patients

The symptoms of confirmed COVID-19 and COVID-19-negative patients are listed in Table 2. The most frequent symptoms in both groups were cough and fever (confirmed cases vs. negative cases; 81.5% vs. 52.1% and 63% vs. 43.7%, respectively). The confirmed COVID-19 patients, compared to the negative patients, had a higher prevalence of cough (81.5% vs. 52.1%; p = 0.004), distorted sense of taste (25.9% vs. 0; p < 0.001), distorted sense of smell (37% vs. 0.5%; p < 0.001), rhinorrhea (44.4% vs. 14.2%; p < 0.001), chest tightness (18.5% vs. 6.3%; p = 0.027), dyspnea (37% vs. 12.6%; p = 0.001), diarrhea (33.3% vs. 5.3%; p < 0.001), and nausea and vomiting (11.1% vs. 2.1%; p = 0.013). On the contrary, there was no significant difference in the prevalence of fever, headache, muscle ache, sore throat, or eye illness.

3.3. Laboratory and Radiological Findings of Confirmed COVID-19 Patients and COVID-19-Negative Cases

The laboratory and radiological findings of confirmed COVID-19 patients and COVID-19-negative cases on admissions are listed in Table 3. Confirmed COVID-19 patients had a lower absolute neutrophil count (3436.7 ± 1151.8 cells/μL vs. 7011.1 ± 8888.9 cells/μL; p = 0.038) and a lower absolute lymphocyte count (1334.4 ± 645.5 cells/μL vs. 1912.4 ± 1357.8 cells/μL; p = 0.031) than COVID-19-negative cases. Among them, 17 (63%) confirmed COVID-19 patients and 84 (44.2%) COVID-19-negative patients had pneumonia.

3.4. Accuracy, Sensitivity, and Specificity of Support Vector Machine (SVM), Decision Tree, Random Forest, and Artificial Neural Network for COVID-19 Detection and Diagnosis

The accuracy, sensitivity, and specificity of the AI models we used for COVID-19 detection and diagnosis are shown in Table 4. In the performance of the models, SVM showed the highest sensitivity (SVM vs. decision tree vs. random forest vs. artificial neural network: 100% vs. 42.86% vs. 28.57% vs. 71.43%), while decision tree and random forest had the highest specificity (SVM vs. decision tree vs. random forest vs. artificial neural network: 88.37% vs. 100% vs. 100% vs. 94.74%).

4. Discussion

COVID-19 spread worldwide in just two months since December 2019. Taiwan has been containing it thanks to efforts in early pre-assessment and appraisal to control the disease risk. Between March 2 2020 and May 4 2020, 217 patients with possible COVID-19 were admitted to our isolation wards, with 27 confirmed cases. These 27 confirmed patients recovered and were discharged, with no occurrence of hospital outbreak.
According to the Taiwan Centers for Disease Control and Prevention (CDC), 934 (89.0%) of the 1050 confirmed COVID-19 cases in Taiwan were imported. Thus, travelers entering Taiwan and symptomatic patients with a travel history are thought to be at the highest risk of SARS-CoV-2 infection. A previous study revealed that the real-time effective reproduction number (R(t)) of SARS-CoV-2 was 3.27 for Italy, 6.32 for France, 6.07 for Germany, and 5.08 for Spain [5]. With the time-dependent method, the R(t) value was 3.1 for Italy, 6.56 for France, 4.43 for Germany, and 3.95 for Spain [44]. Owing to the highly contagious nature of SARS-CoV-2, people with close contact with confirmed patients are also considered to be at the highest risk. Thus, physicians in our hospital are requested to be aware of high-risk groups and/or individuals, i.e., travelers entering Taiwan, symptomatic patients with a travel or contact history, and people with close contact with confirmed patients, and are requested to follow the well-designed and efficient assessment protocol of COVID-19 screening, hospitalization, and home quarantine presented in Figure 1. The timely identification of individuals at risk may be one of the main factors that assisted Taiwan in containing the pandemic and in preventing outbreaks in its hospitals.
In our study, confirmed COVID-19 patients had a higher prevalence of hyperlipidemia. According to a New York-based study, the most common comorbidities in COVID-19 fatalities were hypertension (55.4%), diabetes (37.3%), hyperlipidemia (18.5%), and coronary artery disease (12.4%) [45]. In another study conducted in Wuhan, of the 138 patients hospitalized for COVID-19 and requiring an intensive care support, 25% had cardiovascular disease, and 58% had hypertension. Of those who did not require an intensive care units support, 10% had cardiovascular disease and 22% had hypertension [46]. According to these studies and our study, dysfunction of lipid metabolism, associated metabolic dysfunction, or related complications such as atherosclerotic disease may increase the vulnerability or severity of COVID-19. Further studies are needed to clarify the relationship between lipid metabolism and COVID-19 pathophysiology.
Similar to several previous studies, we noted cough and fever to be the most common symptoms in confirmed COVID-19 patients [46,47,48,49]. In contrast to the what observed for severe acute respiratory syndrome (SARS) of 2003, fever is not considered an important indicator for SARS-CoV-2 transmission. Several studies documented SARS-CoV-2 transmission during the pre-symptomatic incubation period [50,51,52,53], while others documented SARS-CoV-2 infection in patients who never developed symptoms (asymptomatic) [54,55,56]. As shown in an increasing number of studies that report a high prevalence of distorted sense of taste or smell in COVID-19 patients [57,58], 37% of our confirmed COVID-19 patients had a distorted sense of smell, and 25.9% had a distorted sense of taste. This could be due to the high expression level of angiotensin-converting enzyme 2 (ACE2) proteins in nasal respiratory epithelial cells and olfactory epithelial support cells [59]. A previous study suggested that the loss of taste and smell, in combination, is a strong predictor of SARS-CoV-2 infection [60]. Physicians should be on alert when patients have distorted smell or taste.
Considering the laboratory findings noted in our study, confirmed COVID-19 patients had a higher prevalence of neutropenia or lymphopenia than COVID-19-negative patients. According to previous studies, lymphopenia was found to be the most common laboratory finding in COVID-19 patients [48,61,62]. Several factors may contribute to COVID-19-related lymphopenia. First, lymphocytes express the ACE2 receptor on their surface and may be a direct target of SARS-CoV-2 [63]. Second, the subsequent cytokine storm with increased expression of interleukin-6 (IL-6), granulocyte colony-stimulating factor (GCSF), tumor necrosis factor (TNF)-α, and other pro-inflammatory cytokines may cause lymphocyte dysfunction or apoptosis [64,65]. Third, the substantial cytokine storm may also be associated with a dysfunction of lymphoid organs such as the spleen [66]. Lymphopenia is considered one of the predictive factors of severe disease in COVID-19 patients [67,68]. Physicians should be vigilant for the presence of lymphopenia in undiagnosed or confirmed COVID-19 patients.
Early detection and timely diagnosis of COVID-19 infections is very helpful to reduce the spread of the virus. However, the nonspecific clinical characteristics of COVID-19 infections make the diagnosis even more difficult. Thus, the development of AI tools for a timely diagnosis of COVID-19 infection is important and imperative, especially in the circumstances when we only have few data regarding suspicious cases. During the pandemic, many AI models were developed for the early detection of COVID-19. Among them, models based on chest computed tomography (CT) images were the most abundant [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18]. Several studies have developed AI techniques to detect and identify features from chest CT images to assist in the diagnosis of COVID-19 with high accuracy (70.00 to 99.87%), sensitivity (73.00 to 100.00%), specificity (25 to 100.00%), and AUC (0.732 to 1.000) [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18]. However, performing CT scan in all suspected COVID-19 patients may cause significant pressure in countries with limited healthcare resources during the pandemic. In our study, we describe a model to early detect COVID-19 infection by inputting clinical characteristics and routine lab data which is more feasible and economic than routine expensive examinations such as chest CT. With the aid of the AI models we developed, we can identify patients at risk of COVID-19 and early decide who should be quarantined and undergo further exams such as chest CT or RT-PCR.
However, the present study has several limitations that must be considered. First, we enrolled only 217 suspected COVID-19 patients in our study. The small sample size may affect the reliability of the results because it leads to a higher variability, which may cause bias. Second, the study patients were enrolled almost 2 years ago. The sensitivity and specificity of the AI models we used to identify COVID-19 maybe different when applying to current diagnosed patients. Third, these AI models may help physicians to identify symptomatic COVID-19 patients earlier by analyzing their clinical characteristics. However, asymptomatic patients may not be identified by using our AI systems. Forth, our study was conducted during the COVID-19 pandemic. As we know, behavioral changes (social distancing, mask wearing, and hygiene measures) and travel and movement restrictions during the COVID-19 pandemic have led to a reduction in the incidence of influenza and other common respiratory infections [69,70]. The high sensitivity and specificity of the AI models we used to identify COVID-19 maybe due to the reduction in the incidence of other common respiratory infections. Further AI-assisted detection tools still need to be studied and developed.

5. Conclusions

In conclusion, COVID-19 is a highly contagious disease characterized by a long period of communicability, varied presentations, and nonspecific laboratory findings. Physicians should be aware of the clinical characteristics of the disease and keenly observe patients at high risk. Besides, the AI-assisted system for the early detection and timely diagnosis of COVID-19 infection needs to be further developed.

Author Contributions

C.-H.C.: designed research. Y.-C.W., Y.-H.Y., T.-T.C., L.-C.Y., T.-Y.L., K.-M.Y.: collected data. Y.-C.W. and D.-J.T.: analyzed data. Y.-C.W. and C.-H.C.: wrote the manuscript. C.-H.C. and F.-Y.C.: revised the entire manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This work was funded by Tri-Service General Hospital, Taipei, Taiwan [grant numbers TSGH-C108-135, TSGH-C109-147, and 801GB110058] and the National Science Council, Taipei, Taiwan [grant numbers MOST 106-2314-B016-024-MY3, MOST 109-2327-B-016-004].

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board of Tri Service General Hospital (C202005067, 11 May 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study, and written informed consent was obtained from the patients to publish this paper.

Data Availability Statement

All data generated or analyzed during this study are included in this published article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bai, H.X.; Wang, R.; Xiong, Z.; Hsieh, B.; Chang, K.; Halsey, K.; Tran, T.M.L.; Choi, J.W.; Wang, D.C.; Shi, L.B.; et al. Artificial intelligence augmentation of radiologist performance in distinguishing COVID-19 from pneumonia of other origin at chest CT. Radiology 2020, 296, E156–E165. [Google Scholar] [CrossRef] [PubMed]
  2. Abbasian Ardakani, A.; Acharya, U.R.; Habibollahi, S.; Mohammadi, A. COVIDiag: A clinical CAD system to diagnose COVID-19 pneumonia based on CT findings. Eur. Radiol. 2020, 31, 121–130. [Google Scholar] [CrossRef] [PubMed]
  3. Ardakani, A.A.; Kanafi, A.R.; Acharya, U.R.; Khadem, N.; Mohammadi, A. Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks. Comput. Biol. Med. 2020, 121, 103795. [Google Scholar] [CrossRef]
  4. Ko, H.; Chung, H.; Kang, W.S.; Kim, K.W.; Shin, Y.; Kang, S.J.; Lee, J.H.; Kim, Y.J.; Kim, N.Y.; Jung, H.; et al. COVID-19 pneumonia diagnosis using a simple 2d deep learning framework with a single chest CT image: Model development and validation. J. Med. Internet Res. 2020, 22, e19569. [Google Scholar] [CrossRef] [PubMed]
  5. Li, L.; Qin, L.; Xu, Z.; Yin, Y.; Wang, X.; Kong, B.; Bai, J.; Lu, Y.; Fang, Z.; Song, Q.; et al. Using artificial intelligence to detect COVID-19 and community-acquired pneumonia based on pulmonary CT: Evaluation of the diagnostic accuracy. Radiology 2020, 296, E65–E71. [Google Scholar] [CrossRef]
  6. Mei, X.; Lee, H.C.; Diao, K.Y.; Huang, M.; Lin, B.; Liu, C.; Xie, Z.; Ma, Y.; Robson, P.M.; Chung, M.C.; et al. Artificial intelligence–enabled rapid diagnosis of patients with COVID-19. Nat. Med. 2020, 26, 1224–1228. [Google Scholar] [CrossRef]
  7. Mishra, A.K.; Das, S.K.; Roy, P.; Bandyopadhyay, S. Identifying COVID19 from chest CT images: A deep convolutional neural networks based approach. J. Healthc. Eng. 2020, 2020, 8843664. [Google Scholar] [CrossRef]
  8. Ouyang, X.; Huo, J.; Xia, L.; Shan, F.; Liu, J.; Mo, Z.; Yan, F.; Ding, Z.; Yang, Q.; Song, B.; et al. Dual-Sampling attention network for diagnosis of COVID-19 from community acquired pneumonia. IEEE Trans. Med. Imaging 2020, 39, 2595–2605. [Google Scholar] [CrossRef]
  9. Sharma, S. Drawing insights from COVID-19-infected patients using CT scan images and machine learning techniques: A study on 200 patients. Environ. Sci. Pollut. Res. Int. 2020, 27, 37155–37163. [Google Scholar] [CrossRef]
  10. Wang, J.; Bao, Y.; Wen, Y.; Lu, H.; Luo, H.; Xiang, Y.; Li, X.; Liu, C.; Qian, D. Prior-Attention residual learning for more discriminative COVID-19 screening in CT images. IEEE Trans. Med. Imaging 2020, 39, 2572–2583. [Google Scholar] [CrossRef]
  11. Wang, S.; Zha, Y.; Li, W.; Wu, Q.; Li, X.; Niu, M.; Wang, M.; Qiu, X.; Li, H.; Yu, H.; et al. A fully automatic deep learning system for COVID-19 diagnostic and prognostic analysis. Eur. Respir. J. 2020, 56, 2000775. [Google Scholar] [CrossRef] [PubMed]
  12. Wu, X.; Hui, H.; Niu, M.; Li, L.; Wang, L.; He, B.; Yang, X.; Li, L.; Li, H.; Tian, J.; et al. Deep learning-based multi-view fusion model for screening 2019 novel coronavirus pneumonia: A multicentre study. Eur. J. Radiol. 2020, 128, 109041. [Google Scholar] [CrossRef] [PubMed]
  13. Yan, T.; Wong, P.K.; Ren, H.; Wang, H.; Wang, J.; Li, Y. Automatic distinction between COVID-19 and common pneumonia using multi-scale convolutional neural network on chest CT scans. Chaos Solitons Fractals 2020, 140, 110153. [Google Scholar] [CrossRef] [PubMed]
  14. Zhang, K.; Liu, X.; Shen, J.; Li, Z.; Sang, Y.; Wu, X.; Zha, Y.; Liang, W.; Wang, C.; Wang, K.; et al. Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography. Cell 2020, 181, 1423–1433.e11. [Google Scholar] [CrossRef] [PubMed]
  15. Harmon, S.A.; Sanford, T.H.; Xu, S.; Turkbey, E.B.; Roth, H.; Xu, Z.; Yang, D.; Myronenko, A.; Anderson, V.; Amalou, A.; et al. Artificial intelligence for the detection of COVID-19 pneumonia on chest CT using multinational datasets. Nat. Commun. 2020, 11, 4080. [Google Scholar] [CrossRef] [PubMed]
  16. Jaiswal, A.; Gianchandani, N.; Singh, D.; Kumar, V.; Kaur, M. Classification of the COVID-19 infected patients using DenseNet201 based deep transfer learning. J. Biomol. Struct. Dyn. 2020, 39, 5682–5689. [Google Scholar] [CrossRef] [PubMed]
  17. Xu, X.; Jiang, X.; Ma, C.; Du, P.; Li, X.; Lv, S.; Yu, L.; Ni, Q.; Chen, Y.; Su, J. A deep learning system to screen novel coronavirus disease 2019 pneumonia. Engineering 2020, 6, 1122–1129. [Google Scholar] [CrossRef]
  18. Yang, S.; Jiang, L.; Cao, Z.; Wang, L.; Cao, J.; Feng, R.; Zhang, Z.; Xue, X.; Shi, Y.; Shan, F. Deep learning for detecting corona virus disease 2019 (COVID-19) on high-resolution computed tomography: A pilot study. Ann. Transl. Med. 2020, 8, 450. [Google Scholar] [CrossRef]
  19. Li, Z.; Zhong, Z.; Li, Y.; Zhang, T.; Gao, L.; Jin, D.; Sun, Y.; Ye, X.; Yu, L.; Hu, Z.; et al. From community-acquired pneumonia to COVID-19: A deep learning–based method for quantitative analysis of COVID-19 on thick-section CT scans. Eur. Radiol. 2020, 30, 6828–6837. [Google Scholar] [CrossRef]
  20. Yu, Z.; Li, X.; Sun, H.; Wang, J.; Zhao, T.; Chen, H.; Ma, Y.; Zhu, S.; Xie, Z. Rapid identification of COVID-19 severity in CT scans through classification of deep features. Biomed. Eng. Online 2020, 19, 63. [Google Scholar] [CrossRef]
  21. Fu, L.; Li, Y.; Cheng, A.; Pang, P.; Shu, Z. A novel machine learning-derived radiomic signature of the whole lung differentiates stable from progressive COVID-19 infection: A retrospective cohort study. J. Thorac. Imaging 2020, 35, 361–368. [Google Scholar] [CrossRef] [PubMed]
  22. Xiao, L.S.; Li, P.; Sun, F.; Zhang, Y.; Xu, C.; Zhu, H.; Cai, F.Q.; He, Y.L.; Zhang, W.F.; Ma, S.C.; et al. Development and validation of a deep learning-based model using computed tomography imaging for predicting disease severity of coronavirus disease 2019. Front. Bioeng. Biotechnol. 2020, 8, 898. [Google Scholar] [CrossRef] [PubMed]
  23. Alsayed, A.; Sadir, H.; Kamil, R.; Sari, H. Prediction of epidemic peak and infected cases for COVID-19 disease in Malaysia, 2020. Int. J. Environ. Res. Public Health 2020, 17, 4076. [Google Scholar] [CrossRef] [PubMed]
  24. Ayyoubzadeh, S.M.; Ayyoubzadeh, S.M.; Zahedi, H.; Ahmadi, M.; Kalhori, S.R.N. Predicting COVID-19 incidence through analysis of google trends data in iran: Data mining and deep learning pilot study. JMIR Public Health Surveill. 2020, 6, e18828. [Google Scholar] [CrossRef]
  25. Mollalo, A.; Rivera, K.M.; Vahedi, B. Artificial neural network modeling of novel coronavirus (COVID-19) incidence rates across the continental United States. Int. J. Environ. Res. Public Health 2020, 17, 4204. [Google Scholar] [CrossRef]
  26. Shahid, F.; Zameer, A.; Muneeb, M. Predictions for COVID-19 with deep learning models of LSTM, GRU and Bi-LSTM. Chaos Solitons Fractals 2020, 140, 110212. [Google Scholar] [CrossRef]
  27. Zheng, N.; Du, S.; Wang, J.; Zhang, H.; Cui, W.; Kang, Z.; Yang, T.; Lou, B.; Chi, Y.; Long, H.; et al. Predicting COVID-19 in China using hybrid AI model. IEEE Trans. Cybern. 2020, 50, 2891–2904. [Google Scholar] [CrossRef]
  28. Arora, P.; Kumar, H.; Panigrahi, B.K. Prediction and analysis of COVID-19 positive cases using deep learning models: A descriptive case study of India. Chaos Solitons Fractals 2020, 139, 110017. [Google Scholar] [CrossRef]
  29. Chimmula, V.K.R.; Zhang, L. Time series forecasting of COVID-19 transmission in Canada using LSTM networks. Chaos Solitons Fractals 2020, 135, 109864. [Google Scholar] [CrossRef]
  30. Ribeiro, M.; da Silva, R.G.; Mariani, V.C.; Coelho, L.D.S. Short-term forecasting COVID-19 cumulative confirmed cases: Perspectives for Brazil. Chaos Solitons Fractals 2020, 135, 109853. [Google Scholar] [CrossRef]
  31. Shastri, S.; Singh, K.; Kumar, S.; Kour, P.; Mansotra, V. Time series forecasting of Covid-19 using deep learning models: India-USA comparative case study. Chaos Solitons Fractals 2020, 140, 110227. [Google Scholar] [CrossRef] [PubMed]
  32. Gardner, L. Update January 31: Modeling the Spreading Risk of 2019-nCoV. Available online: https://systems.jhu.edu/research/public-health/ncov-model-2/ (accessed on 31 January 2020).
  33. Cheng, S.C.; Chang, Y.C.; Fan Chiang, Y.L.; Chien, Y.C.; Cheng, M.; Yang, C.H.; Huang, C.H.; Hsu, Y.N. First case of Coronavirus Disease 2019 (COVID-19) pneumonia in Taiwan. J. Formos. Med. Assoc. 2020, 119, 747–751. [Google Scholar] [CrossRef] [PubMed]
  34. Wunderink, R.G.; Waterer, G.W. Clinical practice. Community-acquired pneumonia. N. Engl. J. Med. 2014, 370, 543–551. [Google Scholar] [CrossRef] [PubMed]
  35. Postma, D.F.; van Werkhoven, C.H.; van Elden, L.J.; Thijsen, S.F.; Hoepelman, A.I.; Kluytmans, J.A.; Boersma, W.G.; Compaijen, C.J.; van der Wall, E.; Prins, J.M.; et al. Antibiotic treatment strategies for community-acquired pneumonia in adults. N. Engl. J. Med. 2015, 372, 1312–1323. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Butt, L.; Zuccon, G.; Nguyen, A.; Bergheim, A.; Grayson, N. Classification of cancer-related death certificates using machine learning. Australas. Med. J. 2013, 6, 292–299. [Google Scholar] [CrossRef]
  37. Meyer, D.; Dimitriadou, E.; Hornik, K.; Weingessel, A.; Leisch, F. Misc Functions of the Department of Statistics, Probability Theory Group (Formerly: E1071), R package version 1.7-0; Vienna University of Technology (TU Wien): Vienna, Austria, 2018. [Google Scholar]
  38. Mohammed Ali Al-garadi, K.D.V.; Ravana, S.D. Cybercrime detection in online communications: The experimental case of cyberbullying detection in the Twitter network. Comput. Hum. Behav. 2016, 63, 433–443. [Google Scholar] [CrossRef]
  39. Liaw, A.; Wiener, M. Classification and regression based on a forest of trees using random inputs, based on Breiman (2001). R Doc. Package Randomforest 2018, 4, 14. [Google Scholar]
  40. Geurts, P.; Irrthum, A.; Wehenkel, L. Supervised learning with decision tree-based methods in computational and systems biology. Mol. Biosyst. 2009, 5, 1593–1605. [Google Scholar] [CrossRef]
  41. Speybroeck, N.; Berkvens, D.; Mfoukou-Ntsakala, A.; Aerts, M.; Hens, N.; van Huylenbroeck, G.; Thysa, E. Classification trees versus multinomial models in the analysis of urban farming systems in Central Africa. Agric. Syst. 2004, 80, 133–149. [Google Scholar] [CrossRef]
  42. Hothorn, T.; Hornik, K.; Zeileis, A. Unbiased Recursive Partitioning: A Conditional Inference Framework. J. Comput. Graph. Stat. 2006, 15, 651–674. [Google Scholar] [CrossRef] [Green Version]
  43. Chen, T.; Li, M.; Li, Y.; Lin, M.; Wang, N.; Wang, M.; Xiao, T.; Xu, B.; Zhang, C.; Zhang, Z. Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv 2015, arXiv:preprint/1512.01274. [Google Scholar]
  44. Yuan, J.; Li, M.; Lv, G.; Lu, Z.K. Monitoring transmissibility and mortality of COVID-19 in Europe. Int. J. Infect. Dis. 2020, 95, 311–315. [Google Scholar] [CrossRef]
  45. Saldanha, A.L.R.; Chacra, A.P.M.; Rabelo, L.M.; Filho, R.D.S.; Margeotto, A.P.P.; Gasparoto, A.L.V.; Martinez, T.L.D.R. COVID 19 comorbidity interplayers diabetes and atherogenic dyslipidemia. Curr. Trends Intern. Med. 2020, 4, 138. [Google Scholar]
  46. Wang, D.; Hu, B.; Hu, C.; Zhu, F.; Liu, X.; Zhang, J.; Wang, B.; Xiang, H.; Cheng, Z.; Xiong, Y.; et al. Clinical Characteristics of 138 Hospitalized Patients With 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. JAMA 2020, 323, 1061–1069. [Google Scholar] [CrossRef] [PubMed]
  47. Chen, N.; Zhou, M.; Dong, X.; Qu, J.; Gong, F.; Han, Y.; Qiu, Y.; Wang, J.; Liu, Y.; Wei, Y.; et al. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: A descriptive study. Lancet 2020, 395, 507–513. [Google Scholar] [CrossRef] [Green Version]
  48. Huang, C.; Wang, Y.; Li, X.; Ren, L.; Zhao, J.; Hu, Y.; Zhang, L.; Fan, G.; Xu, J.; Gu, X.; et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 2020, 395, 497–506. [Google Scholar] [CrossRef] [Green Version]
  49. Lai, C.C.; Shih, T.P.; Ko, W.C.; Tang, H.J.; Hsueh, P.R. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and coronavirus disease-2019 (COVID-19): The epidemic and the challenges. Int. J. Antimicrob. Agents 2020, 55, 105924. [Google Scholar] [CrossRef]
  50. Hu, Z.; Song, C.; Xu, C.; Jin, G.; Chen, Y.; Xu, X.; Ma, H.; Chen, W.; Lin, Y.; Zheng, Y.; et al. Clinical characteristics of 24 asymptomatic infections with COVID-19 screened among close contacts in Nanjing, China. Sci. China Life Sci. 2020, 63, 706–711. [Google Scholar] [CrossRef] [Green Version]
  51. Wei, W.E.; Li, Z.; Chiew, C.J.; Yong, S.E.; Toh, M.P.; Lee, V.J. Presymptomatic Transmission of SARS-CoV-2—Singapore, January 23–March 16, 2020. Morb. Mortal. Wkly. Rep. 2020, 69, 411–415. [Google Scholar] [CrossRef] [Green Version]
  52. Tong, Z.D.; Tang, A.; Li, K.F.; Li, P.; Wang, H.L.; Yi, J.P.; Zhang, Y.L.; Yan, J.B. Potential Presymptomatic Transmission of SARS-CoV-2, Zhejiang Province, China, 2020. Emerg. Infect. Dis 2020, 26, 1052–1054. [Google Scholar] [CrossRef] [Green Version]
  53. Qian, G.; Yang, N.; Ma, A.H.Y.; Wang, L.; Li, G.; Chen, X.; Chen, X. COVID-19 Transmission Within a Family Cluster by Presymptomatic Carriers in China. Clin. Infect. Dis. 2020, 71, 861–862. [Google Scholar] [CrossRef]
  54. Pan, X.; Chen, D.; Xia, Y.; Wu, X.; Li, T.; Ou, X.; Zhou, L.; Liu, J. Asymptomatic cases in a family cluster with SARS-CoV-2 infection. Lancet Infect. Dis. 2020, 20, 410–411. [Google Scholar] [CrossRef]
  55. Bai, Y.; Yao, L.; Wei, T.; Tian, F.; Jin, D.Y.; Chen, L.; Wang, M. Presumed Asymptomatic Carrier Transmission of COVID-19. JAMA 2020, 323, 1406–1407. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Rothe, C.; Schunk, M.; Sothmann, P.; Bretzel, G.; Froeschl, G.; Wallrauch, C.; Zimmer, T.; Thiel, V.; Janke, C.; Guggemos, W.; et al. Transmission of 2019-nCoV Infection from an Asymptomatic Contact in Germany. N. Engl. J. Med. 2020, 382, 970–971. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  57. Hopkins, C.; Surda, P.; Whitehead, E.; Kumar, B.N. Early recovery following new onset anosmia during the COVID-19 pandemic—An observational cohort study. J. Otolaryngol.–Head Neck Surg. 2020, 49, 26. [Google Scholar] [CrossRef]
  58. Lee, Y.; Min, P.; Lee, S.; Kim, S.W. Prevalence and Duration of Acute Loss of Smell or Taste in COVID-19 Patients. J. Korean Med. Sci. 2020, 35, e174. [Google Scholar] [CrossRef]
  59. Brann, D.H.; Tsukahara, T.; Weinreb, C.; Lipovsek, M.; Van den Berge, K.; Gong, B.; Chance, R.; Macaulay, I.C.; Chou, H.J.; Fletcher, R.B.; et al. Non-neuronal expression of SARS-CoV-2 entry genes in the olfactory system suggests mechanisms underlying COVID-19-associated anosmia. Sci. Adv. 2020, 6, 31, eabc5801. [Google Scholar] [CrossRef]
  60. Menni, C.; Valdes, A.M.; Freidin, M.B.; Sudre, C.H.; Nguyen, L.H.; Drew, D.A.; Ganesh, S.; Varsavsky, T.; Cardoso, M.J.; Moustafa, J.S.E.; et al. Real-time tracking of self-reported symptoms to predict potential COVID-19. Nat. Med. 2020, 26, 1037–1040. [Google Scholar] [CrossRef]
  61. Guan, W.J.; Ni, Z.Y.; Hu, Y.; Liang, W.H.; Ou, C.Q.; He, J.X.; Liu, L.; Shan, H.; Lei, C.L.; Hui, D.S.C.; et al. Clinical Characteristics of Coronavirus Disease 2019 in China. N. Engl. J. Med. 2020, 382, 1708–1720. [Google Scholar] [CrossRef]
  62. Terpos, E.; Ntanasis-Stathopoulos, I.; Elalamy, I.; Kastritis, E.; Sergentanis, T.N.; Politou, M.; Psaltopoulou, T.; Gerotziafas, G.; Dimopoulos, M.A. Hematological findings and complications of COVID-19. Am. J. Hematol. 2020, 95, 834–847. [Google Scholar] [CrossRef] [Green Version]
  63. Xu, H.; Zhong, L.; Deng, J.; Peng, J.; Dan, H.; Zeng, X.; Li, T.; Chen, Q. High expression of ACE2 receptor of 2019-nCoV on the epithelial cells of oral mucosa. Int. J. Oral. Sci. 2020, 12, 8. [Google Scholar] [CrossRef] [PubMed]
  64. Liao, Y.C.; Liang, W.G.; Chen, F.W.; Hsu, J.H.; Yang, J.J.; Chang, M.S. IL-19 induces production of IL-6 and TNF-alpha and results in cell apoptosis through TNF-alpha. J. Immunol. 2002, 169, 4288–4297. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  65. Aggarwal, S.; Gollapudi, S.; Gupta, S. Increased TNF-alpha-induced apoptosis in lymphocytes from aged humans: Changes in TNF-alpha receptor expression and activation of caspases. J. Immunol. 1999, 162, 2154–2161. [Google Scholar] [PubMed]
  66. Chan, J.F.; Zhang, A.J.; Yuan, S.; Poon, V.K.; Chan, C.C.; Lee, A.C.; Chan, W.M.; Fan, Z.; Tsoi, H.W.; Wen, L.; et al. Simulation of the Clinical and Pathological Manifestations of Coronavirus Disease 2019 (COVID-19) in a Golden Syrian Hamster Model: Implications for Disease Pathogenesis and Transmissibility. Clin. Infect. Dis. 2020, 71, 2428–2446. [Google Scholar] [CrossRef] [PubMed]
  67. Tan, L.; Wang, Q.; Zhang, D.; Ding, J.; Huang, Q.; Tang, Y.Q.; Wang, Q.; Miao, H. Lymphopenia predicts disease severity of COVID-19: A descriptive and predictive study. Signal Transduct. Target. Ther. 2020, 5, 33. [Google Scholar] [CrossRef] [PubMed]
  68. Zhao, Q.; Meng, M.; Kumar, R.; Wu, Y.; Huang, J.; Deng, Y.; Weng, Z.; Yang, L. Lymphopenia is associated with severe coronavirus disease 2019 (COVID-19) infections: A systemic review and meta-analysis. Int. J. Infect. Dis. 2020, 96, 131–135. [Google Scholar] [CrossRef]
  69. Laurie, K.L.; Rockman, S. Which influenza viruses will emerge following the SARS-CoV-2 pandemic? Influenza Other Respir. Viruses 2021, 15, 573–576. [Google Scholar] [CrossRef]
  70. Huang, Q.S.; Wood, T.; Jelley, L.; Jennings, T.; Jefferies, S.; Daniells, K.; Nesdale, A.; Dowell, T.; Turner, N.; Campbell-Stokes, P.; et al. Impact of the COVID-19 nonpharmaceutical interventions on influenza and other respiratory viral infections in New Zealand. Nat. Commun. 2021, 12, 1001. [Google Scholar] [CrossRef]
Figure 1. Flow diagram of COVID-19 screening, hospitalization, and home quarantine for travelers entering Taiwan, symptomatic patients who visited our emergency room, and people with close contact with confirmed cases.
Figure 1. Flow diagram of COVID-19 screening, hospitalization, and home quarantine for travelers entering Taiwan, symptomatic patients who visited our emergency room, and people with close contact with confirmed cases.
Jcm 11 01437 g001
Figure 2. Flow chart of patients included in the model building and validation process.
Figure 2. Flow chart of patients included in the model building and validation process.
Jcm 11 01437 g002
Table 1. Demographic data and underlying diseases of confirmed COVID-19 patients and COVID-19-negative patients.
Table 1. Demographic data and underlying diseases of confirmed COVID-19 patients and COVID-19-negative patients.
Confirmed PatientsNegative Patients
Sexmale14 (51.9%)93 (48.9%)p = 0.778
female13 (48.1%)97 (51.1%)
Age (years) 41.7 ± 18.540.7 ± 20.4p = 0.801
Underlying diseases
HTNyes3 (11.1%)32 (16.8%)p = 0.449
no24 (88.9%)158 (83.2%)
DMyes1 (3.7%)15 (7.9%)p = 0.436
no26 (96.3%)175 (92.1%)
Hyperlipidemiayes5 (18.5%)5 (2.6%)p < 0.001
no22 (81.5%)185 (97.4%)
Hyperuricemiayes1 (3.7%)2 (1.1%)p = 0.27
no26 (96.3%)188 (98.9%)
CKDyes02 (1.1%)p = 0.592
no27(100%)188 (98.9%)
CVAyes1 (3.7%)2 (1.1%)p = 0.27
no26 (96.3%)188 (98.9%)
CADyes07(3.7%)p = 0.311
no27 (100%)183 (96.3%)
Cardiac arrhythmiayes03 (1.6%)p = 0.511
no27 (100%)187 (98.4%)
VHDyes04(2.1%)p = 0.447
no27 (100%)186 (97.9%)
CHFyes08 (4.2%)p = 0.447
no27 (100%)182 (95.8%)
Bronchial asthmayes07 (3.7%)p = 0.311
no27 (100%)183 (96.3%)
COPDyes02 (1.1%)p = 0.592
no27 (100%)188 (98.9%)
Solid organ canceryes1 (3.7%)5 (2.6%)p = 0.751
no26 (96.3%)185 (97.4%)
Hematogenic disorderyes02 (1.1%)p = 0.592
no27 (100%)188 (98.9%)
HIV infectionyes02 (1.1%)p = 0.592
no27 (100%)188 (98.9%)
Chronic hepatitisyes2 (7.4%)5 (2.6%)p = 0.189
no25 (92.6%)185 (97.4%)
Autoimmune disease yes05 (2.6%)p = 0.394
no27 (100%)185 (97.4%)
Chronic urticariayes03 (1.6%)p = 0.511
no27 (100%)187 (98.4%)
Allergic rhinitisyes1 (3.7%)2 (1.1%)p = 0.27
no26 (96.3%)188 (98.9%)
CAD, coronary artery disease; CHF, congestive heart failure; CKD, chronic kidney disease; COPD, chronic obstructive pulmonary disease; COVID-19, coronavirus disease; CVA, cerebrovascular accident; DM, diabetes mellitus; HIV, human immunodeficiency virus; HTN, hypertension; VHD, valvular heart disease.
Table 2. Symptoms of confirmed COVID-19 patients and COVID-19-negative patients.
Table 2. Symptoms of confirmed COVID-19 patients and COVID-19-negative patients.
SymptomsConfirmed PatientsNegative Patients
Feveryes17 (63%)83 (43.7%)p = 0.06
no10 (37%)107 (56.3%)
Coughyes22 (81.5%)99 (52.1%)p = 0.004
no5 (18.5%)91 (47.9%)
Headacheyes4 (14.8%)19 (10%)p = 0.447
no23 (85.2%)171 (90%)
Muscle acheyes5 (18.5%)15 (7.9%)p = 0.074
no22 (81.5%)175 (92.1%)
Distorted sense of tasteyes7 (25.9%)0p < 0.001
no20 (74.1%)190 (100%)
Distorted sense of smellyes10 (37%)1 (0.5%)p < 0.001
no17 (63%)189 (99.5%)
Rhinorrheayes12 (44.4%)27 (14.2%)p < 0.001
no15 (55.6%)163 (85.8%)
Sore throatyes8 (29.6%)32 (16.8%)p = 0.109
no19 (70.4%)158 (83.2%)
Chest tightnessyes5 (18.5%)12 (6.3%)p = 0.027
no22 (81.5%)178 (93.7%)
Dyspneayes10 (37%)24 (12.6%)p = 0.001
no17 (63%)166 (87.4%)
Diarrheayes9 (33.3%)10 (5.3%)p < 0.001
no18 (66.7%)180 (94.7%)
Eye illnessyes1 (3.7%)1 (0.5%)p = 0.106
no26 (96.3%)189 (99.5%)
Nausea and vomitingyes3 (11.1%)4 (2.1%)p = 0.013
no24 (88.9%)186 (97.9%)
COVID-19, coronavirus disease 2019.
Table 3. Laboratory and radiological findings of confirmed COVID-19 patients and COVID-19-negative patients on admission.
Table 3. Laboratory and radiological findings of confirmed COVID-19 patients and COVID-19-negative patients on admission.
Confirmed PatientsNegative Patients
LabWBC (/μΛ)5239 ± 14989907 ± 13,371p = 0.072
Neutrophil (%)65.4 ± 11.468.6 ± 14.3p = 0.27
ANC (/μL)3436.7 ± 1151.87011.1 ± 8888.9p = 0.038
Lymphocyte (%)25.5 ± 11.123 ± 12.7p = 0.332
ALC (/μL)1334.4 ± 645.51912.4 ± 1357.8p = 0.031
CRP (mg/dL)1.8 ± 3.13.1 ± 6.1p = 0.117
PCT (ng/mL)0.08 ± 0.110.55 ± 0.84p = 0.071
D-dimer (mg/L)0.85 ± 1.84.1 ± 8.1p = 0.089
AST (U/L)21.1 ± 7.526.8 ± 31.8p = 0.353
ALT (U/L)18.6 ± 8.627.4 ± 37.3p = 0.242
Total bilirubin (mg/dL)0.53 ± 0.241.01 ± 1.50p = 0.2
BUN (mg/dL)13.2 ± 8.113.6 ± 9.0p = 0.84
Cr (mg/dL)0.82 ± 0.30.96 ± 1.26p = 0.57
Pneumoniayes17 (63%)84 (44.2%)
no10 (37%)106 (55.8%)p = 0.068
AST, aspartate aminotransferase; ALT, alanine aminotransferase; ANC, absolute neutrophil count; ALC, absolute lymphocyte count; BUN, blood urea nitrogen; COVID-19, coronavirus disease 2019; Cr, creatinine; CRP, C-reactive protein; PCT: procalcitonin; WBC, white blood cell.
Table 4. Accuracy, area under the curve (AUC), sensitivity, specificity, positive prediction value (PPV), and negative predictive value (NPV) of support Vector Machine (SVM), decision tree, random forest, and artificial neural network for COVID-19 detection and diagnosis.
Table 4. Accuracy, area under the curve (AUC), sensitivity, specificity, positive prediction value (PPV), and negative predictive value (NPV) of support Vector Machine (SVM), decision tree, random forest, and artificial neural network for COVID-19 detection and diagnosis.
ModelAccuracyArea under the Curve (AUC)SensitivitySpecificityPositive
Prediction Value (PPV)
Negative
Predictive Value (NPV)
Support Vector Machine (SVM)88.89%64.29%100.00%88.37%28.57%100%
Decision tree91.11%71.43%42.86%100.00%100%90.48%
Random Forest88.88%64.29%28.57%100.00%100%88.37%
Artificial Neural Network91.11%83.83%71.43%94.74%71.43%94.74%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wang, Y.-C.; Tsai, D.-J.; Yen, L.-C.; Yao, Y.-H.; Chiang, T.-T.; Chiu, C.-H.; Lin, T.-Y.; Yeh, K.-M.; Chang, F.-Y. Clinical Characteristics of COVID-19 Patients and Application to an Artificial Intelligence System for Disease Surveillance. J. Clin. Med. 2022, 11, 1437. https://doi.org/10.3390/jcm11051437

AMA Style

Wang Y-C, Tsai D-J, Yen L-C, Yao Y-H, Chiang T-T, Chiu C-H, Lin T-Y, Yeh K-M, Chang F-Y. Clinical Characteristics of COVID-19 Patients and Application to an Artificial Intelligence System for Disease Surveillance. Journal of Clinical Medicine. 2022; 11(5):1437. https://doi.org/10.3390/jcm11051437

Chicago/Turabian Style

Wang, Ying-Chuan, Dung-Jang Tsai, Li-Chen Yen, Ya-Hsin Yao, Tsung-Ta Chiang, Chun-Hsiang Chiu, Te-Yu Lin, Kuo-Ming Yeh, and Feng-Yee Chang. 2022. "Clinical Characteristics of COVID-19 Patients and Application to an Artificial Intelligence System for Disease Surveillance" Journal of Clinical Medicine 11, no. 5: 1437. https://doi.org/10.3390/jcm11051437

APA Style

Wang, Y. -C., Tsai, D. -J., Yen, L. -C., Yao, Y. -H., Chiang, T. -T., Chiu, C. -H., Lin, T. -Y., Yeh, K. -M., & Chang, F. -Y. (2022). Clinical Characteristics of COVID-19 Patients and Application to an Artificial Intelligence System for Disease Surveillance. Journal of Clinical Medicine, 11(5), 1437. https://doi.org/10.3390/jcm11051437

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop