Next Article in Journal
Infant Perioperative Risk Factors and Adverse Brain Findings Following Long-Gap Esophageal Atresia Repair
Previous Article in Journal
Expression of pH-Sensitive GPCRs in Peritoneal Carcinomatosis of Colorectal Cancer—First Results
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Prediction of Postoperative Pulmonary Edema Risk Using Machine Learning

1
Department of Anesthesiology and Pain Medicine, Chuncheon Sacred Heart Hospital, Hallym University College of Medicine, Chuncheon-si 24253, Republic of Korea
2
Institute of New Frontier Research Team, Hallym University College of Medicine, Chuncheon-si 24252, Republic of Korea
3
Department of Anesthesiology and Pain Medicine, College of Medicine, Kangwon National University, Chuncheon-si 24341, Republic of Korea
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work as the first authors.
These authors contributed equally to this work.
J. Clin. Med. 2023, 12(5), 1804; https://doi.org/10.3390/jcm12051804
Submission received: 30 January 2023 / Revised: 16 February 2023 / Accepted: 22 February 2023 / Published: 23 February 2023
(This article belongs to the Section Pulmonology)

Abstract

:
Postoperative pulmonary edema (PPE) is a well-known postoperative complication. We hypothesized that a machine learning model could predict PPE risk using pre- and intraoperative data, thereby improving postoperative management. This retrospective study analyzed the medical records of patients aged > 18 years who underwent surgery between January 2011 and November 2021 at five South Korean hospitals. Data from four hospitals (n = 221,908) were used as the training dataset, whereas data from the remaining hospital (n = 34,991) were used as the test dataset. The machine learning algorithms used were extreme gradient boosting, light-gradient boosting machine, multilayer perceptron, logistic regression, and balanced random forest (BRF). The prediction abilities of the machine learning models were assessed using the area under the receiver operating characteristic curve, feature importance, and average precisions of precision-recall curve, precision, recall, f1 score, and accuracy. PPE occurred in 3584 (1.6%) and 1896 (5.4%) patients in the training and test sets, respectively. The BRF model exhibited the best performance (area under the receiver operating characteristic curve: 0.91, 95% confidence interval: 0.84–0.98). However, its precision and f1 score metrics were not good. The five major features included arterial line monitoring, American Society of Anesthesiologists physical status, urine output, age, and Foley catheter status. Machine learning models (e.g., BRF) could predict PPE risk and improve clinical decision-making, thereby enhancing postoperative management.

1. Introduction

Postoperative pulmonary edema (PPE) is a well-known complication with multiple possible causes [1]. Preexisting cardiac disease, including heart failure, is the most common cause of PPE. Fluid overload results in increased hydrostatic pressure and worsening left ventricular function [2]. Regardless of preexisting heart disease, fluid overload itself can cause PPE. In particular, excessive postoperative fluid administration and transfusions increase the risk of PPE [1,3]. Neurogenic pulmonary edema is another potential cause of PPE [4]. Although neurogenic pulmonary edema is sometimes regarded as a form of acute respiratory distress syndrome, its pathophysiology and prognosis differ from the characteristics of acute respiratory distress [4,5]. PPE can also be caused by anaphylaxis, which results in negative pressure and acute lung injury [1,6].
It is often difficult to determine the cause of PPE during its early stages, particularly in patients with overlapping etiologies [1,6,7]. There is a need to identify patients at high risk of PPE to allow prevention and early treatment. Several studies have reported the causes and risk factors for PPE, but early diagnosis and management are difficult, more so in patients with overlapping etiologies or uncertain causes [1,2,3,4,5,6,7,8,9,10].
Advances in computing have enhanced several key areas of clinical research; artificial-intelligence-based methods may have additional applications. Machine learning (ML) systems are widely used in clinical research to analyze big data. Compared to traditional scoring systems, ML models perform better when predicting various clinical conditions [11,12,13]. They have been successfully used to predict postoperative complications [14,15,16,17,18,19]. However, there is no reported ML model to predict PPE. In the present study, we hypothesized that ML could predict PPE risk with good performance, and then developed ML models to predict PPE.

2. Materials and Methods

2.1. Data Collection

This retrospective cohort study protocol was approved by the Clinical Research Ethics Committee of Chuncheon Sacred Heart Hospital, Hallym University. The need for informed consent was waived because of the retrospective study design. The medical records of patients treated between 1 January 2011 and 15 November 2021 were obtained from the clinical data warehouses of five hospitals affiliated with Hallym University Medical Center. The hospitals were located in Seoul (Kangnam Sacred Heart Hospital and Hangang Sacred Heart Hospital), Gyeonggi Province (Hallym University Sacred Heart Hospital and Dongtan Sacred Heart Hospital), and Gangwon Province (Chuncheon Sacred Heart Hospital).
A clinical data warehouse is a database of medical records, prescriptions, and test results, which can be used to identify patients based on prescriptions, examinations, and diagnostic data. The timing and results of investigations, drug administration, transfusions, and other information were extracted in an unstructured text format. The requested data were provided in a de-identified format, but the data of specific patients could be extracted using a key.

2.2. Patients and Pulmonary Edema

The study included adult patients aged > 18 years who did not exhibit preoperative pulmonary edema. The exclusion criteria and outlier data were missing. Pulmonary edema was diagnosed by radiologists on the basis of chest radiographs. Patients were presumed not to have PPE if they lacked perioperative respiratory symptoms and did not undergo chest radiography.

2.3. Dataset

The dataset involved the following 98 perioperative variables: age, male sex, and order of surgery; the statuses of preoperative atelectasis, preoperative effusion, preoperative pneumothorax, preoperative pneumonia, preoperative pulmonary thromboembolism, and preoperative acute respiratory distress; body mass index; the statuses of congestive heart failure, cardiac arrhythmia, valvular diseases, pulmonary circulation disorders, peripheral vascular disorders, hypertension (uncomplicated vs. complicated), paralysis, other neurological disorders, chronic pulmonary diseases, diabetes (uncomplicated vs. complicated), hypothyroidism, renal failure, liver diseases, peptic ulcer diseases (excluding bleeding), acquired immune deficiency syndrome/human immunodeficiency virus, lymphoma, metastatic cancer, solid tumors (without metastasis), and rheumatoid arthritis/collagen vascular diseases; alcohol consumption, current smoking status, smoking frequency (packs), smoking duration (years), emergency status, American Society of Anesthesiologists physical status of >2, use of general anesthesia, maintenance anesthetics administered, N2O use, anesthesia time (min), surgery time (min), intraoperative blood and fluid administration, intraoperative urine output, and estimated blood loss; the statuses of arterial line monitoring, central venous pressure monitoring, Foley catheter, Levin tube, and patient-controlled analgesia; the administration of intraoperative packed red blood cells, frozen fresh plasma, platelets (concentration and cryoprecipitate), rocuronium, vecuronium, atracurium, cisatracurium, succinylcholine, pyridostigmine, neostigmine, sugammadex, fentanyl, alfentanil, sufentanil, remifentanil, and pethidine; blood urea nitrogen level, creatinine level, glomerular filtration rate, prothrombin time, activated partial thromboplastin time, and platelet count; the levels of sodium, potassium, uric acid, protein, and albumin; and the statuses of robotic surgery, laparoscopic surgery, heart surgery, abdominal surgery, breast surgery, ear surgery, endocrine surgery, eye surgery, head and neck surgery, musculoskeletal surgery, neurosurgery, obstetric and gynecological surgery, spine surgery, thoracic surgery, transplant surgery, urogenital surgery, vascular surgery, and skin and soft tissue surgery.
The dataset was divided into training and test sets. The training set included data from Kangnam Sacred Heart Hospital, Hangang Sacred Heart Hospital, Hallym University Sacred Heart Hospital, and Dongtan Sacred Heart Hospital. The test set included data from Chuncheon Sacred Heart Hospital. The training set was used for model learning, whereas the test set was used to evaluate model performance. Both datasets were standardized using min.–max. scaling based on the training set.

2.4. Machine Learning

The study used supervised learning, which is an ML paradigm for data consisting of labeled examples (i.e., each data point contains variables and an associated label). Five ML algorithms were used: random forest, light-gradient boosting machine, extreme-gradient boosting machine, multilayer perceptron, and logistic regression [20,21,22,23,24]. Random forest is a regression tree technique that uses bootstrap aggregation and predictor randomization to achieve high predictive accuracy. Various random forest input parameters were explored [25]. A light-gradient boosting machine continuously divides a leaf node with maximum data loss without a consideration of tree balance, resulting in a deep and asymmetric tree [26]. Extreme-gradient boosting machine is an optimized gradient boosting algorithm that involves parallel processing, tree-pruning, missing value management, and regularization to avoid overfitting/bias [27]. Multilayer perceptron is a neural network with ≥1 intermediate layer between the input and output layers. The network is connected in the direction of the input, hidden, and output layers; there are no connections within the layers, but the output layer is directly connected to the input layer through a feedforward network [28]. Logistic regression can solve the binary classification problems associated with the linear model.
The dataset was imbalanced and may have caused low model performance. Therefore, we used the synthetic minority oversampling technique for all algorithms except random forest [29]. After the ratio of pulmonary edema had been balanced, we trained the models with a training set that included synthetic samples. The random forest algorithm includes a classifier method known as balanced random forest (BRF); therefore, the synthetic minority oversampling technique was not used for the random forest algorithm. Data processing and the ML process are summarized in Figure 1. Feature importance was calculated to assess the best model using the built-in function in the algorithm package.

2.5. Modified Dataset

An additional carved dataset was used to modify the prediction model based on the large and complex dataset. This dataset was learned and validated using the best prediction algorithm from the original data. First, the test dataset was reduced by under-sampling using the Tomek’s link method to validate our best model [30]. Second, a simplified prediction model was made using 20 important features of the best model, and was validated using a test dataset that included these features.

2.6. Metrics and Statistics

Six metrics were calculated for model performance. The primary metric was the area under the receiver operating characteristic curve. The average precisions of precision-recall curve, best threshold, precision, recall and f1 score, and accuracy were calculated. Google Colab (Python version 3.7; Google, Mountain View, CA, USA) was used to calculate model metrics.
Descriptive analysis was performed to compare the characteristics of patients with and without PPE. Categorical variables were presented as numbers (%) and compared using the chi-squared test. Continuous variables were presented as medians (interquartile ranges) and compared using the Mann–Whitney U test. p-values of < 0.05 were considered statistically significant.

3. Results

3.1. Patient Characteristics

The study included 287,976 patients aged > 18 years who did not exhibit preoperative pulmonary edema. After the exclusion of 26,597 patients with missing (n = 26,593) and outlier (n = 4) data, and 4480 preoperative PPE patients, a total of 256,899 patients were included in the analysis. PPE occurred in 5480 (2.8%) patients. The training and test sets included 221,908 and 34,991 patients, respectively. PPE occurred in 3584 (2.1%) and 1896 (7.4%) patients in the training and test sets, respectively (Table 1 and Table 2).

3.2. Model Performance

BRF exhibited the best performance for the prediction of PPE risk. As the primary metric, the area under the receiver operating characteristic curve for BRF was 0.91 (95% confidence interval: 0.84–0.98). The performances of the remaining models are summarized in Figure 2. BRF also exhibited the best performance based on the average precision of the precision-recall curve (0.44). The average precisions of the precision-recall curve for the remaining models are summarized in Figure 3. BRF had the best recall (0.832) and f1 score (0.372), whereas the light-gradient boosting machine model had the best precision (0.531) and accuracy (0.946). The remaining metrics are summarized in Table 3.

3.3. Feature Importance

The evaluation of feature importance in the BRF model revealed that arterial line monitoring was the most important feature. Ten major features in the BRF model are shown in Figure 4.

3.4. Validation of under-Sampling Test Dataset and Simplified Model

After under-sampling of the test dataset, PPE patients were 1896 and No-PPE patients were 32,621. In the simplified prediction model, the included features were as follows: arterial monitoring, American Society of Anesthesiologists physical status, age, urine output, intraoperative fluid, estimated blood loss, foley catheter, anesthesia time, albumin, glomerular filtration rate, central venous pressure monitoring, operation time, prothrombin time, blood urea nitrogen, protein, creatinine, prothrombin time-international normalized ratio, platelet, body mass index, and intraoperative packed red blood cell. Validation results are summarized in Table 4.

4. Discussion

We used ML to develop models for the prediction of PPE. Model training using data from 221,908 patients was followed by model testing using data from 34,991 patients. Five algorithms were used to develop the models, whereas six metrics were used to evaluate their performances. BRF exhibited the best performance in terms of area under the receiver operating characteristic curve, recall, and accuracy. However, no model had a good precision or f1 score.
Numerous studies have developed ML models to predict postoperative pulmonary complications. Peng et al. developed and validated a deep-neural-network model based on combined natural language data and structured data to predict pulmonary complications in geriatric patients [15]. Xue et al. developed an ML model to predict postoperative pulmonary complications after emergency gastrointestinal surgery in patients with acute diffuse peritonitis [18]. Chen and colleagues developed an ML model to predict postoperative pneumonia in orthotopic liver transplant patients [14]. Although the outcomes of the above studies included PPE, their findings differed from ours because they also assessed other complications. An ML model to predict PPE risk after any type of surgery has not been developed.
PPE has various causes, several of which can occur simultaneously. PPE may be cardiogenic or noncardiogenic, but it is difficult to distinguish between these etiologies because of their similar clinical features. In patients with acute myocardial infarction, cardiogenic pulmonary edema may be complicated by noncardiogenic edema related to the aspiration of gastric contents, syncope, or cardiac arrest. Conversely, in patients with severe trauma or infections accompanied by noncardiogenic pulmonary edema, fluid resuscitation may cause pulmonary edema through volume overload and increased pulmonary vascular hydrostatic pressure [1,6,31]. Therefore, PPE prediction and the preemptive management of risk factors are important.
The present study investigated the important features of the best model for the prediction of PPE risk. Ten major PPE risk factors were included, primarily those related to fluid and hydrostatic pressure rather than the other causes of PPE. This means that the PPE prediction model could mainly predict cardiogenic and hydrostatic pulmonary edema. However, the evidence is not conclusive because the etiologies of PPE in this study were not known.
The most important feature was arterial line monitoring, which is required in patients who need continuous blood pressure monitoring or multiple blood sampling during surgery [32]. Arterial line monitoring is the standard of care for patients at risk of rapid hemodynamic changes. Patients with a poor preoperative status and those who undergo major surgeries can develop rapid hemodynamic changes and often need multiple sampling [33]. American Society of Anesthesiologists physical status and age also indicate preoperative patient condition. Patients with high American Society of Anesthesiologists physical status grades may develop heart, lung, kidney, and brain problems [34,35]. Old age is generally associated with compromised organ function, resulting in a greater risk of PPE [36]. Urine output, fluid volume, EBL, albumin, and glomerular filtration rate directly and indirectly affect body fluid status, which is associated with hydrostatic pressure [37,38,39,40,41].
To the best of our knowledge, our model is the first to predict PPE risk, and its performance was better than the previous PPE models. However, the present study had some limitations. First, the overall performance of the model was good, but its precision and f1 scores were low, even for the best threshold. Because recall (sensitivity) was good, the proportion of false positives may be high, presumably because of the low proportion of patients with pulmonary edema in the overall dataset. Thus, our model interpreted the normal state as PPE in many cases. There were similar results in the validation with the under-sampling dataset. Second, our model requires many features to predict PPE, which reduces its practicality. Although the performance was not significantly worse in the model with twenty features, this limitation of the model could not be resolved. A prediction model based on fewer features while maintaining the performance may be needed in the future. To resolve the first two limitations, additional datasets should be acquired and learned, or features with better predictive values should be selected. Third, our model could not distinguish between cardiogenic and noncardiogenic PPE. Additional studies are needed to develop models that can distinguish between the two PPE types and predict the risk of each type.
In conclusion, we developed an ML model that could predict PPE risk in patients undergoing surgery. The model was superior to previously reported prediction models for postoperative pulmonary complications. Our ML model may improve clinical decision-making, thereby enhancing postoperative management. However, further improvements are needed to reduce the false positive rate and enhance the practical usefulness.

Author Contributions

Conceptualization, Y.-S.K. and J.J.L.; methodology, Y.-S.K. and J.H.K.; software, J.H.K.; validation, Y.K., formal analysis, Y.-S.K.; investigation, K.Y. and M.K.; resources, J.J.L. and S.S.K.; data curation, K.Y. and M.K.; writing—original draft preparation, Y.K. and J.J.L.; writing—editing, all authors.; visualization, J.H.K.; supervision, J.J.L. and S.S.K.; project administration, J.J.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by Hallym University Research Fund and the grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (Grant number: HR21C0198).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Clinical Research Ethics Committee of Chuncheon Sacred Hospital (No. 2019-08-016).

Informed Consent Statement

Not applicable.

Data Availability Statement

Restrictions apply to the availability of these data. Data was obtained from Hallym Medical Center and are available from clinical data warehouse of Hallym Medical Center with the permission of Hallym Medical Center.

Conflicts of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  1. Bajwa, S.S.; Kulshrestha, A. Diagnosis, prevention and management of postoperative pulmonary edema. Ann. Med. Health Sci. Res. 2012, 2, 180–185. [Google Scholar] [CrossRef] [Green Version]
  2. Katz, A.M. Cardiomyopathy of overload. A major determinant of prognosis in congestive heart failure. N. Engl. J. Med. 1990, 322, 100–110. [Google Scholar] [CrossRef]
  3. Kwon, Y.-S.; Kim, H.; Lee, H.; Kim, J.-H.; Jang, J.-S.; Hwang, S.-M.; Hong, J.-Y.; Yang, G.-E.; Kim, Y.; Lee, J.-J. Effect of Intra- and Post-Operative Fluid and Blood Volume on Postoperative Pulmonary Edema in Patients with Intraoperative Massive Bleeding. J. Clin. Med. 2021, 10, 4224. [Google Scholar] [CrossRef]
  4. Baumann, A.; Audibert, G.; McDonnell, J.; Mertes, P.M. Neurogenic pulmonary edema. Acta Anaesthesiol. Scand. 2007, 51, 447–455. [Google Scholar] [CrossRef] [PubMed]
  5. Matthew Wemple, M.H.; Andrew, M.M.D.; Luks, M.D. Neurogenic Pulmonary Edema. Available online: https://www.uptodate.com/contents/neurogenic-pulmonary-edema (accessed on 24 October 2022).
  6. Benson, A.B. Pulmonary complications of transfused blood components. Crit. Care Nurs. Clin. North Am. 2012, 24, 403–418. [Google Scholar] [CrossRef] [Green Version]
  7. Ware, L.B.; Matthay, M.A. Acute Pulmonary Edema. N. Engl. J. Med. 2005, 353, 2788–2796. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Miskovic, A.; Lumb, A.B. Postoperative pulmonary complications. Br. J. Anaesth. 2017, 118, 317–334. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Mulkey, Z.; Yarbrough, S.; Guerra, D.; Roongsritong, C.; Nugent, K.; Phy, M.P. Postextubation pulmonary edema: A case series and review. Respir. Med. 2008, 102, 1659–1662. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Tsai, P.-H.; Wang, J.-H.; Huang, S.-C.; Lin, Y.-K.; Lam, C.-F. Characterizing post-extubation negative pressure pulmonary edema in the operating room—A retrospective matched case-control study. Perioper. Med. 2018, 7, 28. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Artzi, N.S.; Shilo, S.; Hadar, E.; Rossman, H.; Barbash-Hazan, S.; Ben-Haroush, A.; Balicer, R.D.; Feldman, B.; Wiznitzer, A.; Segal, E. Prediction of gestational diabetes based on nationwide electronic health records. Nat. Med. 2020, 26, 71–76. [Google Scholar] [CrossRef]
  12. Macesic, N.; Bear Don’t Walk IV, O.J.; Pe’er, I.; Tatonetti, N.P.; Peleg, A.Y.; Uhlemann, A.-C. Predicting phenotypic polymyxin resistance in Klebsiella pneumoniae through machine learning analysis of genomic data. Msystems 2020, 5, e00656-19. [Google Scholar] [CrossRef]
  13. Quesada, J.A.; Lopez-Pineda, A.; Gil-Guillén, V.F.; Durazo-Arvizu, R.; Orozco-Beltrán, D.; López-Domenech, A.; Carratalá-Munuera, C. Machine learning to predict cardiovascular risk. Int. J. Clin. Pract. 2019, 73, e13389. [Google Scholar] [CrossRef] [Green Version]
  14. Chen, C.; Yang, D.; Gao, S.; Zhang, Y.; Chen, L.; Wang, B.; Mo, Z.; Yang, Y.; Hei, Z.; Zhou, S. Development and performance assessment of novel machine learning models to predict pneumonia after liver transplantation. Respir. Res. 2021, 22, 94. [Google Scholar] [CrossRef] [PubMed]
  15. Peng, X.; Zhu, T.; Chen, G.; Wang, Y.; Hao, X. A multicenter prospective study on postoperative pulmonary complications prediction in geriatric patients with deep neural network model. Front. Surg. 2022, 9, 976536. [Google Scholar] [CrossRef] [PubMed]
  16. Ren, Y.; Loftus, T.J.; Datta, S.; Ruppert, M.M.; Guan, Z.; Miao, S.; Shickel, B.; Feng, Z.; Giordano, C.; Upchurch, G.R., Jr.; et al. Performance of a Machine Learning Algorithm Using Electronic Health Record Data to Predict Postoperative Complications and Report on a Mobile Platform. JAMA Netw. Open 2022, 5, e2211973. [Google Scholar] [CrossRef] [PubMed]
  17. Xue, B.; Li, D.; Lu, C.; King, C.R.; Wildes, T.; Avidan, M.S.; Kannampallil, T.; Abraham, J. Use of Machine Learning to Develop and Evaluate Models Using Preoperative and Intraoperative Data to Identify Risks of Postoperative Complications. JAMA Netw. Open 2021, 4, e212240. [Google Scholar] [CrossRef] [PubMed]
  18. Xue, Q.; Wen, D.; Ji, M.-H.; Tong, J.; Yang, J.-J.; Zhou, C.-M. Developing Machine Learning Algorithms to Predict Pulmonary Complications After Emergency Gastrointestinal Surgery. Front. Med. 2021, 8, 655686. [Google Scholar] [CrossRef]
  19. Zeng, S.; Li, L.; Hu, Y.; Luo, L.; Fang, Y. Machine learning approaches for the prediction of postoperative complication risk in liver resection patients. BMC Med. Inform. Decis. Mak. 2021, 21, 371. [Google Scholar] [CrossRef]
  20. LightGBM. Available online: https://lightgbm.readthedocs.io/en/latest/index.html (accessed on 24 October 2022).
  21. XGBoost. Available online: https://xgboost.readthedocs.io/en/stable/ (accessed on 24 October 2022).
  22. MLPClassifier. Available online: https://scikit-learn.org/stable/modules/generated/sklearn.neural_network.MLPClassifier.html (accessed on 24 October 2022).
  23. LogisticRegression. Available online: https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html (accessed on 24 October 2022).
  24. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef] [Green Version]
  25. Rigatti, S.J. Random forest. J. Insur. Med. 2017, 47, 31–39. [Google Scholar] [CrossRef] [Green Version]
  26. Joseph, M. The Gradient Boosters IV: LightGBM. Available online: https://deep-and-shallow.com/2020/02/21/the-gradient-boosters-iii-lightgbm/ (accessed on 24 October 2022).
  27. Scalable and Flexible Gradient Boosting. Available online: https://xgboost.ai/ (accessed on 24 October 2022).
  28. Abirami, S.; Chitra, P. Chapter Fourteen—Energy-efficient edge based real-time healthcare support system. In Advances in Computers; Raj, P., Evangeline, P., Eds.; Elsevier: Amsterdam, The Netherlands, 2020; Volume 117, pp. 339–368. [Google Scholar]
  29. Chawla, N.V.; Bowyer, K.W.; Hall, L.O.; Kegelmeyer, W.P. SMOTE: Synthetic minority over-sampling technique. J. Artif. Intell. Res. 2002, 16, 321–357. [Google Scholar] [CrossRef]
  30. Ivan, T. Two modifications of CNN. IEEE Trans. Syst. Man Commun. SMC 1976, 6, 769–772. [Google Scholar]
  31. Roubinian, N. TACO and TRALI: Biology, risk factors, and prevention strategies. Hematol. 2014 Am. Soc. Hematol. Educ. Program Book 2018, 2018, 585–594. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Hager, H.H.; Burns, B. Artery Cannulation; StatPearls: Treasure Island, FL, USA, 2022. Available online: https://www.ncbi.nlm.nih.gov/books/NBK482242/ (accessed on 15 February 2023).
  33. Arthur, C.; Theodore, G.C.; Dalton, A. Intra-Arterial Catheterization for Invasive Monitoring: Indications, Insertion Techniques, and Interpretation. Available online: https://www.uptodate.com/contents/intra-arterial-catheterization-for-invasive-monitoring-indications-insertion-techniques-and-interpretation (accessed on 15 February 2022).
  34. ASA Physical Status Classification System. Available online: https://www.asahq.org/standards-and-guidelines/asa-physical-status-classification-system (accessed on 15 February 2022).
  35. Kim, J.H.; Kim, H.; Yoo, K.; Hwang, S.M.; Lim, S.Y.; Lee, J.J.; Kwon, Y.S. Effect of the preoperative physical status on postoperative nausea and vomiting risk: A matched cohort study. Perioper. Med. 2022, 11, 31. [Google Scholar] [CrossRef]
  36. Poulose, N.; Raju, R. Aging and injury: Alterations in cellular energetics and organ function. Aging Dis. 2014, 5, 101–108. [Google Scholar] [CrossRef]
  37. Boldt, J. RETRACTED: Use of albumin: An update. Br. J. Anaesth. 2010, 104, 276–284. [Google Scholar] [CrossRef] [Green Version]
  38. Galvagno, S.M.; Steurer, M.P.; Grissom, T.E. Anesthesia for Trauma. In Miller’s Anesthesia; Gropper, M.A.M.D.P., Ed.; Elsevier: Amsterdam, The Netherlands, 2020; pp. 2115–2155.e2118. [Google Scholar]
  39. Kaufman, D.P.; Basit, H.; Knohl, S.J. Physiology, Glomerular Filtration Rate; StatPearls: Treasure Island, FL, USA, 2022. Available online: https://www.ncbi.nlm.nih.gov/books/NBK500032/ (accessed on 15 February 2023).
  40. Munis, J.R.; Munis, J.R. 19Hydrostatic Pressure. In Just Enough Physiology; Oxford University Press: Oxford, UK, 2011. [Google Scholar]
  41. Nakamura, T.; Sakamaki, T.; Kurashina, T.; Sato, K.; Ono, Z.; Murata, K. Effect of Renal Perfusion Pressure on Renal Interstitial Hydrostatic Pressure and Sodium Excretion. Hypertension 1995, 25, 866–871. [Google Scholar] [CrossRef]
Figure 1. Data processing and machine learning process. LGBM, light-gradient boosting machine; LR, logistic regression; ML, machine learning; MLP, multilayer perceptron; XGB, extreme-gradient boosting machine.
Figure 1. Data processing and machine learning process. LGBM, light-gradient boosting machine; LR, logistic regression; ML, machine learning; MLP, multilayer perceptron; XGB, extreme-gradient boosting machine.
Jcm 12 01804 g001
Figure 2. Receiver operating characteristic curve for prediction of postoperative pulmonary edema risk. BRF, balanced random forest; CI, confidence interval; LGBM, light-gradient boosting machine; LR, logistic regression; MLP, multilayer perceptron; ROC, receiver operating characteristic; XGB, extreme-gradient boosting machine.
Figure 2. Receiver operating characteristic curve for prediction of postoperative pulmonary edema risk. BRF, balanced random forest; CI, confidence interval; LGBM, light-gradient boosting machine; LR, logistic regression; MLP, multilayer perceptron; ROC, receiver operating characteristic; XGB, extreme-gradient boosting machine.
Jcm 12 01804 g002
Figure 3. Precision-recall curve for prediction of postoperative pulmonary edema risk. BRF, balanced random forest; CI, confidence interval; LGBM, light-gradient boosting machine; LR, logistic regression; MLP, multilayer perceptron; AP, average precision; ROC, receiver operating characteristic; XGB, extreme-gradient boosting machine.
Figure 3. Precision-recall curve for prediction of postoperative pulmonary edema risk. BRF, balanced random forest; CI, confidence interval; LGBM, light-gradient boosting machine; LR, logistic regression; MLP, multilayer perceptron; AP, average precision; ROC, receiver operating characteristic; XGB, extreme-gradient boosting machine.
Jcm 12 01804 g003
Figure 4. Ten major features of the balanced random forest model for prediction of postoperative pulmonary edema risk. A-line, arterial line monitoring; ASA-PS, American Society of Anesthesiologists physical status; EBL, estimated blood loss; Fluid, fluid administration; Foley, Foley catheter use; GFR, glomerular filtration rate; Protein, protein level.
Figure 4. Ten major features of the balanced random forest model for prediction of postoperative pulmonary edema risk. A-line, arterial line monitoring; ASA-PS, American Society of Anesthesiologists physical status; EBL, estimated blood loss; Fluid, fluid administration; Foley, Foley catheter use; GFR, glomerular filtration rate; Protein, protein level.
Jcm 12 01804 g004
Table 1. Training dataset.
Table 1. Training dataset.
No PPE (n = 218,324)PPE (n = 3584)p-Value
Age50.0 (37.0, 62.0)69.0 (56.0, 78.0)<0.001
Male sex100,552 (46.1)1739 (48.5)0.004
Order of surgery1.0 (1.0, 1.0)1.0 (1.0, 1.0)<0.001
Preoperative atelectasis6276 (2.9)418 (11.7)<0.001
Preoperative effusion4658 (2.1)410 (11.4)<0.001
Preoperative pneumothorax1968 (0.9)71 (2.0)<0.001
Preoperative pneumonia1401 (0.6)176 (4.9)<0.001
Preoperative PTE178 (0.1)18 (0.5)<0.001
Preoperative ARDS19 (0.0)1 (0.0)0.754
Body mass index24.0 (21.8, 26.5)23.9 (21.5, 26.6)0.059
Congestive heart failure4236 (1.9)467 (13.0)<0.001
Cardiac arrhythmia6520 (3.0)353 (9.8)<0.001
Valvular diseases1170 (0.5)153 (4.3)<0.001
Pulmonary circulation disorders921 (0.4)77 (2.1)<0.001
Peripheral vascular disorders4399 (2.0)192 (5.4)<0.001
Hypertension, uncomplicated24,413 (11.2)903 (25.2)<0.001
Hypertension, complicated9025 (4.1)420 (11.7)<0.001
Paralysis609 (0.3)33 (0.9)<0.001
Other neurological disorders5120 (2.4)243 (6.8)<0.001
Chronic pulmonary diseases14,365 (6.6)394 (11.0)<0.001
Diabetes, uncomplicated11,051 (5.1)373 (10.4)<0.001
Diabetes, complicated14,996 (6.9)562 (15.7)<0.001
Hypothyroidism4828 (2.2)162 (4.5)<0.001
Renal failure5847 (2.7)426 (11.9)<0.001
Liver disease11,293 (5.2)244 (6.8)<0.001
Peptic ulcer diseases (excluding bleeding)4055 (1.9)92 (2.6)0.002
AIDS/HIV59 (0.0)0 (0)0.640
Lymphoma744 (0.3)26 (0.7)<0.001
Metastatic cancer2261 (1.0)77 (2.1)<0.001
Solid tumors without metastasis33,956 (15.6)991 (27.6)<0.001
Rheumatoid arthritis/collagen vascular diseases3176 (1.4)83 (2.3)<0.001
Alcohol consumption59,560 (27.3)698 (19.5)<0.001
Current smoking37,885 (17.4)533 (14.9)<0.001
Smoking frequency (packs)0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Smoking duration (years)0.0 (0.0, 0.0)0.0 (0.0, 0.0)0.014
Emergency36,571 (16.8)1057 (29.5)<0.001
ASA-PS > 282,608 (37.8)1053 (0.5)<0.001
General anesthesia181,268 (83.0)3210 (89.6)<0.001
Anesthetics (sevoflurane)124,935 (57.2)2415 (1.1)<0.001
N2O10,226 (4.7)73 (2.0)<0.001
Anesthesia time (min)105.0 (70.0, 160.0)190.0 (125.0, 300.0)<0.001
Surgery time (min)65.0 (35.0, 115.0)130.0 (75.0, 230.5)<0.001
Intraoperative blood administration0.0 (0.0, 0.0)0.0 (0.0, 400.0)<0.001
Intraoperative fluid administration500.0 (300.0, 900.0)1500.0 (850.0, 2500.0)<0.001
Intraoperative urine output0.0 (0.0, 90.0)215.0 (60.0, 550.0)<0.001
Estimated blood loss20.0 (0.0, 100.0)500.0 (100.0, 800.0)<0.001
Arterial line56,990 (26.1)3252 (90.7)<0.001
Central venous line14,362 (6.6)1649 (46.0)<0.001
Foley catheter77,786 (35.6)3097 (86.4)<0.001
Levin tube3656 (1.7)277 (7.7)<0.001
Patient-controlled analgesia (intravenous)83,711 (38.3)1119 (0.5)<0.001
Intraoperative packed red blood cells0.0 (0.0, 0.0)0.0 (0.0, 2.0)<0.001
Intraoperative FFP0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Intraoperative PC0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Intraoperative cryoprecipitate0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Rocuronium50.0 (0.0, 50.0)50.0 (25.0, 60.0)<0.001
Vecuronium0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Atracurium0.0 (0.0, 0.0)0.0 (0.0, 0.0)0.214
Cisatracurium0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Succinylcholine0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Pyridostigmine0.0 (0.0, 15.0)0.0 (0.0, 15.0)<0.001
Neostigmine0.0 (0.0, 1.0)0.0 (0.0, 1.0)0.026
Sugammadex0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Fentanyl0.0 (0.0, 0.1)0.0 (0.0, 0.0)<0.001
Alfentanil0.0 (0.0, 0.0)0.0 (0.0, 0.0)0.171
Sufentanil0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Remifentanil0.0 (0.0, 1.0)0.0 (0.0, 1.0)<0.001
Pethidine0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
BUN13.3 (10.5, 16.6)16.1 (12.1, 21.6)<0.001
Cr0.8 (0.6, 0.9)0.8 (0.7, 1.1)<0.001
GFR98.0 (83.0, 116.0)85.0 (63.0, 107.0)<0.001
PT12.1 (11.3, 12.9)12.9 (12.0, 13.9)<0.001
aPTT31.6 (27.9, 35.2)33.2 (28.5, 37.8)<0.001
INR1.0 (0.9, 1.1)1.0 (1.0, 1.1)<0.001
PLT246.0 (206.0, 291.0)219.0 (171.0, 276.0)<0.001
Na140.0 (138.0, 141.0)139.0 (136.0, 141.0)<0.001
K4.1 (3.9, 4.4)4.0 (3.7, 4.3)<0.001
Uric acid4.7 (3.7, 5.8)4.6 (3.4, 5.9)0.004
Protein7.2 (6.7, 7.5)6.6 (6.0, 7.2)<0.001
Albumin4.4 (4.1, 4.6)3.9 (3.3, 4.3)<0.001
Robotic surgery5022 (2.3)117 (3.3)<0.001
Laparoscopic surgery41,921 (19.2)436 (12.2)<0.001
Heart surgery970 (0.4)265 (7.4)<0.001
Abdominal surgery (minor/major)34,286 (15.7)/6750 (3.1)434 (12.1)/369 (10.3)<0.001
Breast surgery (minor/major)7304 (3.4)/20 (0.0)19 (0.5)/2 (0.1)<0.001
Ear surgery (minor/major)4270 (2.0)/2 (0.0)8 (0.2)/0 (0)<0.001
Endocrine surgery (minor/major)3145 (1.4)/2691 (1.2)19 (0.5)/7 (0.2)<0.001
Eye surgery4215 (1.9)10 (0.3)<0.001
Head and neck surgery (minor/major)25,006 (11.4)/269 (0.1)41 (1.1)/8 (0.2)<0.001
Musculoskeletal surgery (minor/major)50,412 (23.1)/3040 (1.4)666 (18.6)/306 (8.5)<0.001
Neurosurgery (minor/major)5837 (2.7)/1707 (0.8)306 (8.5)/197 (5.5)<0.001
OBGY surgery (minor/major)33,713 (15.4)/602 (0.3)128 (3.6)/30 (0.8)<0.001
Spine surgery (minor/major)4181 (1.9)/2743 (1.3)144 (4.0)/208 (5.8)<0.001
Thoracic surgery (minor/major)3130 (1.4)/945 (0.4)142 (4.0)/71 (2.0)<0.001
Transplantation surgery (minor/major)64 (0.0)/127 (0.1)4 (0.1)/37 (1.0)<0.001
Urogenital surgery (minor/major)19,458 (8.9)/1894 (0.9)98 (2.7)/118 (3.3)<0.001
Vascular surgery (minor/major)1610 (0.7)/82 (0.0)76 (2.1)/25 (0.7)<0.001
Skin and soft tissue surgery (minor/major)15,406 (7.1)/97 (0.0)111 (3.1)/7 (0.2)<0.001
AIDS, acquired immunodeficiency syndrome; aPTT, activated partial thromboplastin time; ARDS, acute respiratory distress; ASA-PS, American Society of Anesthesiologists physical status; BUN, blood urea nitrogen; Cr, creatine; FFP, fresh frozen plasma, GFR, glomerular filtration rate; HIV, human immunodeficiency virus; INR, international normalized ratio; OBGY, obstetric and gynecologic; PC, platelet concentrate; PLT, platelet; PPE, postoperative pulmonary edema; PT, prothrombin time; PTE, pulmonary thromboembolism.
Table 2. Test dataset.
Table 2. Test dataset.
No PPE (n = 33,095)PPE (n = 1896)p-Value
Age, year52.0 (39.0, 64.0)71.0 (60.0, 79.0)<0.001
Male sex18,038 (54.5)973 (51.3)0.007
Order of surgery1.0 (1.0, 1.0)1.0 (1.0, 1.0)<0.001
Preoperative atelectasis788 (2.4)172 (9.1)<0.001
Preoperative effusion725 (2.2)194 (10.2)<0.001
Preoperative pneumothorax191 (0.6)25 (1.3)<0.001
Preoperative pneumonia257 (0.8)109 (5.8)<0.001
Preoperative PTE17 (0.1)6 (0.3)<0.001
Preoperative ARDS6 (0.0)0 (0)>0.999
Body mass index24.4 (22.1, 26.9)23.9 (21.3, 26.5)<0.001
Congestive heart failure1168 (3.5)238 (12.6)<0.001
Cardiac arrhythmias1438 (4.3)231 (12.2)<0.001
Valvular disease231 (0.7)51 (2.7)<0.001
Pulmonary circulation disorders239 (0.7)65 (3.4)<0.001
Peripheral vascular disorders534 (1.6)73 (3.9)<0.001
Hypertension, uncomplicated3896 (11.8)467 (24.6)<0.001
Hypertension, complicated2507 (7.6)264 (13.9)<0.001
Paralysis282 (0.8)38 (2.0)<0.001
Other neurological disorders1021 (3.1)163 (8.6)<0.001
Chronic pulmonary diseases4377 (13.2)380 (20.0)<0.001
Diabetes, uncomplicated3325 (10.1)338 (17.8)<0.001
Diabetes, complicated2067 (6.2)251 (13.2)<0.001
Hypothyroidism537 (1.6)54 (2.9)<0.001
Renal failure1378 (4.2)236 (12.4)<0.001
Liver disease2556 (7.7)221 (11.7)<0.001
Peptic ulcer diseases (excluding bleeding)1147 (3.5)75 (4.0)0.287
AIDS/HIV2 (0.0)0 (0)>0.999
Lymphoma132 (0.4)9 (0.5)0.749
Metastatic cancer333 (1.0)57 (3.0)<0.001
Solid tumors without metastasis4336 (13.1)595 (31.4)<0.001
Rheumatoid arthritis/collagen vascular diseases655 (2.0)45 (2.4)0.268
Alcohol consumption8651 (26.1)309 (16.3)<0.001
Current smoking5953 (18.0)258 (13.6)<0.001
Smoking frequency (packs)0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Smoking duration (years)0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Emergency4606 (13.9)596 (31.4)<0.001
ASA-PS > 213,558 (41.0)829 (2.5)<0.001
General anesthesia29,306 (88.5)1886 (99.5)<0.001
Anesthetics (Sevoflurane)16,024 (48.4)888 (2.7)<0.001
N2O18,445 (55.7)578 (30.5)<0.001
Anesthesia time (min)85.0 (60.0, 130.0)140.0 (95.0, 215.0)<0.001
Surgery time (min)55.0 (35.0, 95.0)100.0 (60.0, 165.0)<0.001
Intraoperative blood administration0.0 (0.0, 0.0)0.0 (0.0, 240.0)<0.001
Intraoperative fluid administration350.0 (200.0, 600.0)950.0 (500.0, 1750.0)<0.001
Intraoperative urine output0.0 (0.0, 30.0)85.0 (20.0, 230.0)<0.001
Estimated blood loss20.0 (5.0, 50.0)200.0 (30.0, 600.0)<0.001
Arterial line7387 (22.3)1627 (85.8)<0.001
Central venous line3314 (10.0)1258 (66.3)<0.001
Foley catheter10,807 (32.6)1560 (82.3)<0.001
Levin tube1070 (3.2)278 (14.7)<0.001
Patient-controlled analgesia (intravenous)15,263 (46.1)490 (1.5)<0.001
Intraoperative packed red blood cell0.0 (0.0, 0.0)0.0 (0.0, 1.0)<0.001
Intraoperative FFP0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Intraoperative PC0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Intraoperative cryoprecipitate0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Rocuronium50.0 (50.0, 75.0)75.0 (50.0, 150.0)<0.001
Vecuronium0.0 (0.0, 0.0)0.0 (0.0, 0.0)>0.999
Atracurium0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Cisatracurium0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
Succinylcholine0.0 (0.0, 0.0)0.0 (0.0, 0.0)0.081
Pyridostigmine20.0 (0.0, 20.0)0.0 (0.0, 20.0)<0.001
Neostigmine0.0 (0.0, 0.0)0.0 (0.0, 0.0)>0.999
Sugammadex0.0 (0.0, 0.0)0.0 (0.0, 200.0)<0.001
Fentanyl0.0 (0.0, 0.0)0.0 (0.0, 0.0)0.056
Alfentanil0.0 (0.0, 0.5)0.0 (0.0, 0.2)<0.001
Sufentanil0.0 (0.0, 0.0)0.0 (0.0, 0.0)0.095
Remifentanil0.0 (0.0, 0.0)0.0 (0.0, 0.4)<0.001
Pethidine0.0 (0.0, 0.0)0.0 (0.0, 0.0)<0.001
BUN14.1 (11.5, 17.4)16.4 (12.6, 22.0)<0.001
Cr0.8 (0.7, 1.0)0.9 (0.7, 1.1)0.002
GFR90.0 (77.0, 104.0)81.6 (63.0, 100.7)<0.001
PT11.1 (10.6, 11.7)11.6 (11.0, 12.5)<0.001
aPTT31.2 (29.0, 33.7)30.0 (27.5, 32.8)<0.001
INR1.0 (1.0, 1.1)1.1 (1.0, 1.1)<0.001
PLT247.0 (208.0, 292.0)218.0 (169.8, 274.0)<0.001
Na141.0 (140.0, 143.0)140.0 (138.0, 142.0)<0.001
K4.2 (3.9, 4.4)4.1 (3.8, 4.4)<0.001
Uric acid4.8 (3.8, 5.9)4.5 (3.4, 5.8)<0.001
Protein7.0 (6.6, 7.3)6.5 (6.0, 7.0)<0.001
Albumin4.4 (4.1, 4.6)3.9 (3.4, 4.3)<0.001
Robotic surgery208 (0.6)73 (3.9)<0.001
Laparoscopic surgery4240 (12.8)427 (22.5)<0.001
Heart surgery24 (0.1)8 (0.4)<0.001
Abdominal surgery (minor/major)5113 (15.4)/706 (2.1)428 (22.6)/268 (14.1)<0.001
Breast surgery (minor/major)1306 (4.0)/2 (0.0)5 (0.3)/1 (0.1)<0.001
Ear surgery (minor/major)855 (2.6)1 (0.1)<0.001
Endocrine surgery (minor/major)369 (1.1)/107 (0.3)8 (0.4)/1 (0.1)0.002
Eye surgery606 (1.8)4 (0.2)<0.001
Head and neck surgery (minor/major)4087 (12.3)/12 (0.0)22 (1.2)/3 (0.2)<0.001
Musculoskeletal surgery (minor/major)11,044 (33.4)/530 (1.6)353 (18.6)/226 (11.9)<0.001
Neurosurgery (minor/major)779 (2.4)/231 (0.7)99 (5.2)/96 (5.1)<0.001
OBGY surgery (minor/major)1705 (5.2)/24 (0.1)5 (0.3)/1 (0.1)<0.001
Spine surgery (minor/major)2050 (6.2)/220 (0.7)73 (3.9)/44 (2.3)<0.001
Thoracic surgery (minor/major)272 (0.8)/54 (0.2)76 (4.0)/19 (1.0)<0.001
Transplantation surgery (minor/major)0 (0)0 (0)>0.999
Urogenital surgery (minor/major)2021 (6.1)/104 (0.3)62 (3.3)/69 (3.6)<0.001
Vascular surgery (minor/major)368 (1.1)/2 (0.0)13 (0.7)/0 (0)0.208
Skin and soft tissue surgery (minor/major)1510 (4.6)/14 (0.0)12 (0.6)/4 (0.2)<0.001
AIDS, acquired immunodeficiency syndrome; aPTT, activated partial thromboplastin time; ARDS, acute respiratory distress; ASA-PS, American Society of Anesthesiologists physical status; BUN, blood urea nitrogen; Cr, creatine; FFP, fresh frozen plasma, GFR, glomerular filtration rate; HIV, human immunodeficiency virus; INR, international normalized ratio; OBGY, obstetric and gynecologic; PC, platelet concentrate; PLT, platelet; PPE, postoperative pulmonary edema; PT, prothrombin time; PTE, pulmonary thromboembolism.
Table 3. Best threshold, precision, recall, f1 score, and accuracy values for each model.
Table 3. Best threshold, precision, recall, f1 score, and accuracy values for each model.
Best ThresholdAccuracy PrecisionRecallF1 Score
BRF0.420.82Normal0.990.810.89
PPE0.210.890.34
LGBM0.0480.72Normal0.980.720.83
PPE0.140.800.24
XGB0.3530.76Normal0.980.770.86
PPE0.140.660.23
MLP00.93Normal0.950.980.96
PPE0.070.030.04
LR697.80.75Normal0.980.750.85
PPE0.140.680.23
BRF, balanced random forest; LGBM, light-gradient boosting machine; XGB, extreme-gradient boosting machine; MLP, multilayer perceptron; LR, logistic regression; PPE, postoperative edema.
Table 4. Validation of the under-sampling test dataset and simplified model using balanced random forest algorithm.
Table 4. Validation of the under-sampling test dataset and simplified model using balanced random forest algorithm.
AUC
(95% CI)
Best
Threshold
Accuracy PrecisionRecallF1 Score
After under sampling0.911
(0.855–0.972)
0.420.83Normal0.990.820.90
PPE0.220.890.36
Simplified model0.901
(0.829–0.978)
0.440.82Normal0.990.810.89
PPE0.210.880.34
AUC, area under curve; CI, confidence interval; PPE, postoperative pulmonary edema.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kim, J.H.; Kim, Y.; Yoo, K.; Kim, M.; Kang, S.S.; Kwon, Y.-S.; Lee, J.J. Prediction of Postoperative Pulmonary Edema Risk Using Machine Learning. J. Clin. Med. 2023, 12, 1804. https://doi.org/10.3390/jcm12051804

AMA Style

Kim JH, Kim Y, Yoo K, Kim M, Kang SS, Kwon Y-S, Lee JJ. Prediction of Postoperative Pulmonary Edema Risk Using Machine Learning. Journal of Clinical Medicine. 2023; 12(5):1804. https://doi.org/10.3390/jcm12051804

Chicago/Turabian Style

Kim, Jong Ho, Youngmi Kim, Kookhyun Yoo, Minguan Kim, Seong Sik Kang, Young-Suk Kwon, and Jae Jun Lee. 2023. "Prediction of Postoperative Pulmonary Edema Risk Using Machine Learning" Journal of Clinical Medicine 12, no. 5: 1804. https://doi.org/10.3390/jcm12051804

APA Style

Kim, J. H., Kim, Y., Yoo, K., Kim, M., Kang, S. S., Kwon, Y. -S., & Lee, J. J. (2023). Prediction of Postoperative Pulmonary Edema Risk Using Machine Learning. Journal of Clinical Medicine, 12(5), 1804. https://doi.org/10.3390/jcm12051804

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop