Next Article in Journal
Detecting Coronary Artery Disease from Computed Tomography Images Using a Deep Learning Technique
Next Article in Special Issue
Prone Positioning Decreases Inhomogeneity and Improves Dorsal Compliance in Invasively Ventilated Spontaneously Breathing COVID-19 Patients—A Study Using Electrical Impedance Tomography
Previous Article in Journal
Case Report: MRI, CEUS, and CT Imaging Features of Metanephric Adenoma with Histopathological Correlation and Literature Review
Previous Article in Special Issue
Testosterone Therapy and Diaphragm Performance in a Male Patient with COVID-19: A Case Report
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The RALE Score Versus the CT Severity Score in Invasively Ventilated COVID-19 Patients—A Retrospective Study Comparing Their Prognostic Capacities

by
Christel M. Valk
1,†,
Claudio Zimatore
1,2,*,†,
Guido Mazzinari
3,4,
Charalampos Pierrakos
1,5,
Chaisith Sivakorn
6,
Jutamas Dechsanga
7,
Salvatore Grasso
2,
Ludo Beenen
8,
Lieuwe D. J. Bos
1,9,
Frederique Paulus
1,
Marcus J. Schultz
1,10,11 and
Luigi Pisani
1,10,12
1
Department of Intensive Care & Laboratory of Experimental Intensive Care and Anesthesiology (L·E·I·C·A), Amsterdam UMC, Location ‘AMC’, 1105 AZ Amsterdam, The Netherlands
2
Department of Emergency and Organ Transplantation, University of Bari Aldo Moro, 70124 Bari, Italy
3
Department of Anaesthesiology and Critical Care, Hospital Universitario y Politecnico la Fe, 46026 Valencia, Spain
4
Perioperative Medicine Research Group, Instituto de Investigación Sanitaria la Fe, 46026 Valencia, Spain
5
Department of Intensive Care, Centre Hospitalier Universitaire Brussels, 1020 Brussels, Belgium
6
Intensive Care Unit, NHS Foundation Trust, University College London Hospitals, London NW1 2BU, UK
7
Division of Pulmonary and Critical Care, Department of Medicine, Chonburi Hospital, Chonburi 20000, Thailand
8
Department of Radiology, Amsterdam UMC, Location ‘AMC’, 1105 AZ Amsterdam, The Netherlands
9
Department of Pulmonology, Amsterdam UMC, Location ‘AMC’, 1105 AZ Amsterdam, The Netherlands
10
Mahidol-Oxford Tropical Medicine Research Unit (MORU), Mahidol University, Bangkok 10400, Thailand
11
Nuffield Department of Medicine, University of Oxford, Oxford OX1 2JD, UK
12
Anaesthesia and Intensive Care Unit, Miulli Regional Hospital, 70021 Acquaviva Delle Fonti, Italy
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Diagnostics 2022, 12(9), 2072; https://doi.org/10.3390/diagnostics12092072
Submission received: 30 July 2022 / Revised: 20 August 2022 / Accepted: 22 August 2022 / Published: 26 August 2022
(This article belongs to the Special Issue Critical Care Imaging)

Abstract

:
Background: Quantitative radiological scores for the extent and severity of pulmonary infiltrates based on chest radiography (CXR) and computed tomography (CT) scan are increasingly used in critically ill invasively ventilated patients. This study aimed to determine and compare the prognostic capacity of the Radiographic Assessment of Lung Edema (RALE) score and the chest CT Severity Score (CTSS) in a cohort of invasively ventilated patients with acute respiratory distress syndrome (ARDS) due to COVID-19. Methods: Two-center retrospective observational study, including consecutive invasively ventilated COVID-19 patients. Trained scorers calculated the RALE score of first available CXR and the CTSS of the first available CT scan. The primary outcome was ICU mortality; secondary outcomes were duration of ventilation in survivors, length of stay in ICU, and hospital-, 28-, and 90-day mortality. Prognostic accuracy for ICU death was expressed using odds ratios and Area Under the Receiver Operating Characteristic curves (AUROC). Results: A total of 82 patients were enrolled. The median RALE score (22 [15–37] vs. 26 [20–39]; p = 0.34) and the median CTSS (18 [16–21] vs. 21 [18–23]; p = 0.022) were both lower in ICU survivors compared to ICU non-survivors, although only the difference in CTSS reached statistical significance. While no association was observed between ICU mortality and RALE score (OR 1.35 [95%CI 0.64–2.84]; p = 0.417; AUC 0.50 [0.44–0.56], this was noticed with the CTSS (OR, 2.31 [1.22–4.38]; p = 0.010) although with poor prognostic capacity (AUC 0.64 [0.57–0.69]). The correlation between the RALE score and CTSS was weak (r2 = 0.075; p = 0.012). Conclusions: Despite poor prognostic capacity, only CTSS was associated with ICU mortality in our cohort of COVID-19 patients.

1. Introduction

Quantitative scores for pulmonary infiltrates and consolidations on lung images such as chest radiography (CXR) and chest computed tomography (CT) are increasingly used in critically ill invasively ventilated patients. Such visual scores may have comparable diagnostic and prognostic capacities [1,2,3]. Advantages of a CXR-based score over chest CT scan-based score rely on CXRs being easier and cheaper to obtain, with no patient transportation outside of the ICU, and lower radiation exposure than a chest CT scan.
The Radiographic Assessment of Lung Edema (RALE) score quantifies both extent and severity of parenchymal abnormalities in the CXR [4]. The RALE score has been shown to have an excellent diagnostic accuracy for acute respiratory distress syndrome (ARDS) [5,6,7], and early changes in the RALE score have been found to have an association with outcome in critically ill invasively ventilated patients [4,8,9]. This was confirmed in invasively ventilated patients with coronavirus disease 2019 (COVID-19) [1]. A recent analysis on invasively ventilated patients showed how higher RALE scores were associated with worse parameters of respiratory mechanics and higher levels of pro-inflammatory biomarkers [10]. The CT severity score (CTSS) quantifies the extent of parenchymal involvement on the chest CT scan, by summing the percentage of affected lung tissue per each lung lobe [11]. The CTSS has been used successfully in the diagnostic process in COVID-19 patients and has been shown to correlate well with disease severity and laboratory parameters [12]. The CTSS may even have a correlation with short-term outcome [13,14].
In the current study, we aimed to determine the association with mortality of the RALE score and the CTSS in critically ill invasively ventilated COVID-19 patients and compare their prognostic capacity for ICU mortality. We also sought to determine the correlation between the RALE score and the CTSS. We hypothesized that the RALE score and the CTSS have comparable prognostic capacity for outcome.

2. Materials and Methods

2.1. Study Design

This was a retrospective observational study in critically ill invasively ventilated COVID-19 patients admitted to the intensive care units (ICUs) of two tertiary centers, the Academic Medical Center, and the Free University Medical Center, Amsterdam, The Netherlands. The Institutional Review Boards of both hospitals approved the study protocol (approval W20_494 # 20.546). The need for individual patient informed consent was waived because the data used for this analysis were collected as part of standard care. The study is registered at clinicaltrials.gov (NCT05047653).

2.2. Inclusion and Exclusion Criteria

Consecutive patients admitted between 1 March 2020, and 1 June 2020, the first wave of the national outbreak in the Netherlands, and between 1 October 2020 and 31 December 2020, the first 3 months of the second wave of the national outbreak in the Netherlands were screened for participation. Patients were selected if having received invasive ventilation for acute hypoxemic respiratory failure due to COVID-19 that was confirmed by reverse transcriptase–polymerase chain reaction for SARS-CoV-2. Patients aged <18 years, patients with an alternate diagnosis, and patients receiving other forms of oxygen support, such as high flow nasal oxygen (HFNO), noninvasive ventilation, or continuous positive airway pressure, were excluded. We also excluded patients that had their first CXR and first chest CT scan too far apart in time, using a cutoff of 24 h.

2.3. Data Collection

An online case report form created with Castor (www.castoredc.com (accessed on 29 July 2022)) was used to collect baseline and demographic characteristics, the Acute Physiology and Chronic Health Evaluation (APACHE) II score, and typical ventilation parameters at the moment of lung imaging, including inhaled oxygen fraction (FiO2), positive end-expiratory pressure (PEEP), maximum airway pressure (Pmax), respiratory rate (RR), tidal volume (VT), and the blood gas analysis results.

2.4. Imaging Scores

CXRs and chest CT scans were collected from the electronic imaging systems in each hospital and uploaded in Joint Photographic Experts Group (JPEG) format into the database. Then, CXRs were scored by at least two independent scorers that were extensively trained in calculating RALE scores. For this, each scorer was trained in the RALE scoring by one of the investigators (C.Z.), who was trained during a 1-month focused period by the team that developed the RALE score [6]. An interclass correlation coefficient (ICC) > 0.8 between the trainer and other scorers on a training sample of 22 CXRs from another set of CXRs of patients with ARDS was a prerequisite for scoring CXRs in the study dataset. A third scorer was only involved if the difference in numeric RALE score between two scorers was >25%, in order to reach a final consensus by discussion. Chest CT scans were scored by a radiologist experienced in chest CT.
For the RALE score, the chest was divided into four quadrants by a vertical line over the spine and a horizontal line at the level of the first branch of the left main bronchus; each quadrant was then scored for extent of alveolar opacities (consolidation score, from 0 to 4), and the corresponding density of alveolar opacities (density score, from 1 to 3), and the final score was the sum of the product of the consolidation and density scores for each quadrant. The RALE score thus ranged from 0 (no abnormalities) to 48 (maximum abnormalities) [4]. For details on RALE score computation, see Figure S1.
For the CTSS, the percentage of involvement per each lung lobe was scored and summed; the final score was the sum of the individual lobar scores, which could range from 0 (no lung involvement) to 25 (maximum involvement when all the 5 lobes show more than 75% involvement) [15]. For details, see Table S1.

2.5. Outcomes

The primary outcome was ICU mortality. Secondary outcomes were duration of ventilation in survivors, length of stay in ICU, and hospital-, 28-, and 90-day mortality.

2.6. Power Calculation

We did not perform a formal sample size calculation. Instead, the available patients served as the sample size for this study.

2.7. Statistical Analysis

Demographic data and clinical and outcome variables were summarized as medians (interquartile range) for continuous variables and as frequencies (percentage) for categorical variables. Normally distributed variables were compared between groups with t-test or ANOVA. Not normally distributed variables were compared between groups with Wilcoxon signed rank tests or Mann–Whitney U test. Categorical variables were compared between groups by Wilcoxon signed rank test.
To test the association of the radiological scores with outcomes, we performed univariable and multivariable logistic regression models introducing the RALE score and the CTSS alternatively. As covariates for the logistic regression models, we used age, body mass index, and the APACHE II score [16]. We performed a sensitivity analysis introducing PEEP as covariate, as PEEP can influence imaging scores. In a further sensitivity analysis, we used a Splines fitted model to take into consideration the non-normal distribution of the CTSS. For this purpose, linear tail restricted cubic splines with three knots and three degrees of freedom were fitted, as by default values from the ‘rcs’ function of the ‘rms’ R package. For both univariable and multivariable logistic regression model, a receiver operating characteristic (ROC) was constructed from which the area under curve (AUROC) was calculated. In order to assess the prognostic potential of both scores, ROC curves were estimated on the averaged terms after applying a repeated (5 times) 10-fold cross-validation algorithm to the dataset, and 95% confidence interval on ROC estimates were obtained by 500 bootstrap repetitions. When the AUROC was 0.9–1.0, the prognostic capacity was considered excellent, if 0.8–0.9, 0.7–0.8, and 0.6–0.7, the test was defined as good, fair, or poor, respectively. The De Long test was used for the comparison of the AUROCs [17]. A non-significant result would confirm that the two scores are comparable in terms of prognostic capability for ICU mortality. For the correlation between the RALE and CTSS, we used the coefficient of determination obtained from a simple linear regression model (r2), using RALE as independent variable and CTSS as dependent variable.
To assess the continuous outcomes such as duration of ventilation and ICU length of stay in survivors, we fitted a linear regression model for each score with the same covariates structure as the aforementioned logistic models. We compared which score performs best in the model using R2.
All analyses were performed using a two-sided superiority hypothesis test, with a significance level of 0.05 and presented with two-sided 95% confidence intervals. No corrections were performed for multiple comparisons across secondary clinical outcomes, thus the findings should be considered as exploratory. All analyses were performed using R (version 4.0.2, R Core Team, 2016, Vienna, Austria).

3. Results

3.1. Patients

From 1 March 2020 through 1 June 2020 (the first 3 months of the first wave) and from 1 October 2020 through 31 December 2020 (the first 3 months of the second wave), we screened 254 patients (Figure 1). We excluded 172 patients for various reasons, the most frequent one being a missing CXR or CT scan within the predefined timespan of 24 h.
Patient demography and ventilation characteristics and outcomes are shown in Table 1 and Table 2. The median age was 65 [60–72] years, with the most common comorbidities being hypertension and diabetes. There were no significant differences in frequencies in demographic characteristics and comorbidities between ICU survivors and ICU non-survivors except for hypertension. Furthermore, ventilation parameters were not different between the same groups and most patients had moderate or severe ARDS. ICU mortality was 42.7%.

3.2. Imaging Scores

The median RALE score was 22 [15–37] in ICU survivors and 26 [19–39] in non–ICU survivors (p = 0.34); the median CTSS was lower in ICU survivors compared to ICU non-survivors (18 [16–21] vs. 21 [18–23]; p = 0.02). The CTSS showed a skewed distribution towards higher values (Figure 2). The correlation between the two scores was poor, with very little variance in RALE being explained by the CTSS (r2 = 0.075; p = 0.012) (Figure 3). In 19.4% of CXRs, a third scorer was needed to reach a consensus regarding the RALE score.

3.3. Prognostic Capacity for ICU Death

The RALE score had no association with ICU mortality (OR, 1.35 [95%CI 0.64–2.84]; p = 0.42) (Table 3), neither showed prognostic capacity, with an area under ROC (AUROC) for ICU mortality of 0.50 [0.44–0.56] (Figure 4), although the calibration of the fitted model was poor (Figure S2A). The CTSS had an association with ICU mortality (OR, 2.31 [95%CI 1.22–4.38]; p = 0.01), with an adequate calibration of the fitted model (Figure S2B). The prognostic capacity of the CTSS was poor, with an AUROC for ICU mortality of 0.64 [0.57–0.69] (Figure 4), yet significantly superior to the RALE score (p value for De Long test = 0.006) (Table 4).
The CTSS had an association with hospital mortality, 28-day, and 90-day mortality, but not with length of stay or duration of ventilation (Table 3). The RALE score was not associated with any of the secondary outcomes.

3.4. Sensitivity Analyses

The addition of PEEP in the model and using splines fitted models did not modify the findings for the primary outcome (Figure S3). Both scores were not associated with ICU mortality when only the CXRs of the first 3 days were taken into consideration (Table 3).

4. Discussion

The main findings of this study in COVID-19 patients with ARDS can be summarized as follows: (1) The first available CTSS score is associated with patient mortality albeit with a poor prognostic capacity; (2) the first available RALE score has no association with outcome and no prognostic capacity; (3) there is a lack of correlation between the two radiological scores; (4) none of the scores can predict ICU length of stay or duration of mechanical ventilation.
In contrast to the study hypothesis, the two radiological scores showed a different behavior with regards to prognostication of patient outcome. The CT-based score was significantly higher in non-survivors and showed an association with all mortality outcomes. Although the CTSS was initially developed to discriminate the severity of disease [15,18], subsequent studies did show a consistent association with outcome. In a validation study performed in the Netherlands, the CTSS was associated with 30-day mortality, although that study was performed in the emergency department and recruited suspected rather than confirmed COVID-19 cases [14]. In ICU patients, the CTSS was shown to predict the composite outcome of death or ICU stay for more than 30 days [19].
Despite showing an association with mortality and a superior predictive potential as compared to the RALE score, the prognostic capability of the CTSS was minimal and unfit for clinical purposes. This highlights the complexity of the trajectory of COVID-19 ARDS, where the extent of pulmonary impairment as assessed by imaging at baseline has a limited impact on survival. The poor prognostic capacity of the CTSS was also observed in the emergency department [14]. Although chest CT manages to identify progression of COVID-19 ground-glass opacities towards consolidations and absorption [20], the baseline score seems to provide scarce predictive information. The failure to predict mortality using baseline scores has also been shown for lung ultrasound [21] and chest X-ray [1]. The use of early changes in radiological scores seem to outperform the use of baseline values for prognostication purposes [1,8,14].
The RALE score had consistently no association with any of the mortality outcomes. This echoes the finding of a recent international multicenter study performed on 139 patients with COVID-19 ARDS [1] and another study in five German ICUs [22]. Yet, these findings are in contrast with other studies conducted in less severe cohorts or patients outside of the ICU that did find an association between the entity of pulmonary impairment estimated by the RALE score and adverse outcomes [8,23,24,25]. The RALE score provides a reliable interpretation of signs of lung edema on chest radiographs and has been validated as a good predictor of ARDS [4,8]. The RALE may also be associated with long term diffusion impairment, as recently shown in a cohort of patients performing CXR at six months from discharge [26]. COVID-19 worked as a boost for a development of machine learning solutions to assist specialists in early diagnostic detection and treatment of ICU patients [27]. For instance, the RALE score was also used as benchmark to validate a fully automated segmentation and intensity quantification method in CXRs for COVID–19 patients [28]. To date, the overall evidence is against the routine use of the baseline RALE score for the prediction of outcome in mechanically ventilated ICU patients with COVID-19 ARDS.
Pulmonary vascular dysfunctions described in COVID-19 ARDS are not captured by the CTSS and RALE score [29,30,31,32,33,34]. Aside from thrombo-embolic complications, mortality may be also driven by other factors, such as bacterial and fungal infections complications [35,36] and ICU-acquired weakness. The initial ventilator management was also shown to moderate the prognostic value of other predictive parameters [37]. These mechanisms aid to justify the absent or scarce prognostic potential of baseline radiological scores in COVID-19 ARDS.
The negligible correlation between CXR RALE score and the chest CT scan CTSS was unexpected and does not have a univocal explanation [38,39]. In fact, several conceptual differences may impede interchangeable use of the two scores. The RALE attempts to quantify both extent and severity of alveolar infiltrates of pulmonary edema while the CTSS solely estimates the extent of lung involvement [13,14,15,18]. Secondly, the different distributions observed suggest that caution should be taken before comparing a CXR based score with a CT derived one. For instance, the CTSS was skewed towards higher values, while the RALE showed a normal distribution. For the bedside clinician, chest radiographs remain easier to perform, require lower radiation dose, and are safer compared to CT. The possible benefits of routine CT examinations (fast triage, high resolution imaging, association with mortality) may not outweigh the harms such as overuse of medical resources and higher radiation dose [14]. Considered these shortcomings and the poor prognostic capacity of the CTSS, the use of early changes in the RALE score or lung ultrasound score could be more useful as first line imaging technique [1,8,19,21].
The study was designed to minimize bias by strictly adhering to a predefined statistical analysis plan and systematic training of the RALE scorers. We had a low interobserver variability between the scorers [6,7,9,40]. We collected data in both the first as the second wave in the Netherlands, with minimal loss to follow-up.
This study has several limitations. First, the sample size of this study was relatively small in combination with a high overall mortality and the retrospective design of this study limits the inclusion of all potential confounders. Secondly, the inclusion criteria of the study could have resulted in selection bias and patient-level differences in terms of treatments received. This study only included mechanical ventilated patients with both a CT scan and CXR within the same timeframe and ICU length of stay for at least 24 h. This may potentially create a systematic bias towards patients with higher severity or generate a risk of attrition bias. Finally, despite the high ICC among scorers, there was still significant variability in one out of five CXRs with the need of a third scorer. This additional scorer was not blinded to the results of the previous assessments, and this could have generated scoring bias.

5. Conclusions

In this cohort of invasively ventilated patients with ARDS due to COVID-19, the CTSS of the first available chest CT scan was associated with short- and medium-term mortality outcomes, albeit with poor prognostic capacity. The CXR-based RALE score was not associated with any mortality outcome and had no prognostic capacity. No correlation was found between the CXR and CT-based score, a finding to be validated in future studies. Neither score could predict duration of ventilation or length of stay in ICU.

Supplementary Materials

The following supporting information can be downloaded at: www.mdpi.com/article/10.3390/diagnostics12092072/s1, Figure S1: The RALE scoring sheet, showing the total score and the score for each of the four quadrants for a representative study patient; Figure S2: Calibration plots of the fitted model of (A) the RALE score and (B) the CTSS; Figure S3: Spline graphical association of the RALE score (panel A) and CTSS (panel B) versus ICU mortality, adjusted median APACHE II of 12 score and BMI of 29; Table S1: The CT severity score per lobe. A system for scoring ground-glass opacity, interstitial opacity, and air trapping on thin-section CT scan.

Author Contributions

Conception and design: L.P., C.M.V., C.Z., G.M., M.J.S., L.D.J.B., C.P. and F.P.; data acquisition, analysis or interpretation of data: G.M., C.M.V., C.Z., L.P., C.S., J.D., L.B., L.D.J.B., S.G., M.J.S. and F.P.; drafting the manuscript: C.M.V., L.P., C.Z., G.M., L.D.J.B., M.J.S., L.B., S.G. and F.P.; critical revision of the manuscript for important intellectual content: all authors. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki. This was a retrospective observational study in critically ill invasively ventilated COVID-19 patients admitted to the intensive care units (ICUs) of two tertiary centers, the Academic Medical Center, and the Free University Medical Center, Amsterdam, The Netherlands. The Institutional Review Boards of both hospitals approved the study protocol (approval W20_494 # 20.546).

Informed Consent Statement

The need for individual patient informed consent was waived because the data used for this analysis were collected as part of standard care. The study is registered at clinicaltrials.gov (NCT05047653).

Data Availability Statement

Requests for the data should be sent to Claudio Zimatore; email address: [email protected].

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Valk, C.M.A.; Zimatore, C.; Mazzinari, G.; Pierrakos, C.; Sivakorn, C.; Dechsanga, J.; Grasso, S.; Beenen, L.; Bos, L.D.J.; Paulus, F.; et al. The Prognostic Capacity of the Radiographic Assessment for Lung Edema Score in Patients With COVID-19 Acute Respiratory Distress Syndrome—An International Multicenter Observational Study. Front. Med. 2022, 8. [Google Scholar] [CrossRef]
  2. Treanor, L.; Islam, N.; Ebrahimzadeh, S.; McInnes, M.D.F. Role of Imaging in Diagnosing COVID-19. Radiology 2021, 299, E289. [Google Scholar] [CrossRef]
  3. Schalekamp, S.; Bleeker-Rovers, C.P.; Beenen, L.F.M.; Quarles van Ufford, H.M.E.; Gietema, H.A.; Stöger, J.L.; Harris, V.; Reijers, M.H.E.; Rahamat-Langendoen, J.; Korevaar, D.A.; et al. Chest CT in the Emergency Department for Diagnosis of COVID-19 Pneumonia: Dutch Experience. Radiology 2021, 298, E98–E106. [Google Scholar] [CrossRef]
  4. Warren, M.A.; Zhao, Z.; Koyama, T.; Bastarache, J.A.; Shaver, C.M.; Semler, M.W.; Rice, T.W.; Matthay, M.A.; Calfee, C.S.; Ware, L.B. Severity scoring of lung oedema on the chest radiograph is associated with clinical outcomes in ARDS. Thorax 2018, 73, 840–846. [Google Scholar] [CrossRef]
  5. Ebrahimian, S.; Homayounieh, F.; Rockenbach, M.; Putha, P.; Raj, T.; Dayan, I.; Bizzo, B.C.; Buch, V.; Wu, D.; Kim, K.; et al. Artificial intelligence matches subjective severity assessment of pneumonia for prediction of patient outcome and need for mechanical ventilation: A cohort study. Sci. Rep. 2021, 11, 858. [Google Scholar] [CrossRef]
  6. Zimatore, C.; Pisani, L.; Lippolis, V.; Calfee, C.S.; Ware, L.B.; Algera, A.G.; Smit, M.; Grasso, S.; Schultz, M.J. The radiographic assessment of lung edema (RALE) score has excellent diagnostic accuracy for ARDS. Eur. Respir. J. 2019, 54 (Suppl. 63), OA3299. [Google Scholar]
  7. Zimatore, C.; Pisani, L.; Lippolis, V.; Warren, M.A.; Calfee, C.S.; Ware, L.B.; Algera, A.G.; Smit, M.R.; Grasso, S.; Schultz, M.J. Accuracy of the Radiographic Assessment of Lung Edema Score for the Diagnosis of ARDS. Front. Physiol. 2021, 12, 672823. [Google Scholar] [CrossRef]
  8. Jabaudon, M.; Audard, J.; Pereira, B.; Jaber, S.; Lefrant, J.Y.; Blondonnet, R.; Godet, T.; Futier, E.; Lambert, C.; Bazin, J.E.; et al. Early Changes Over Time in the Radiographic Assessment of Lung Edema Score Are Associated With Survival in ARDS. Chest 2020, 158, 2394–2403. [Google Scholar] [CrossRef]
  9. Kotok, D.; Yang, L.; Evankovich, J.W.; Bain, W.; Dunlap, D.G.; Shah, F.; Zhang, Y.; Manatakis, D.V.; Benos, P.V.; Barbash, I.J.; et al. The evolution of radiographic edema in ARDS and its association with clinical outcomes: A prospective cohort study in adult patients. J. Crit. Care 2020, 56, 222–228. [Google Scholar] [CrossRef]
  10. Al-Yousif, N.; Komanduri, S.; Qurashi, H.; Korzhuk, A.; Lawal, H.O.; Abourizk, N.; Schaefer, C.; Mitchell, K.J.; Dietz, C.M.; Hughes, E.K.; et al. Radiographic Assessment of Lung Edema (RALE) Scores are Highly Reproducible and Prognostic of Clinical Outcomes for Inpatients with COVID-19. medRxiv 2022. Available online: https://www.medrxiv.org/content/10.1101/2022.06.10.22276249v1 (accessed on 1 July 2022).
  11. Available online: https://radiologyassistant.nl/chest/covid-19/covid19-imaging-findings (accessed on 2 February 2022).
  12. Chang, Y.C.; Yu, C.J.; Chang, S.C.; Galvin, J.R.; Liu, H.M.; Hsiao, C.H.; Kuo, P.H.; Chen, K.Y.; Franks, T.J.; Huang, K.M.; et al. Pulmonary sequelae in convalescent patients after severe acute respiratory syndrome: Evaluation with thin-section CT1. Radiology 2005, 236, 1067–1075. [Google Scholar] [CrossRef]
  13. Francone, M.; Iafrate, F.; Masci, G.M.; Coco, S.; Cilia, F.; Manganaro, L.; Panebianco, V.; Andreoli, C.; Colaiacomo, M.C.; Zingaropoli, M.A.; et al. Chest CT score in COVID-19 patients: Correlation with disease severity and short-term prognosis. Eur. Radiol. 2020, 30, 6808–6817. [Google Scholar] [CrossRef]
  14. Lieveld, A.W.E.; Azijli, K.; Teunissen, B.P.; van Haaften, R.M.; Kootte, R.S.; van den Berk, I.A.H.; van der Horst, S.F.B.; de Gans, C.; van de Ven, P.M.; Nanayakkara, P.W.B. Chest CT in COVID-19 at the ED: Validation of the COVID-19 Reporting and Data System (CO-RADS) and CT Severity Score: A Prospective, Multicenter, Observational Study. Chest 2021, 159, 1126–1135. [Google Scholar] [CrossRef]
  15. Li, K.; Fang, Y.; Li, W.; Pan, C.; Qin, P.; Zhong, Y.; Liu, X.; Huang, M.; Liao, Y.; Li, S. CT image visual quantitative evaluation and clinical classification of coronavirus disease (COVID-19). Eur. Radiol. 2020, 30, 4407–4416. [Google Scholar] [CrossRef]
  16. Botta, M.; Tsonas, A.M.; Pillay, J.; Boers, L.S.; Algera, A.G.; Bos, L.D.J.; Dongelmans, D.A.; Hollmann, M.W.; Horn, J.; Vlaar, A.P.J.; et al. Ventilation Management and Clinical Outcome in Invasively Ventilated COVID–19 Patients (PRoVENT–COVID)—a national, multicentre, observational cohort study. Lancet Respir Med. 2021, 9, 139–148. [Google Scholar] [CrossRef]
  17. DeLong, E.R.; DeLong, D.M.; Clarke-Pearson, D.L. Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach. Biometrics 1988, 44, 837–845. [Google Scholar] [CrossRef]
  18. Yang, R.; Li, X.; Liu, H.; Zhen, Y.; Zhang, X.; Xiong, Q.; Luo, Y.; Gao, C.; Zeng, W. Chest CT Severity Score: An Imaging Tool for Assessing Severe COVID-19. Radiol. Cardiothorac. Imaging 2020, 2, e200047. [Google Scholar] [CrossRef]
  19. Heldeweg, M.L.A.; Lopez Matta, J.E.; Haaksma, M.E.; Smit, J.M.; Elzo Kraemer, C.V.; de Grooth, H.J.; de Jonge, E.; Meijboom, L.J.; Heunks, L.M.A.; van Westerloo, D.J.; et al. Lung ultrasound and computed tomography to monitor COVID-19 pneumonia in critically ill patients: A two-center prospective cohort study. Intensive Care Med. Exp. 2021, 9, 1. [Google Scholar] [CrossRef]
  20. Pan, F.; Ye, T.; Sun, P.; Gui, S.; Liang, B.; Li, L.; Zheng, D.; Wang, J.; Hesketh, R.L.; Yang, L.; et al. Time Course of Lung Changes at Chest CT during Recovery from Coronavirus Disease 2019 (COVID-19). Radiology 2020, 295, 715–721. [Google Scholar] [CrossRef]
  21. Pierrakos, C.; Lieveld, A.; Pisani, L.; Smit, M.R.; Heldeweg, M.; Hagens, L.A.; Smit, J.; Haaksma, M.; Veldhuis, L.; Schmidt, R.W.; et al. A Lower Global Lung Ultrasound Score Is Associated with Higher Likelihood of Successful Extubation in Invasively Ventilated COVID-19 Patients. Am. J. Trop. Med. Hyg. 2021, 105, 1490–1497. [Google Scholar] [CrossRef] [PubMed]
  22. Herrmann, J.; Adam, E.H.; Notz, Q.; Helmer, P.; Sonntagbauer, M.; Ungemach-Papenberg, P.; Sanns, A.; Zausig, Y.; Steinfeldt, T.; Torje, I.; et al. COVID-19 Induced Acute Respiratory Distress Syndrome—A Multicenter Observational Study. Front. Med. 2020, 7, 599533. [Google Scholar] [CrossRef]
  23. Mushtaq, J.; Pennella, R.; Lavalle, S.; Colarieti, A.; Steidler, S.; Martinenghi, C.M.A.; Palumbo, D.; Esposito, A.; Rovere-Querini, P.; Tresoldi, M.; et al. Initial chest radiographs and artificial intelligence (AI) predict clinical outcomes in COVID-19 patients: Analysis of 697 Italian patients. Eur. Radiol. 2021, 31, 1770–1779. [Google Scholar] [CrossRef] [PubMed]
  24. Sensusiati, A.D.; Amin, M.; Nasronudin, N.; Rosyid, A.N.; Ramadhan, N.A.; Lathifah, R.; Puspitasari, E.; Wahyuningtyas, R.I.; Soebakti, E. Age, neutrophil lymphocyte ratio, and radiographic assessment of the quantity of lung edema (RALE) score to predict in-hospital mortality in COVID-19 patients: A retrospective study. F1000Research 2020, 9, 1286. [Google Scholar] [CrossRef] [PubMed]
  25. Au-Yong, I.; Higashi, Y.; Giannotti, E.; Fogarty, A.; Morling, J.R.; Grainge, M.; Race, A.; Juurlink, I.; Simmonds, M.; Briggs, S.; et al. Chest Radiograph Scoring Alone or Combined with Other Risk Scores for Predicting Outcomes in COVID-19. Radiology 2022, 302, 460–469. [Google Scholar] [CrossRef]
  26. Safont, B.; Tarraso, J.; Rodriguez-Borja, E.; Fernández-Fabrellas, E.; Sancho-Chust, J.N.; Molina, V.; Lopez-Ramirez, C.; Lope-Martinez, A.; Cabanes, L.; Andreu, A.L.; et al. Lung Function, Radiological Findings and Biomarkers of Fibrogenesis in a Cohort of COVID-19 Patients Six Months After Hospital Discharge. Arch. Bronconeumol. 2022, 58, 142–149. [Google Scholar] [CrossRef]
  27. Barbieri, D.; Giuliani, E.; Del Prete, A.; Losi, A.; Villani, M.; Barbieri, A. How Artificial Intelligence and New Technologies Can Help the Management of the COVID-19 Pandemic. Int. J. Environ. Res. Public Health 2021, 18, 7648. [Google Scholar] [CrossRef]
  28. Kim, Y.G.; Kim, K.; Wu, D.; Ren, H.; Tak, W.Y.; Park, S.Y.; Lee, Y.R.; Kang, M.K.; Park, J.G.; Kim, B.S.; et al. Deep Learning-Based Four-Region Lung Segmentation in Chest Radiography for COVID-19 Diagnosis. Diagnostics 2022, 12, 101. [Google Scholar] [CrossRef]
  29. Gupta, A.; Madhavan, M.V.; Sehgal, K.; Nair, N.; Mahajan, S.; Sehrawat, T.S.; Bikdeli, B.; Ahluwalia, N.; Ausiello, J.C.; Wan, E.Y.; et al. Extrapulmonary manifestations of COVID-19. Nat. Med. 2020, 26, 1017–1032. [Google Scholar] [CrossRef]
  30. Behzad, S.; Aghaghazvini, L.; Radmard, A.R.; Gholamrezanezhad, A. Extrapulmonary manifestations of COVID-19: Radiologic and clinical overview. Clin. Imaging 2020, 66, 35–41. [Google Scholar] [CrossRef]
  31. AlSamman, M.; Caggiula, A.; Ganguli, S.; Misak, M.; Pourmand, A. Non-respiratory presentations of COVID-19, a clinical review. Am. J. Emerg. Med. 2020, 38, 2444–2454. [Google Scholar] [CrossRef]
  32. Satturwar, S.; Fowkes, M.; Farver, C.; Wilson, A.M.; Eccher, A.; Girolami, I.; Pujadas, E.; Bryce, C.; Salem, F.; El Jamal, S.M.; et al. Postmortem Findings Associated With SARS-CoV-2: Systematic Review and Meta-analysis. Am. J. Surg. Pathol. 2021, 45, 587–603. [Google Scholar] [CrossRef]
  33. Nahum, J.; Morichau-Beauchant, T.; Daviaud, F.; Echegut, P.; Fichet, J.; Maillet, J.M.; Thierry, S. Venous Thrombosis Among Critically Ill Patients With Coronavirus Disease 2019 (COVID-19). JAMA Netw. Open 2020, 3, e2010478. [Google Scholar] [CrossRef] [PubMed]
  34. Tavazzi, G.; Civardi, L.; Caneva, L.; Mongodi, S.; Mojoli, F. Thrombotic events in SARS-CoV-2 patients: An urgent call for ultrasound screening. Intensive Care Med. 2020, 46, 1121–1123. [Google Scholar] [CrossRef] [PubMed]
  35. Grasselli, G.; Scaravilli, V.; Mangioni, D.; Scudeller, L.; Alagna, L.; Bartoletti, M.; Bellani, G.; Biagioni, E.; Bonfanti, P.; Bottino, N.; et al. Hospital-Acquired Infections in Critically Ill Patients With COVID-19. Chest 2021, 160, 454–465. [Google Scholar] [CrossRef] [PubMed]
  36. Liu, H.H.; Yaron, D.; Piraino, A.S.; Kapelusznik, L. Bacterial and fungal growth in sputum cultures from 165 COVID-19 pneumonia patients requiring intubation: Evidence for antimicrobial resistance development and analysis of risk factors. Ann. Clin. Microbiol. Antimicrob. 2021, 20, 69. [Google Scholar] [CrossRef]
  37. Palanidurai, S.; Phua, J.; Chan, Y.H.; Mukhopadhyay, A. P/FP ratio: Incorporation of PEEP into the PaO(2)/FiO(2) ratio for prognostication and classification of acute respiratory distress syndrome. Ann. Intensive Care 2021, 11, 124. [Google Scholar] [CrossRef]
  38. Sun, J.; Yu, D.; Yoo, K.; Choi, R.; Lu, X.; Standiford, T.; Cohen, G.; Marchetti, N.; Agosto, O.; Kumaran, M.; et al. Sextus chest radiograph severity score correlates to clinical outcomes in patients with COVID-19: A cross-sectional study. Medicine 2021, 100, e27663. [Google Scholar] [CrossRef] [PubMed]
  39. Zeng, F.; Cai, Y.; Guo, Y.; Chen, W.; Lin, M.; Zheng, J.; Zeng, H.; Wang, S.; Qin, G. The diagnostic value of chest X-ray in coronavirus disease 2019: A comparative study of X-ray and CT. Sci. Prog. 2021, 104, 368504211016204. [Google Scholar] [CrossRef]
  40. Cozzi, D.; Albanesi, M.; Cavigli, E.; Moroni, C.; Bindi, A.; Luvarà, S.; Lucarini, S.; Busoni, S.; Mazzoni, L.N.; Miele, V. Chest X-ray in new Coronavirus Disease 2019 (COVID-19) infection: Findings and correlation with clinical outcome. Radiol. Med. 2020, 125, 730–737. [Google Scholar] [CrossRef]
Figure 1. Patient flow. Consecutive patients were screened for participation. Patients were selected if having received invasive ventilation for acute hypoxemic respiratory failure due to COVID-19 that was confirmed by reverse transcriptase–polymerase chain reaction for SARS-CoV-2. Abbreviations: CXR: chest X-ray; CT: chest CT scan.
Figure 1. Patient flow. Consecutive patients were screened for participation. Patients were selected if having received invasive ventilation for acute hypoxemic respiratory failure due to COVID-19 that was confirmed by reverse transcriptase–polymerase chain reaction for SARS-CoV-2. Abbreviations: CXR: chest X-ray; CT: chest CT scan.
Diagnostics 12 02072 g001
Figure 2. Boxplots of the (A) RALE score and (B) CTSS in survivors versus non-survivors.
Figure 2. Boxplots of the (A) RALE score and (B) CTSS in survivors versus non-survivors.
Diagnostics 12 02072 g002
Figure 3. Scatterplot showing the correlation between the RALE score and the CTSS, with the linear regression estimation (in blue), and the 95%CI shown in shaded area. R2 = 0.075; p = 0.012. Beta coefficient for RALE score: 0.08 [95%CI 0.02–0.16].
Figure 3. Scatterplot showing the correlation between the RALE score and the CTSS, with the linear regression estimation (in blue), and the 95%CI shown in shaded area. R2 = 0.075; p = 0.012. Beta coefficient for RALE score: 0.08 [95%CI 0.02–0.16].
Diagnostics 12 02072 g003
Figure 4. Discriminative capacity of (A) the RALE score and (B) the CTSS for ICU mortality. Shaded areas show 95% confidence intervals. Abbreviations: AUC: area under the curve; RALE: Radiographic Assessment of Lung Edema; CTSS: Chest CT Severity Score.
Figure 4. Discriminative capacity of (A) the RALE score and (B) the CTSS for ICU mortality. Shaded areas show 95% confidence intervals. Abbreviations: AUC: area under the curve; RALE: Radiographic Assessment of Lung Edema; CTSS: Chest CT Severity Score.
Diagnostics 12 02072 g004
Table 1. Baseline characteristics of the patients.
Table 1. Baseline characteristics of the patients.
Overall
n = 82
Alive *
n = 35
Dead
n = 47
p-ValueSMD
demographics
Age, years (median [IQR])65 [60–72]65 [59–72]65 [60–72]0.6690.174
Male gender, n (%)60 (73.2)24 (68.6)36 (76.6)0.5760.181
Body mass index, kg∙m2 (median [IQR])
severity and comorbidities
APACHE II (median [IQR])12.0 [10.0–20.0]12.0 [10.0–15.5]13.0 [10.0–20.0]0.2890.245
Comorbidities, yes, n (%)46 (56.1)20 (57.1)26 (55.3)1.000
Arterial hypertension, n (%)41 (50.0)24 (68.6)17 (36.2)0.007
Heart failure, n (%)4 (4.9)2 (5.7)2 (4.3)1.000
Diabetes mellitus, n (%)32 (39.0)15 (42.9)17 (36.2)0.700
Chronic kidney disease, n (%)15 (18.3)5 (14.3)10 (21.3)0.602
Liver cirrhosis, n (%)0 (0.0)0 (0.0)0 (0.0)NA
Chronic obstructive pulmonary disease, n (%)5 (6.1)3 (8.6)2 (4.3)0.733
Active hematological malignancy, n (%)4 (4.9)1 (2.9)3 (6.4)0.830
Active solid tumor malignancy, n (%)3 (3.7)2 (5.7)1 (2.1)0.794
Metastatic cancer, n (%)1 (1.2)0 (0.0)1 (2.1)1.000
Neuromuscular disease, n (%)2 (2.4)1 (2.9)1 (2.1)1.000
Immunosuppression, n (%)1 (1.2)0 (0.0)1 (2.1)1.000
Cardiovascular disease, n (%)14 (17.1)6 (17.1)8 (17.0)1.000
AIDS, n (%)0 (0.0)0 (0.0)0 (0.0)NA
Asthma, n (%)3 (3.7)2 (5.7)1 (2.1)0.794
Obstructive sleep apnea, n (%)2 (2.4)0 (0.0)2 (4.3)0.609
Other, n (%)35 (42.7)16 (45.7)19 (40.4)0.800
outcomes
Successful extubation, n (%)35 (43.2)33 (97.1)2 (4.3)<0.001
RALE score (median [IQR])25 [18–38]22 [15–37]26 [19–39]0.3430.187
CT severity score (median [IQR])20 [17–22]18 [16–21]21 [18–23]0.0220.545
Intubation time-days (median [IQR])10 [6–28]9 [5–23]40 [36–43]0.1171.638
ICU length of stay-days (median [IQR])12 [7–26]12 [7–26]---
Hospital length of stay-days (median [IQR])28 [16–53]28 [16–53]---
Data are median (quartile 25–75%), mean (±SD) or n (%). Percentages may not total 100 because of rounding. Abbreviations: ICU: intensive care unit; SMD: standardized mean difference; IQR: interquartile range; CT: computed tomography; RALE: Radiographic Assessment of Lung Edema. * At day ICU discharge.
Table 2. Ventilation parameters measured with the first available combination of CXR and CT imaging.
Table 2. Ventilation parameters measured with the first available combination of CXR and CT imaging.
OverallAlive *Deadp-ValueSMD
n = 82n = 35n = 47
Ventilation mode, n (%) 0.5870.326
Pressure controlled26 (33.3)8 (25.0)18 (39.1)
Pressure support12 (15.4)6 (18.8)6 (13.0)
Volume controlled2 (2.5)1 (2.9)1 (2.1)
ASV/Intellivent10 (12.8)5 (15.6)5 (10.9)
Spontaneous30 (38.5)13 (40.6)17 (37.0)
PEEP, cmH2O (median [IQR])10 [9–12]10 [9–12]10 [8–12]0.9690.035
FiO2, % (median [IQR])65 [50–80]61 [50–80]70 [50–85]0.3680.234
Tidal expiratory volume set, ml (median [IQR])458 [379–518]435 [356–508]466 [399–582]0.1550.381
Respiratory rate, breaths/min (median [IQR])24 [20–29]25 [21–29]21.30 [19–28]0.1220.337
Peak pressure, cmH2O (median [IQR])24 [19–31]24 [20–31]23 [19–29]0.5090.201
SpO2, % (median [IQR])92 [90–94]93 [91–94]92 [90–95]0.8560.025
etCO2, kPa (median [IQR])5.2 [4.2–6.1]5.1 [3.9–5.6]5.4 [4.4–6.2]0.1590.175
pH (median [IQR])7.38 [7.32–7.44]7.40 [7.33–7.45]7.37 [7.31–7.42]0.3580.251
PaO2, kpa (median [IQR])9.5 [8.3–10.5]9.6 [8.2–10.6]9.3 [8.4–10.5]0.9140.125
PaO2/FiO2 (median [IQR])113 [88–151]119 [92–154]109 [86–142]0.5830.149
PaCO2, kpa (median [IQR])6.1 [5.3–7.6]5.7 [5.3–7.4]6.2 [5.5–7.9]0.3810.218
Data are median (quartile 25–75%) or n (%). Percentages may not total 100 because of rounding. Abbreviations: SMD: standardized mean difference; PEEP: positive end expiratory pressure; ASV: adaptive support ventilation; FiO2: fraction of inspired oxygen; PaO2: partial pressure of oxygen; etCO2: end-tidal carbon dioxide; PaCO2: partial pressure of carbon dioxide; IQR: interquartile range. * At day ICU discharge.
Table 3. Association between imaging scores and outcomes.
Table 3. Association between imaging scores and outcomes.
RALE ScoreCTSS
OutcomeOR [95%CI]
Univariable Estimate
OR [95%CI]
Adjusted Estimate
OR [95%CI]
Univariable Estimate
OR [95%CI]
Adjusted Estimate
Primary
ICU mortality1.34 [0.67–2.69]1.35 [0.64–2.84]1.99 [1.11–3.54]2.31 [1.22–4.38]
Sensitivity analyses
Splines fitted model2.97 [0.75–11.7]1.67 [0.41–6.84]2.98 [0.75–11.78]2.31 [1.22–4.38]
Model with added PEEP 1.89 [0.81–4.38] 1.99 [1.025–3.87]
Only CXRs of the first 3 days0.89 [0.39–2.03]0.92 [0.39–2.16]1.82 [0.91–3.63]2.23 [0.99–4.98]
Secondary
28-day mortality1.04 [0.52–2.05]1.02 [0.50–2.10]1.79 [1.01–3.16]1.96 [1.07–3.58]
Hospital mortality1.21 [0.60–2.44]1.19 [0.57–2.50]1.70 [0.97–2.97]1.94 [1.06–3.58]
90-day mortality1.13 [0.58–2.26]1.10 [0.53–2.29]1.76 [1.01–3.10]1.98 [1.10–3.65]
Adjusted β linear coefficient
[95%CI]
Adjusted β linear coefficient
[95%CI]
Duration of ventilation in survivors-0.40 [−0.04–0.86]
p = 0.075 $
-1.57 [0.10–3.03]
p = 0.03 $
ICU length of stay in survivors-0.30 [−0.20–0.81]
p = 0.232 $
-1.48 [−0.12–3.09]
p = 0.070 $
Data are median (quartile 25–75%) or n (%). Percentages may not total 100 because of rounding. Table effect estimates from the fitted models. Abbreviations: RALE score: Radiographic Assessment of Lung Edema score; CTSS: Chest CT Severity Score; ICU: intensive care unit; OR: odds ratio; CI: confidence interval. $ p-values for the beta coefficients of the linear regression output.
Table 4. Comparison of prognostic capacity across primary and secondary outcomes between the two imaging scores.
Table 4. Comparison of prognostic capacity across primary and secondary outcomes between the two imaging scores.
OutcomeAUC of Univariate ROC for RALEAUC of Univariate ROC for CTSSComparison between AUCs(De Long Test)AUC of Adjusted Logistic Regression Model for RALE *AUC of Adjusted Logistic Regression Model for CTSS *Comparison between AUCs (De Long)R2 from the Adjusted Linear Model with RALER2 from the Adjusted Linear Model with CTSS
Primary
ICU mortality0.50
[0.44–0.56]
0.64
[0.57–0.69]
p = 0.0010.55
[0.43–0.56]
0.66
[0.60–0.72]
p = 0.006
Sensitivity analyses
Splines fitted model0.53
[0.47–0.58]
0.56
[0.50–0.62]
p = 0.4110.54
[0.47–0.58]
0.62
[0.57–0.68]
p = 0.005
Only 3 days after ICU admission0.66
[0.59–0.72]
0.60
[0.54–0.67]
p = 0.2830.60
[0.49–0.61]
0.61
[0.60–0.72
p = 0.776
Secondary
28-day
mortality
0.66
[0.61–0.71]
0.64
[0.58–0.69]
p = 0.4450.53
[0.48–0.59]
0.65
[0.60–0.70]
p = 0.004
Hospital mortality0.58
[0.53–0.64]
0.61
[0.55–0.61]
p = 0.5070.48
[0.42–0.54]
0.64
[0.58–0.64]
p < 0.001
90-day
mortality
0.57
[0.52–0.63]
0.63
[0.54–0.65]
p = 0.2580.51
[0.45–0.57]
0.64
[0.59–0.70]
p < 0.001
Duration of ventilation in survivors0.1360.186
ICU length of stay in survivors0.0660.034
Data are median (quartile 25–75%) or n (%). Abbreviations: AUC: area under the curve; RALE: Radiographic Assessment of Lung Edema; CTSS: Chest CT Severity Score; ICU: intensive care unit; ROC: receiver operating characteristic. * Comparison between areas under the curve was tested using the De Long test.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Valk, C.M.; Zimatore, C.; Mazzinari, G.; Pierrakos, C.; Sivakorn, C.; Dechsanga, J.; Grasso, S.; Beenen, L.; Bos, L.D.J.; Paulus, F.; et al. The RALE Score Versus the CT Severity Score in Invasively Ventilated COVID-19 Patients—A Retrospective Study Comparing Their Prognostic Capacities. Diagnostics 2022, 12, 2072. https://doi.org/10.3390/diagnostics12092072

AMA Style

Valk CM, Zimatore C, Mazzinari G, Pierrakos C, Sivakorn C, Dechsanga J, Grasso S, Beenen L, Bos LDJ, Paulus F, et al. The RALE Score Versus the CT Severity Score in Invasively Ventilated COVID-19 Patients—A Retrospective Study Comparing Their Prognostic Capacities. Diagnostics. 2022; 12(9):2072. https://doi.org/10.3390/diagnostics12092072

Chicago/Turabian Style

Valk, Christel M., Claudio Zimatore, Guido Mazzinari, Charalampos Pierrakos, Chaisith Sivakorn, Jutamas Dechsanga, Salvatore Grasso, Ludo Beenen, Lieuwe D. J. Bos, Frederique Paulus, and et al. 2022. "The RALE Score Versus the CT Severity Score in Invasively Ventilated COVID-19 Patients—A Retrospective Study Comparing Their Prognostic Capacities" Diagnostics 12, no. 9: 2072. https://doi.org/10.3390/diagnostics12092072

APA Style

Valk, C. M., Zimatore, C., Mazzinari, G., Pierrakos, C., Sivakorn, C., Dechsanga, J., Grasso, S., Beenen, L., Bos, L. D. J., Paulus, F., Schultz, M. J., & Pisani, L. (2022). The RALE Score Versus the CT Severity Score in Invasively Ventilated COVID-19 Patients—A Retrospective Study Comparing Their Prognostic Capacities. Diagnostics, 12(9), 2072. https://doi.org/10.3390/diagnostics12092072

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop