Next Article in Journal
Evolution of CT Findings and Lung Residue in Patients with COVID-19 Pneumonia: Quantitative Analysis of the Disease with a Computer Automatic Tool
Next Article in Special Issue
Update on Robotic Rectal Prolapse Treatment
Previous Article in Journal
Appetite and Nutritional Status as Potential Management Targets in Patients with Heart Failure with Reduced Ejection Fraction—The Relationship between Echocardiographic and Biochemical Parameters and Appetite
Previous Article in Special Issue
Review on Perioperative and Oncological Outcomes of Robotic Gastrectomy for Cancer
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Robotic Esophagectomy. A Systematic Review with Meta-Analysis of Clinical Outcomes

by
Michele Manigrasso
1,
Sara Vertaldi
2,
Alessandra Marello
2,
Stavros Athanasios Antoniou
3,4,
Nader Kamal Francis
5,
Giovanni Domenico De Palma
2 and
Marco Milone
2,*
1
Department of Advanced Biomedical Sciences, University of Naples “Federico II”, Via Pansini 5, 80131 Naples, Italy
2
Department of Clinical Medicine and Surgery, University of Naples “Federico II”, Via Pansini 5, 80131 Naples, Italy
3
Medical School, European University Cyprus, 2404 Nicosia, Cyprus
4
Department of Surgery, Mediterranean Hospital of Cyprus, 3117 Limassol, Cyprus
5
Yeovil District Hospital, Somerset BA21 4AT, UK
*
Author to whom correspondence should be addressed.
J. Pers. Med. 2021, 11(7), 640; https://doi.org/10.3390/jpm11070640
Submission received: 26 April 2021 / Revised: 22 June 2021 / Accepted: 1 July 2021 / Published: 6 July 2021
(This article belongs to the Special Issue Update on Robotic Gastrointestinal Surgery)

Abstract

:
Background: Robot-Assisted Minimally Invasive Esophagectomy is demonstrated to be related with a facilitation in thoracoscopic procedure. To give an update on the state of art of robotic esophagectomy for cancr a systematic review with meta-analysis has been performed. Methods: a search of the studies comparing robotic and laparoscopic or open esophagectomy was performed trough the medical libraries, with the search string “robotic and (oesophagus OR esophagus OR esophagectomy OR oesophagectomy)”. Outcomes were: postoperative complications rate (anastomotic leakage, bleeding, wound infection, pneumonia, recurrent laryngeal nerves paralysis, chylotorax, mortality), intraoperative outcomes (mean blood loss, operative time and conversion), oncologic outcomes (harvested nodes, R0 resection, recurrence) and recovery outcomes (length of hospital stay). Results: Robotic approach is superior to open surgery in terms of blood loss p = 0.001, wound infection rate, p = 0.002, pneumonia rate, p = 0.030 and mean number of harvested nodes, p < 0.0001 and R0 resection rate, p = 0.043. Similarly, robotic approach is superior to conventional laparoscopy in terms of mean number of harvested nodes, p = 0.001 pneumonia rate, p = 0.003. Conclusions: robotic surgery could be considered superior to both open surgery and conventional laparoscopy. These encouraging results should promote the diffusion of the robotic surgery, with the creation of randomized trials to overcome selection bias.

1. Introduction

Esophageal cancer represents the seventh most common cause of cancer morbidity and the sixth cause of cancer-related death [1].
Radical esophagectomy with lymphadenectomy represents nowadays the milestone for the treatment of esophageal cancer [2]. Since its introduction in the late 1940s, open esophagectomy has been adopted for a long time, obtaining considerable oncologic results [3]. In the new era of minimally invasive laparoscopic surgery, minimally invasive esophagectomy started to be performed in the 2000s, providing the well-known advantages on recovery of the minimally invasive procedures. Safety and efficacy of minimally invasive esophagectomy has been reported in several experiences [4,5,6,7], further providing similar oncologic results and long term recurrence rate [8,9,10]. However, on a clinical point of view, the introduction of minimally invasive esophagectomy in the clinical practice is far to be considered as a standard of care. Major reason for that should be considered technical challenges in performing minimally invasive esophagectomy.
Since its introduction in 2000s, robotic surgery has been adopted to overcome technical difficulties of laparoscopic surgery. The facilities of the robotic approach lay in the intrinsic characteristics of the robotic platforms. In fact, the three-dimensional view allowed a better visualization of the operative field and the EndoWrist® technology with the seven-degrees movement of the robotic arms allows to perform more accurate movements in narrow space [11,12]. Even if robotic approach could be considered the gold standard only for the treatment of the prostate cancer, it has accumulated consensus in many surgical fields [13,14,15,16]. In the setting of minimally invasive esophagectomy, it was first introduced in 2003 by Kernstine et al. [17], but controversies about the advantages of robotic approach have to be considered still an open issue.
Interest about the results of robotic surgery, also in comparison with open and laparoscopic approach, is fervent worldwide. Results on robotic esophagectomy were accumulated exponentially in the last years providing advantages of robot-assisted surgery.
To delineate the state of art of robotic approach to treat esophageal cancer, we have designed a systematic review and meta- analysis comparing robotic with both open and laparoscopic surgery, toward to the identification of a gold standard treatment.

2. Materials and Methods

2.1. Literature Search and Study Selection

This systematic review complied with PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) reporting standards [18] and was developed in line with Meta-Analysis of Observational Studies Epidemiology (MOOSE) guidelines [19].
Cochrane Library, EMBASE, PubMed, SCOPUS, and Web of Science were interrogated. The search string “robotic and (oesophagus OR esophagus OR esophagectomy OR oesophagectomy)” was used. Only articles published in English were considered.
Indexed abstract of posters and podium presentations at international meetings were not included. We did not consider systematic reviews and meta-analyses. However, the latter were consulted to identify additional studies of interest. The reference lists of retrieved studies were reviewed. In case of overlapping series in different studies, only the most recent article was included.
The research question was structured within a PICO (Problem/Population, Intervention, Comparison and Outcome) framework. Population of interest included patients affected by histologically proven esophageal adenocarcinoma/squamous cells cancer. The intervention was robotic transthoracic esophagectomy, and the comparator was open esophagectomy and laparoscopic esophagectomy, respectively.
Outcome measures were divided in short- and long-term outcomes. Short-term outcomes encompassed postoperative complications rate, in terms of anastomotic leakage, postoperative bleeding, wound infection, pneumonia, recurrent laryngeal nerves (RLN) paralysis, chylotorax, reoperation rate and overall mortality, intraoperative outcomes (mean blood loss, operative time and conversion), oncologic outcomes (harvested nodes, R0 resection rate) and recovery outcomes (length of hospital stay). Long-term outcomes included recurrences and 5-year overall survival.
The literature search and study selection were performed independently by two reviewers. In case of disagreement, a third investigator was consulted and an agreement was reached by consensus.

2.2. Data Extraction and Risk of Bias Assessment

The following data were extracted from each study: first author, year of publication, study design, sample size, demographic characteristics, number of patients in each surgical group, gender, mean age, mean BMI (Body Mass Index), ASA (American Society of Anesthesiologists) Score, tumor stage according to UICC (Union for International Cancer Control), preoperative radio-chemotherapy rate, mean blood loss, operative time, conversion, anastomotic leakage, postoperative bleeding, wound infection, pneumonia, recurrent laryngeal nerves (RLN) paralysis, chylotorax, reoperation rate and overall mortality, harvested nodes, R0 resection rate, length of hospital stay, recurrence rate and 5-years overall survival. In order to assess overall mortality, we considered in-hospital mortality and 30-days and 90-days mortality, performing a sum of these data in each group.
Study quality assessment of the included studies was performed with the Newcastle Ottawa Scale (NOS) [20]. This scoring system encompasses three major domains (selection, comparability and exposure), with scores between 0 (lowest quality) to 9 (highest quality). In case of Randomized Controlled Trial (RCTs), the risk of bias was evaluated according to the Cochrane Collaboration Tool for assessing risk of bias [21]. According to this scoring system, seven domains were evaluated as “Low risk of bias” or “High risk of bias” or “Unclear” according to reporting on sequence generation, allocation concealment, blinding of participants, blinding of outcome assessment, incomplete outcome data, selective outcome reporting, and other potential threats to validity.

2.3. Statistical Analysis

Statistical analysis was performed using Comprehensive Meta-Analysis (Version 2.2, Biostat Inc, Englewood, NJ, USA, 2005). In order to provide a complete update on robotic surgery for esophageal cancer, two different group analyses were performed: robotic vs. laparoscopic and robotic vs. open approach.
Furthermore, for each meta-analysis, two subgroup analyses were performed dividing the studies according to the surgical procedure (Ivor-Lewis esophagectomy or McKeown esophagectomy). Finally, a sensitivity analysis excluded studies applying a hybrid approach (robotic abdominal phase and laparoscopic/open thoracic phase) and studies which did not specify the surgical procedure.
The odds ratio (OR) along with 95% confidence interval was used as effect estimate for dichotomous outcomes. In case of rare events, the risk difference (RD) with corresponding 95%CI were calculated, maintaining analytic consistency and including all available data, in accordance with Messori et al. [22]. In case studies reporting median, range and sample size, or studies reporting median and quartile ranges, the means and standard deviations were estimated according to Shi, Luo and Wan [23,24,25]. In studies reporting mean values without standard deviation, the latter was imputed, according to Furukawa et al. [26]. The overall effect was tested using Z scores and significance was set at p < 0.05. The summary estimate was computed under a random effects assumption as per DerSimonian and Laird [27]. A conservative random effect model was chosen a priori in consideration of foreseen heterogeneity among the included studies. The heterogeneity among the studies was quantified by the I2 statistic, with I2 values < 25%, between 25–50%, and >50% indicating respectively low, moderate, and high heterogeneity [28,29]. The presence of publication bias was investigated through a funnel plot where the summary estimate of each study (OR) was plotted against the standard error as a measure of study precision. In addition to visual inspection, funnel plot symmetry was tested using the Egger’s linear regression method [30]. p values ≤ 0.05 were considered statistically significant.

3. Results

Study Selection

The electronic search returned a total of 2113 results. After duplicates removal, 543 studies entered first-level screening. A total of 507 studies were excluded for the following reasons: 44 were written in a language other than English, 10 were case reports/case series, 97 were reviews, 46 were non-comparative studies, 293 were off-topic and 18 did not provide any usable data. Thus, 35 studies were included in the final analysis, out of which 20 compared robotic vs. laparoscopic surgery, 11 compared robotic vs. open esophagectomy and 4 reported on a three-arms comparison (robotic vs. laparoscopic vs. open) [20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54]. From the latter [54], it was possible to extract only data about the comparison between robotic and laparoscopic esophagectomy. Record selection is illustrated in the PRISMA flowchart (Figure 1). Inter-rater agreement was perfect (κ = 1).

4. Robotic Versus Laparoscopic Esophagectomy

4.1. Study Characteristics

All were prospective (n = 5) or retrospective studies (n = 18) [20,21,22,23,29,32,33,37,40,42,43,44,45,46,48,51,53], reporting on 11,779 patients, of whom 3832 underwent robotic esophagectomy and 7947 laparoscopic esophagectomy. The characteristics of the included studies are summarized in Table 1.
Ivor-Lewis procedure was performed in four studies [39,49,51,56], McKeown esophagectomy in ten studies [34,42,43,53,54,57,58,59,60,61] while nine studies did not specify the intervention [31,32,33,40,47,48,50,52,55].

4.2. Risk of Bias Assessment

All studies had NOS quality scores greater than 6, indicating fair methodological quality. Specifically, thirteen studies had NOS quality score = 7; ten studies had NOS quality score = 8. The NOS quality score is represented in Supplementary Table S1. No RCTs comparing robotic and laparoscopic transthoracic esophagectomy were published.

4.3. Short Term-Outcomes

Intraoperative outcomes are shown in Figure 2. Operative time was reported by 15 Authors [23,25,26,28,29,30,31,35,37,40,45,46,49,54,57] on 2690 procedures (which of 1089 robotic and 1601 laparoscopic), demonstrating a lower operative time in the laparoscopic group (MD = 31, p = 0.003, 95%CI 10.743; 52.478), with a significant heterogeneity among the studies (I2 = 93.720%, p < 0.0001). Estimated blood loss was analysed by 14 Authors [21,23,28,29,33,37,38,39,42,48,50,51,53,57], on 1977 procedures (which of 995 robotic and 982 laparoscopic), demonstrating no significant differences between the two approaches (MD = 1.673, p = 0.805, 95%CI −11.638; 14.985), with no heterogeneity among the studies (I2 = 0%, p = 0.760). Number of conversion was reported by 5 Authors [33,47,50,56,57] on 1591 procedures (which of 533 robotic and 1058 laparoscopic), with no significant difference between the two groups (RD = −0.007, p = 0.662, 95%CI −0.036; 0.023), but with a significant heterogeneity among the studies (I2 = 61.532%, p = 0.034).
Statistical analysis for postoperative complications are shown in Figure 3. Anastomotic leakage was analysed by 18 Authors [22,23,28,29,32,33,37,38,39,42,43,45,48,50,51,53,54,57] on 3482 procedures (1471 robotic and 2011 laparoscopic), with no statistical differences between the two approaches (OR = 0.936, p = 0.612, 95%CI 0.724, 1.210) and no significant heterogeneity among the studies (I2 = 0%, p = 0.871). Postoperative bleeding was reported by 4 Authors [33,34,57,61] on 1556 procedures (489 robotic and 1067 laparoscopic), demonstrating no significant differences between the two groups (OR = 0.952, p = 0.882, 95%CI 0.494, 1.831) and no significant heterogeneity among the studies (I2 = 0%, p = 0.898). Postoperative wound infection was analysed by 10 Authors [32,38,49,51,53,54,56,57,60,61] on 2189 procedures (1088 robotic and 1101 laparoscopic), with no significant differences between the two approaches (RD = −0.001, p = 0.885, 95%CI −0.010; 0.009) and no significant heterogeneity among the studies (I2 = 7.881%, p = 0.370). Pneumonia was reported by 15 Authors [27,29,32,38,39,40,42,43,45,48,50,51,53,54,57] on 2586 procedures (1276 robotic and 1310 laparoscopic), with a lower number of pneumonias in the robotic group (RD = −0.038, p = 0.003, 95%CI −0.064; −0.013) and no significant heterogeneity among the studies (I2 = 0%, p = 0.726).
RLN paralysis was reported by 14 Authors [23,29,32,33,37,38,40,42,45,48,50,51,53,57] on 2370 procedures (1153 robotic and 1217 laparoscopic), with no significant differences between the two approaches (OR = 0.760, p = 0.258, 95%CI 0.473, 1.223), but with a significant heterogeneity among the studies (I2 = 69.109%, p < 0.0001). Chylothorax was analysed by 13 Authors [23,27,29,32,38,43,45,48,50,51,53,54,57] on 2433 procedures (1207 robotic and 1226 laparoscopic), with no significant differences between the two groups (OR = 0.816, p = 0.564, 95%CI 0.409, 1.627), and no significant heterogeneity among the studies (I2 = 0%, p = 0.954). Mortality was analysed by 17 Authors [22,23,28,31,32,36,38,41,43,44,45,46,48,50,51,53,54] including 3727 patients (1604 robotic and 2123 laparoscopic) with no differences between the two groups (RD = −0.003, p = 0.352, 95%CI −0.011; 0.004) and no significant heterogeneity among the studies (I2 = 0%, p = 0.962). It was not possible to assess the reoperation rate because no studies reported this data.
Oncologic outcomes are shown in Figure 4. Mean number of harvested nodes was reported by 17 Authors [31,34,38,40,43,48,49,52,53,54,55,56,57,58,59,60,61] on 10,707 procedures (which of 3566 robotic and 7141 laparoscopic), demonstrating a higher number in the harvested nodes during the robotic approach (MD = 1.307, p = 0.001, 95%CI 0.553; 2.060), with a significant heterogeneity among the studies (I2 = 74.857%, p < 0.0001). The number of complete resection (R0 resection) was reported by 12 Authors [32,38,48,49,50,52,53,56,57,58,60,61] on 2940 procedures (which of 1469 robotic and 1471 laparoscopic), with no significant differences between the two procedures (RD = 0.005, p = 0.473, 95%CI −0.009; 0.019), and no significant heterogeneity among the studies (I2 = 20.790%, p = 0.258).
Length of hospital stay was represented in Figure 5. This data was reported by 16 Authors [20,21,22,23,28,36,37,38,41,43,45,46,48,50,51,54], on 9642 patients (2713 robotic and 6749 laparoscopic), demonstrating no differences between the two approaches (MD = −0.476, p = 0.289, 95%CI −1.241; 0.289), with a significant heterogeneity among the studies (I2 = 72.303%, p < 0.0001).

5. Long-Term Outcomes

Long-term outcomes are summarized in Figure 6. Recurrences were analysed by 3 Authors [32,54,57] on 1176 patients (588 in each arm), with no significant differences between the two groups (OR = 1.035, p = 0.855, 95%CI 0.720, 1.487) and no significant heterogeneity among the studies (I2 = 0%, p = 0.742). The 5-years overall survival was reported by 2 Authors [43,54], with no significant differences between the two groups (OR = 1.105, p = 0.527, 95%CI 0.811, 1.506) and no significant differences among the studies (I2 = 0%, p = 0.380).

6. Subgroup Analysis

6.1. Fully Robotic vs. Fully Laparoscopic Procedures

Excluding the two studies in which the surgical procedures was not clearly described [52] or in which a hybrid approach was adopted [33,55], this subgroup analysis included 21 studies [31,32,33,34,38,40,42,43,47,48,49,50,51,53,54,56,57,58,59,60,61].
It was not possible to obtain data about blood loss, wound infection, postoperative pneumonia, RLN paralysis and chylothorax because the above-mentioned study did not report these data.
Of the remaining outcomes, the subgroup analysis confirmed the results of the main analysis in terms of operative time (lower in the laparoscopic group, MD = 32, p = 0.004, 95%CI 9.983; 53.978), conversion (RD = −0.011, p = 0.495, 95%CI −0.043; 0.021), anastomotic leakage (OR = 0.945, p = 0.693, 95%CI 0.711; 1.254), bleeding (OR = 0.587, p = 0.555, 95%CI 0.100; 3.443), mortality (RD = −0.004, p = 0.283, 95%CI −0.012; 0.003), harvested nodes (MD = 1.748, p < 0.0001, 95%CI 0.795; 2.701), R0 resection (RD = 0.005, p = 0.528, 95%CI −0.011; 0.022) and hospital stay (MD = −0.462, p = 0.318, 95%CI −1.369; 0.444).

6.2. McKeown Esophagectomy

After excluding four studies about Ivor-Lewis procedure [38,49,51,56] and other nine in which Ivor-Lewis and Mckeown were not separately analysed [31,32,33,40,47,48,50,52,55], ten studies [34,42,43,53,54,57,58,59,60,61] were included in the subgroup analysis according to Mckeown procedure.
Of intraoperative data, no difference was found between robotic and laparoscopic approach in terms of estimated blood loss (MD = −1.370, p = 0.876, 95%CI −18.547; 15.808, respectively). Interestingly, in this subgroup analysis there was no difference in term of operative time (MD = 11.262, p = 0.334, 95%CI −11.595; 34.118), conversely to the main analysis. It was not possible to extract data about conversion because only one study was about McKeown esophagectomy.
Of postoperative complications, the subgroups analysis confirmed no significant differences were between the two approaches in terms of anastomotic leakage (OR = 0.928, p = 0.659, 95%CI 0.667, 1.291), bleeding (OR = 0.587, p = 0.555, 95%CI 0.100; 3.443), wound infection (RD = −0.001, p =0.878, 95%CI −0.009; 0.011), RLN paralysis (OR = 0.994, p = 0.981, 95%CI 0.609, 1.623), chylothorax (OR = 0.880, p = 0.753, 95%CI 0.397; 1.949) and mortality (RD = −0.004, p = 0.285, 95%CI −0.013; 0.004). Similarly, a significant difference was confirmed in terms of postoperative pneumonia between the two groups in favour of robotic surgery (RD = −0.035, p = 0.028, 95%CI −0.066; −0.004).
Confirming the data of the main analysis, robotic surgery was associated with a higher number of harvested nodes (MD = 1.445, p = 0.001, 95%CI 0.572; 2.318), while no differences were found in terms of R0 resection and recurrences (RD = 0.004, p = 0.593, 95%CI −0.010; 0.017 and OR = 1.018, p = 0.925, 95%CI 0.701; 1.478, respectively).
Finally, no significant differences were found in terms of length of hospital stay between the two approaches (MD = −1.058, p = 0.316, 95%CI −3.125; 1.009).

6.3. Ivor-Lewis Esophagectomy

The subgroup analysis on Ivor-Lewis esophagectomy included four studies [38,49,51,56].
The sub-analysis of intraoperative data confirmed that there was no difference between the two approaches in terms of estimated blood loss (MD = 11.916, p = 0.513, 95%CI −23.794; 47.626, respectively). On the contrary, subgroup analysis showed no difference in terms of operative time (MD = 39.990, p = 0.112, 95%CI −9.367; 89.347) between the two approaches. It was not possible to extract data about conversions because only one study was about the Ivor-Lewis procedure.
Of postoperative complications, no significant differences were found in terms of anastomotic leakage (OR = 0.956, p = 0.907, 95%CI 0.446; 2.049), wound infection (RD = −0.014, p = 0.531, 95%CI −0.059; 0.030), RLN paralysis (OR = 1.553, p = 0.524, 95%CI 0.401; 6.022), chylothorax (OR = 0.267, p = 0.255, 95%CI 0.028; 2.597) and mortality (RD = −0.006, p = 0.652, 95%CI −0.031; 0.019), confirming the data of the main analysis. Interestingly, rate of postoperative pneumonia (RD = −0.042, p = 0.123, 95%CI −0.096; 0.011) did not differ between the two approaches. No data were extracted about postoperative bleeding because no studies about Ivor-Lewis esophagectomy reported this data.
About oncologic outcomes, no difference was found in terms of R0 resection (RD = 0.024, p = 0.473, 95%CI −0.042; 0.091) and differently to the main analysis, no difference was found on number of harvested nodes (MD = 4.091, p = 0.077, 95%CI −0.450; 8.631). No data were extracted about recurrence because of the absence of studies about Ivor-Lewis esophagectomy analysing this aspect.
No differences in terms of length of hospital stay was found between the two approaches (MD = −0.001, p = 0.993, 95%CI −0.274; 0.272).

6.4. Publication Bias

Forest plots were symmetrical across outcomes and the Egger’s test was not suggestive of publication bias, except for the mean number of harvested nodes and operative time, in which visual inspection suggested an asymmetric distribution of studies around the mean and the Egger’s test confirmed significant publication bias (p = 0.01 and p = 0.006, respectively). Funnel plots are provided in Supplementary Figures S1–S4.

7. Robotic Versus Open Esophagectomy

7.1. Study Characteristics

Seven retrospective [35,41,44,45,52,61,62] and four prospective cohort studies [37,39,46,63], and two RCTs were identified [11,64], reporting on 4485 patients, out of whom 1919 underwent robotic esophagectomy and 2566 open esophagectomy. The characteristics of the included studies are detailed in Table 2.
About surgical intervention, all the surgical interventions of the included studies were performed with a fully robotic approach, except for the study by Rolff et al. [45], in which an hybrid procedure (robotic approach to the abdomen and open approach to the thorax) was used. Two articles reported on Ivor-Lewis procedure [37,39], one on McKeown esophagectomy [61] while ten did not provide relevant data to allow subgroup analysis [11,35,41,44,45,46,52,62,63,64].

7.2. Risk of Bias Assessment

All studies had NOS quality scores greater than 6, indicating that all these studies had fair methodological quality. Specifically, seven studies had NOS quality score = 8; six had NOS quality score = 7. The NOS quality score is represented in Table 2. The two included RCTs [11,64] had low risk of bias.

7.3. Short-Term Outcomes

Intraoperative outcomes are shown in Figure 7. Operative time was reported by 9 Authors [11,35,37,38,41,45,46,61,63] on 1982 procedure (which of 668 robotic and 1314 open), demonstrating a lower operative time in the open group (MD = 57, p < 0.0001, 95%CI 27.597; 87.684), with a significant heterogeneity among the studies (I2 = 97.190%, p < 0.0001). Estimated blood loss was analysed by 8 Authors [11,35,39,41,45,46,61,63], on 1960 procedures (which of 657 robotic and 1303 open), demonstrating a significantly lower blood loss in the robotic group (MD = −118.783, p = 0.001, 95%CI −187.492; −50.073), with a significant heterogeneity among the studies (I2 = 96.086%, p < 0.0001).
Postoperative complications are shown in Figure 8. Anastomotic leakage was analysed by 8 Authors [11,35,39,41,44,46,61,63] on 2188 procedures (823 robotic and 1365 open), with no statistical differences between the two approaches (OR = 0.953, p = 0.799, 95%CI 0.655; 1.385) and no significant heterogeneity among the studies (I2 = 0%, p = 0.556). Postoperative bleeding was reported by 4 Authors [11,46,61,63] on 818 procedures (339 robotic and 479 open), demonstrating no significant differences between the two groups (RD = −0.007, p = 0.372, 95%CI −0.022; 0.008) and no significant heterogeneity among the studies (I2 = 0%, p = 0.439). Postoperative wound infection was analysed by 6 Authors [11,39,41,44,46,61] on 1570 procedures (605 robotic and 965 open), with a significant differences between the two approaches in favour of robotic surgery (OR = 0.425, p = 0.002, 95%CI 0.245; 0.737) and no significant heterogeneity among the studies (I2 = 11.051%, p = 0.345). Pneumonia was reported by 6 Authors [11,35,39,44,61,63] on 1958 procedures (729 robotic and 1229 open), with a lower number of pneumonias in the robotic group (OR = 0.548, p = 0.03, 95%CI 0.318; 0.944), but with a significant heterogeneity among the studies (I2 = 61.247%, p = 0.024). Pneumonia rate are expressed in percentage and are available in Supplementary Table S3.
RLN paralysis was reported by 6 Authors [11,35,41,46,61,63] on 1125 procedures (457 robotic and 668 open), with no significant differences between the two approaches (OR = 1.352, p = 0.120, 95%CI 0.925, 1.978) and no significant heterogeneity among the studies (I2 = 0%, p = 0.807). Chylothorax was analysed by 4 Authors [11,46,61,63] on 818 procedures (339 robotic and 479 open), with no significant differences between the two groups (OR = 1.407, p = 0.273, 95%CI 0.764; 2.589), and no significant heterogeneity among the studies (I2 = 0%, p = 0.463). Re-operations were reported by 3 Authors [11,38,44] on 1172 procedures (420 robotic and 752 open), with a significant differences in favour of robotic surgery approaches (OR = 0.300, p = 0.035, 95%CI 0.098, 0.919) with no significant heterogeneity among the studies (I2 = 58.531%, p = 0.09). Mortality was analysed by 9 Authors [11,39,44,45,46,52,61,62,63] including 4047 patients (1736 robotic and 2311 open) with no differences between the two groups (OR = 0.971, p = 0.917, 95%CI 0.555; 1.699) and no significant heterogeneity among the studies (I2 = 72.556%, p < 0.0001).
Oncologic outcomes are shown in Figure 9. Mean number of harvested nodes was reported by 10 Authors [11,37,38,41,45,46,52,61,62,63] on 3685 procedures (which of 1555 robotic and 2130 open), demonstrating a higher number of the harvested nodes during the robotic approach (MD = −4, p < 0.0001, 95%CI −5.299; −2.888), with a significant heterogeneity among the studies (I2 = 94.059%, p < 0.0001). The number of complete resection (R0 resection) was reported by 7 Authors [11,39,46,52,61,62,63] on 3387 procedures (which of 1458 robotic and 1929 open), with a significantly higher number of R0 resection in the robotic group (OR = 1.420, p = 0.043, 95%CI 1.011; 1.994), and no significant heterogeneity among the studies (I2 = 0%, p = 0.462). Oncologic outcomes are expressed as means and standard deviation (harvested nodes) and percentage (R0 resection rate) in Supplementary Tables S4 and S5, respectively.
Length of hospital stay was represented in Figure 10. This data was reported by 9 Authors [11,35,37,41,44,45,46,62,63], on 2549 patients (1110 robotic and 1439 open), demonstrating a shorter length of hospital stay in the robotic group (MD = −1.341, p < 0.0001, 95%CI −1.797; −0.885), with a significant heterogeneity among the studies (I2 = 87.169%, p < 0.0001).

8. Long-Term Outcomes

Long-term outcomes are represented in Figure 11. Recurrences was analysed by 2 Authors [63,64] on 480 patients (184 robotic and 296 open), with no significant differences between the two groups (OR = 0.955, p = 0.853, 95%CI 0.590; 1.547) and no significant heterogeneity among the studies (I2 = 0%, p = 0.971). The 5-years overall survival was reported by 4 Authors [11,36,44,64] on 1670 procedures (834 robotic and 836 open), with no significant differences (OR = 1.018, p = 0.861, 95%CI 0.837; 1.237) and no significant heterogeneity among the studies (I2 = 0%, p = 0.562).

9. Subgroup Analysis

9.1. Fully Robotic vs. Open Procedures

To perform this subgroup analysis only the study by Rolff et al. [45] and Weksler et al. [52] were excluded. Thus, the subgroup analysis included eleven studies [11,35,37,38,41,44,46,61,62,63,64].
About intraoperative outcomes, subgroup analysis confirmed a significantly lower operative time (MD = 61.676, p < 0.0001, 95%CI 28.905; 94.448) in the open surgery group and lower estimated blood estimated blood loss (MD = −100.742, p = 0.004, 95%CI −169.793; −31.692) in the robotic group.
About postoperative complications, only data about mortality could be extracted, without a significant difference between the two approaches (OR = 0.855, p = 0.668, 95%CI 0.418; 1.748).
Only data regarding harvested nodes could be extracted in terms of oncologic outcomes in the subgroup analysis, confirming a significant difference between the two approaches in favour of robotic approach (MD = 3.783, p = 0.002, 95%CI 1.385; 6.180).
Hospital stay was confirmed to be shorter in the robotic group (MD = −1.353, p < 0.0001, 95%CI −1.814; −0.892).

9.2. McKeown Esophagectomy

It was not possible to perform a subgroup analysis because only one study [61] reported data about the comparison between robotic and open McKeown esophagectomy.

9.3. Ivor-Lewis Esophagectomy

Ivor-Lewis esophagectomy was described by only two studies [37,38]. It was possible to perform a subgroup analysis about operative time and harvested nodes. Analysis of operative time showed no significant differences between the two approaches (MD = 60.568, p = 0.367, 95%CI −71.084; 192.219). On the contrary, the analysis on harvested nodes confirmed the higher number of this parameter in the robotic group (MD = 10.029, p < 0.0001, 95%CI 8.768; 11.289).

9.4. Publication Bias

Plot analysis showed a symmetrical distribution of the studies evaluating all the analysed outcomes, without evidence of publication bias by the Egger’s test. Funnel plots are shown in Supplementary Figures S5–S8.

10. Discussion

The standard treatment of the esophageal cancer is nowadays considered radical esophagectomy with a complete lymphadenectomy whenever this is feasible [65]. Minimally invasive approaches have emerged over the last decades, with the objective to minimize surgical trauma and optimize postoperative outcomes [65].
Minimally invasive esophagectomy (MIE) has gained momentum because of evidence suggesting lower postoperative complication rate and similar oncologic results compared to conventional thoracotomy approaches [66,67,68].
More recently, Robot-Assisted Minimally Invasive Esophagectomy (RAMIE) was introduced as an alternative minimally invasive method which may allow improved view of thoracic structures and increased precision [69]. Nevertheless, the presumed advantages of the robotic surgery are still under debate [69,70,71]. In this setting, three meta-analysis tried to assess if the robotic approach could be considered the best treatment to the esophageal cancer [70,71,72]. In a network meta-analysis on 98 studies and 32,315 patients, Siaw-Acheampong et al. [70] compared all combinations of open, laparoscopic and robotic approaches to transthoracic esophagectomy. Their results demonstrated that compared with open surgery, both laparoscopic and robotic approaches were associated with less blood loss, significantly lower rates of pulmonary complications, shorter hospital stay and higher mean of harvested nodes, concluding that minimally invasive approaches were related with better postoperative outcomes with no compromise in oncologic results. Regarding the comparison between laparoscopic and robot-assisted approach, Zheng et al. [71] identified fourteen studies with a total of 2887 patients included in the final an analysis. The Authors demonstrated that RAMIE was associated with a lower incidence of pneumonia and vocal cord palsy than MIE, but still be associated with longer operative time. Additionally, Li et al. [72] demonstrated in a meta-analytic comparison between 866 patients in the RAMIE group and 883 patients in the MIE group that RAMIE yielded significantly higher number of lymph nodes. Both Authors independently concluded that RAMIE could be a standard treatment for transthoracic approach to esophageal cancer. From that knowledge, in the last two years fifteen new studies have been published comparing robotic approach with the other surgical techniques, confirming the fervid interest in this topic.
By pooling respectively 11,779 comparing robotic versus laparoscopic and 4485 robotic versus open esophagectomy we are able to provide pros and cons of the robotic approach.
Robotic approach appears to provide some advantages over open approach. In fact, our results showed that robotic approach is clearly superior over open surgery in terms of intraoperative outcomes (less blood loss p = 0.001), postoperative complications (lower wound infection rate, p = 0.002; pneumonia rate, p = 0.03; re-operation rate p = 0.03) and oncologic outcomes (mean number of harvested nodes, p < 0.0001; R0 resection rate, p = 0.043). The possible explanation of these better oncologic results could lay in the magnification of the images and in the finer dissection movements properly related to the robotic technology. Considering the current literature, these results are completely in accordance with the previous network meta-analysis by Siaw-Acheampong et al. [70], confirming the advantages of the robotic approach over open technique. On the contrary, no disadvantages were associated with the robotic surgery, except for operative time (longer in the robotic group, p < 0.0001), but with no association with non-surgical postoperative complications. Finally, we can assess the safety of robotic approach, guaranteed by the absence of significant differences over open surgery in terms of postoperative complications. Additional conclusion could be provided by the comparison between robotic and conventional laparoscopic approach. Robotic approach seemed to be superior to conventional laparoscopy in terms of oncologic outcomes (mean number of harvested nodes obtained, p = 0.001) and postoperative complications (incidence of pneumonia after surgery, p = 0.003). Even in this case robotic surgery has the only disadvantage of operative time (shorter in the laparoscopic group, p = 0.003), but this data was not associated with increased postoperative morbidities.Our results are in accordance with the results of the meta-analysis by Zheng et al. [71] in terms of longer operative time in the robotic group. Similarly pneumonia rate was lower in the robotic group, and this data has been confirmed by our analysis. Comparing our results with the results obtained by the meta-analysis by Li et al. [72], it is easy to notice an accordance in the setting of number of yielded lymph nodes, significantly higher in the robotic group. On the contrary, Li et al. [72] demonstrated a lower blood loss in the robotic group, in our meta-analysis there was no significant differences between the two groups.
Finally, it is important to highlight that our results were confirmed by the subgroups analyses both for robotic versus laparoscopic and robotic versus open comparison.
In fact, excluding hybrid procedures in both main comparisons, and organizing the studies according to Ivor-Lewis or McKeown procedures, we could confirm the superiority of robotic approach.
Despite these results, major limitation of this study has to be addressed. As known, meta-analysis has to be considered the mirror of the current literature and, thus, the major limitation of our report is that most studies are on a retrospective manner, foreclosing the possibility to exclude patients selection bias.
We cannot exclude that patients’ allocation into robotic, laparoscopic or open group would be related to surgeons’ preference and experience, patients’ and tumors’ characteristics.

11. Conclusions

Even if further randomized clinical trials are needed to give definitive conclusions to include the robotic esophagectomy as the gold standard treatment for esophageal cancer, we can assess that robotic surgery could be considered associated with several advantages over both open and laparoscopic surgery.
Take home messages from our analysis are:
  • robotic surgery could be considered absolutely safe, being the results about postoperative complications comparable to open and laparoscopic surgery;
  • robotic surgery could be considered superior to open approach, being guaranteed less postoperative complications and superior oncologic results;
  • robotic approach appeared to be slightly superor to laparoscopic surgery, providing less postoperative pneumonia and higher number of harvested nodes;
  • being by our results safety and effectiveness of robotic surgery to treat esophageal cancer, future perspective is the call to perform randomized clinical trial to confirm the advantages of robotic surgery. Definitive conclusions cannot be drawn, due to limitations of the current literature.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/jpm11070640/s1, Supplementary Figure S1. Funnel plot analysis of the comparison between robotic and laparoscopic surgery about intraoperative outcomes. (a) operative time; (b) estimated blood loss; (c) conversion. Supplementary Figure S2. Funnel plot analysis of the comparison between robotic and laparoscopic surgery about postoperative complications. (a) anastomotic leakage; (b) postoperative bleeding; (c) wound infection; (d) pneumonia; (e) RLN paralysis; (f) chylothorax; (g) mortality. Supplementary Figure S3. Funnel plot analysis of the comparison between robotic and laparoscopic surgery about oncologic outcomes. (a) number of harvested nodes; (b) R0 resection. Supplementary Figure S4. Funnel plot analysis of the comparison between robotic and laparoscopic surgery about length of hospital stay. Supplementary Figure S5. Funnel plot analysis of the comparison between robotic and laparoscopic surgery about long-term outcomes. (a) recurrences; (b) 5-years overall survival. Supplementary Figure S6. Funnel plot analysis of the comparison between robotic and open surgery about intraoperative outcomes. (a) operative time; (b) estimated blood loss. Supplementary Figure S7. Funnel plot analysis of the comparison between robotic and open surgery about postoperative complications. (a) anastomotic leakage; (b) postoperative bleeding; (c) wound infection; (d) pneumonia; (e) RLN paralysis; (f) chylothorax; (g) re-operation rate; (h) mortality. Supplementary Figure S8. Funnel plot analysis of the comparison between robotic and open surgery about oncologic outcomes. (a) number of harvested nodes; (b) R0 resection. Supplementary Figure S9. Funnel plot analysis of the comparison between robotic and open surgery about length of hospital stay. Supplementary Figure S10. Funnel plot analysis of the comparison between robotic and open surgery about 5-years overall survival. Supplementary Table S1. NOS quality assessment of the included studies comparing robotic and laparoscopic approach. Supplementary Table S2. NOS quality assessment of the included studies comparing robotic and open approach. Supplementary Table S3. Comparison between robotic and open surgery in terms of pneumonia rate.

Author Contributions

M.M. (Marco Milone): design of the study; S.V., A.M., S.A.A., N.K.F.: Acquisition, analysis and interpretation of the data; G.D.D.P. and M.M. (Michele Manigrasso): Interpretation of the data and critical revisions; M.M. (Michele Manigrasso): Conception of the study, critical revisions and final approval. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors have no conflict of interest to declare.

References

  1. Arnold, M.; Abnet, C.C.; Neale, R.E.; Vignat, J.; Giovannucci, E.L.; McGlynn, K.A.; Bray, F. Global Burden of 5 Major Types of Gastrointestinal Cancer. Gastroenterology 2020. [Google Scholar] [CrossRef] [PubMed]
  2. Chen, M.F.; Yang, Y.H.; Lai, C.H.; Chen, P.C.; Chen, W.C. Outcome of patients with esophageal cancer: A nationwide analysis. Ann. Surg. Oncol. 2013. [Google Scholar] [CrossRef]
  3. Lewis, I. The surgical treatment of carcinoma of the oesophagus with special reference to a new operation for growths of the middle third. Br. J. Surg. 1946. [Google Scholar] [CrossRef] [PubMed]
  4. Wang, B.; Zuo, Z.; Chen, H.; Qiu, B.; Du, M.; Gao, Y. The comparison of thoracoscopic-laparoscopic esophagectomy and open esophagectomy: A meta-analysis. Indian J. Cancer 2017. [Google Scholar] [CrossRef]
  5. Guo, W.; Ma, X.; Yang, S.; Zhu, X.; Qin, W.; Xiang, J.; Lerut, T.; Li, H. Combined thoracoscopic-laparoscopic esophagectomy versus open esophagectomy: A meta-analysis of outcomes. Surg. Endosc. 2016. [Google Scholar] [CrossRef]
  6. Wang, K.; Zhong, J.; Liu, Q.; Lin, P.; Fu, J. A Propensity Score-matched Analysis of Thoraco-laparoscopic versus Open McKeown’s Esophagectomy. Ann. Thorac. Surg. 2021. [Google Scholar] [CrossRef] [PubMed]
  7. Nuytens, F.; Dabakuyo-Yonli, T.S.; Meunier, B.; Gagnière, J.; Collet, D.; D’Journo, X.B.; Brigand, C.; Perniceni, T.; Carrère, N.; Mabrut, J.Y.; et al. Five-Year Survival Outcomes of Hybrid Minimally Invasive Esophagectomy in Esophageal Cancer: Results of the MIRO Randomized Clinical Trial. JAMA Surg. 2021. [Google Scholar] [CrossRef] [PubMed]
  8. Mariette, C.; Markar, S.; Dabakuyo-Yonli, T.S.; Meunier, B.; Pezet, D.; Collet, D.; D’Journo, X.B.; Brigand, C.; Perniceni, T.; Carrere, N.; et al. Health-related quality of life following hybrid minimally invasive versus open esophagectomy for patients with esophageal cancer, analysis of a multicenter, open-label, randomized phase III controlled trial: The MIRO trial. Ann. Surg. 2020. [Google Scholar] [CrossRef]
  9. Yoshida, N.; Yamamoto, H.; Baba, H.; Miyata, H.; Watanabe, M.; Toh, Y.; Matsubara, H.; Kakeji, Y.; Seto, Y. Can Minimally Invasive Esophagectomy Replace Open Esophagectomy for Esophageal Cancer? Latest Analysis of 24,233 Esophagectomies from the Japanese National Clinical Database. Ann. Surg. 2020. [Google Scholar] [CrossRef]
  10. Maas, K.W.; Cuesta, M.A.; Van Berge Henegouwen, M.I.; Roig, J.; Bonavina, L.; Rosman, C.; Gisbertz, S.S.; Biere, S.S.A.Y.; Van Der Peet, D.L. Quality of Life and Late Complications After Minimally Invasive Compared to Open Esophagectomy: Results of a Randomized Trial. World J. Surg. 2015. [Google Scholar] [CrossRef] [Green Version]
  11. van der Sluis, P.C.; van der Horst, S.; May, A.M.; Schippers, C.; Brosens, L.A.A.; Joore, H.C.A.; Kroese, C.C.; Haj Mohammad, N.; Mook, S.; Vleggaar, F.P.; et al. Robot-assisted Minimally Invasive Thoracolaparoscopic Esophagectomy Versus Open Transthoracic Esophagectomy for Resectable Esophageal Cancer: A Randomized Controlled Trial. Ann. Surg. 2019. [Google Scholar] [CrossRef] [PubMed]
  12. Egberts, J.H.; Stein, H.; Aselmann, H.; Jan-Hendrik, A.; Becker, T. Fully robotic da Vinci Ivor-Lewis esophagectomy in four-arm technique-problems and solutions. Dis. Esophagus 2017. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Milone, M.; Manigrasso, M.; Velotti, N.; Torino, S.; Vozza, A.; Sarnelli, G.; Aprea, G.; Maione, F.; Gennarelli, N.; Musella, M.; et al. Completeness of total mesorectum excision of laparoscopic versus robotic surgery: A review with a meta-analysis. Int. J. Colorectal Dis. 2019, 34, 983–991. [Google Scholar] [CrossRef] [PubMed]
  14. Ceccarelli, G.; Andolfi, E.; Biancafarina, A.; Rocca, A.; Amato, M.; Milone, M.; Scricciolo, M.; Frezza, B.; Miranda, E.; De Prizio, M.; et al. Robot-assisted surgery in elderly and very elderly population: Our experience in oncologic and general surgery with literature review. Aging Clin. Exp. Res. 2017. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Moon, A.S.; Garofalo, J.; Koirala, P.; Vu, M.L.T.; Chuang, L. Robotic Surgery in Gynecology. Surg. Clin. N. Am. 2020, 82, 96–109. [Google Scholar] [CrossRef]
  16. Tang, A.B.; Lamaina, M.; Childers, C.P.; Mak, S.S.; Ruan, Q.; Begashaw, M.M.; Bergman, J.; Booth, M.S.; Shekelle, P.G.; Wilson, M.; et al. Perioperative and Long-Term Outcomes of Robot-Assisted Partial Nephrectomy: A Systematic Review. Am. Surg. 2021. [Google Scholar] [CrossRef] [PubMed]
  17. Kernstine, K.H.; DeArmond, D.T.; Karimi, M.; Van Natta, T.L.; Campos, J.C.; Yoder, M.R.; Everett, J.E. The robotic, 2-stage, 3-field esophagolymphadenectomy. J. Thorac. Cardiovasc. Surg. 2004. [Google Scholar] [CrossRef]
  18. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; Altman, D.; Antes, G.; Atkins, D.; Barbour, V.; Barrowman, N.; Berlin, J.A.; et al. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009, 6, e1000097. [Google Scholar] [CrossRef] [Green Version]
  19. Brooke, B.S.; Schwartz, T.A.; Pawlik, T.M. MOOSE Reporting Guidelines for Meta-analyses of Observational Studies. JAMA Surg. 2021. [Google Scholar] [CrossRef]
  20. Wells, G.A.; Shea, B.; O’connell, D.; Petersen, J.; Welch, V.; Losos, M.; Tugwell, P.; The Newcastle-Ottawa Scale (NOS) for Assessing the Quality of Nonrandomized Studies in Meta-Analyses. Department of Epidemiology and Community Medicine, University of Ottawa: ottawa, ON, Canada, 2012. Available online: www.ohri.ca/programs/clinical_epidemiology/oxford.asp (accessed on 12 May 2021).
  21. Higgins, J.P.T.; Altman, D.G.; Gøtzsche, P.C.; Jüni, P.; Moher, D.; Oxman, A.D.; Savović, J.; Schulz, K.F.; Weeks, L.; Sterne, J.A.C. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ 2011. [Google Scholar] [CrossRef] [Green Version]
  22. Messori, A.; Maratea, D.; Fadda, V.; Trippoli, S. Using risk difference as opposed to odds-ratio in meta-analysis. Int. J. Cardiol. 2013. [Google Scholar] [CrossRef] [PubMed]
  23. Shi, J.; Luo, D.; Weng, H.; Zeng, X.T.; Lin, L.; Chu, H.; Tong, T. Optimally estimating the sample standard deviation from the five-number summary. Res. Synth. Methods 2020. [Google Scholar] [CrossRef] [PubMed]
  24. Luo, D.; Wan, X.; Liu, J.; Tong, T. Optimally estimating the sample mean from the sample size, median, mid-range, and/or mid-quartile range. Stat. Methods Med. Res. 2018. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Wan, X.; Wang, W.; Liu, J.; Tong, T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med. Res. Methodol. 2014. [Google Scholar] [CrossRef] [Green Version]
  26. Furukawa, T.A.; Barbui, C.; Cipriani, A.; Brambilla, P.; Watanabe, N. Imputing missing standard deviations in meta-analyses can provide accurate results. J. Clin. Epidemiol. 2006. [Google Scholar] [CrossRef] [PubMed]
  27. DerSimonian, R.; Laird, N. Meta-analysis in clinical trials revisited. Contemp. Clin. Trials 2015. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Higgins, J.P.T.; Thompson, S.G.; Deeks, J.J.; Altman, D.G. Measuring inconsistency in meta-analyses. Br. Med. J. 2003, 327, 557–560. [Google Scholar] [CrossRef] [Green Version]
  29. Thompson, S.G.; Sharp, S.J. Explaining heterogeneity in meta-analysis: A comparison of methods. Stat. Med. 1999, 18, 2693–2708. [Google Scholar] [CrossRef]
  30. Egger, M.; Smith, G.D.; Schneider, M.; Minder, C. Bias in meta-analysis detected by a simple, graphical test. Br. Med. J. 1997. [Google Scholar] [CrossRef] [Green Version]
  31. Ali, A.M.; Bachman, K.C.; Worrell, S.G.; Gray, K.E.; Perry, Y.; Linden, P.A.; Towe, C.W. Robotic minimally invasive esophagectomy provides superior surgical resection. Surg. Endosc. 2020. [Google Scholar] [CrossRef]
  32. Grimminger, P.P.; Tagkalos, E.; Hadzijusufovic, E.; Corvinus, F.; Babic, B.; Lang, H. Change from Hybrid to Fully Minimally Invasive and Robotic Esophagectomy is Possible without Compromises. Thorac. Cardiovasc. Surg. 2019. [Google Scholar] [CrossRef]
  33. Harbison, G.J.; Vossler, J.D.; Yim, N.H.; Murayama, K.M. Outcomes of robotic versus non-robotic minimally-invasive esophagectomy for esophageal cancer: An American College of Surgeons NSQIP database analysis. Am. J. Surg. 2019. [Google Scholar] [CrossRef]
  34. He, H.; Wu, Q.; Wang, Z.; Zhang, Y.; Chen, N.; Fu, J.; Zhang, G. Short-term outcomes of robot-assisted minimally invasive esophagectomy for esophageal cancer: A propensity score matched analysis. J. Cardiothorac. Surg. 2018. [Google Scholar] [CrossRef]
  35. Jeong, D.M.; Kim, J.A.; Ahn, H.J.; Yang, M.; Heo, B.Y.; Lee, S.H. Decreased Incidence of Postoperative Delirium in Robot-assisted Thoracoscopic Esophagectomy Compared with Open Transthoracic Esophagectomy. Surg. Laparosc. Endosc. Percutaneous Tech. 2016, 26, 516–522. [Google Scholar] [CrossRef] [PubMed]
  36. Kamel, M.K.; Sholi, A.N.; Rahouma, M.; Harrison, S.W.; Lee, B.; Stiles, B.M.; Altorki, N.K.; Port, J.L. National trends and perioperative outcomes of robotic oesophagectomy following induction chemoradiation therapy: A National Cancer Database propensity-matched analysis. Eur. J. Cardio-Thoracic Surg. 2021. [Google Scholar] [CrossRef]
  37. Mehdorn, A.-S.; Möller, T.; Franke, F.; Richter, F.; Kersebaum, J.-N.; Becker, T.; Egberts, J.-H. Long-Term, Health-Related Quality of Life after Open and Robot-Assisted Ivor-Lewis Procedures—A Propensity Score-Matched Study. J. Clin. Med. 2020. [Google Scholar] [CrossRef] [PubMed]
  38. Meredith, K.L.; Maramara, T.; Blinn, P.; Lee, D.; Huston, J.; Shridhar, R. Comparative Perioperative Outcomes by Esophagectomy Surgical Technique. J. Gastrointest. Surg. 2020. [Google Scholar] [CrossRef] [PubMed]
  39. Meredith, K.; Blinn, P.; Maramara, T.; Takahashi, C.; Huston, J.; Shridhar, R. Comparative outcomes of minimally invasive and robotic-assisted esophagectomy. Surg. Endosc. 2020. [Google Scholar] [CrossRef]
  40. Motoyama, S.; Sato, Y.; Wakita, A.; Kawakita, Y.; Nagaki, Y.; Imai, K.; Minamiya, Y. Extensive lymph node dissection around the left laryngeal nerve achieved with robot-assisted thoracoscopic esophagectomy. Anticancer Res. 2019. [Google Scholar] [CrossRef]
  41. Osaka, Y.; Tachibana, S.; Ota, Y.; Suda, T.; Makuuti, Y.; Watanabe, T.; Iwasaki, K.; Katsumata, K.; Tsuchida, A. Usefulness of robot-assisted thoracoscopic esophagectomy. Gen. Thorac. Cardiovasc. Surg. 2018. [Google Scholar] [CrossRef] [PubMed]
  42. Chao, Y.K.; Hsieh, M.J.; Liu, Y.H.; Liu, H.P. Lymph Node Evaluation in Robot-Assisted Versus Video-Assisted Thoracoscopic Esophagectomy for Esophageal Squamous Cell Carcinoma: A Propensity-Matched Analysis. World J. Surg. 2018. [Google Scholar] [CrossRef] [PubMed]
  43. Park, S.; Hwang, Y.; Lee, H.J.; Park, I.K.; Kim, Y.T.; Kang, C.H. Comparison of robot-assisted esophagectomy and thoracoscopic esophagectomy in esophageal squamous cell carcinoma. J. Thorac. Dis. 2016. [Google Scholar] [CrossRef] [Green Version]
  44. Pointer, D.T.; Saeed, S.; Naffouje, S.A.; Mehta, R.; Hoffe, S.E.; Dineen, S.P.; Fleming, J.B.; Fontaine, J.P.; Pimiento, J.M. Outcomes of 350 Robotic-assisted Esophagectomies at a High-volume Cancer Center. Ann. Surg. 2020. [Google Scholar] [CrossRef] [PubMed]
  45. Rolff, H.C.; Ambrus, R.B.; Belmouhand, M.; Achiam, M.P.; Wegmann, M.; Siemsen, M.; Kofoed, S.C.; Svendsen, L.B. Robot-Assisted Hybrid Esophagectomy Is Associated with a Shorter Length of Stay Compared to Conventional Transthoracic Esophagectomy: A Retrospective Study. Minim. Invasive Surg. 2017. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Sarkaria, I.S.; Rizk, N.P.; Goldman, D.A.; Sima, C.; Tan, K.S.; Bains, M.S.; Adusumilli, P.S.; Molena, D.; Bott, M.; Atkinson, T.; et al. Early Quality of Life Outcomes After Robotic-Assisted Minimally Invasive and Open Esophagectomy. Ann. Thorac. Surg. 2019. [Google Scholar] [CrossRef]
  47. Shirakawa, Y.; Noma, K.; Kunitomo, T.; Hashimoto, M.; Maeda, N.; Tanabe, S.; Sakurama, K.; Fujiwara, T. Initial introduction of robot-assisted, minimally invasive esophagectomy using the microanatomy-based concept in the upper mediastinum. Surg. Endosc. 2020. [Google Scholar] [CrossRef]
  48. Suda, K.; Ishida, Y.; Kawamura, Y.; Inaba, K.; Kanaya, S.; Teramukai, S.; Satoh, S.; Uyama, I. Robot-assisted thoracoscopic lymphadenectomy along the left recurrent laryngeal nerve for esophageal squamous cell carcinoma in the prone position: Technical report and short-term outcomes. World J. Surg. 2012. [Google Scholar] [CrossRef] [PubMed]
  49. Tagkalos, E.; Goense, L.; Hoppe-Lotichius, M.; Ruurda, J.P.; Babic, B.; Hadzijusufovic, E.; Kneist, W.; Van Der Sluis, P.C.; Lang, H.; Van Hillegersberg, R.; et al. Robot-assisted minimally invasive esophagectomy (RAMIE) compared to conventional minimally invasive esophagectomy (MIE) for esophageal cancer: A propensity-matched analysis. Dis. Esophagus 2020. [Google Scholar] [CrossRef] [PubMed]
  50. Tsunoda, S.; Obama, K.; Hisamori, S.; Nishigori, T.; Okamura, R.; Maekawa, H.; Sakai, Y. Lower Incidence of Postoperative Pulmonary Complications Following Robot-Assisted Minimally Invasive Esophagectomy for Esophageal Cancer: Propensity Score-Matched Comparison to Conventional Minimally Invasive Esophagectomy. Ann. Surg. Oncol. 2021. [Google Scholar] [CrossRef] [PubMed]
  51. Weksler, B.; Sharma, P.; Moudgill, N.; Chojnacki, K.A.; Rosato, E.L. Robot-assisted minimally invasive esophagectomy is equivalent to thoracoscopic minimally invasive esophagectomy. Dis. Esophagus 2012. [Google Scholar] [CrossRef]
  52. Weksler, B.; Sullivan, J.L. Survival after Esophagectomy: A Propensity-Matched Study of Different Surgical Approaches. Ann. Thorac. Surg. 2017. [Google Scholar] [CrossRef] [Green Version]
  53. Chao, Y.K.; Wen, Y.W.; Chuang, W.Y.; Cerfolio, R.J. Transition from video-assisted thoracoscopic to robotic esophagectomy: A single surgeon’s experience. Dis. Esophagus 2020. [Google Scholar] [CrossRef] [PubMed]
  54. Xu, Y.; Li, X.-K.; Cong, Z.-Z.; Zhou, H.; Wu, W.-J.; Qiang, Y.; Yi, J.; Shen, Y. Long-term outcomes of robotic-assisted versus thoraco-laparoscopic McKeown esophagectomy for esophageal cancer: A propensity score-matched study. Dis. Esophagus 2020. [Google Scholar] [CrossRef] [PubMed]
  55. Yerokun, B.A.; Sun, Z.; Jeffrey Yang, C.F.; Gulack, B.C.; Speicher, P.J.; Adam, M.A.; D’Amico, T.A.; Onaitis, M.W.; Harpole, D.H.; Berry, M.F.; et al. Minimally Invasive Versus Open Esophagectomy for Esophageal Cancer: A Population-Based Analysis. Ann. Thorac. Surg. 2016. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  56. Zhang, Y.; Han, Y.; Gan, Q.; Xiang, J.; Jin, R.; Chen, K.; Che, J.; Hang, J.; Li, H. Early Outcomes of Robot-Assisted Versus Thoracoscopic-Assisted Ivor Lewis Esophagectomy for Esophageal Cancer: A Propensity Score-Matched Study. Ann. Surg. Oncol. 2019. [Google Scholar] [CrossRef]
  57. Yang, Y.; Zhang, X.; Li, B.; Hua, R.; Yang, Y.; He, Y.; Ye, B.; Guo, X.; Sun, Y.; Li, Z. Short- And mid-term outcomes of robotic versus thoraco-laparoscopic McKeown esophagectomy for squamous cell esophageal cancer: A propensity score-matched study. Dis. Esophagus 2020. [Google Scholar] [CrossRef] [PubMed]
  58. Chen, J.; Liu, Q.; Zhang, X.; Yang, H.; Tan, Z.; Lin, Y.; Fu, J. Comparisons of short-term outcomes between robot-assisted and thoraco-laparoscopic esophagectomy with extended two-field lymph node dissection for resectable thoracic esophageal squamous cell carcinoma. J. Thorac. Dis. 2019. [Google Scholar] [CrossRef]
  59. Deng, H.Y.; Luo, J.; Li, S.X.; Li, G.; Alai, G.; Wang, Y.; Liu, L.X.; Lin, Y.D. Does robot-assisted minimally invasive esophagectomy really have the advantage of lymphadenectomy over video-assisted minimally invasive esophagectomy in treating esophageal squamous cell carcinoma? A propensity score-matched analysis based on short-term. Dis. Esophagus 2019. [Google Scholar] [CrossRef]
  60. Duan, X.; Yue, J.; Chen, C.; Gong, L.; Ma, Z.; Shang, X.; Yu, Z.; Jiang, H. Lymph node dissection around left recurrent laryngeal nerve: Robot-assisted vs. video-assisted McKeown esophagectomy for esophageal squamous cell carcinoma. Surg. Endosc. 2020. [Google Scholar] [CrossRef]
  61. Gong, L.; Jiang, H.; Yue, J.; Duan, X.; Tang, P.; Ren, P.; Zhao, X.; Liu, X.; Zhang, X.; Yu, Z. Comparison of the short-term outcomes of robot-assisted minimally invasive, video-assisted minimally invasive, and open esophagectomy. J. Thorac. Dis. 2020. [Google Scholar] [CrossRef]
  62. Espinoza-Mercado, F.; Imai, T.A.; Borgella, J.D.; Sarkissian, A.; Serna-Gallegos, D.; Alban, R.F.; Soukiasian, H.J. Does the Approach Matter? Comparing Survival in Robotic, Minimally Invasive, and Open Esophagectomies. Ann. Thorac. Surg. 2019. [Google Scholar] [CrossRef]
  63. Yun, J.K.; Chong, B.K.; Kim, H.J.; Lee, I.S.; Gong, C.S.; Kim, B.S.; Lee, G.D.; Choi, S.; Kim, H.R.; Kim, D.K.; et al. Comparative outcomes of robot-assisted minimally invasive versus open esophagectomy in patients with esophageal squamous cell carcinoma: A propensity score-weighted analysis. Dis. Esophagus 2021. [Google Scholar] [CrossRef] [PubMed]
  64. de Groot, E.M.; van der Horst, S.; Feike Kingma, B.; Goense, L.; van der Sluis, P.C.; Ruurda, J.P.; van Hillegersberg, R. Robot-assisted minimally invasive thoracolaparoscopic esophagectomy versus open esophagectomy: Long-term follow-up of a randomized clinical trial. Dis. Esophagus 2020. [Google Scholar] [CrossRef]
  65. Gisbertz, S.S.; Hagens, E.R.C.; Ruurda, J.P.; Schneider, P.M.; Tan, L.J.; Domrachev, S.A.; Hoeppner, J.; van Berge Henegouwen, M.I. The evolution of surgical approach for esophageal cancer. Ann. N. Y. Acad. Sci. 2018. [Google Scholar] [CrossRef] [PubMed]
  66. Lv, L.; Hu, W.; Ren, Y.; Wei, X. Minimally invasive esophagectomy versus open esophagectomy for esophageal cancer: A meta-analysis. OncoTargets Ther. 2016. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  67. Mariette, C.; Piessen, G.; Triboulet, J.P. Therapeutic strategies in oesophageal carcinoma: Role of surgery and other modalities. Lancet Oncol. 2007, 8, 545–553. [Google Scholar] [CrossRef]
  68. Biere, S.S.A.Y.; Van Berge Henegouwen, M.I.; Maas, K.W.; Bonavina, L.; Rosman, C.; Garcia, J.R.; Gisbertz, S.S.; Klinkenbijl, J.H.G.; Hollmann, M.W.; De Lange, E.S.M.; et al. Minimally invasive versus open oesophagectomy for patients with oesophageal cancer: A multicentre, open-label, randomised controlled trial. Lancet 2012. [Google Scholar] [CrossRef]
  69. Jin, D.; Yao, L.; Yu, J.; Liu, R.; Guo, T.; Yang, K.; Gou, Y. Robotic-assisted minimally invasive esophagectomy versus the conventional minimally invasive one: A meta-analysis and systematic review. Int. J. Med. Robot. Comput. Assist. Surg. 2019, 15, e1988. [Google Scholar] [CrossRef]
  70. Siaw-Acheampong, K.; Kamarajah, S.K.; Gujjuri, R.; Bundred, J.R.; Singh, P.; Griffiths, E.A. Minimally invasive techniques for transthoracic oesophagectomy for oesophageal cancer: Systematic review and network meta-analysis. BJS Open 2020, 4, 787–803. [Google Scholar] [CrossRef]
  71. Zheng, C.; Li, X.K.; Zhang, C.; Zhou, H.; Ji, S.G.; Zhong, J.H.; Xu, Y.; Cong, Z.Z.; Wang, G.M.; Wu, W.J.; et al. Comparison of short-term clinical outcomes between robot-assisted minimally invasive esophagectomy and video-assisted minimally invasive esophagectomy: A systematic review and meta-analysis. J. Thorac. Dis. 2021. [Google Scholar] [CrossRef]
  72. Li, X.K.; Xu, Y.; Zhou, H.; Cong, Z.Z.; Wu, W.J.; Qiang, Y.; Shen, Y. Does robot-assisted minimally invasive oesophagectomy have superiority over thoraco-laparoscopic minimally invasive oesophagectomy in lymph node dissection? Dis. esophagus Off. J. Int. Soc. Dis. Esophagus 2021. [Google Scholar] [CrossRef] [PubMed]
Figure 1. PRISMA Flowchart.
Figure 1. PRISMA Flowchart.
Jpm 11 00640 g001
Figure 2. Robotic versus laparoscopic surgery: intraoperative outcomes. (a) operative time; (b) estimated blood loss; (c) conversion.
Figure 2. Robotic versus laparoscopic surgery: intraoperative outcomes. (a) operative time; (b) estimated blood loss; (c) conversion.
Jpm 11 00640 g002
Figure 3. Robotic versus laparoscopic surgery: postoperative complications. (a) anastomotic leakage; (b) postoperative bleeding; (c) wound infection; (d) pneumonia; (e) RLN paralysis; (f) chylothorax; (g) mortality.
Figure 3. Robotic versus laparoscopic surgery: postoperative complications. (a) anastomotic leakage; (b) postoperative bleeding; (c) wound infection; (d) pneumonia; (e) RLN paralysis; (f) chylothorax; (g) mortality.
Jpm 11 00640 g003aJpm 11 00640 g003bJpm 11 00640 g003c
Figure 4. Robotic versus laparoscopic surgery: oncologic outcomes. (a) Number of harvested nodes; (b) R0 resection.
Figure 4. Robotic versus laparoscopic surgery: oncologic outcomes. (a) Number of harvested nodes; (b) R0 resection.
Jpm 11 00640 g004
Figure 5. Robotic versus laparoscopic surgery: length of hospital stay.
Figure 5. Robotic versus laparoscopic surgery: length of hospital stay.
Jpm 11 00640 g005
Figure 6. Robotic versus laparoscopic surgery: long-term outcomes. (a) recurrences; (b) 5-years overall survival.
Figure 6. Robotic versus laparoscopic surgery: long-term outcomes. (a) recurrences; (b) 5-years overall survival.
Jpm 11 00640 g006
Figure 7. Robotic versus open surgery: intraoperative outcomes. (a) operative time; (b) estimated blood loss.
Figure 7. Robotic versus open surgery: intraoperative outcomes. (a) operative time; (b) estimated blood loss.
Jpm 11 00640 g007
Figure 8. Robotic versus open surgery: postoperative complications. (a) anastomotic leakage; (b) postoperative bleeding; (c) wound infection; (d) pneumonia; (e) RLN paralysis; (f) chylothorax; (g) re-operation rate; (h) mortality.
Figure 8. Robotic versus open surgery: postoperative complications. (a) anastomotic leakage; (b) postoperative bleeding; (c) wound infection; (d) pneumonia; (e) RLN paralysis; (f) chylothorax; (g) re-operation rate; (h) mortality.
Jpm 11 00640 g008aJpm 11 00640 g008bJpm 11 00640 g008c
Figure 9. Robotic versus open surgery: oncologic outcomes. (a) number of harvested nodes; (b) R0 resection.
Figure 9. Robotic versus open surgery: oncologic outcomes. (a) number of harvested nodes; (b) R0 resection.
Jpm 11 00640 g009
Figure 10. Robotic versus open surgery: length of hospital stay.
Figure 10. Robotic versus open surgery: length of hospital stay.
Jpm 11 00640 g010
Figure 11. Robotic versus open surgery: long-term outcomes. (a) recurrences; (b) 5-years overall survival.
Figure 11. Robotic versus open surgery: long-term outcomes. (a) recurrences; (b) 5-years overall survival.
Jpm 11 00640 g011
Table 1. Characteristics of the included studies comparing robotic and laparoscopic approach.
Table 1. Characteristics of the included studies comparing robotic and laparoscopic approach.
StudyStudy DesignN. of Enrolled PatientsMean AgeMean BMIASA Score (%)Tumor Stage (%)Tumor Localization (%)
RAMIEMIEIIIIIIIV0IIIIIIIV
Ali et al., 2020retro1543511863.71NRNRNRNRNRNRNRNRNRNRNRNRNRNR
Chao et al., 2018retro343455.12NRNRNRNRNR0.0047.100.0052.900.0029.4050.0020.600.00
Chao et al., 2020retro396755.6022.34NRNRNRNR0.000.007.5592.450.0022.6548.0829.270.00
Chen et al., 2019retro545461.8022.85NRNRNRNRNRNRNRNRNRNRNRNRNR
Deng et al., 2018prosp525260.95NRNRNRNRNR0.0012.5045.1537.500.0016.3560.6022.100.95
Duan et al., 2020retro1097560.45NRNRNRNRNRNRNRNRNRNRNRNRNRNR
Gong et al., 2020retro91144NRNRNRNRNRNR0.0018.5933.3320.832.573.5333.0138.780.00
Grimminger et al., 2019prosp252562.0525.55NRNRNRNR0.000.000.000.000.000.0014.0089.000.00
Harbison et al., 2019retro10062564.0027.6317.380.0077.664.97NRNRNRNRNRNRNRNRNR
He et al., 2018retro272761.3021.70NRNRNRNR0.000.000.000.000.007.4061.1031.450.00
Meredith et al., 2020prosp1449550.9721.840.3535.9442.150.670.0015.7025.1135.372.22NRNRNRNR
Motoyama et al., 2019retro213864.10NRNRNRNRNR0.0038.8015.1445.710.0025.7838.8035.420.00
Park et al., 2016retro624365.0823.4230.5065.723.840.000.0058.0825.7915.240.9414.2922.8562.860.00
Shirakawa et al., 2020retro515168.0021.9521.6064.7013.70NRNRNRNRNRNR18.6046.1025.503.90
Suda et al., 2012prosp162065.3920.78NRNRNRNR2.7833.3311.1150.002.7811.1152.7836.110.00
Tagkalos et al., 2020prosp404062.5026.00NRNRNRNRNRNRNRNRNRNRNRNRNR
Tsunoda et al., 2021retro4545NRNR9.0089.002.000.000.0051.0019.0023.007.0014.5028.0057.500.00
Weksler et al., 2012retro112662.6427.66NRNRNRNR27.0232.3916.2324.350.00NRNRNRNR
Weksler et al., 2017retro56956941.90NRNRNRNRNR4.7022.7319.3317.532.40NRNRNRNR
Xu et al., 2020retro29229264.6323.0917.5076.056.500.000.0038.9020.9039.051.157.5073.3019.200.00
Yang et al., 2020retro27127163.4523.201.5089.509.050.000.0028.2033.7526.9511.0512.7062.7524.550.00
Yerokun et al., 2016retro17017062.95NRNRNRNRNR0.000.000.000.000.002.9551.1545.900.00
Zhang et al., 2019retro666662.1523.0042.4552.255.300.006.1027.2543.2023.450.000.0021.9528.050.00
BMI: Body Mass Index; RAMIE: Robot-Assisted Minimally Invasive Esophagectomy; MIE: Minimally Invasive Esophagectomy; RCT: Randomized Controlled Trial; NR: not reported.All studies reported on the surgical approach, adopting totally robotic or totally laparoscopic approach, except for the study by Yerokun et al. [55] and Harbison et al. [33], in which a hybrid approach was used and for the study by Weksler et al. [52], in which information on surgical procedures was insufficiently provided.
Table 2. Characteristics of the included studies comparing robotic and open approach.
Table 2. Characteristics of the included studies comparing robotic and open approach.
StudyStudy DesignN. of Enrolled PatientsMean AgeMean BMIASA Score (%)Tumor Stage (%)Tumor Localization (%)
RAMIEOPENIIIIIIIV0IIIIIIIV
Espinoza-Mercado et al., 2019retro40640664NRNRNRNRNR14.6525.7537.821.30NRNRNRNR
Gong et al., 2020retro9177NRNRNRNRNRNR2.97433.3339.8821.422.3826.1837.5031.540.91
Jeong et al., 2016retro88159NR22.66NRNRNRNR41.1983842.5313.122.780.35NRNRNRNR
Mehdorn et al., 2020prosp111163.827.4031.8568.15013.659.136.427.34.55NRNRNRNR
Meredith et al., 2020prosp14447564.46280.3849.6249.200.709.6634.7841.2412.2744.43NRNRNRNR
Osaka et al., 2018retro303062.5NRNRNRNRNR26.654518.310026.6548.3526.350
Pointer et al., 2020retro222222NRNRNRNRNRNRNRNRNRNRNRNRNRNRNR
Rolff et al., 2017retro5616064.6526.5127.035023.220.51NRNRNRNRNRNRNRNRNR
Sarkaria et al., 2019prosp6410661.8929.12014.1679.386.4822.4832.5224.838.24001.1863.5441.54
Weksler et al., 2017retro56956963NRNRNRNRNR20.432.1527.714.3535.55NRNRNRNR
Yun et al., 2020prosp13024162.9223.21NRNRNRNR20.7419.1620.513.78043.6231.805.924.54
BMI: Body Mass Index; RAMIE: Robot-Assisted Minimally Invasive Esophagectomy; RCT: Randomized Controlled Trial; NR: not reported.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Manigrasso, M.; Vertaldi, S.; Marello, A.; Antoniou, S.A.; Francis, N.K.; De Palma, G.D.; Milone, M. Robotic Esophagectomy. A Systematic Review with Meta-Analysis of Clinical Outcomes. J. Pers. Med. 2021, 11, 640. https://doi.org/10.3390/jpm11070640

AMA Style

Manigrasso M, Vertaldi S, Marello A, Antoniou SA, Francis NK, De Palma GD, Milone M. Robotic Esophagectomy. A Systematic Review with Meta-Analysis of Clinical Outcomes. Journal of Personalized Medicine. 2021; 11(7):640. https://doi.org/10.3390/jpm11070640

Chicago/Turabian Style

Manigrasso, Michele, Sara Vertaldi, Alessandra Marello, Stavros Athanasios Antoniou, Nader Kamal Francis, Giovanni Domenico De Palma, and Marco Milone. 2021. "Robotic Esophagectomy. A Systematic Review with Meta-Analysis of Clinical Outcomes" Journal of Personalized Medicine 11, no. 7: 640. https://doi.org/10.3390/jpm11070640

APA Style

Manigrasso, M., Vertaldi, S., Marello, A., Antoniou, S. A., Francis, N. K., De Palma, G. D., & Milone, M. (2021). Robotic Esophagectomy. A Systematic Review with Meta-Analysis of Clinical Outcomes. Journal of Personalized Medicine, 11(7), 640. https://doi.org/10.3390/jpm11070640

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop