Next Article in Journal
Reliability of Sonography Measures of the Lumbar Multifidus and Transversus Abdominis during Static and Dynamic Activities in Subjects with Non-Specific Chronic Low Back Pain
Previous Article in Journal
Comparison of Regularized Reconstruction and Ordered Subset Expectation Maximization Reconstruction in the Diagnostics of Prostate Cancer Using Digital Time-of-Flight 68Ga-PSMA-11 PET/CT Imaging
Previous Article in Special Issue
Fast and Automated Segmentation for the Three-Directional Multi-Slice Cine Myocardial Velocity Mapping
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Pretreatment MRI Radiomics Based Response Prediction Model in Locally Advanced Cervical Cancer

by
Benedetta Gui
1,
Rosa Autorino
1,
Maura Miccò
1,
Alessia Nardangeli
1,*,
Adele Pesce
2,
Jacopo Lenkowicz
1,
Davide Cusumano
1,
Luca Russo
2,
Salvatore Persiani
2,
Luca Boldrini
1,
Nicola Dinapoli
1,
Gabriella Macchia
3,
Giuseppina Sallustio
3,
Maria Antonietta Gambacorta
1,2,
Gabriella Ferrandina
1,2,
Riccardo Manfredi
1,2,
Vincenzo Valentini
1,2 and
Giovanni Scambia
1,2
1
Fondazione Policlinico Universitario “Agostino Gemelli” IRCCS, 00168 Roma, Italy
2
Istituto di Radiologia, Università Cattolica del Sacro Cuore, 00168 Roma, Italy
3
Gemelli Molise Hospital, Università Cattolica del Sacro Cuore, 86100 Campobasso, Italy
*
Author to whom correspondence should be addressed.
Diagnostics 2021, 11(4), 631; https://doi.org/10.3390/diagnostics11040631
Submission received: 26 February 2021 / Revised: 25 March 2021 / Accepted: 27 March 2021 / Published: 31 March 2021
(This article belongs to the Special Issue Advanced Techniques in Body Magnetic Resonance Imaging)

Abstract

:
The aim of this study was to create a radiomics model for Locally Advanced Cervical Cancer (LACC) patients to predict pathological complete response (pCR) after neoadjuvant chemoradiotherapy (NACRT) analysing T2-weighted 1.5 T magnetic resonance imaging (MRI) acquired before treatment start. Patients with LACC and an International Federation of Gynecology and Obstetrics stage from IB2 to IVA at diagnosis were retrospectively enrolled for this study. All patients underwent NACRT, followed by radical surgery; pCR―assessed on surgical specimen―was defined as absence of any residual tumour. Finally, 1889 features were extracted from MR images; features showing statistical significance in predicting pCR at the univariate analysis were selected following an iterative method, which was ad-hoc developed for this study. Based on this method, 15 different classifiers were trained considering the most significant features selected. Model selection was carried out using the area under the receiver operating characteristic curve (AUC) as target metrics. One hundred eighty-three patients from two institutions were analysed. The model, showing the highest performance with an AUC of 0.80, was the random forest method initialised with default parameters. Radiomics appeared to be a reliable tool in pCR prediction for LACC patients undergoing NACRT, supporting the identification of patient risk groups, which paves treatment pathways tailored according to the predicted outcome.

1. Introduction

Cervical cancer (CC) represents the fourth leading cause of cancer death in women, with 311,000 deaths in 2018 worldwide [1]. Treatment depends mainly on the stage of the tumour at diagnosis, as assessed by the International Federation of Gynecology and Obstetrics (FIGO) 2009 staging system [2].
Locally advanced stages are usually treated with external beam radiotherapy in association with platinum-based chemotherapy (CRT) followed by brachytherapy boost [3]. Although survival rates for women with Locally Advanced Cervical Cancer (LACC) are improving, one in three women develop local and pelvic recurrences, which supports the hypothesis of residual disease presence after definitive chemoradiation therapy [4].
Data suggest a role of neoadjuvant chemoradiotherapy (NACRT) followed by radical hysterectomy to remove potential radio- and chemo-resistant neoplastic foci, which improves local control in nonresponding patients [5,6,7]. Furthermore, pathological complete response (pCR) was associated with higher disease-free and long-term survival [8,9,10]. Therefore, a pCR pretreatment prediction may have a significant impact on LACC patient management by identifying tailored approaches for patient subgroups to achieve better clinical results.
In this context, the application of medical imaging technologies has significantly developed during the last decade from a primarily qualitative analysis to a quantitative approach disclosing an immense amount of information. The revised FIGO staging permits the use of imaging and pathological findings, where accessible, to determine the stage. Regarding imaging technique the revised FIGO staging allows any of the imaging modalities depending on the accessible sources, such as ultrasound, CT, magnetic resonance imaging (MRI), positron emission tomography (PET), to give information regarding tumour dimension, nodal status and local and systemic extension [11]. MRI is the best imaging technique for the assessment of cervical lesions greater than 1 cm and it is recommended for initial imaging evaluation when tumour dimension is greater than 2 cm, showing to be effective for LACC staging and prognosis evaluation [12]. Different MRI sequences (T2WI, DW-MRI, DCE-MRI) have been assessed as noninvasive biomarkers of treatment response with variable and promising results [13,14,15]. In particular, T2-sequences and diffusion-weighted imaging (DWI) have been studied in this setting. However, the role of DWI and apparent diffusion coefficient (ADC), to monitor early treatment response in patients affected by LACC undergoing CRT, is still controversial in literature [14,16]. Moreover, the future direction in term of prognostic noninvasive biomarkers should include the combination of different imaging technique such us US, CT, MRI and PET integrated with clinical and histologic data.
Radiomics is to date a rapidly expanding field of clinical research, which gives the possibility to quantify intratumoural heterogeneity in a high throughput and noninvasive way, and offers the chance to individuate risk groups for single patients to allow tailored treatment according to the predicted outcome [17,18,19]. Indeed, tumour heterogeneity showed significant correlations with radiomics in a variety of cancer patients, including cervical cancer [20,21,22].
Some preliminary studies reporting CC pretreatment experiences used MRI images to characterise cervical lesions [13,14], to predict local response and to assess biological tumour heterogeneity [23]. However, no studies have correlated pretreatment MRI radiomics and histopathology in LACC patients treated with NACRT followed by radical hysterectomy.
The aim of this study was to investigate the potential role of MRI radiomics, used for staging, to predict pCR following NACRT in LACC patients with different FIGO stages.

2. Materials and Methods

2.1. Patient Enrolment and Image Acquisition Protocol

Patients affected by LACC, with FIGO stage from IB2 to IVA, treated in two different institutions, were considered for this retrospective analysis.
The cohort of institution A consisted of patients treated between 2007 and 2014; the cohort of institution B included cases treated from 2005 to 2013. Inclusion criteria were histological confirmed invasive carcinoma of the cervix, FIGO stage from IB2 to IVA, and absence of distant metastasis (cM0). Patients younger than 18 years, without pretreatment MRI, treated with palliative intent or those who did not undergo surgery for histological confirmation of response, were excluded from the analysis. Table 1 summarises a complete description of the cohorts investigated in this study.
In both centres, a 1.5 T MR machine (GE Signa Exite, Little Chalfont, UK) was used for imaging.

2.2. Treatment Workflow and Response Assessment

All patients underwent NACRT. Radiotherapy volumes were delineated according to consensus guidelines [24]. Concurrent chemotherapy was administrated with cisplatin alone or cisplatin plus 5-fluorouracil [25,26]. Radiotherapy consisted of 50.6 Gy administration to the primary tumour (PTV1) and 45 Gy to nodal drainage (PTV2) or 45 Gy to PTV1 and PTV2, according to the clinical disease stage. Restaging was performed 4–6 weeks after NACRT completion with MRI and PET-CT. All patients underwent radical hysterectomy plus pelvic lymphadenectomy within 6–8 weeks from NACRT completion. Pathological response to treatment was evaluated on surgical specimens. Complete pathological response (pCR) was defined as absence of any residual tumour after treatment at any site; microscopic response (pR1) as persistent tumour foci of maximum dimension inferior to 3 mm; macroscopic response (pR2) as persistent tumour foci with maximum dimension exceeding 3 mm [27].

2.3. Image Analysis

MRI for staging was acquired according to local institutional diagnostic protocols without injecting contrast agents. Acquisition parameters adopted in the MR protocol are reported in Table 2.
The gross tumour volume (GTV) was contoured on the axial T2-weighted MR images. GTV was manually contoured in consensus by two radiologists, experts in gynaecological imaging, using a radiotherapy treatment planning system (TPS) (Eclipse, Varian Medical Systems, Palo Alto, CA, USA).
The segmented images were then processed using MODDICOM, an R library designed to perform radiomic analysis. Before starting the radiomic analysis, image resolution was homogenised and all MR images were resampled to a value of spatial planar resolution equal to 0.548 × 0.548 mm2 [28,29].

2.4. Feature Extraction

Once resampled, MR images were processed using the Laplacian of Gaussian (LoG) or the intensity based (IB) image filter. The LOG filter was applied varying the σ parameter, which is a measure of filter width, in the range 0–4.2 mm with steps of 0.35 mm (13 steps in total). Regarding the IB filter, a preliminary normalisation of the pixel intensities inside the region of interest (ROI) was performed, using the first and 99th percentile of ROI histogram grey levels as extremes. Pixel clusters were then identified considering two threshold levels (lower and upper level), defined as percentages of the maximum intensity level [30].
The IB filter was applied considering all the possible combinations of thresholds for levels ranging from 0% to 100% by 10% steps (for 55 combinations).
The feature extraction was then performed on the filtered images considering the GTV as ROI: in particular, first-order features were calculated on the images processed with the LOG filter, while fractal, textural and morphological features were calculated considering the MR images processed using the IB filter.
Considering the application of all the filters used, a total of 1889 radiomic features were extracted. The computer code used for image analysis can be found at https://bitbucket.org/kboadmin/lacc_radiomics/src/master/ (accessed date: 24 February 2020), while the comprehensive list of the features calculated is reported in the IBSI initiative [31].

2.5. Statistical Analysis

The two patient cohorts were merged in a unique training set: feature selection and model training were carried out following an iterative method, ad-hoc developed for this study.
This process consisted in a first step of feature selection and in a following step of classifier selection.
Concerning the feature selection step, an eight-fold cross validation was performed: the merged dataset was randomly divided in eight folders and eight different datasets were analysed, considering each time seven of the eight folders defined.
For each combination of the seven folders selected, Wilcoxon Mann–Whitney (WMW) test (or Student’s t-test depending on normality of the data distribution) was computed to investigate the ability of each radiomic feature in predicting the defined outcome at the univariate analysis.
Features, resulting at least five times on the eight folder combinations significant (p < 0.05), were selected for correlation analysis, which was computed calculating the Pearson correlation coefficient (PCC). The final set of significant features was composed by features showing a correlation value inferior to 0.6, to remove features with moderate mutual correlation [32].
Regarding the model selection, 15 different classifiers were trained considering significant features selected by previous analysis.
Table 3 reports the extended names and the caret method of each of the tested models.
Even in this case, the merged dataset was partitioned in eight folders and each classifier was trained on seven of the eight folders considered, using the remaining folder as validation set. For each classifier, eight receiver operating characteristic (ROC) curves were calculated, one for each unique combination of folders. The area under these ROC curves (AUC) was considered as metric to identify the best model. The model selection process was repeated three times, modifying the random selection of the cases in the eight folders. At the end of the three iterations, 24 ROC curves were analysed for each classifier, and the mean AUC value with the corresponding standard deviation was calculated. The model showing the highest mean AUC value on the three iterations of the cross-validation analysis was considered as the best classifier [33]. The best classifier was then trained on the whole dataset to obtain the final predictive model. The scheme of the entire workflow adopted for the features and model selection is reported in Figure 1.
The performance of the final predictive model was quantified in terms of sensitivity, specificity and accuracy at the optimal discriminative threshold, which was identified through the Youden Index calculation, as reported in similar experiences [34,35].
All analyses described were performed using the caret package of the R software (version 3.4.3, 2017; www.r-project.org (accessed on 25 February 2021)).

3. Results

In total, 183 patients were included in the analysis. Out of 156 patients of cohort A, 66 (42%) pCR, 45 (29%) pR1 and 45 (29%) pR2 were observed. In cohort B (n = 27), we observed 8 (30%) patients with pCR, 9 (33%) with pR1 and 10 (37%) with pR2. The feature selection process identified 19 radiomic features significant at the univariate analysis.
Starting from the identified significant features, a total of 15 predictive models were calculated: Table 4 reports the mean AUC values obtained on the 24 iterations performed during model selection for 15 classifiers considered, together with the standard deviation (SD) value, which was considered as measurement of the variation in predictive performance of the elaborated models.
The AUC of the ROC curves calculated on the 24 iterations performed for the 15 classifiers considered in the work are provided as Supplementary Materials.
The model showing the highest performance was the random forest (RF_DEF), which was initialised with the following default parameters: number of trees (ntree) equal to 500, and number of variables randomly sampled as candidates for each split (mtry) set equal to 4, which corresponds to the square root of variable numbers for classification. The final ROC curve model trained on the whole dataset is reported in Figure 2.
The RF_DEF model showed a mean AUC of 0.80 ± 0.8. The best cut off threshold was equal to 0.69 which corresponds to a Youden Index of 0.486.
At the best cut-off threshold, the present model reports a specificity of 98.4% and a sensitivity of 50.2%, with an overall accuracy of 74.5%.
The importance of the single variables included in the random forest model is reported in Figure 3.
The most important feature of the model is the cluster shade calculated on the grey level co-occurrence matrix, after the application of the LOG filter on the raw images with a σ value of 0.7.
The other two features showing an importance higher than 50% are the maximum fractal dimension calculated on the subpopulation from 20% to 60% of the maximum pixel value and the kurtosis calculated on the raw MR images.

4. Discussion

Although NACRT followed by surgery is not a care standard for LACC patients in many centres, this approach achieved encouraging results with high rates of pathologically assessed complete response and local control rates with acceptable toxicity [8,9].
In this context, a tool to identify specific subgroups of patients who can benefit from a given treatment is necessary to achieve a fully personalised clinical approach. Several studies aimed to predict and monitor treatment response and clinical outcome analysing functional imaging like MRI or 18-FDG PET-TC in CC patients [23,36,37,38]. Literature suggests that metabolic response in post-therapy PET-CT correlates with failure patterns [36] and can predict OS in patients treated with CRT [37]. Some studies focused on temporal changes in tumour heterogeneity patterns on functional imaging such as dynamic contrast enhanced MRI, DWI [23] and FDG PET-CT [38] performed before, during and after CRT course to correlate imaging with treatment response outcomes and to define prognostic factors. In particular, tumour volume and ADC value were the most important prognostic factors [12,13,14,22]. However, the role of functional imaging is still under investigation in literature.
Promising evidence supports the use of delta radiomics assessment in predicting outcomes (e.g., response to therapies) for treatment personalisation [23,39]. To the best of our knowledge, this study represents the first radiomics based pCR prediction model on pretreatment staging MRI in patients affected by locally advanced cervical cancer undergoing NACRT. The choice of pCR as outcome parameter represents the strength of this study; in fact, surgery following CRT allows verifying the pathological response to the treatment. The majority of studies on response prediction in CC is focused on early treatment response assessment during or soon after NACRT.
The proposed model allows to predict the probability of achieving pCR using pretreatment imaging to allow clinicians the possibility to better plan the entire treatment using routinely acquired imaging for disease staging.
Clinicians can also consider new protocols of dose escalation or dose-de-intensification based on single patient’s predicted outcomes, in order to ensure a response to treatment. This approach could significantly save resources in the management of this patient population optimising treatment workflows based on outcome prediction.
The technical robustness of the model selection procedures and the encouraging AUC values (0.80) of the random forest method proposed represent an innovative tool for clinical decision support and oncological treatment personalisation. However, one of the main weaknesses of this predictive model is the low degree of direct interpretability of the individual features extracted from the MR images; the proposed method acts as a black-box, limiting the clinical interpretability of the key parameters on which this model is based. The poor interpretability of the model elaborated represents one of the main limitations of the modern techniques of image analysis, such as machine learning and deep learning: several experiences have already highlighted these limitations and new research fields are currently aiming to explain the artificial cognitive processes of these techniques [40,41].
Another limitation is represented by the lack of an external validation dataset, which is partially overcome by means of cross-validation: further studies aiming to externally validate this model are recommended in the future.
The present study was performed considering only T2-w MR images, as it was the only imaging modality available for all patients included in the study. Other MR imaging modalities, such as DWI or dynamic contrast enhanced sequences, were object of radiomic analysis in some experiences [20,23,42,43], and not considered in other studies based only on T2-w MR image analysis [42,43,44].
Future developments of this innovative approach can therefore take into account external validation cohorts with images acquired on scanners provided by different vendors, as already performed for other tumour sites like rectal cancer [45]. Moreover, the inclusion of DWI ADC-maps segmentation should be evaluated in future studies in order to find other radiomic features useful for pCR prediction [46,47].
These innovative imaging approaches could play a fundamental role in hybrid magnetic resonance guided radiotherapy (MRgRT) treatments, optimising radiotherapy planning of radiomics’ analysis output through the quantification of feature changes throughout treatment. Taken this into consideration, new dose delivery and targeting paradigms could be proposed and better treatment outcomes may be achieved, as already demonstrated in rectal and cervical cancer [48,49].
In conclusion, this radiomics based prediction pCR model can be useful to guide clinicians in their decision-making process, tailoring treatment according to response prediction in the frame of fully personalised clinical management of cervical cancer care.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/diagnostics11040631/s1, Table S1: AUC of the ROC curves calculated on the 24 iterations performed for the 15 classifiers considered in the work.

Author Contributions

Conceptualisation, B.G., R.A., M.M., A.P. and L.B.; methodology, J.L., D.C., L.B. and N.D.; validation, D.C. and L.B.; formal analysis, J.L.; resources, B.G., R.A., M.M., G.M. and G.S. (Giuseppina Sallustio); data curation, A.P., L.R. and S.P.; writing—original draft preparation, A.P. and L.B.; writing—review and editing, B.G., R.A., A.N., G.M., M.A.G., G.F., R.M., V.V. and G.S. (Giovanni Scambia); supervision, M.A.G., G.F., R.M., V.V. and G.S. (Giovanni Scambia). All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval were waived for this study, being a retrospective and fully anonimised study.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors upon request, without undue reservation.

Acknowledgments

We would like to thank Franziska M. Lohmeyer, Fondazione Policlinico Universitario A. Gemelli IRCCS, for her support revising our manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

LACCLocally Advanced Cervical Cancer;
pCRpathological complete response;
NACRTneoadjuvant chemoradiotherapy;
MRImagnetic resonance imaging;
AUCarea under the curve;
CCcervical cancer;
FIGOInternational Federation of Gynecology and Obstetrics;
CRTchemoradiotherapy;
DWIdiffusion-weighted imaging;
ADCapparent diffusion coefficient;
PTVplanned target volume;
GTVgross tumour volume;
TPStreatment planning systems;
LoGLaplacian of Gaussian;
IBintensity based;
ROIregion of interest;
WMWWilcoxon Mann–Whitney;
PCCPearson correlation coefficient;
ROCreceiver operating characteristic;
SDstandard deviation;
RF_DEFrandom forest model;
Ntreenumber of trees;
Mtrynumber of variables randomly sampled as candidates for each split;
OSoverall survival;
MRgRTmagnetic resonance guided radiotherapy.

References

  1. Bray, F.; Ferlay, J.; Soerjomataram, I.; Siegel, R.L.; Torre, L.A.; Jemal, A. Global Cancer Statistics 2018: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J. Clin. 2018, 68, 394–424. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Pecorelli, S. Revised FIGO Staging for Carcinoma of the Vulva, Cervix, and Endometrium. Int. J. Gynecol. Obstet. 2009, 105, 103–104. [Google Scholar] [CrossRef] [PubMed]
  3. Koh, W.-J.; Abu-Rustum, N.R.; Bean, S.; Bradley, K.; Campos, S.M.; Cho, K.R.; Chon, H.S.; Chu, C.; Clark, R.; Cohn, D.; et al. Cervical Cancer, Version 3.2019, NCCN Clinical Practice Guidelines in Oncology. J. Natl. Compr. Canc. Netw. 2019, 17, 64–84. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Quinn, M.A.; Benedet, J.L.; Odicino, F.; Maisonneuve, P.; Beller, U.; Creasman, W.T.; Heintz, A.P.M.; Ngan, H.Y.S.; Pecorelli, S. Carcinoma of the Cervix Uteri. FIGO 26th Annual Report on the Results of Treatment in Gynecological Cancer. Int. J. Gynaecol. Obstet 2006, 95 (Suppl. 1), S43–S103. [Google Scholar] [CrossRef]
  5. Mariagrazia, D.; Anna, F.; Gabriella, F.; Francesco, F.; Daniela, S.; Giuseppe, D.; Alessio, M.; Giovanni, S. Preoperative Chemoradiotherapy in Locally Advanced Cervical Cancer: Long-Term Outcome and Complications. Gynecol. Oncol. 2005, 99, S166–S170. [Google Scholar] [CrossRef] [PubMed]
  6. Resbeut, M.; Cowen, D.; Viens, P.; Noirclerc, M.; Perez, T.; Gouvernet, J.; Delpero, J.R.; Gamerre, M.; Boubli, L.; Houvenaeghel, G. Concomitant Chemoradiation Prior to Surgery in the Treatment of Advanced Cervical Carcinoma. Gynecol. Oncol. 1994, 54, 68–75. [Google Scholar] [CrossRef]
  7. Ferrandina, G.; Legge, F.; Fagotti, A.; Fanfani, F.; Distefano, M.; Morganti, A.; Cellini, N.; Scambia, G. Preoperative Concomitant Chemoradiotherapy in Locally Advanced Cervical Cancer: Safety, Outcome, and Prognostic Measures. Gynecol. Oncol. 2007, 107, S127–S132. [Google Scholar] [CrossRef]
  8. Ferrandina, G.; Gambacorta, A.; Gallotta, V.; Smaniotto, D.; Fagotti, A.; Tagliaferri, L.; Foti, E.; Fanfani, F.; Autorino, R.; Scambia, G.; et al. Chemoradiation with Concomitant Boosts Followed by Radical Surgery in Locally Advanced Cervical Cancer: Long-Term Results of the ROMA-2 Prospective Phase 2 Study. Int. J. Radiat. Oncol. Biol. Phys. 2014, 90, 778–785. [Google Scholar] [CrossRef]
  9. Ferrandina, G.; Margariti, P.A.; Smaniotto, D.; Petrillo, M.; Salerno, M.G.; Fagotti, A.; Macchia, G.; Morganti, A.G.; Cellini, N.; Scambia, G. Long-Term Analysis of Clinical Outcome and Complications in Locally Advanced Cervical Cancer Patients Administered Concomitant Chemoradiation Followed by Radical Surgery. Gynecol. Oncol. 2010, 119, 404–410. [Google Scholar] [CrossRef]
  10. Colombo, P.E.; Bertrand, M.M.; Gutowski, M.; Mourregot, A.; Fabbro, M.; Saint-Aubert, B.; Quenet, F.; Gourgou, S.; Kerr, C.; Rouanet, P. Total Laparoscopic Radical Hysterectomy for Locally Advanced Cervical Carcinoma (Stages IIB, IIA and Bulky Stages IB) after Concurrent Chemoradiation Therapy: Surgical Morbidity and Oncological Results. Gynecol. Oncol. 2009, 114, 404–409. [Google Scholar] [CrossRef]
  11. Bhatla, N.; Aoki, D.; Sharma, D.N.; Sankaranarayanan, R. Cancer of the Cervix Uteri. Int. J. Gynecol. Obstet. 2018, 143, 22–36. [Google Scholar] [CrossRef]
  12. Sala, E.; Rockall, A.G.; Freeman, S.J.; Mitchell, D.G.; Reinhold, C. The Added Role of MR Imaging in Treatment Stratification of Patients with Gynecologic Malignancies: What the Radiologist Needs to Know. Radiology 2013, 266, 717–740. [Google Scholar] [CrossRef] [PubMed]
  13. Gui, B.; Miccò, M.; Valentini, A.L.; Cambi, F.; Pasciuto, T.; Testa, A.; Autorino, R.; Zannoni, G.F.; Rufini, V.; Gambacorta, M.A.; et al. Prospective Multimodal Imaging Assessment of Locally Advanced Cervical Cancer Patients Administered by Chemoradiation Followed by Radical Surgery-the “PRICE” Study 2: Role of Conventional and DW-MRI. Eur. Radiol. 2019, 29, 2045–2057. [Google Scholar] [CrossRef] [PubMed]
  14. Valentini, A.L.; Miccò, M.; Gui, B.; Giuliani, M.; Rodolfino, E.; Telesca, A.M.; Pasciuto, T.; Testa, A.; Gambacorta, M.A.; Zannoni, G.; et al. The PRICE Study: The Role of Conventional and Diffusion-Weighted Magnetic Resonance Imaging in Assessment of Locally Advanced Cervical Cancer Patients Administered by Chemoradiation Followed by Radical Surgery. Eur. Radiol. 2018, 28, 2425–2435. [Google Scholar] [CrossRef] [PubMed]
  15. Jalaguier-Coudray, A.; Villard-Mahjoub, R.; Delouche, A.; Delarbre, B.; Lambaudie, E.; Houvenaeghel, G.; Minsat, M.; Tallet, A.; Sabatier, R.; Thomassin-Naggara, I. Value of Dynamic Contrast-Enhanced and Diffusion-Weighted MR Imaging in the Detection of Pathologic Complete Response in Cervical Cancer after Neoadjuvant Therapy: A Retrospective Observational Study. Radiology 2017, 284, 432–442. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Schreuder, S.M.; Lensing, R.; Stoker, J.; Bipat, S. Monitoring Treatment Response in Patients Undergoing Chemoradiotherapy for Locally Advanced Uterine Cervical Cancer by Additional Diffusion-Weighted Imaging: A Systematic Review. J. Magn. Reson. Imaging 2015, 42, 572–594. [Google Scholar] [CrossRef] [PubMed]
  17. Gatenby, R.A.; Grove, O.; Gillies, R.J. Quantitative Imaging in Cancer Evolution and Ecology. Radiology 2013, 269, 8–15. [Google Scholar] [CrossRef] [Green Version]
  18. Kim, J.Y.; Gatenby, R.A. Quantitative Clinical Imaging Methods for Monitoring Intratumoral Evolution. Methods Mol. Biol. 2017, 1513, 61–81. [Google Scholar] [CrossRef]
  19. Lambin, P.; Rios-Velazquez, E.; Leijenaar, R.; Carvalho, S.; van Stiphout, R.G.P.M.; Granton, P.; Zegers, C.M.L.; Gillies, R.; Boellard, R.; Dekker, A.; et al. Radiomics: Extracting More Information from Medical Images Using Advanced Feature Analysis. Eur. J. Cancer 2012, 48, 441–446. [Google Scholar] [CrossRef] [Green Version]
  20. Lucia, F.; Visvikis, D.; Desseroit, M.-C.; Miranda, O.; Malhaire, J.-P.; Robin, P.; Pradier, O.; Hatt, M.; Schick, U. Prediction of Outcome Using Pretreatment 18F-FDG PET/CT and MRI Radiomics in Locally Advanced Cervical Cancer Treated with Chemoradiotherapy. Eur. J. Nucl. Med. Mol. Imaging 2018, 45, 768–786. [Google Scholar] [CrossRef] [Green Version]
  21. Torheim, T.; Groendahl, A.R.; Andersen, E.K.F.; Lyng, H.; Malinen, E.; Kvaal, K.; Futsaether, C.M. Cluster Analysis of Dynamic Contrast Enhanced MRI Reveals Tumor Subregions Related to Locoregional Relapse for Cervical Cancer Patients. Acta Oncol. 2016, 55, 1294–1298. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Guan, Y.; Li, W.; Jiang, Z.; Chen, Y.; Liu, S.; He, J.; Zhou, Z.; Ge, Y. Whole-Lesion Apparent Diffusion Coefficient-Based Entropy-Related Parameters for Characterizing Cervical Cancers: Initial Findings. Acad Radiol. 2016, 23, 1559–1567. [Google Scholar] [CrossRef] [PubMed]
  23. Bowen, S.R.; Yuh, W.T.; Hippe, D.S.; Wu, W.; Partridge, S.C.; Elias, S.; Jia, G.; Huang, Z.; Sandison, G.A.; Nelson, D. Tumor Radiomic Heterogeneity: Multiparametric Functional Imaging to Characterize Variability and Predict Response Following Cervical Cancer Radiation Therapy. J. Magn. Reson. Imaging 2018, 47, 1388–1396. [Google Scholar] [CrossRef]
  24. Lim, K.; Small, W.; Portelance, L.; Creutzberg, C.; Jürgenliemk-Schulz, I.M.; Mundt, A.; Mell, L.K.; Mayr, N.; Viswanathan, A.; Jhingran, A.; et al. Consensus Guidelines for Delineation of Clinical Target Volume for Intensity-Modulated Pelvic Radiotherapy for the Definitive Treatment of Cervix Cancer. Int. J. Radiat. Oncol. Biol. Phys. 2011, 79, 348–355. [Google Scholar] [CrossRef] [PubMed]
  25. Macchia, G.; Morganti, A.G.; Deodato, F.; Cilla, S.; Lucidi, A.; Massaccesi, M.; Scambia, G.; Valentini, V.; Cellini, N.; Ferrandina, G. Concomitant Boost plus Large-Field Preoperative Chemoradiation in Locally Advanced Uterine Cervix Carcinoma: Phase II Clinical Trial Final Results (LARA-CC-1). Gynecol. Oncol. 2012, 125, 594–599. [Google Scholar] [CrossRef] [PubMed]
  26. Macchia, G.; Cilla, S.; Deodato, F.; Legge, F.; Di Stefano, A.; Chiantera, V.; Scambia, G.; Valentini, V.; Morganti, A.G.; Ferrandina, G. Intensity-Modulated Extended-Field Chemoradiation plus Simultaneous Integrated Boost in the Pre-Operative Treatment of Locally Advanced Cervical Cancer: A Dose-Escalation Study. Br. J. Radiol. 2015, 88, 20150385. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Zannoni, G.F.; Vellone, V.G.; Carbone, A. Morphological Effects of Radiochemotherapy on Cervical Carcinoma: A Morphological Study of 50 Cases of Hysterectomy Specimens after Neoadjuvant Treatment. Int. J. Gynecol. Pathol. 2008, 27, 274–281. [Google Scholar] [CrossRef] [PubMed]
  28. Gatta, R.; Vallati, M.; Dinapoli, N.; Masciocchi, C.; Lenkowicz, J.; Cusumano, D.; Casá, C.; Farchione, A.; Damiani, A.; van Soest, J.; et al. Towards a Modular Decision Support System for Radiomics: A Case Study on Rectal Cancer. Artif. Intell. Med. 2019, 96, 145–153. [Google Scholar] [CrossRef] [Green Version]
  29. Dinapoli, N.; Alitto, A.R.; Vallati, M.; Gatta, R.; Autorino, R.; Boldrini, L.; Damiani, A.; Valentini, V. Moddicom: A Complete and Easily Accessible Library for Prognostic Evaluations Relying on Image Features. Conf Proc. IEEE Eng. Med. Biol. Soc. 2015, 2015, 771–774. [Google Scholar] [CrossRef] [Green Version]
  30. Cusumano, D.; Dinapoli, N.; Boldrini, L.; Chiloiro, G.; Gatta, R.; Masciocchi, C.; Lenkowicz, J.; Casà, C.; Damiani, A.; Azario, L.; et al. Fractal-Based Radiomic Approach to Predict Complete Pathological Response after Chemo-Radiotherapy in Rectal Cancer. Radiol. Med. 2018, 123, 286–295. [Google Scholar] [CrossRef]
  31. Zwanenburg, A.; Vallières, M.; Abdalah, M.A.; Aerts, H.J.W.L.; Andrearczyk, V.; Apte, A.; Ashrafinia, S.; Bakas, S.; Beukinga, R.J.; Boellaard, R.; et al. The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-Based Phenotyping. Radiology 2020, 295, 328–338. [Google Scholar] [CrossRef] [Green Version]
  32. Chan, Y.H. Biostatistics 104: Correlational Analysis. Singapore Med. J. 2003, 44, 614–619. [Google Scholar] [PubMed]
  33. International Commission on Radiation Units and Measurements (ICRU). Available online: https://icru.org/home/reports/receiver-operating-characteristic-roc-analysis-in-medical-imaging-icru-report-79 (accessed on 9 June 2019).
  34. Cusumano, D.; Boldrini, L.; Yadav, P.; Yu, G.; Musurunu, B.; Chiloiro, G.; Piras, A.; Lenkowicz, J.; Placidi, L.; Broggi, S.; et al. External Validation of Early Regression Index (ERITCP) as Predictor of Pathologic Complete Response in Rectal Cancer Using Magnetic Resonance-Guided Radiation Therapy. Int. J. Radiat. Oncol. Biol. Phys. 2020, 108, 1347–1356. [Google Scholar] [CrossRef] [PubMed]
  35. Ruopp, M.D.; Perkins, N.J.; Whitcomb, B.W.; Schisterman, E.F. Youden Index and Optimal Cut-Point Estimated from Observations Affected by a Lower Limit of Detection. Biom. J. 2008, 50, 419–430. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Schwarz, J.K.; Siegel, B.A.; Dehdashti, F.; Grigsby, P.W. Metabolic Response on Post-Therapy FDG-PET Predicts Patterns of Failure after Radiotherapy for Cervical Cancer. Int. J. Radiat. Oncol. Biol. Phys. 2012, 83, 185–190. [Google Scholar] [CrossRef] [PubMed]
  37. Lima, G.M.; Matti, A.; Vara, G.; Dondi, G.; Naselli, N.; De Crescenzo, E.M.; Morganti, A.G.; Perrone, A.M.; De Iaco, P.; Nanni, C.; et al. Prognostic Value of Posttreatment 18F-FDG PET/CT and Predictors of Metabolic Response to Therapy in Patients with Locally Advanced Cervical Cancer Treated with Concomitant Chemoradiation Therapy: An Analysis of Intensity- and Volume-Based PET Parameters. Eur. J. Nucl. Med. Mol. Imaging 2018, 45, 2139–2146. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Yang, F.; Thomas, M.A.; Dehdashti, F.; Grigsby, P.W. Temporal Analysis of Intratumoral Metabolic Heterogeneity Characterized by Textural Features in Cervical Cancer. Eur. J. Nucl. Med. Mol. Imaging 2013, 40, 716–727. [Google Scholar] [CrossRef] [Green Version]
  39. Cusumano, D.; Catucci, F.; Romano, A.; Boldrini, L.; Piras, A.; Broggi, S.; Votta, C.; Placidi, L.; Nardini, M.; Chiloiro, G.; et al. Evaluation of an Early Regression Index (ERITCP) as Predictor of Pathological Complete Response in Cervical Cancer: A Pilot-Study. Appl. Sci. 2020, 10, 8001. [Google Scholar] [CrossRef]
  40. Ching, T.; Himmelstein, D.S.; Beaulieu-Jones, B.K.; Kalinin, A.A.; Do, B.T.; Way, G.P.; Ferrero, E.; Agapow, P.-M.; Zietz, M.; Hoffman, M.M.; et al. Opportunities and Obstacles for Deep Learning in Biology and Medicine. J. R. Soc. Interface 2018, 15. [Google Scholar] [CrossRef] [Green Version]
  41. Giger, M.L. Machine Learning in Medical Imaging. J. Am. Coll Radiol 2018, 15, 512–520. [Google Scholar] [CrossRef]
  42. Sun, C.; Tian, X.; Liu, Z.; Li, W.; Li, P.; Chen, J.; Zhang, W.; Fang, Z.; Du, P.; Duan, H.; et al. Radiomic Analysis for Pretreatment Prediction of Response to Neoadjuvant Chemotherapy in Locally Advanced Cervical Cancer: A Multicentre Study. EBioMedicine 2019, 46, 160–169. [Google Scholar] [CrossRef] [Green Version]
  43. Kan, Y.; Dong, D.; Zhang, Y.; Jiang, W.; Zhao, N.; Han, L.; Fang, M.; Zang, Y.; Hu, C.; Tian, J.; et al. Radiomic Signature as a Predictive Factor for Lymph Node Metastasis in Early-Stage Cervical Cancer. J. Magn Reson Imaging 2019, 49, 304–310. [Google Scholar] [CrossRef] [Green Version]
  44. Li, Z.; Li, H.; Wang, S.; Dong, D.; Yin, F.; Chen, A.; Wang, S.; Zhao, G.; Fang, M.; Tian, J.; et al. MR-Based Radiomics Nomogram of Cervical Cancer in Prediction of the Lymph-Vascular Space Invasion Preoperatively. J. Magn Reson Imaging 2019, 49, 1420–1426. [Google Scholar] [CrossRef] [PubMed]
  45. Dinapoli, N.; Barbaro, B.; Gatta, R.; Chiloiro, G.; Casà, C.; Masciocchi, C.; Damiani, A.; Boldrini, L.; Gambacorta, M.A.; Dezio, M.; et al. Magnetic Resonance, Vendor-Independent, Intensity Histogram Analysis Predicting Pathologic Complete Response After Radiochemotherapy of Rectal Cancer. Int. J. Radiat. Oncol. Biol. Phys. 2018, 102, 765–774. [Google Scholar] [CrossRef] [PubMed]
  46. Thomeer, M.G.; Vandecaveye, V.; Braun, L.; Mayer, F.; Franckena-Schouten, M.; de Boer, P.; Stoker, J.; Van Limbergen, E.; Buist, M.; Vergote, I.; et al. Evaluation of T2-W MR Imaging and Diffusion-Weighted Imaging for the Early Post-Treatment Local Response Assessment of Patients Treated Conservatively for Cervical Cancer: A Multicentre Study. Eur Radiol 2019, 29, 309–318. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Makino, H.; Kato, H.; Furui, T.; Morishige, K.; Kanematsu, M. Predictive Value of Diffusion-Weighted Magnetic Resonance Imaging during Chemoradiotherapy for Uterine Cervical Cancer. J. Obstet. Gynaecol. Res. 2014, 40, 1098–1104. [Google Scholar] [CrossRef] [PubMed]
  48. Boldrini, L.; Piras, A.; Chiloiro, G.; Autorino, R.; Cellini, F.; Cusumano, D.; Fionda, B.; D’Aviero, A.; Campitelli, M.; Marazzi, F.; et al. Low Tesla Magnetic Resonance Guided Radiotherapy for Locally Advanced Cervical Cancer: First Clinical Experience. Tumori 2020, 106, 497–505. [Google Scholar] [CrossRef] [PubMed]
  49. Boldrini, L.; Cusumano, D.; Chiloiro, G.; Casà, C.; Masciocchi, C.; Lenkowicz, J.; Cellini, F.; Dinapoli, N.; Azario, L.; Teodoli, S.; et al. Delta Radiomics for Rectal Cancer Response Prediction with Hybrid 0.35 T Magnetic Resonance-Guided Radiotherapy (MRgRT): A Hypothesis-Generating Study for an Innovative Personalized Medicine Approach. Radiol Med. 2019, 124, 145–153. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Scheme of the workflow used for features and model selection.
Figure 1. Scheme of the workflow used for features and model selection.
Diagnostics 11 00631 g001
Figure 2. Receiver operating characteristic (ROC) curve obtained considering the random forest model initialised with default parameters.
Figure 2. Receiver operating characteristic (ROC) curve obtained considering the random forest model initialised with default parameters.
Diagnostics 11 00631 g002
Figure 3. Importance of the parameters included in the model.
Figure 3. Importance of the parameters included in the model.
Diagnostics 11 00631 g003
Table 1. Patient characteristics.
Table 1. Patient characteristics.
Institution A
(156 pts)
Institution B
(27 pts)
Age (Mean)22–76 (50.2)28–79 (54.2)
Histology
Squamous cell carcinoma142 (91%)23 (85.2%)
Glassy cell squamous carcinoma01 (3.7%)
Clear cell adeno-squamous carcinoma1 (0.7%)0
Adenocarcinoma12 (7.6%)2 (7.4%)
Adeno-squamous1 (0.7%)1 (3.7%)
FIGO Stage
IB26 (3.8%)2 (7.4%)
IIA9 (5.8%)2 (7.4%)
IIB119 (76.3%)21 (77.8%)
IIIA6 (3.8%)2 (7.4%)
IIIB13 (8.4%)0
IVA3 (1.9%)0
Nodal status
N075 (48.1%)17 (63%)
N181 (51.9%)10 (37%)
Pathological Response
pR066 (42.4%)8 (29.7%)
pR145 (28.8%)9 (33.3%)
pR245 (28.8%)10 (37%)
pR0: absence of any residual tumour after treatment at any site; pR1: microscopic response as persistent tumour foci of maximum dimension inferior to 3 mm; pR2: macroscopic response as persistent tumour foci with maximum dimension exceeding 3 mm.
Table 2. Magnetic resonance imaging (MRI) acquisition parameters used in the MR clinical protocol adopted for axial (AX), sagittal (SAG) and coronal (COR) acquisitions.
Table 2. Magnetic resonance imaging (MRI) acquisition parameters used in the MR clinical protocol adopted for axial (AX), sagittal (SAG) and coronal (COR) acquisitions.
AX T1-WAX T2-WSAG T2-WAX OBLIQUE T2-W (Perpendicular to the Long Axis of the Cervix)COR OBLIQUE T2-W (Parallel to the Long Axis of the Cervix)AX ABDOMINAL T2-WAX OBLIQUE DWI (= Ax Oblique T2-w)
SequenceFSEFRFSEFRFSEFRFSEFRFSEFRFSE- XLEPI
Echo time (ms)168585858584Minimum
NEX2224416
Repetition time (ms), TR470450045004500450018505425
No. of sections30302616164830
Receiver bandwidth (kHz)31.2531.2541.6741.6741.6741.67
Echo train length32615262617
Field of view (mm), FOV24242422244628
Section thickness (mm)4443454
Section spacing (mm)0.50.50.40.50.510.5
Matrix size448 × 288384 × 256384 × 256384 × 256384 × 256256 × 256128 × 128
b Value (s/mm2)------------------800
Phase directionA/PA/PS/IUNSWAPUNSWAPR/LR/L
Table 3. Models’ legend, extended name and method used to calculate the classifier using the caret package of the R statistical software.
Table 3. Models’ legend, extended name and method used to calculate the classifier using the caret package of the R statistical software.
ModelExtended NameCaret Method
C5TREEDecision treeC5.0Tree
DTDecision treeC5.0
HDDAHigh dimensional discriminant analysishda
KNNK-nearest neighbourskknn
LOGREGLogistic regressionglm
NBNaive Bayesnb
NNNeural networknn
PAMNearest shrunken centroidspam
PDAPenalised discriminant analysispda
PLSPartial least squarepls
RF_DEFRandom forestrf. Default parameters
RF_GRIDRandom forestrf. Grid search
RF_RANDRandom forestrf. Random search
SDAShrinkage discriminant analysissda
SVMSupport vector machinesvmPoly. Polynomial Kernel
Table 4. Mean and standard deviation (SD) values obtained in terms of area under the receiver operating characteristic curve (AUC) on the 24 iterations performed for model selection.
Table 4. Mean and standard deviation (SD) values obtained in terms of area under the receiver operating characteristic curve (AUC) on the 24 iterations performed for model selection.
ModelMean AUCSD (AUC)
RF_DEF0.800.08
RF_GRID0.790.11
RF_RAND0.790.07
NN0.730.11
SVM0.690.11
PLS0.680.10
PDA0.680.11
DT0.670.13
NB0.670.09
SDA0670.10
KNN0.660.09
LOGREG0.660.12
PAM0.640.12
HDDA0.630.09
C5TREE0.630.11
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Gui, B.; Autorino, R.; Miccò, M.; Nardangeli, A.; Pesce, A.; Lenkowicz, J.; Cusumano, D.; Russo, L.; Persiani, S.; Boldrini, L.; et al. Pretreatment MRI Radiomics Based Response Prediction Model in Locally Advanced Cervical Cancer. Diagnostics 2021, 11, 631. https://doi.org/10.3390/diagnostics11040631

AMA Style

Gui B, Autorino R, Miccò M, Nardangeli A, Pesce A, Lenkowicz J, Cusumano D, Russo L, Persiani S, Boldrini L, et al. Pretreatment MRI Radiomics Based Response Prediction Model in Locally Advanced Cervical Cancer. Diagnostics. 2021; 11(4):631. https://doi.org/10.3390/diagnostics11040631

Chicago/Turabian Style

Gui, Benedetta, Rosa Autorino, Maura Miccò, Alessia Nardangeli, Adele Pesce, Jacopo Lenkowicz, Davide Cusumano, Luca Russo, Salvatore Persiani, Luca Boldrini, and et al. 2021. "Pretreatment MRI Radiomics Based Response Prediction Model in Locally Advanced Cervical Cancer" Diagnostics 11, no. 4: 631. https://doi.org/10.3390/diagnostics11040631

APA Style

Gui, B., Autorino, R., Miccò, M., Nardangeli, A., Pesce, A., Lenkowicz, J., Cusumano, D., Russo, L., Persiani, S., Boldrini, L., Dinapoli, N., Macchia, G., Sallustio, G., Gambacorta, M. A., Ferrandina, G., Manfredi, R., Valentini, V., & Scambia, G. (2021). Pretreatment MRI Radiomics Based Response Prediction Model in Locally Advanced Cervical Cancer. Diagnostics, 11(4), 631. https://doi.org/10.3390/diagnostics11040631

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop