Next Article in Journal
Timeline of Adverse Events during Immune Checkpoint Inhibitors for Advanced Melanoma and Their Impacts on Survival
Next Article in Special Issue
Deep Sequencing of Early T Stage Colorectal Cancers Reveals Disruption of Homologous Recombination Repair in Microsatellite Stable Tumours with High Mutational Burdens
Previous Article in Journal
The BRCA Gene in Epithelial Ovarian Cancer
Previous Article in Special Issue
Role of Furin in Colon Cancer Stem Cells Malignant Phenotype and Expression of LGR5 and NANOG in KRAS and BRAF-Mutated Colon Tumors
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

EOB-MR Based Radiomics Analysis to Assess Clinical Outcomes following Liver Resection in Colorectal Liver Metastases

1
Division of Radiology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Napoli, Italy
2
Medical Oncology Division, Igea SpA, 41012 Carpi, Italy
3
Diagnostic Imaging Section, Department of Medical and Surgical Sciences & Neurosciences, University of Molise, 86100 Campobasso, Italy
4
Department of Medicine, Surgery and Dentistry, University of Salerno, 84084 Fisciano, Italy
5
Division of Radiology, Università degli Studi della Campania Luigi Vanvitelli, 81100 Caserta, Italy
6
Division of Abdominal Oncology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Napoli, Italy
7
Division of Radiology, Azienda Ospedaliera Universitaria Careggi, 50134 Firenze, Italy
8
Italian Society of Medical and Interventional Radiology (SIRM), SIRM Foundation, 20122 Milan, Italy
9
Division of Pathology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Napoli, Italy
10
Division of Epatobiliary Surgical Oncology, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Napoli, Italy
*
Author to whom correspondence should be addressed.
Cancers 2022, 14(5), 1239; https://doi.org/10.3390/cancers14051239
Submission received: 18 January 2022 / Revised: 24 February 2022 / Accepted: 25 February 2022 / Published: 27 February 2022
(This article belongs to the Special Issue Colorectal Cancer Metastasis)

Abstract

:

Simple Summary

The aim of this study was to assess the efficacy of radiomics features obtained by EOB-MRI phase in order to predict clinical outcomes following liver resection in Colorectal Liver Metastases Patients, and evaluate recurrence, mutational status, pathological characteristic (mucinous) and surgical resection margin. Ours results confirmed the capacity of radiomics to identify, as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach. These results were confirmed by external validation dataset. We obtained a good performance considering the single textural significant metric in the identification of front of tumor growth (expansive versus infiltrative) and tumor budding (high grade versus low grade or absent), in the recognition of mucinous type and in the detection of recurrences.

Abstract

The aim of this study was to assess the efficacy of radiomics features obtained by EOB-MRI phase in order to predict clinical outcomes following liver resection in Colorectal Liver Metastases Patients, and evaluate recurrence, mutational status, pathological characteristic (mucinous) and surgical resection margin. This retrospective analysis was approved by the local Ethical Committee board of National Cancer of Naples, IRCCS “Fondazione Pascale”. Radiological databases were interrogated from January 2018 to May 2021 in order to select patients with liver metastases with pathological proof and EOB-MRI study in pre-surgical setting. The cohort of patients included a training set (51 patients with 61 years of median age and 121 liver metastases) and an external validation set (30 patients with single lesion with 60 years of median age). For each segmented volume of interest by 2 expert radiologists, 851 radiomics features were extracted as median values using PyRadiomics. non-parametric test, intraclass correlation, receiver operating characteristic (ROC) analysis, linear regression modelling and pattern recognition methods (support vector machine (SVM), k-nearest neighbors (KNN), artificial neural network (NNET), and decision tree (DT)) were considered. The best predictor to discriminate expansive versus infiltrative front of tumor growth was HLH_glcm_MaximumProbability extraxted on VIBE_FA30 with an accuracy of 84%, a sensitivity of 83%, and a specificity of 82%. The best predictor to discriminate tumor budding was Inverse Variance obtained by the original GLCM matrix extraxted on VIBE_FA30 with an accuracy of 89%, a sensitivity of 96% and a specificity of 65%. The best predictor to differentiate the mucinous type of tumor was the HHL_glszm_ZoneVariance extraxted on VIBE_FA30 with an accuracy of 85%, a sensitivity of 46% and a specificity of 95%. The best predictor to identify tumor recurrence was the LHL_glcm_Correlation extraxted on VIBE_FA30 with an accuracy of 86%, a sensitivity of 52% and a specificity of 97%. The best linear regression model was obtained in the identification of the tumor growth front considering the height textural significant metrics by VIBE_FA10 (an accuracy of 89%; sensitivity of 93% and a specificity of 82%). Considering significant texture metrics tested with pattern recognition approaches, the best performance for each outcome was reached by a KNN in the identification of recurrence with the 3 textural significant features extracted by VIBE_FA10 (AUC of 91%, an accuracy of 93%; sensitivity of 99% and a specificity of 77%). Ours results confirmed the capacity of radiomics to identify as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach.

1. Introduction

Radiomics is a rapidly evolving field of research concerned with the extraction of quantitative metrics—the so-called radiomics features—within medical images. Radiomic features capture tissue and lesion characteristics such as heterogeneity and shape and may, alone or in combination with demographic, histologic, genomic, or proteomic data, be used for clinical problem solving. In oncology, the assessment of tissue heterogeneity is of particular interest; genomic analyses have demonstrated that the degree of tumor heterogeneity is a prognostic determinant of survival and an obstacle to cancer control. Studies have demonstrated that radiomics features are strongly correlated with heterogeneity indices at the cellular level [1,2,3,4,5,6,7,8]. Therefore, that Radiomics could support cancer detection, diagnosis, evaluation of prognosis and response to treatment, so as could supervise disease status [9,10,11,12,13,14]. Using standard of care images that are usually obtained in a clinical setting, Radiomics analysis is a cost-effective and highly feasible implement for clinical decision support, providing prognostic and/or predictive biomarkers which enables a fast, low-cost, and repeatable tool for longitudinal monitoring [15,16,17,18,19,20]. Even though individual features may correlate with genomic data, so-called radiogenomics, or clinical outcomes, the impact of radiomics is increased when the data are processed using machine learning techniques. Nowadays, several studies have assessed the role of radiogenomics in hepatocellular carcinoma, but only a few have examined liver metastases [1,2,3].
During the work-up of patients with liver metastases, imaging plays an important role, since it enables one to estimate the number and sites of lesions, to assess the resectability, and to evaluate the response to treatment and drug toxicities [21,22,23,24,25]. Though computed tomography (CT) is routinely used for primary staging and disease surveillance, Magnetic Resonance imaging (MRI) is a valuable diagnostic technique in oncologic settings since it allows one to assess morphological and functional data [21,22,23,24]. Moreover, several liver-specific contrast agents have been introduced to improve lesions detection and characterization. Gadobenate dimeglumine (Gd-BOPTA) and gadolinium ethoxybenzyl diethylenetriamine pentaacetic acid (Gd-EOB-DTPA) allow one to obtain data on the lesions vascularization during the different phases of contrast study and functional data in the delayed, hepatobiliary phase (EOB-phase).
In this context, the possibility to correlate radiomics parameters obtained by MRI studies to recurrences, mutational status, pathological characteristic (mucinous and tumor budding), and surgical resection margin offers notable advantages over qualitative imaging assessment, allowing a better patient selection for cancer therapy, treatment response prediction, and discrimination of favorable subsets of patients from those with poor prognosis. In the present study, we assessed the efficacy of radiomics features obtained by EOB-MRI phase to predict clinical outcomes following liver resection in Colorectal Liver Metastases Patients.

2. Materials and Methods

2.1. Dataset Characteristics

This study aligned with National appropriate guidelines and procedures. The National Cancer Institute of Naples Ethical Committee board approved this retrospective study, renouncing the need for informed patient consent given the study nature.
Radiological archive was evaluated from January 2018 to May 2021 in order to choose patients with: (1) liver metastases with pathological proof; (2) EOB-MRI study in pre-surgical setting after neoadjuvant chemotherapy; (3) MR images of high quality; (4) a follow-up CT scan of at least six months after surgery. The exclusion criteria were: (1) discordance among the imaging diagnosis and the pathologically ones, (2) no EOB-MRI phase studies; (3) no high-quality MR images.
The cohort of patients included a training set and an external validation set. The internal training set consisted of 51 patients (33 women and 18 men) with a median age of 61 years (range 35–82 years) and 121 liver metastases. The validation cohort consisted of 30 patients with single lesion (10 women and 20 men) with 60 years of median age (range 40–78 years). The external validation patient dataset was provided by “Careggi Hospital”, Florence, Italy.
No liver metastases identified by EOB-MRI during the period investigated in this retrospective study were pathologically confirmed and thus not included in the study.
The patient characteristics are summarized in Table 1.

2.2. MR Imaging Protocol

MR studies were performed with 2 1.5T MR tomographs: a Magnetom Symphony (Siemens, Erlangen, Germany) and Magnetom Aera (Siemens). The MRI images were acquired before and after an intravenous (IV) contrast agent (CA) injection.
In this study, a radiomics features extraction was made on volumetric interpolated breath-hold examination (VIBE) T1-weighted SPAIR with controlled respiration used to acquire images after IV CA injection with a liver-specific CA (0.1 mL/kg of Gd-EOB-BPTA—Primovist, Bayer Schering Pharma, Berlin, Germany). The VIBE T1-W sequence was acquired with 2 different flip angles (10 and 30 degrees). A power injector (Spectris Solaris® EP MR, MEDRAD Inc., Indianola, IA, USA) was used to administrate the CA at an infusion rate of 2 mL/s, as descripted in our previous studies [26,27]. Table 2 reports MR Sequence parameters.

2.3. Image Processing

Regions of interest (ROIs) were manually drawn slice-by-slice by 2 expert radiologists with 22 and 15 years of abdominal imaging experience, respectively; first separately and then together and in accordance with each other, annotating all of the slices of the lesions. The segmentation was performed on arterial phase of VIBE T1-W images for both sequences acquired using 10 and 30 degrees of flip angle. For these reasons, we performed the analysis on 2 sequence VIBE_FA10 (VIBE T1-W images with flip angle 10°) and VIBE_FA30 (VIBE T1-W images with flip angle 30°). Manual definition of the ROIs was made using segmentation tool of 3DSlicer (https://www.slicer.org/; accessed on 21 December 2021).

2.4. MRI Post-Processing with Pyradiomics Tool

For each volume of interest, 851 radiomics features were extracted as median values using open-source PyRadiomics python package [28].
We used wavelet filtering (LLH, LHL, LHH, LLL, HLL, HLH, HHL, HHH high (H) or low (L) -pass filters along the X and Y axis and a Z-axis) to six different matrices:
  • First Order (FIRST ORDER): describes the individual values of voxels obtained as a result of ROI cropping. These are generally histogram-based properties (energy, entropy, kurtosis, skewness);
  • Shape based features both 2D and 3D measures;
  • Gray Level Co-occurrence Matrix (GLCM): calculates how often the same and similar pixel values come together in an image and records statistical measurements according to this matrix. These resulting values numerically characterize the texture of the image;
  • Gray Level Run Length Matrix (GLRLM): Defined as the number of homogeneous consecutive pixels with the same gray tone and quantifies the gray-level studies;
  • Gray Level Size Zone Matrix (GLSZM): Properties based on this matrix assign voxel counts according to the logic of measuring gray-level regions in an image;
  • Neighboring Gray Tone Difference Matrix (NGTDM): Digitization of textures obtained from filtered images and their fractal properties;
  • Gray Level Dependence Matrix (GLDM): Number of bound voxels at x distance from the central voxel;
The extracted features are in compliance with feature definitions as described by the Imaging Biomarker Standardization Initiative (IBSI) [29] and as reported in (https://readthedocs.org/projects/pyradiomics/downloads/; accessed on 21 December 2021).
Median values of radiomics features were considered for each segmented volume of interest.
A graphical representation of the radiomics process and of the extracted features has been reported in Figure 1. However, Radiomics involves 3D qualitative and quantitative high throughput extraction of digital imaging data that cannot be represented as an image.
Radiomics analysis was performed blinded to the clinical and pathological data in pre-surgical setting after neoadjuvant chemotherapy. No registration techniques to reduce movements artefacts were applied, however, the use of median value of extracted metrics allows one to reduce the influence of artefacts.

2.5. Statistical Analysis

Statistical analysis includes both univariate and multivariate approaches performed considering a per-lesion analysis. The statistical analyses were performed using the Statistics and Machine Toolbox of MATLAB R2021b (MathWorks, Natick, MA, USA).

2.6. Univariate Analysis

The assessment of observer variability was performed by calculating the intraclass correlation coefficient.
A non-parametric Kruskal-Wallis test was performed to identify differences statistically significant among clinical parameters and radiomics metrics of two groups (front of tumor growth: expansive versus infiltrative; tumor budding: high grade versus low grade or absent; mucinous type and presence of recurrence).
Receiver operating characteristic (ROC) analysis was performed using the Youden index to calculate the optimal cut-off for each metric and then the area under the ROC curve (AUC), sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and accuracy.
A p value < 0.05 was considered as significant.

2.7. Multivariate Analysis

A multivariate analysis was performed in order to identify the combinations of variables which best predict the outcomes: (1) front of tumor growth: expansive versus infiltrative; (2) tumor budding: high grade versus low grade or absent; (3) mucinous type; (4) presence of recurrence.
Given the high number of textural features, a first selection of variables was made based on the results obtained from the univariate analysis: significant at nonparametric Kruskal-Wallis test and with an accuracy ≥ 75%. A linear regression modelling was used to assess the best linear combination of significant textural features for each outcome. The linear regression model was used to assess the accuracy of linear combination and ROC analysis with Youden index was used to identify the optimal cut-off value. Considering the optimal cut-off value, we reported accuracy, sensitivity, specificity, PPV and NPV.
Pattern recognition techniques including support vector machine (SVM), k-nearest neighbors (KNN), artificial neural network (NNET), and decision tree (DT) were performed to calculate the diagnostic performance considering all of the features and/or a subset of features after a feature selection approach [30]. The best model was identified calculating the highest area under ROC curve and highest accuracy. Each classifier was trained with a 10-k fold cross validation; therefore, median values of AUC, accuracy, sensitivity, and specificity were calculated. Moreover, an external validation cohort was used to validate the findings of the best classifier.

3. Results

3.1. Univariate Analysis Findings

The median value of intraclass correlation coefficients for features was 0.92 (range 0.86–0.96). The size of the lesion did not affect the extracted metrics (p-value > 0.05 at the Kruskal-Wallis test performed between the 2 groups: lesions < 2 cm and lesions ≥ 2 cm). In addition, the RAS mutational status did not affect the extracted metrics (p-value > 0.05 at the Kruskal-Wallis test performed between the groups). Therefore, considering homogeneous the two groups respect to the extracted radiomics metrics, RAS mutational was not considered for the following analysis.
There were no differences between the extracted radiomics metrics on VIBE_FA10 and on VIBE_FA30 (p-value > 0.05 at the Kruskal-Wallis test).
Significant radiomics metrics for each outcome at univariate analysis are reported in Table 3.
Among the significant features to differentiate the front of tumor growth on VIBE_FA10, 8 textural parameters obtained an accuracy ≥ 75%. Among these 8 features, the best predictor to discriminate expansive versus infiltrative front of tumor growth was HHL_glcm_MaximumProbability with an accuracy of 81%, a sensitivity of 92%, a specificity of 62%, a PPV and a NPV of 80% and 82%, respectively.
Among the significant features to differentiate the front of tumor growth on VIBE_FA30, 15 textural parameters obtained an accuracy ≥ 75%. Among these 15 features, the best predictor to discriminate expansive versus infiltrative front of tumor growth was HLH_glcm_MaximumProbability (the same feature of previous case obtained with another wavelet filter HLH respect to HHL) with an accuracy of 84%, a sensitivity of 83%, a specificity of 82%, a PPV and a NPV of 89% and 74%, respectively.
Among the significant features to differentiate the tumor budding on VIBE_FA10, 8 textural parameters obtained an accuracy ≥ 85%. Among these 8 features, the best predictor to discriminate tumor budding was again the HHL_glcm_MaximumProbability with an accuracy of 88%, a sensitivity of 94%, a specificity of 68%, a PPV and a NPV of 89% and 81%, respectively.
Among the significant features to differentiate the tumor budding on VIBE_FA30, 16 textural parameters obtained an accuracy ≥ 85%. Among these 16 features, the best predictor to discriminate tumor budding was Inverse Variance obtained by the original GLCM matrix with an accuracy of 89%, a sensitivity of 96%, a specificity of 65%, a PPV and a NPV of 89% and 83%, respectively.
Among the significant features to differentiate the mucinous type of tumor on VIBE_FA10, 8 textural parameters obtained an accuracy ≥ 80%. Among these 8 features, the best predictor to differentiate the mucinous type of tumor was the HHH_ngtdm_Busyness with an accuracy of 84%, a sensitivity of 65%, a specificity of 42%, a PPV and a NPV of 69% and 86%, respectively.
Among the significant features to differentiate the mucinous type of tumor on VIBE_FA30, 12 textural parameters obtained an accuracy ≥ 80%. Among these 12 features, the best predictor to differentiate the mucinous type of tumor was the HHL_glszm_ZoneVariance with an accuracy of 85%, a sensitivity of 46%, a specificity of 95%, a PPV and a NPV of 71% and 87%, respectively.
Among the significant features to identify tumor recurrence on VIBE_FA10, 3 textural parameters obtained an accuracy ≥ 80%. Among these 3 features, the best predictor to identify tumor recurrence was the LLH_glrlm_ShortRunEmphasis with accuracy of 85%, a sensitivity of 31%, a specificity of 100%, a PPV and a NPV of 100% and 84%, respectively.
Among the significant features to identify tumor recurrence on VIBE_FA30, 8 textural parameters obtained an accuracy ≥ 80%. Among these 8 features, the best predictor to identify tumor recurrence was the LHL_glcm_Correlation with an accuracy of 86%, a sensitivity of 52%, a specificity of 97%, a PPV and a NPV of 84% and 85%, respectively.
In total, 26 features extracted by VIBE_FA10 were resulted significant at univariate analysis while 48 were resulted significand among those extracted on VIBE_FA30. Figure 2 shows a heat map.

3.2. Multivariate Analysis Findings

3.2.1. Linear Regression Analysis Findings

Linear regression models obtained good results in each considered classification problem (1. Front of tumor growth: expansive versus infiltrative; 2. tumor budding: high grade versus low grade or absent; 3. mucinous type; 4. presence of recurrence) with an accuracy in the range of 72 to 89% Table 4 and Table 5, Figure 3 and Figure 4. The best linear regression model was obtained in the identification of the front of tumor growth considering the height textural significant metrics by VIBE_FA10 (AUC of 72%, an accuracy of 89%; sensitivity of 93% and a specificity of 82%). The coefficients of this linear models are reported in the Table 6.

3.2.2. Pattern Recognition Approaches Findings

Considering the significant texture metrics tested with pattern recognition approaches, the best performance for each outcome (1. Front of tumor growth: expansive versus infiltrative; 2. tumor budding: high grade versus low grade or absent; 3. mucinous type and 4. presence of recurrence) was reached by a KNN, both considering the features extracted by VIBE_FA10 and VIBE_FA30. The accuracy was always major to 88% (Table 4 and Table 5, Figure 5 and Figure 6) both on training and validation set and the best results was obtained in the identification of recurrence with the 3 textural significant features extracted by VIBE_FA10 (AUC of 91%, an accuracy of 93%; sensitivity of 99% and a specificity of 77%).

4. Discussions

Ours results confirmed the capacity of radiomics to identify as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach. In fact, the possibility to correlate radiomics parameters to RAS status offers notable advantages over qualitative imaging assessment, allowing one to tailor cancer therapy to the patient, to predict response to treatment, to distinguish favorable subsets of patients from those with poor prognosis, to select patients that may benefit of surgical treatment. Literature data underlines the role of several features, as RAS mutation, front of tumor growth, tumor budding and mucinous type as a strong prognostic and predictive biomarker in patients subjected to target therapy or surgical resection. In this scenario, our results confirmed the possibility of radiomics to allow one to tailor cancer therapy at the patient, to predict response to treatment, to detect favorable subsets of patients from those with poor prognosis and to select patients that may benefit from surgical treatment [5,6].
Our results were confirmed by external validation dataset. We obtained a good performance considering the single textural significant metric in the identification of front of tumor growth (expansive versus infiltrative) and tumor budding (high grade versus low grade or absent), in the recognition of mucinous type and in the detection of recurrences. The median value of intraclass correlation coefficients for features was 0.92.
With regard to the front of tumor growth on VIBE_FA10, the best performance was obtained with HHL_glcm_MaximumProbability with an accuracy of 81%; while on VIBE_FA30, the best performance was with HLH_glcm_MaximumProbability (the same feature of previous case obtained with another wavelet filter HLH respect to HHL) with an accuracy of 84%. Among significant features to differentiate the tumor budding on VIBE_FA10, the best predictot was again the HHL_glcm_MaximumProbability with an accuracy of 88% while on VIBE_FA30, the best performance was of the Inverse Variance extracted by the original GLCM matrix with an accuracy of 89%.
Regarding to differentiate the mucinous type of tumor on VIBE_FA10, the best predictor was the HHH_ngtdm_Busyness with an accuracy of 84% while on VIBE_FA30, the best performance was obtained by the HHL_glszm_ZoneVariance with an accuracy of 85%.
Among the significant features to identify tumor recurrence on VIBE_FA10, the best performance was obtained by the LLH_glrlm_ShortRunEmphasis with an accuracy of 85% while on VIBE_FA30, the best predictor was the LHL_glcm_Correlation with an accuracy of 86%.
Therefore, all of the significant and better predictors for each outcome except that the Inverse Variance obtained by the original GLCM matrix were Higher-order statistics features obtained by statistical methods after wavelet transform. However, all of these metrics capture certain statistical regularities of tumor lesions through images linked to the heterogeneity of gray levels on the segmented volume of interest.
Considering a linear regression models or neural network classifiers in a multivariate approach was possible to increase the performance in terms of accuracy, sensitivity, and specificity. The best linear regression model was obtained in the identification of the front of tumor growth considering the height textural significant metrics by VIBE_FA10 (AUC of 72%, an accuracy of 89%; sensitivity of 93% and a specificity of 82%) while the best results with a KNN was obtained in the identification of recurrence with the 3 textural significant features (AUC of 91%, an accuracy of 93%; sensitivity of 99% and a specificity of 77%).
Research has shown the association between entropy and prognosis [31,32,33,34,35,36,37,38,39,40]. Homogeneity in the texture of healthy liver tissue is predictive of worse survival. Andersen et al. [32] demonstrated a link between homogeneity features and overall survival (OS). Rahmim et al. [37] showed as radiomics data of heterogeneity, obtained by FDG PET study, were prognosticators of lower OS [37]. Research has shown the degree of skewness was inversely correlated with KRAS status, while the entropy was related to OS [34]. Moreover, the opportunity to identify the patients for recurrence has been shown [37,38,39,40,41]. Ravanelli et al. [39] correlated high CT uniformity and low OS and Progression Free Survival (PFS).
Radiomics and radiogenomics are emerging fields with important weaknesses that need to be taken into account. The main limit is the heterogeneity of software analysis and the variety of the metrics in different hospitals. Therefore, the segmentation of lesion may affect results [41].
The present study had several limitations: (1) the small population size considered, although the analysis was conducted on a homogeneous sample and on all individual lesions; (2) the retrospective nature of the study, (3) a manual segmentation, that, although research has supported automatic segmentation to avoid inter-observer variability, in our opinion, the manual approach is more realistic. Moreover, we did not assess the impact of the contrast administration and the different phases of contrast study (arterial, portal and transitional phase) respect to EOB-phase, data that we are evaluating in a future paper. However, we evaluated the impact of different flip angle (10 and 30). Additionally, we did not evaluate the impact of chemotherapy on our data.

5. Conclusions

Ours results confirmed the capacity of radiomics to identify, as biomarkers, several prognostic features that could affect the treatment choice in patients with liver metastases, in order to obtain a more personalized approach. These results were confirmed by external validation dataset. We obtained a good performance considering the single textural significant metric in the identification of front of tumor growth (expansive versus infiltrative) and tumor budding (high grade versus low grade or absent), in the recognition of mucinous type and in the detection of recurrences.

Author Contributions

Data curation, V.G.; Formal analysis, V.G. and R.F.; Investigation, V.G., F.D.M., C.C., S.V.S., F.D.A., A.O., G.N., R.G., V.P., V.M., M.C.B., F.T., F.I. and A.P.; Methodology, V.G., R.F., F.D.M., C.C., S.V.S., F.D.A., A.O., G.N., R.G., V.P., V.M., M.C.B., F.T., F.I. and A.P.; Writing—original draft, V.G.; Writing—review & editing, V.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

This study aligned with National appropriate guidelines and procedures. The National Cancer Institute of Naples (80131 Naples, Italy) Ethical Committee board approved this retrospective study.

Informed Consent Statement

This study aligned with National appropriate guidelines and procedures. Renouncing the need for informed patient consent given the study nature.

Data Availability Statement

Data and material are available at https://zenodo.org/record/6299754#.Yh-ezOjMK3A.

Acknowledgments

The authors are grateful to Alessandra Trocino, librarian at the National Cancer Institute of Naples, Italy. Moreover, for the collaboration, authors are grateful for the research support to Paolo Pariate, Martina Totaro and Andrea Esposito of Radiology Division, Istituto Nazionale Tumori IRCCS Fondazione Pascale—IRCCS di Napoli, 80131 Napoli, Italy.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Granata, V.; Fusco, R.; Costa, M.; Picone, C.; Cozzi, D.; Moroni, C.; La Casella, G.V.; Montanino, A.; Monti, R.; Mazzoni, F.; et al. Preliminary Report on Computed Tomography Radiomics Features as Biomarkers to Immunotherapy Selection in Lung Adenocarcinoma Patients. Cancers 2021, 13, 3992. [Google Scholar] [CrossRef] [PubMed]
  2. Granata, V.; Fusco, R.; Barretta, M.L.; Picone, C.; Avallone, A.; Belli, A.; Patrone, R.; Ferrante, M.; Cozzi, D.; Grassi, R.; et al. Radiomics in hepatic metastasis by colorectal cancer. Infect. Agent Cancer 2021, 16, 39. [Google Scholar] [CrossRef] [PubMed]
  3. Fusco, R.; Piccirillo, A.; Sansone, M.; Granata, V.; Rubulotta, M.R.; Petrosino, T.; Barretta, M.L.; Vallone, P.; Di Giacomo, R.; Esposito, E.; et al. Radiomics and Artificial Intelligence Analysis with Textural Metrics Extracted by Contrast-Enhanced Mammography in the Breast Lesions Classification. Diagnostics 2021, 11, 815. [Google Scholar] [CrossRef] [PubMed]
  4. Fusco, R.; Granata, V.; Mazzei, M.A.; Meglio, N.D.; Roscio, D.D.; Moroni, C.; Monti, R.; Cappabianca, C.; Picone, C.; Neri, E.; et al. Quantitative imaging decision support (QIDSTM) tool consistency evaluation and radiomic analysis by means of 594 metrics in lung carcinoma on chest CT scan. Cancer Control 2021, 28, 1073274820985786. [Google Scholar] [CrossRef] [PubMed]
  5. Granata, V.; Fusco, R.; Avallone, A.; De Stefano, A.; Ottaiano, A.; Sbordone, C.; Brunese, L.; Izzo, F.; Petrillo, A. Radiomics-Derived Data by Contrast Enhanced Magnetic Resonance in RAS Mutations Detection in Colorectal Liver Metastases. Cancers 2021, 13, 453. [Google Scholar] [CrossRef]
  6. Granata, V.; Fusco, R.; Risi, C.; Ottaiano, A.; Avallone, A.; De Stefano, A.; Grimm, R.; Grassi, R.; Brunese, L.; Izzo, F.; et al. Diffusion-Weighted MRI and Diffusion Kurtosis Imaging to Detect RAS Mutation in Colorectal Liver Metastasis. Cancers 2020, 12, 2420. [Google Scholar] [CrossRef]
  7. Petralia, G.; Summers, P.E.; Agostini, A.; Ambrosini, R.; Cianci, R.; Cristel, G.; Calistri, L.; Colagrande, S. Dynamic contrast-enhanced MRI in oncology: How we do it. Radiol. Med. 2020, 125, 1288–1300. [Google Scholar] [CrossRef]
  8. Ria, F.; Samei, E. Is regulatory compliance enough to ensure excellence in medicine? Radiol. Med. 2020, 125, 904–905. [Google Scholar] [CrossRef]
  9. Zhang, A.; Song, J.; Ma, Z.; Chen, T. Combined dynamic contrast-enhanced magnetic resonance imaging and diffusion-weighted imaging to predict neoadjuvant chemotherapy effect in FIGO stage IB2-IIA2 cervical cancers. Radiol. Med. 2020, 125, 1233–1242. [Google Scholar] [CrossRef]
  10. Crimi, F.; Capelli, G.; Spolverato, G.; Bao, Q.R.; Florio, A.; Milite Rossi, S.; Cecchin, D.; Albertoni, L.; Campi, C.; Pucciarelli, S.; et al. MRI T2-weighted sequences-based texture analysis (TA) as a predictor of response to neoadjuvant chemo-radiotherapy (nCRT) in patients with locally advanced rectal cancer (LARC). Radiol. Med. 2020, 125, 1216–1224. [Google Scholar] [CrossRef]
  11. Kirienko, M.; Ninatti, G.; Cozzi, L.; Voulaz, E.; Gennaro, N.; Barajon, I.; Ricci, F.; Carlo-Stella, C.; Zucali, P.; Sollini, M.; et al. Computed tomography (CT)-derived radiomic features differentiate prevascular mediastinum masses as thymic neoplasms versus lymphomas. Radiol. Med. 2020, 125, 951–960. [Google Scholar] [CrossRef] [PubMed]
  12. Zhang, L.; Kang, L.; Li, G.; Zhang, X.; Ren, J.; Shi, Z.; Li, J.; Yu, S. Computed tomography-based radiomics model for discriminating the risk stratification of gastrointestinal stromal tumors. Radiol. Med. 2020, 125, 465–473. [Google Scholar] [CrossRef] [PubMed]
  13. Gurgitano, M.; Angileri, S.A.; Rodà, G.M.; Liguori, A.; Pandolfi, M.; Ierardi, A.M.; Wood, B.J.; Carrafiello, G. Interventional Radiology ex-machina: Impact of Artificial Intelligence on practice. Radiol. Med. 2021, 126, 998–1006. [Google Scholar] [CrossRef]
  14. Scapicchio, C.; Gabelloni, M.; Barucci, A.; Cioni, D.; Saba, L.; Neri, E. A deep look into radiomics. Radiol. Med. 2021, 126, 1296–1311. [Google Scholar] [CrossRef] [PubMed]
  15. Wei, J.; Jiang, H.; Gu, D.; Niu, M.; Fu, F.; Han, Y.; Song, B.; Tian, J. Radiomics in liver diseases: Current progress and future opportunities. Liver Int. 2020, 40, 2050–2063. [Google Scholar] [CrossRef]
  16. Saini, A.; Breen, I.; Pershad, Y.; Naidu, S.; Knuttinen, M.G.; Alzubaidi, S.; Sheth, R.; Albadawi, H.; Kuo, M.; Oklu, R. Radiogenomics and Radiomics in Liver Cancers. Diagnostics 2018, 9, 4. [Google Scholar] [CrossRef] [Green Version]
  17. De la Pinta, C.; Castillo, M.E.; Collado, M.; Galindo-Pumariño, C.; Peña, C. Radiogenomics: Hunting Down Liver Metastasis in Colorectal Cancer Patients. Cancers 2021, 13, 5547. [Google Scholar] [CrossRef]
  18. Nardone, V.; Reginelli, A.; Grassi, R.; Boldrini, L.; Vacca, G.; D’Ippolito, E.; Annunziata, S.; Farchione, A.; Belfiore, M.P.; Desideri, I.; et al. Delta radiomics: A systematic review. Radiol. Med. 2021, 126, 1571–1583. [Google Scholar] [CrossRef]
  19. Brunese, L.; Brunese, M.C.; Carbone, M.; Ciccone, V.; Mercaldo, F.; Santone, A. Automatic PI-RADS assignment by means of formal methods. Radiol. Med. 2021, 127, 83–89. [Google Scholar] [CrossRef]
  20. Van der Lubbe, M.F.J.A.; Vaidyanathan, A.; de Wit, M.; van den Burg, E.L.; Postma, A.A.; Bruintjes, T.D.; Bilderbeek-Beckers, M.A.L.; Dammeijer, P.F.M.; Bossche, S.V.; Van Rompaey, V.; et al. A non-invasive, automated diagnosis of Menière’s disease using radiomics and machine learning on conventional magnetic resonance imaging: A multicentric, case-controlled feasibility study. Radiol. Med. 2021, 27, 72–82. [Google Scholar] [CrossRef]
  21. Granata, V.; Fusco, R.; Avallone, A.; Cassata, A.; Palaia, R.; Delrio, P.; Grassi, R.; Tatangelo, F.; Grazzini, G.; Izzo, F.; et al. Abbreviated MRI protocol for colorectal liver metastases: How the radiologist could work in pre surgical setting. PLoS ONE 2020, 15, e0241431. [Google Scholar] [CrossRef] [PubMed]
  22. Granata, V.; Fusco, R.; Venanzio Setola, S.; Mattace Raso, M.; Avallone, A.; De Stefano, A.; Nasti, G.; Palaia, R.; Delrio, P.; Petrillo, A.; et al. Liver radiologic findings of chemotherapy-induced toxicity in liver colorectal metastases patients. Eur. Rev. Med. Pharmacol. Sci. 2019, 23, 9697–9706. [Google Scholar] [CrossRef] [PubMed]
  23. Granata, V.; Fusco, R.; Maio, F.; Avallone, A.; Nasti, G.; Palaia, R.; Albino, V.; Grassi, R.; Izzo, F.; Petrillo, A. Qualitative assessment of EOB-GD-DTPA and Gd-BT-DO3A MR contrast studies in HCC patients and colorectal liver metastases. Infect. Agent Cancer 2019, 14, 40. [Google Scholar] [CrossRef] [PubMed]
  24. Granata, V.; Fusco, R.; de Lutio di Castelguidone, E.; Avallone, A.; Palaia, R.; Delrio, P.; Tatangelo, F.; Botti, G.; Grassi, R.; Izzo, F.; et al. Diagnostic performance of gadoxetic acid-enhanced liver MRI versus multidetector CT in the assessment of colorectal liver metastases compared to hepatic resection. BMC Gastroenterol. 2019, 19, 129. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Granata, V.; Fusco, R.; Avallone, A.; Catalano, O.; Piccirillo, M.; Palaia, R.; Nasti, G.; Petrillo, A.; Izzo, F. A radiologist’s point of view in the presurgical and intraoperative setting of colorectal liver metastases. Future Oncol. 2018, 14, 2189–2206. [Google Scholar] [CrossRef]
  26. Granata, V.; Fusco, R.; Catalano, O.; Avallone, A.; Palaia, R.; Botti, G.; Tatangelo, F.; Granata, F.; Cascella, M.; Izzo, F.; et al. Diagnostic accuracy of magnetic resonance, computed tomography and contrast enhanced ultrasound in radiological multimo-dality assessment of peribiliary liver metastases. PLoS ONE 2017, 12, e0179951. [Google Scholar] [CrossRef] [Green Version]
  27. Granata, V.; Fusco, R.; Catalano, O.; Filice, S.; Amato, D.M.; Nasti, G.; Avallone, A.; Izzo, F.; Petrillo, A. Early Assessment of Colorectal Cancer Patients with Liver Metastases Treated with Antiangiogenic Drugs: The Role of Intravoxel Incoherent Motion in Diffusion-Weighted Imaging. PLoS ONE 2015, 10, e0142876. [Google Scholar] [CrossRef]
  28. Van Griethuysen, J.J.M.; Fedorov, A.; Parmar, C.; Hosny, A.; Aucoin, N.; Narayan, V.; Beets-Tan, R.G.H.; Fillion-Robin, J.C.; Pieper, S.; Aerts, H.J.W.L. Computational Radiomics System to Decode the Radiographic Phenotype. Cancer Res. 2017, 77, e104–e107. [Google Scholar] [CrossRef] [Green Version]
  29. Zwanenburg, A.; Vallières, M.; Abdalah, M.A.; Aerts, H.J.W.L.; Andrearczyk, V.; Apte, A.; Ashrafinia, S.; Bakas, S.; Beukinga, R.J.; Boellaard, R.; et al. The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping. Radiology 2020, 295, 328–338. [Google Scholar] [CrossRef] [Green Version]
  30. Fusco, R.; Sansone, M.; Filice, S.; Carone, G.; Amato, D.M.; Sansone, C.; Petrillo, A. Pattern Recognition Approaches for Breast Cancer DCE-MRI Classification: A Systematic Review. J. Med. Biol. Eng. 2016, 36, 449–459. [Google Scholar] [CrossRef] [Green Version]
  31. Beckers, R.C.J.; Trebeschi, S.; Maas, M.; Schnerr, R.S.; Sijmons, J.M.L.; Beets, G.L.; Houwers, J.B.; Beets-Tan, R.G.H.; Lambregts, D.M.J. CT texture analysis in colorectal liver metastases and the surrounding liver parenchyma and its potential as an imaging biomarker of disease aggressiveness, response and survival. Eur. J. Radiol. 2018, 102, 15–21. [Google Scholar] [CrossRef]
  32. Andersen, I.R.; Thorup, K.; Andersen, M.B.; Olesen, R.; Mortensen, F.V.; Nielsen, D.T.; Rasmussen, F. Texture in the monitoring of regorafenib therapy in patients with colorectal liver metastases. Acta Radiol. 2019, 60, 1084–1093. [Google Scholar] [CrossRef] [PubMed]
  33. Zhang, H.; Li, W.; Hu, F.; Sun, Y.; Hu, T.; Tong, T. MR texture analysis: Potential imaging biomarker for predicting the chemotherapeutic response of patients with colorectal liver metastases. Abdom. Radiol. 2018, 44, 65–71. [Google Scholar] [CrossRef]
  34. Lubner, M.G.; Stabo, N.; Lubner, S.J.; del Rio, A.M.; Song, C.; Halberg, R.B.; Pickhardt, P.J. CT textural analysis of hepatic metastatic colorectal cancer: Pre-treatment tumor heterogeneity correlates with pathology and clinical outcomes. Abdom. Imaging 2015, 40, 2331–2337. [Google Scholar] [CrossRef] [PubMed]
  35. Simpson, A.L.; Doussot, A.; Creasy, J.M.; Adams, L.B.; Allen, P.J.; DeMatteo, R.P.; Gönen, M.; Kemeny, N.E.; Kingham, T.P.; Shia, J.; et al. Computed Tomography Image Texture: A Noninvasive Prognostic Marker of Hepatic Recurrence After Hepatectomy for Metastatic Colorectal Cancer. Ann. Surg. Oncol. 2017, 24, 2482–2490. [Google Scholar] [CrossRef] [PubMed]
  36. Ganeshan, B.; Miles, K.A.; Young, R.C.; Chatwin, C.R. Hepatic Enhancement in Colorectal Cancer: Texture Analysis Correlates with Hepatic Hemodynamics and Patient Survival. Acad. Radiol. 2007, 14, 1520–1530. [Google Scholar] [CrossRef]
  37. Rahmim, A.; Bak-Fredslund, K.P.; Ashrafinia, S.; Lu, L.; Schmidtlein, C.; Subramaniam, R.M.; Morsing, A.; Keiding, S.; Horsager, J.; Munk, O.L. Prognostic modeling for patients with colorectal liver metastases incorporating FDG PET radiomic features. Eur. J. Radiol. 2019, 113, 101–109. [Google Scholar] [CrossRef]
  38. Dercle, L.; Lu, L.; Schwartz, L.H.; Qian, M.; Tejpar, S.; Eggleton, P.; Zhao, B.; Piessevaux, H. Radiomics Response Signature for Identification of Metastatic Colorectal Cancer Sensitive to Therapies Targeting EGFR Pathway. J. Natl. Cancer Inst. 2020, 112, 902–912. [Google Scholar] [CrossRef]
  39. Ravanelli, M.; Agazzi, G.M.; Tononcelli, E.; Roca, E.; Cabassa, P.; Baiocchi, G.L.; Berruti, A.; Maroldi, R.; Farina, D. Texture features of colorectal liver metastases on pretreatment contrast-enhanced CT may predict response and prognosis in patients treated with bevacizumab-containing chemotherapy: A pilot study including comparison with standard chemotherapy. Radiol. Med. 2019, 124, 877–886. [Google Scholar] [CrossRef]
  40. Taghavi, M.; Staal, F.C.; Simões, R.; Hong, E.K.; Lambregts, D.M.; van der Heide, U.A.; Beets-Tan, R.G.; Maas, M. CT radiomics models are unable to predict new liver metastasis after successful thermal ablation of colorectal liver metastases. Acta Radiol. 2021, 17, 2841851211060437. [Google Scholar] [CrossRef]
  41. Rizzetto, F.; Calderoni, F.; de Mattia, C.; Defeudis, A.; Giannini, V.; Mazzetti, S.; Vassallo, L.; Ghezzi, S.; Sartore-Bianchi, A.; Marsoni, S.; et al. Impact of inter-reader contouring variability on textural radiomics of colorectal liver metastases. Eur. Radiol. Exp. 2020, 4, 62. [Google Scholar] [CrossRef] [PubMed]
Figure 1. A graphical representation of the radiomics process and of the extracted features.
Figure 1. A graphical representation of the radiomics process and of the extracted features.
Cancers 14 01239 g001
Figure 2. Heat maps pf significant radiomics features (26 extracted by VIBE_FA10 and 48 extracted by VIBE_FA30).
Figure 2. Heat maps pf significant radiomics features (26 extracted by VIBE_FA10 and 48 extracted by VIBE_FA30).
Cancers 14 01239 g002
Figure 3. ROC curves of linear regression analysis respect to the front of tumor growth (A), the tumor budding (B), the tumor mucinous type (C), recurrence presence (D) obtained considering significant features extracted by VIBE_FA10.
Figure 3. ROC curves of linear regression analysis respect to the front of tumor growth (A), the tumor budding (B), the tumor mucinous type (C), recurrence presence (D) obtained considering significant features extracted by VIBE_FA10.
Cancers 14 01239 g003
Figure 4. ROC curves of linear regression analysis respect to the front of tumor growth (A), the tumor budding (B), the tumor mucinous type (C), recurrence presence (D) obtained considering significant features extracted by VIBE_FA30.
Figure 4. ROC curves of linear regression analysis respect to the front of tumor growth (A), the tumor budding (B), the tumor mucinous type (C), recurrence presence (D) obtained considering significant features extracted by VIBE_FA30.
Cancers 14 01239 g004
Figure 5. ROC curves of KNN respect to the front of tumor growth (A), the tumor budding (B), the tumor mucinous type (C), recurrence presence (D) obtained considering significant features extracted by VIBE_FA10.
Figure 5. ROC curves of KNN respect to the front of tumor growth (A), the tumor budding (B), the tumor mucinous type (C), recurrence presence (D) obtained considering significant features extracted by VIBE_FA10.
Cancers 14 01239 g005
Figure 6. ROC curves of KNN respect to the front of tumor growth (A), the tumor budding (B), the tumor mucinous type (C), recurrence presence (D) obtained considering significant features extracted by VIBE_FA30.
Figure 6. ROC curves of KNN respect to the front of tumor growth (A), the tumor budding (B), the tumor mucinous type (C), recurrence presence (D) obtained considering significant features extracted by VIBE_FA30.
Cancers 14 01239 g006
Table 1. Characteristics of the study population (81 patients).
Table 1. Characteristics of the study population (81 patients).
Patient DescriptionNumbers (%)/Range
GenderMen 53 (65.4%)
Women 28 (34.6%)
Age61 years; range: 35–82 years
Primary Cancer Site
Colon52 (64.2%)
Rectum29 (35.8%)
Prior Chemotherapy81 (100%)
Hepatic Metastases Description
Patients with single nodule52 (64.2%)
Patients with multiple nodules29 (35.8%)/range: 2–13 metastases
Nodule size (mm)mean size 36.4 mm; range 7–58 mm
Front of Tumor Growth
expansive30 (37.0%)
infiltrative51 (63.0%)
Tumor Budding
Absent12 (14.8%)
Low grade14 (17.3%)
High grade55 (67.9%)
Mucinous Carcinoma25 (30.9%)
Recurrence19 (23.5%)
RAS Mutation42 (51.9%)
Table 2. MR Sequence parameters.
Table 2. MR Sequence parameters.
SequenceOrientationTR/TE/FA
(ms/ms/deg.)
AT
(min)
Acquisition MatrixST/Gap (mm)FS
Trufisp T2-WCoronal4.30/2.15/800.46512 × 5124/0without
HASTE T2-W Axial1500/90/1700.36320 × 3205/0without and with (SPAIR)
HASTE T2wCoronal1500/92/1700.38320 × 3205/0without
In-Out phase T1-WAxial160/2.35/700.33256 × 1925/0without
VIBE
T1-W_FA10
Axial4.80/1.76/100.18320 × 2603/0with (SPAIR)
VIBE
T1-W_FA30
Axial4.80/1.76/300.18320 × 2603/0with (SPAIR)
Note: W = Weighted, TR = Repetition time, TE = Echo time, FA = Flip angle, AT = Acquisition time, SPAIR = Spectral Adiabatic Inversion Recovery, VIBE = Volumetric interpolated breath hold examination, HASTE = HASTE = Half-Fourier-Acquired Single-shot Turbo spin Echo.
Table 3. Significant radiomics features for each considered outcome.
Table 3. Significant radiomics features for each considered outcome.
Significant Textural Features Extracted byVIBE_FA10 Respect to the Front of Tumor GrowthVIBE_FA30 Respect to the Front of Tumor GrowthVIBE_FA10 Respect to the Tumor BuddingVIBE_FA30 Respect to the Tumor BuddingVIBE_FA10 Respect to the Mucinous TypeVIBE_FA30 Respect to the Mucinous TypeVIBE_FA10 Respect to RecurrenceVIBE_FA30 Respect to Recurrence
Wavelet_HHL_glcm_MaximumProbabilityWavelet_HLH_glcm_MaximumProbabilityWavelet_HHL_glcm_MaximumProbabilityOriginal_glcm_InverseVarianceWavelet_HHH_ngtdm_BusynessWavelet_HHL_glszm_ZoneVarianceWavelet_LLH_glrlm_ShortRunEmphasisWavelet_LHL_glcm_Correlation
AUC0.660.680.700.700.650.630.480.74
Sensitivity0.920.830.940.960.420.460.310.52
Specificity0.620.820.680.650.950.961.000.97
PPV0.800.890.890.890.690.751.000.84
NPV0.820.740.810.830.860.870.840.85
Accuracy0.810.840.880.890.840.850.850.86
Cut-off0.280.280.280.351306.261,289,504.660.840.46
Note: GLCM, Gray Level Co-occurrence Matrix; GLSZM, Gray Level Size Zone Matrix; GLRLM, Gray Level Run Length Matrix; GLDM, Gray Level Dependence Matrix; NGTDM, Neighboring Gray Tone Difference Matrix.
Table 4. Linear regression and Pattern recognition analysis with significant features from the VIBE_FA10.
Table 4. Linear regression and Pattern recognition analysis with significant features from the VIBE_FA10.
Linear Regression of Significant FeaturesAUCSensitivitySpecificityPPVNPVAccuracyCut-Off
Linear regression of the textural features extracted from the VIBE_FA10 with respect to the front of tumor growth0.720.930.820.900.880.891.49
Linear regression of the textural features extracted from the VIBE_FA10 with respect to the tumor budding0.780.840.840.940.650.841.54
Linear regression of the textural features extracted from the VIBE_FA10 with respect to the mucinous type0.800.850.820.560.950.830.28
Linear regression of the textural features extracted from the VIBE_FA10 with respect to the recurrence presence0.630.520.880.590.840.793.81
Pattern Recognition Analysis with Significant FeaturesDatasetAUCAccuracySensitivitySpecificityTraining
Time [sec]
Model Type and Parameters
KNNTraining set0.960.910.840.958.7Weighted KNN; number of neighbors:10; distance metric: Euclidean; distance weight: squared inverse
Validation set0.970.9210.86
Training set0.890.930.810.973.9
Validation set0.90.930.731
Training set0.930.890.940.733.2
Validation set0.950.880.910.8
Training set0.910.930.990.779.21
Validation set0.970.940.90.91
Table 5. Linear regression and Pattern recognition analysis with significant features from the VIBE_FA30.
Table 5. Linear regression and Pattern recognition analysis with significant features from the VIBE_FA30.
Linear Regression of Significant FeaturesAUCSensitivitySpecificityPPVNPVAccuracyCut-Off
Linear regression of the textural features extracted from the VIBE_FA30 with respect to the front of tumor growth0.550.880.560.770.740.768.81
Linear regression of the textural features extracted from the VIBE_FA30 with respect to the tumor budding0.650.960.640.820.910.840.56
Linear regression of the textural features extracted from the VIBE_FA30 with respect to the mucinous type0.261.000.040.641.000.64−0.17
Linear regression of the textural features extracted from the VIBE_FA30 with respect to the recurrence presence0.790.900.660.470.950.720.27
Pattern Recognition Analysis with Significant FeaturesDatasetAUCAccuracySensitivitySpecificityTraining
time [sec]
Model Type and Parameters
KNNTraining set0.960.900.910.8913.4Weighted KNN; number of neighbors:10; distance metric: Euclidean; distance weight: squared inverse
Validation set0.950.800.671
Training set0.940.930.840.968.3
Validation set0.940.890.890.89
Training set0.930.910.960.737.51
Validation set0.890.880.890.8
Training set0.90.940.980.848.4
Validation set0.850.910.940.8
Table 6. Linear regression model parameters.
Table 6. Linear regression model parameters.
Linear Regression of the Textural Features Extracted by VIBE_FA10 with Respect to the Front of Tumor Growth Coefficients p Value p Value
Intercept−7.370.080.000
original_shape_SurfaceVolumeRatio−0.850.58
wavelet_LHL_glszm_SmallAreaLowGrayLevelEmphasis1.500.19
wavelet_LLH_glcm_InverseVariance4.150.00
wavelet_HHH_glrlm_ShortRunHighGrayLevelEmphasis0.140.00
wavelet_HHH_glrlm_ShortRunEmphasis6.250.51
wavelet_HHH_glrlm_RunPercentage−6.730.57
wavelet_HHH_glrlm_RunLengthNonUniformityNormalized5.150.40
wavelet_HHL_glcm_MaximumProbability16.110.00
Linear Regression of the Textural Features ExtractedbyVIBE_FA10 with Respect to the Tumor Budding Coefficients p value p value
Intercept−17.880.000.000
wavelet_HLL_gldm_LargeDependenceLowGrayLevelEmphasis0.110.32
wavelet_HLL_glrlm_LongRunLowGrayLevelEmphasis−3.280.33
wavelet_HLL_glszm_GrayLevelNonUniformityNormalized−4.280.05
wavelet_LLH_glrlm_GrayLevelNonUniformityNormalized2.150.07
wavelet_HLH_glcm_JointEnergy48.410.00
wavelet_HLH_firstorder_10Percentile0.000.96
wavelet_HHH_glcm_MaximumProbability1.420.87
wavelet_HHL_glcm_MaximumProbability24.940.00
Linear Regression of the Textural Features ExtractedbyVIBE_FA10 with Respect to the Mucinous Type Coefficients p value p value
Intercept3.310.140.000
wavelet_LHL_gldm_DependenceNonUniformity0.000.03
wavelet_LHL_ngtdm_Strength−1.200.08
wavelet_LHL_ngtdm_Busyness0.000.07
wavelet_LHH_glcm_ClusterTendency7.500.00
wavelet_HLH_gldm_DependenceEntropy−0.030.97
wavelet_HLH_firstorder_Mean0.120.59
wavelet_HHH_ngtdm_Busyness0.000.08
wavelet_HHL_gldm_DependenceEntropy−1.440.04
Linear Regression of the Textural Features ExtractedbyVIBE_FA10 with Respect to the Recurrence Presence Coefficients p value p value
Intercept−2.950.050.030
wavelet_LLH_glrlm_ShortRunEmphasis8.190.04
wavelet_LLH_glrlm_RunLengthNonUniformityNormalized−5.250.10
wavelet_HHH_ngtdm_Busyness0.000.49
Linear Regression of the Textural Features ExtractedbyVIBE_FA30 with Respect to the Front of Tumor Growth Coefficients p value p value
Intercept−4.8680.0100.000
original_glcm_InverseVariance1.4840.260
wavelet_HLL_gldm_GrayLevelVariance−4.9070.206
wavelet_HLL_glcm_InverseVariance4.2570.165
wavelet_HLL_glcm_DifferenceVariance−0.9670.182
wavelet_HLL_glcm_SumEntropy1.3290.195
wavelet_HLL_glcm_SumSquares−0.4620.540
wavelet_HLL_firstorder_RobustMeanAbsoluteDeviation0.3600.244
wavelet_HLL_firstorder_MeanAbsoluteDeviation−0.6120.161
wavelet_HLL_firstorder_RootMeanSquared0.1530.273
wavelet_HLL_firstorder_RootMeanSquared0.8230.717
wavelet_HLL_firstorder_Variance0.0100.162
wavelet_LHH_glrlm_ShortRunLowGrayLevelEmphasis−0.0180.944
wavelet_HLH_glcm_MaximumProbability8.6130.051
wavelet_HLH_glcm_MaximumProbability0.9030.817
wavelet_LLL_gldm_SmallDependenceLowGrayLevelEmphasis24.7400.440
Linear Regression of the Textural Features ExtractedbyVIBE_FA30 with Respect to the Tumor Budding Coefficients p value p value
Intercept5.2200.5210.000
original_glcm_InverseVariance2.9780.008
wavelet_HLL_glcm_JointEnergy−12.5940.008
wavelet_HLL_glcm_Idm114.9990.000
wavelet_HLL_glcm_Id−123.5180.002
wavelet_HLL_firstorder_Uniformity−18.6510.011
wavelet_HLL_firstorder_10Percentile−0.0050.801
wavelet_HLL_glrlm_GrayLevelNonUniformityNormalized14.7120.009
wavelet_HLL_glszm_GrayLevelNonUniformityNormalized−0.8040.458
wavelet_LHL_glcm_Idm−71.4940.012
wavelet_LHL_glcm_Id79.8150.014
wavelet_LHH_firstorder_10Percentile−0.0030.941
wavelet_LLH_firstorder_Uniformity10.5400.002
wavelet_LLH_glrlm_GrayLevelNonUniformityNormalized−12.8080.002
wavelet_LLH_glszm_GrayLevelNonUniformityNormalized2.0660.156
wavelet_HHL_glcm_JointEnergy1.6720.853
wavelet_HHL_firstorder_10Percentile0.2020.006
Linear Regression of the Textural Features ExtractedbyVIBE_FA30 with Respect to the Mucinous Type Coefficients p value p value
Intercept13.2930.0180.000
original_shape_SurfaceVolumeRatio−2.6690.000
wavelet_LHH_gldm_DependenceNonUniformity0.0040.113
wavelet_LHH_gldm_GrayLevelNonUniformity0.0000.710
wavelet_HLH_gldm_DependenceNonUniformity−0.0140.000
wavelet_HLH_glrlm_GrayLevelNonUniformity0.0050.003
wavelet_HHH_gldm_DependenceNonUniformity−0.0020.473
wavelet_HHH_glszm_ZonePercentage67.1210.000
wavelet_HHH_ngtdm_Busyness0.0000.000
wavelet_HHL_gldm_DependenceNonUniformity0.0120.000
wavelet_HHL_glrlm_GrayLevelNonUniformity−0.0050.004
wavelet_HHL_glszm_ZoneVariance0.0000.462
wavelet_LLL_glcm_Idmn−12.5780.025
Linear Regression of the Textural Features ExtractedbyVIBE_FA30 with Respect to the Recurrence Presence Coefficients p value p value
Intercept−0.0180.9660.000
original_glszm_ZonePercentage0.8520.540
wavelet_HLL_glcm_Correlation−0.4640.684
wavelet_LHL_glcm_Correlation5.3240.001
wavelet_LHL_glcm_SumEntropy−0.2430.474
wavelet_LHL_glcm_Imc2v2.9560.037
wavelet_LHL_glcm_ClusterTendency−0.0140.891
wavelet_HLH_glcm_Correlation2.2660.341
wavelet_HHL_glrlm_HighGrayLevelRunEmphasis0.0330.010
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Granata, V.; Fusco, R.; De Muzio, F.; Cutolo, C.; Setola, S.V.; Dell’Aversana, F.; Ottaiano, A.; Nasti, G.; Grassi, R.; Pilone, V.; et al. EOB-MR Based Radiomics Analysis to Assess Clinical Outcomes following Liver Resection in Colorectal Liver Metastases. Cancers 2022, 14, 1239. https://doi.org/10.3390/cancers14051239

AMA Style

Granata V, Fusco R, De Muzio F, Cutolo C, Setola SV, Dell’Aversana F, Ottaiano A, Nasti G, Grassi R, Pilone V, et al. EOB-MR Based Radiomics Analysis to Assess Clinical Outcomes following Liver Resection in Colorectal Liver Metastases. Cancers. 2022; 14(5):1239. https://doi.org/10.3390/cancers14051239

Chicago/Turabian Style

Granata, Vincenza, Roberta Fusco, Federica De Muzio, Carmen Cutolo, Sergio Venanzio Setola, Federica Dell’Aversana, Alessandro Ottaiano, Guglielmo Nasti, Roberta Grassi, Vincenzo Pilone, and et al. 2022. "EOB-MR Based Radiomics Analysis to Assess Clinical Outcomes following Liver Resection in Colorectal Liver Metastases" Cancers 14, no. 5: 1239. https://doi.org/10.3390/cancers14051239

APA Style

Granata, V., Fusco, R., De Muzio, F., Cutolo, C., Setola, S. V., Dell’Aversana, F., Ottaiano, A., Nasti, G., Grassi, R., Pilone, V., Miele, V., Brunese, M. C., Tatangelo, F., Izzo, F., & Petrillo, A. (2022). EOB-MR Based Radiomics Analysis to Assess Clinical Outcomes following Liver Resection in Colorectal Liver Metastases. Cancers, 14(5), 1239. https://doi.org/10.3390/cancers14051239

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop