Next Article in Journal
Special Issue: “Anti-inflammatory Effects of Glucagon-like Peptide-1”
Next Article in Special Issue
Comparison of the Capacity of Several Machine Learning Tools to Assist Immunofluorescence-Based Detection of Anti-Neutrophil Cytoplasmic Antibodies
Previous Article in Journal
Special Issue with Research Topics on “Recent Analysis and Applications of Mass Spectra on Biochemistry”
Previous Article in Special Issue
TEMINET: A Co-Informative and Trustworthy Multi-Omics Integration Network for Diagnostic Prediction
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Application of Machine Learning Techniques to Assess Alpha-Fetoprotein at Diagnosis of Hepatocellular Carcinoma

by
Sergio Gil-Rojas
1,2,3,
Miguel Suárez
1,2,3,
Pablo Martínez-Blanco
1,2,3,
Ana M. Torres
2,3,
Natalia Martínez-García
4,
Pilar Blasco
5,
Miguel Torralba
4,6,7 and
Jorge Mateo
2,3,*
1
Gastroenterology Department, Virgen de la Luz Hospital, 16002 Cuenca, Spain
2
Medical Analysis Expert Group, Institute of Technology, Universidad de Castilla-La Mancha, 16071 Cuenca, Spain
3
Medical Analysis Expert Group, Instituto de Investigación Sanitaria de Castilla-La Mancha (IDISCAM), 45071 Toledo, Spain
4
Internal Medicine Unit, University Hospital of Guadalajara, 19002 Guadalajara, Spain
5
Department of Pharmacy, General University Hospital, 46014 Valencia, Spain
6
Faculty of Medicine, Universidad de Alcalá de Henares, 28801 Alcalá de Henares, Spain
7
Translational Research Group in Cellular Immunology (GITIC), Instituto de Investigación Sanitaria de Castilla-La Mancha (IDISCAM), 45071 Toledo, Spain
*
Author to whom correspondence should be addressed.
Int. J. Mol. Sci. 2024, 25(4), 1996; https://doi.org/10.3390/ijms25041996
Submission received: 8 January 2024 / Revised: 29 January 2024 / Accepted: 5 February 2024 / Published: 7 February 2024
(This article belongs to the Special Issue Machine Learning and Bioinformatics in Human Health and Disease)

Abstract

:
Hepatocellular carcinoma (HCC) is the most common primary liver tumor and is associated with high mortality rates. Approximately 80% of cases occur in cirrhotic livers, posing a significant challenge for appropriate therapeutic management. Adequate screening programs in high-risk groups are essential for early-stage detection. The extent of extrahepatic tumor spread and hepatic functional reserve are recognized as two of the most influential prognostic factors. In this retrospective multicenter study, we utilized machine learning (ML) methods to analyze predictors of mortality at the time of diagnosis in a total of 208 patients. The eXtreme gradient boosting (XGB) method achieved the highest values in identifying key prognostic factors for HCC at diagnosis. The etiology of HCC was found to be the variable most strongly associated with a poorer prognosis. The widely used Barcelona Clinic Liver Cancer (BCLC) classification in our setting demonstrated superiority over the TNM classification. Although alpha-fetoprotein (AFP) remains the most commonly used biological marker, elevated levels did not correlate with reduced survival. Our findings suggest the need to explore new prognostic biomarkers for individualized management of these patients.

1. Introduction

Hepatocellular carcinoma (HCC) is the seventh most frequently diagnosed cancer worldwide, with approximately 906,000 new cases reported in 2020 [1]. With a five-year survival rate of approximately 18%, it represents the third most common cause of cancer-related mortality worldwide [2,3]. Incidence and mortality rates have increased in many parts of the world, primarily due to the large number of undiagnosed chronic hepatitis C virus (HCV) infections, rising alcohol consumption, and metabolic dysfunction-associated steatotic liver disease (MASLD) [4,5]. The epidemiology of HCC is changing. This is based on hepatitis B vaccination policies and new hepatitis C treatments, which have led to a decrease in secondary cases of these diseases. Despite this good news, the increase in the incidence of patients with MASLD contributes to the sustained high figures of this tumor’s impact on cancer-related deaths [6].
Most of these tumors occur in patients with liver cirrhosis [7]. As most patients are diagnosed in this situation, they often present a deteriorated general condition as a result. Without considering common situations such as malnutrition or other comorbidities, patients will exhibit altered liver function [8]. This also implies that, in the face of any hepatic decompensation, it is necessary to rule out the presence of HCC in these patients [7]. There are various prognostic and therapeutic classifications of HCC, and none of them is universally valid. This is because different geographic areas have distinct risk factors that can modify the course and prognosis of the disease [9,10]. Furthermore, no molecule capable of predicting the course of these tumors has been identified or included in staging systems. The Barcelona Clinic Liver Cancer (BCLC) classification is widely used in our context, proving particularly useful for approximately 70% of patients not eligible for curative intent treatment at the time of diagnosis [11]. The implementation of appropriate screening programs for early-stage detection is of great importance. It is recommended to perform a surveillance ultrasound every 6 months in all cirrhotic patients, apart from those in Child–Pugh stage C who are not candidates for liver transplantation, non-cirrhotic patients with hepatitis B virus (HBV) infection, and those with advanced fibrosis (F3–F4). The determination of alpha-fetoprotein (AFP) levels is not highly sensitive or specific for screening, and its use does not seem justified [12].
The poor prognosis of this disease demands further research. It is essential to identify parameters and biomarkers that enable earlier detection of HCC and establish a prognosis upon diagnosis. This prognosis is crucial for determining the most optimal treatments in each case and providing better information regarding survival. Current evidence regarding biomarkers is limited and inadequate [13]. There are multiple avenues under investigation, many of which are focused on liquid biopsy, the presence of circulating tumor DNA and cells, microRNA in blood, and metabolomics, among others [14,15]. All of these are far from validation and application in routine clinical practice. Therefore, currently, in many cases, AFP levels are used due to their traditional application, accessibility, and being one of the few available options [16].
If the use of AFP in screening is controversial, its utility as a prognostic factor is also a subject of debate. Despite its classical use, there are doubts about its effectiveness as a prognostic factor at the time of HCC diagnosis [12,17]. It has been suggested that elevated AFP levels may have prognostic implications, as an inversely proportional relationship with patient survival has been observed [7]. Moreover, a significant elevation of AFP levels above 1000 mcg/L has been associated with an increased risk of recurrence in transplanted patients, regardless of tumor size [18]. Given the limited evidence regarding the use of AFP to predict prognosis in these tumors, the following study is proposed to analyze whether a real relationship exists between AFP levels and patient survival. For this purpose, machine learning (ML) techniques have been implemented. Compared to conventional statistics, ML employs mathematical algorithms that can analyze many variables and uncover patterns that are not accessible through these statistical techniques [19,20]. The eXtreme gradient boosting (XGB) method has been proposed as the algorithm for the development of the model. This algorithm has been selected for its characteristics in terms of execution speed, scalability, and the utilization of regularization techniques [21]. This method has already been utilized in other medical fields, including hepatology. Through the application of this algorithm, the aim is to develop a predictive model to assess the utility of AFP as a prognostic factor for mortality in the diagnosis of HCC.

2. Results

In the retrospective cohort obtained from the coding records of two hospital centers in Castilla-La Mancha (Cuenca and Guadalajara), a total of 208 patients diagnosed with HCC, both through histological and radiological studies, were identified between the years 2008 and 2022.
Figure 1 depicts the importance of the variables in constructing the predictive model using ML methods. The etiology of HCC was the most crucial variable, followed by the BCLC classification, which proved superior to TNM. Alcohol consumption was the etiological factor associated with a worse prognosis, emerging as an independent predictive factor for mortality in the study. The Eastern Cooperative Oncology Group (ECOG) general status scale and the Child–Pugh scale, all included in the BCLC classification, also emerged as independent predictive factors for mortality. Other prognostic factors included levels of aspartate aminotransferase (AST), albumin, and the presence of ascites, encompassed in hepatic functional reserve classifications such as Child–Pugh and MELD. However, AFP turned out to be a less significant variable, highlighting the lack of correlation between its isolated elevated levels and the prognosis of these patients.
Table 1 and Table 2 present the results of the different ML methods used: Support vector machine (SVM), Bayesian linear discriminant analysis (BLDA), decision tree (DT), Gaussian naïve Bayes (GNB), K-nearest neighbors (KNN), and the proposed XGB system. As observed, GNB achieved the lowest accuracy, barely surpassing 80%; BLDA and DT obtained slightly higher values, though not reaching 85%; and SVM showed higher accuracy with values exceeding 86%. The proposed XGB system achieved accuracy values surpassing 95%, representing a difference of over 6% compared to the second-ranking KNN method. This translates to a significant improvement in prediction compared to the other proposed algorithms. As seen in Table 1 and Table 2, the same trend occurs when analyzing precision, recall, and F1 score for the different proposed methods. XGB obtained higher values compared to other algorithms, indicating better classification of the study variables.
To assess the performance of the proposed XGB method, other commonly used parameters in the scientific literature were employed. These included area under the curve (AUC), kappa index, Matthews correlation coefficient (MCC), and degenerate Youden index (DYI). For this analysis, MCC serves as the best parameter to discern whether the prediction has been accurately made across the four categories of the confusion matrix (true positives, false positives, true negatives, and false negatives). The results in the four categories of the matrix are proportional to the size of positive and negative elements in the dataset. As can be observed in Table 1 and Table 2, the proposed XGB method achieved a value of 84.46%, clearly superior to the values obtained by the other algorithms. The second-ranking algorithm in classification is KNN, with a value of 79.28%, followed by SVM with 76.95%. Regarding the kappa index, XGB obtained a value of 84.74%, surpassing the values of KNN and SVM by 5.2% and 7.53%, respectively. The same trend is observed when analyzing AUC and DYI, where XGB achieved the highest values, indicating a better prediction of prognostic factors at the diagnosis of HCC.
On the other hand, Figure 2 represents the receiver operating characteristic (ROC) curve comparing the XGB system with the other algorithms used. The curve is plotted based on sensitivity and specificity for each threshold value. As can be seen in Figure 2, the XGB method obtains a larger area under the curve, indicating it as the best algorithm for the study’s objective. The various AUC values can be referred to in Table 1. XGB achieves an AUC value of 0.95, followed by KNN with a value of 0.89.
To synthesize all the parameters analyzed across different algorithms, a radar plot has been compiled. This representation includes all metrics and displays them as a circle of the entire grid size in Figure 3. The larger the area of the circle, the better the predictive method. The performances of various ML methods validated in the scientific community were compared. The proposed XGB system was able to classify patients in line with the study’s purpose with high precision, proving to be a balanced method. The similarity obtained between the training and validation phases of the test explains the absence of overfitting in this method, making it highly generalizable. Furthermore, XGB is characterized by automatically classifying patients, making it a valuable tool in clinical practice. As shown in Figure 3, the GNB algorithm yielded the worst results for all parameters.

3. Discussion

Up to one-third of patients with cirrhosis will develop HCC during their lifetime, with an annual incidence rate ranging from 1 to 7%, as reported in long-term follow-up studies [7]. Chronic infection with HBV and HCV is responsible for more than 50% of diagnosed cases worldwide. Patients with chronic HBV infection are at risk of developing HCC, even in the absence of cirrhosis [5]. Universal vaccination of newborns against HBV and the development of antiviral treatments for HCV contribute to a decrease in the risk of developing HCC [22,23]. Other factors associated with the development of these tumors include hemochromatosis, Wilson’s disease, primary biliary cirrhosis (PBC), autoimmune hepatitis (AIH), alpha-1 antitrypsin deficiency, and environmental aflatoxins [2,24]. This tumor typically appears around the sixth decade of life and has 2 to 3 times higher incidence and mortality rates in men [12]. Spain is considered a region with an intermediate incidence of primary liver cancer, with approximately 4.8–6 cases per 100,000 inhabitants per year. In the conducted study, the cumulative incidence was 3 cases of HCC per 100,000 inhabitants per year for a population of close to 462,000 residents across the two hospital centers. Considering that HCC is the most common primary liver tumor, following intrahepatic cholangiocarcinoma and mixed differentiation hepatic tumors, in our analyzed geographical area, the incidence of HCC was somewhat lower compared to the rest of the country [7,12]. The difference can be explained by the management of this tumor in each hospital. There are cases diagnosed in other medical services for which the necessary data were not available for this study. Its diagnosis is often delayed due to the absence of early symptoms and the presence of very nonspecific symptoms related to chronic liver disease [22,25]. Although there are continuous advances in imaging techniques that have modified diagnostic criteria in cirrhotic patients and new therapeutic options are being developed, the fact that these patients often start with poor functional liver reserve limits the possibility of receiving curative treatment [26,27]. Since these tumors exhibit exclusively arterial vascularization, unlike the hepatic parenchyma, which has a mixed vascular supply (portal and arterial), typical radiological images of their behavior can be obtained through dynamic imaging tests such as computed tomography (CT) or magnetic resonance imaging (MRI), as can be observed in Figure 4 [7]. This characteristic image is a result of histological changes secondary to the presence of hepatic cirrhosis. The fibrous and inflammatory tissue that replaces the normal architecture of the liver in these patients hinders the flow of blood through the portal vein. Increased vascular resistance promotes the development of portal hypertension, contributing to the creation of a hypoxic environment. In order to survive this unfavorable environment, the formation of new blood vessels takes place, enhancing the arrival of blood from the hepatic artery [28,29]. Due to the occurrence of a neoangiogenic process during tumor development, replacing venous vascularization with a purely arterial one, imaging techniques have been developed to enable diagnosis in cirrhotic livers without the need for a liver biopsy. However, histological confirmation is necessary in non-cirrhotic patients or those with liver cirrhosis who do not present a typical radiological pattern according to LI-RADS criteria in dynamic imaging tests [30]. The enormous heterogeneity in this type of tumor makes it relevant to have other prognostic factors that can improve the survival of these patients [17,31].
AFP is a glycoprotein produced in the yolk sac, fetal liver, and gastrointestinal tract during gestation. The AFP gene is located on chromosome 4 in the region 4q11-q13 [32]. It is a 69 to 70 kDa protein that belongs to the albuminoid gene family, along with albumin, vitamin D-binding protein, and alpha-albumin [33]. The concentration of this protein in fetal serum increases until the second trimester of pregnancy, reaching peaks of 3 mg/mL. Its levels in adults are extremely low compared to albumin synthesis [34,35]. Elevated levels of AFP in adults can be found in HCC and other tumor diseases (germ cell tumors, cholangiocarcinoma, and gastric adenocarcinoma). They can also be elevated in benign liver diseases and in processes of liver regeneration (viral hepatitis or drug-induced hepatitis, and cirrhosis) [36,37].
Although AFP continues to be the most widely used serum biomarker in the diagnosis of patients with HCC, its role remains controversial [38]. There are different recommendations in various international clinical practice guidelines due to their low sensitivity and specificity and the lack of established cutoff values [39,40]. American and European clinical practice guidelines do not recommend its determination as a useful screening tool because up to 80% of small-sized HCCs (<2 cm) do not show elevated values [9,12]. However, Asian clinical guidelines and some recent meta-analyses, such as the one conducted by Colli et al., suggest its determination in screening programs for these patients, combined with abdominal ultrasound every 6 months [26,41]. Different AFP levels have been described in relation to the etiology of HCC and the histological subtype, making their determination in screening programs especially useful in countries with a high incidence of HCC [42]. The recent study led by Oh et al. demonstrated the clinical significance of AFP determination in HCC screening in an endemic area. According to this study, frequent AFP determination was independently associated with an overall increase in patient survival, facilitating early-stage detection and the likelihood of receiving curative treatments upon diagnosis. Among the various etiologies of HCC, patients with HBV infection obtained greater benefits in relation to an increased frequency of AFP determinations [43].
Different studies that have analyzed AFP levels as a prognostic marker after receiving treatment for HCC have shown variable results. The determination of AFP levels is not usually included in most prognostic and therapeutic algorithms for HCC, except for those patients eligible for liver transplantation. Some studies, such as the one conducted by Dominguez et al. [44], have indicated that patients with elevated AFP levels have a higher risk of recurrence after liver transplantation. Thus, levels >1000 ng/mL have been considered exclusion criteria for liver transplantation in large hospital centers [18]. In line with the previous study, the research led by Baj et al. establishes that elevated AFP levels prior to surgical resection are associated with a worse prognosis after surgery and a higher risk of recurrence [44,45]. In the meta-analysis carried out by He et al., AFP levels were assessed in patients diagnosed with HCC after receiving treatment. Despite a significant disparity in treatment response, AFP levels emerge as a promising non-invasive prognostic marker in this type of tumor, particularly in those who underwent curative-intent treatment. Consequently, the decline in AFP levels after liver transplantation or surgical resection was associated with an increase in overall survival, extended progression-free survival, and recurrence-free survival in patients with HCC [46]. However, other studies, such as the one conducted by Schlosser et al., do not indicate a strong correlation between AFP levels and the prognosis of the disease. They suggest the implementation of a combination of different biomarkers to improve the treatment of these patients [47]. Moreover, according to the clinical trial by Zhu et al., an improvement in overall survival has been demonstrated in patients with advanced disease who had AFP levels exceeding 400 ng/mL and showed no response to sorafenib. These patients were treated with ramucirumab as a second-line drug [48].
In the conducted study, the etiology of HCC was the most important variable in predicting mortality at the time of diagnosis, followed by the BCLC classification, which proved superior to TNM. The BCLC classification, widely used in our context, includes the degree of hepatic functional reserve through the Child–Pugh scale, in addition to the tumor’s own characteristics as in the TNM. Alcohol consumption was the etiological factor associated with a worse prognosis. This cause was not only isolated but also worsened the prognosis when associated with other causes of HCC, such as chronic hepatitis C infection. This fact may be because alcohol is one of the most associated etiological factors with the development of liver cirrhosis. Also, closely monitoring these patients is challenging, making early detection of HCC more complex [49]. However, elevated levels of AFP were not associated with lower survival in these patients. Therefore, despite being one of the most commonly used serological biomarkers to date, its isolated determination was not related to the prognosis of these tumors. AFP has different isoforms according to the composition of sugars during the enzymatic glycosylation process [34,50]. Three different isoforms of AFP with varying affinities for lectin binding, such as Lens culinaris agglutinin (LCA), have been identified. These isoforms are known as AFP-L1, AFP-L2, and AFP-L3 [32,50]. AFP-L3 binds more strongly to LCA and is the predominant isoform in patients with HCC, especially in those with small tumors (<3 cm) [32,51]. Its determination could be very useful in the early diagnosis and prognosis of HCC. It has already been employed in several studies, including one by Ido et al. It involves an automated immunoassay by electrophoresis, demonstrating that it is a biomarker capable of increasing sensitivity and specificity, especially in patients with serum AFP values below 20 ng/mL [52,53].
In line with the study conducted by Schlosser et al. [47], according to research by Cagnin et al., the combination of different variables such as gender, age, AFP-L3 levels, AFP, and des-carboxyprothrombin (DCP) grouped under the term GALAD score could be useful in detecting these tumors at earlier stages, proving to be a promising prognostic tool [54]. The conduct of further studies to enhance our understanding of prognostic factors in HCC at the time of diagnosis would be advisable. The development and implementation of new prognostic biomarkers could prove beneficial in clinical practice, aiming to improve survival and enable personalized management for these patients.

4. Materials and Methods

4.1. Study Design and Population

A multicenter retrospective cohort study was conducted at the Virgen de la Luz Hospital in Cuenca and the University Hospital of Guadalajara. All patients diagnosed with HCC from 2008 to 2022 were included in the study, totaling 208 cases. Inclusion criteria encompassed patients aged 18 and above diagnosed with HCC through either histological examination or imaging techniques. Exclusion criteria applied to patients with a previous diagnosis from another facility without knowledge of prognostic variables at the initial diagnosis. The study received approval from the Ethics Committee of the University Hospital of Guadalajara, and obtaining informed consent was deemed unnecessary.

4.2. Study Data

The study included variables generally associated with the progression of HCC. Demographic variables encompassed gender and age at the time of HCC diagnosis. Age was defined as the difference between the diagnosis date and the date of birth. The censoring date for each patient in our study corresponded to the date of death for deceased patients and the date of the last medical visit for those who remained alive. Variables related to toxic habits acquired by patients were analyzed. Among these, alcohol consumption was recorded, with harmful consumption defined as >30 g/day in males and >20 g/day in females [55]; smoking status was categorized as being a smoker or former smoker compared to those who had never smoked. Variables related to metabolic syndrome included type 2 diabetes mellitus, defined according to the medical history by fasting glucose ≥ 126 mg/dL and/or glucose tolerance test > 200 mg/dL 2 h after glucose overload [56]; the presence of dyslipidemia was determined based on medical history and/or the use of lipid-lowering medications [57]; body mass index (BMI), calculated using the formula weight (kg)/height2 (m2), was used to define obesity (BMI ≥ 30 kg/m2) [58].
The patient’s health status was defined according to the ECOG general status scale [59]. The presence of cirrhosis was defined based on clinical and radiological criteria [60]; the diagnosis of HCC was achieved through invasive or radiological methods in cirrhotic livers with typical behavior, distinguishing between patients included in HCC screening programs with semi-annual ultrasound and those not undergoing close surveillance. Different etiologies related to the development of these tumors were considered, such as alcohol, HCV, HBV, MASLD, hemochromatosis, autoimmune hepatitis, primary biliary cirrhosis, Wilson’s disease, porphyrias, aflatoxins, and alpha-1 antitrypsin deficiency. According to the degree of functional hepatic reserve, some of the most representative variables were examined, such as the Child–Pugh classification, MELD. The presence of clinically relevant portal hypertension was defined by a hepatic venous pressure gradient greater than 10 mmHg, the presence of esophagogastric varices, or the presence of ascites [61]. Regarding the tumor’s own characteristics, the number of space-occupying lesions (SOL), the size of the largest SOL in cm, and the presence of portal thrombosis, pathological lymph nodes, or metastases at the time of diagnosis were recorded. Two of the most widely used prognostic and therapeutic classifications, namely BCLC and TNM, were also collected [62].
The analytical values included bilirubin (mg/dL), albumin (g/dL), INR, Na (mEq/L), lymphocytes (cells/mm3), neutrophils (cells/mm3), platelets (cells/mm3), CRP (mg/L), AFP (ng/mL), creatinine (mg/dL), AST (U/L), and alanine aminotransferase (ALT) (U/L).

4.3. Development Model

For the statistical analysis, the variables were collected in an anonymized database. The analysis focused on prognostic factors for HCC at the time of diagnosis using machine learning (ML) methods.
XGB is a predictive algorithm characterized by its utilization of boosting techniques within a supervised learning framework. Boosting involves the sequential generation of multiple “weak” prediction models, where each subsequent model leverages the results of the preceding one to create a more “robust” model with enhanced predictive power and result stability. The optimization algorithm used, specifically gradient descent, contributes to refining the model’s strength. Throughout the training process, the parameters of each weak model are iteratively adjusted in an attempt to minimize an objective function [63,64]. When presented with a dataset set (xi, yi), the XGB algorithm was formulated as:
y i ^ = p = 1 P t p x i
In this context, xi denotes the input featuring m time variables, yi signifies the output, y i ^ denotes the predicted output, tp represents a tree characterized by leaf weight wp and structure up, where i ranges from 1 to n, and P corresponds to the total number of trees.
Equation (2) introduces the regularized objective function for the proposed method, showcasing a deviation from traditional ensemble methods. In this case, the suggested approach leverages a second-order Taylor expansion to approximate the target function of XGB, ultimately elevating the precision of prediction [63,64].
R = i r y i ^ , y i + p Φ t p
Φ t p = λ f p + 1 2 γ ω p 2
To control the method’s complexity and prevent overfitting, a regulatory term, denoted by weights, serves as a monitoring mechanism. Described in Equation (3), fp signifies the tree trimming utilized for overfitting control, representing the number of leaves in the tree; λ denotes the learning rate; and w is the vector of scores assigned to the leaves. The function R() assesses the disparity between the target output yi and the predicted output y i ^ . The function Φ punishes the complexity of the system. The parameter γ is employed to regulate the complexity weight of the system [63,64]. In pursuit of enhanced performance, the objective of this work is to minimize Equation (2).
In the machine learning system learning process, it is necessary to control overfitting. In our case, the k-fold cross-validation technique was employed for this purpose. As can be seen in Figure 5, each iteration involves the random classification of 70% of patients for training and 30% for validation. Specifically, patient data are not shared between the training and validation subsets to prevent the algorithm from being validated with data from the same patients used in the training phase. In this study, bootstrapped resampling techniques have been applied. In this approach, a subset of the available labeled data is randomly sampled with replacement, creating a new training set. By generating multiple bootstrapped training sets, a machine learning model can be trained on each set, thus creating multiple models. These models are then combined to make predictions. The bootstrapping process introduces randomness and diversity in the training sets, allowing the models to capture different aspects of the data and reduce overfitting [65]. We have also used the data augmentation technique. This technique is widely used in machine learning to increase the amount of training data. This helps to improve model generalization and avoid overfitting [66].
To enhance the performance of the machine learning algorithms, various hyperparameters of each method were fine-tuned during the training phase. Bayesian techniques were employed in this study to determine hyperparameter values. Bayesian optimization is a type of optimization algorithm based on sequential models, utilizing the results of previous interactions to refine parameter tests in subsequent experiments. This approach reduces the number of times a model needs to be tested for validation, focusing only on hyperparameters expected to yield superior validation scores. The optimization method significantly improved the performance of the developed models.
The proposed XGB algorithm was chosen to develop the predictive model due to its scalability, high execution speed, and support for parallel computing, which are its main advantages over other machine learning methods. XGB also allows second-order regularization, aiding in preventing a common machine learning issue, overfitting, by enhancing model generalization. Therefore, the XGB algorithm exhibits high accuracy and proves to be more efficient than other algorithms in data analysis through machine learning [21,67]. Machine Learning Toolbox and MATLAB Statistics (The MathWorks, Natick, MA, USA; MATLAB 2023) were used to design the models. The proposed XGB method was compared with other ML algorithms such as SVM [68], DT [69], GNB [70], KNN [71], and BLDA [72].
The most prominent hyperparameters of the implemented systems are as follows. For the SVM method, a Gaussian kernel function is chosen with the following parameters: C = 1, sigma = 0.5, numerical tolerance = 0.001, and iteration limit = 100. For the DT system, the base parameter estimator is adjusted: Tree, maximum number of splits = 20, learning rate = 0.1, and number of learners = 40. GNB algorithm: usekernel: False, fL = 0 and Adjust = 0. As for the BLDA algorithm, the Bayesian kernel has been selected. For the KNN method, the distance metric is Euclidean, and it uses 20 neighbors. Finally, for the XGB system, the hyperparameters eta = 0.2, minimum chil weight = 1, gamma = 0.3, alpha = 0.5, maximum depth = 9, lambda = 0.3, col sample by tree = 0.5, and maximum delta step = 5 have been adjusted.
The preference for the proposed XGB over other alternative machine learning algorithms is based on its notable advantages, positioning it as a superior choice in terms of robustness, accuracy, and versatility [73].
Compared to SVM, XGB showcases a distinctive ability to handle intricate and high-dimensional datasets while maintaining computational efficiency. Its ensemble approach inherently introduces diversity, reducing the risk of overfitting and producing more generalized and predictive models, particularly in situations with heightened problem complexity.
In contrast to GNB, XGB excels at effectively managing irrelevant or noisy features. The integration of multiple independent decision trees allows the model to dis-miss less informative variables, significantly improving robustness and predictive efficacy.
Unlike KNN, which may be sensitive to noisy data, XGB demonstrates inherent resilience to dataset noise and variability. By constructing models based on multiple trees, the impact of outliers or errors is mitigated, ensuring greater reliability in decision making.
To sum up, the preference for XGB is substantiated by its ability to generate robust and accurate predictive models, particularly in complex environments and large datasets. Its resistance to overfitting, capability to handle irrelevant features, and versatility relative to other algorithms make it a favored choice, ensuring more dependable results and enhancing the model’s generalization capabilities.

5. Conclusions

In conclusion, the currently widely used AFP isoform lacks utility as a prognostic factor for mortality at the diagnosis of HCC. Other variables, such as the presence of alcohol as a cause of HCC or the BCLC score, are more useful and provide more information.
The proposed XGB method has successfully developed a valuable diagnostic tool for predicting mortality in HCC patients. Through this model, the primary predictive factors influencing the objective of this study have been identified. The XGB algorithm yielded the best results for the analyzed metrics, exhibiting no overfitting or excessive tuning. This system has demonstrated a high model generalization capacity, rendering it a valuable tool in daily clinical practice.
Further studies involving additional isoforms of AFP, alongside exploration of other biomarkers, are necessary to more accurately predict mortality in these patients. This approach will also facilitate the optimization of patient management and aid in determining the most effective treatments for this population. This will also facilitate optimizing their management and determining the best treatments for these patients. Utilizing ML algorithms, particularly XGB, can be highly beneficial in assessing the utility of these new parameters.

Author Contributions

Conceptualization, M.S., S.G.-R., P.M.-B., A.M.T., N.M.-G., M.T. and J.M.; methodology, S.G.-R., M.S., A.M.T., M.T. and J.M.; software, A.M.T. and J.M.; validation, A.M.T. and J.M.; formal analysis, A.M.T. and J.M.; investigation, S.G.-R., M.S., P.M.-B., N.M.-G. and M.T.; resources, S.G.-R., M.S., P.M.-B., A.M.T., N.M.-G., M.T. and J.M.; data curation, S.G.-R., M.S., P.M.-B., A.M.T., N.M.-G., M.T. and J.M.; writing—original draft preparation, S.G.-R. and J.M.; writing—review and editing, S.G.-R., M.S., P.M.-B., A.M.T., N.M.-G., P.B., M.T. and J.M.; visualization, S.G.-R., M.S., P.M.-B., A.M.T., N.M.-G., P.B., M.T. and J.M.; supervision, M.T. and J.M.; project administration, S.G.-R., M.S., M.T. and J.M.; funding acquisition, P.B. and J.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Fundación Investigación Hospital General Universitario de Valencia and University of Castilla-La Mancha (Spain).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of University Hospital of Guadalajara.

Informed Consent Statement

Patient consent was waived due to the number of patients, study design (retrospective), absence of medical prescription, and the number of deceased patients.

Data Availability Statement

The datasets used and/or analyzed during the present study are available from the corresponding author on reasonable request.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Vogel, A.; Meyer, T.; Sapisochin, G.; Salem, R.; Saborowski, A. Hepatocellular carcinoma. Lancet 2022, 400, 1345–1362. [Google Scholar] [CrossRef]
  2. McGlynn, K.A.; Petrick, J.L.; El-Serag, H.B. Epidemiology of Hepatocellular Carcinoma. Hepatology 2021, 73 (Suppl. 1), 4–13. [Google Scholar] [CrossRef] [PubMed]
  3. Siegel, R.L.; Miller, K.D.; Wagle, N.S.; Jemal, A. Cancer statistics, 2023. CA A Cancer J. Clin. 2023, 73, 17–48. [Google Scholar] [CrossRef] [PubMed]
  4. Cronin, K.A.; Scott, S.; Firth, A.U.; Sung, H.; Henley, S.J.; Sherman, R.L.; Siegel, R.L.; Anderson, R.N.; Kohler, B.A.; Benard, V.B.; et al. Annual report to the nation on the status of cancer, part 1: National cancer statistics. Cancer 2022, 128, 4251–4284. [Google Scholar] [CrossRef] [PubMed]
  5. Tan, D.J.H.; Ng, C.H.; Lin, S.Y.; Pan, X.H.; Tay, P.; Lim, W.H.; Teng, M.; Syn, N.; Lim, G.; Yong, J.N.; et al. Clinical characteristics, surveillance, treatment allocation, and outcomes of non-alcoholic fatty liver disease-related hepatocellular carcinoma: A systematic review and meta-analysis. Lancet Oncol. 2022, 23, 521–530. [Google Scholar] [CrossRef] [PubMed]
  6. Konyn, P.; Ahmed, A.; Kim, D. Current epidemiology in hepatocellular carcinoma. Expert Rev. Gastroenterol. Hepatol. 2021, 15, 1295–1307. [Google Scholar] [CrossRef]
  7. Reig, M.; Forner, A.; Ávila, M.A.; Ayuso, C.; Mínguez, B.; Varela, M.; Bilbao, I.; Bilbao, J.I.; Burrel, M.; Bustamante, J.; et al. Diagnosis and treatment of hepatocellular carcinoma. Update of the consensus document of the AEEH, AEC, SEOM, SERAM, SERVEI, and SETH. Med. Clín. (Engl. Ed.) 2021, 156, 463.e1–463.e30. [Google Scholar] [CrossRef]
  8. Schütte, K.; Tippelt, B.; Schulz, C.; Röhl, F.-W.; Feneberg, A.; Seidensticker, R.; Arend, J.; Malfertheiner, P. Malnutrition is a prognostic factor in patients with hepatocellular carcinoma (HCC). Clin. Nutr. 2014, 34, 1122–1127. [Google Scholar] [CrossRef]
  9. Singal, A.G.; Llovet, J.M.; Yarchoan, M.; Mehta, N.; Heimbach, J.K.; Dawson, L.A.; Jou, J.H.; Kulik, L.M.; Agopian, V.G.; Marrero, J.A.; et al. AASLD practice guidance on prevention, diagnosis, and treatment of hepatocellular carcinoma. Hepatology 2023, 78, 1922–1965. [Google Scholar] [CrossRef]
  10. Bruix, J.; Chan, S.L.; Galle, P.R.; Rimassa, L.; Sangro, B. Systemic treatment of hepatocellular carcinoma: An EASL position paper. J. Hepatol. 2021, 75, 960–974. [Google Scholar] [CrossRef]
  11. Reig, M.; Forner, A.; Rimola, J.; Ferrer-Fàbrega, J.; Burrel, M.; Garcia-Criado, Á.; Kelley, R.K.; Galle, P.R.; Mazzaferro, V.; Salem, R.; et al. BCLC strategy for prognosis prediction and treatment recommendation: The 2022 update. J. Hepatol. 2021, 76, 681–693. [Google Scholar] [CrossRef]
  12. European Association for the Study of the Liver. EASL Clinical Practice Guidelines: Management of hepatocellular carcinoma. J. Hepatol. 2018, 69, 182–236. [Google Scholar] [CrossRef]
  13. Tandon, P.; Garcia-Tsao, G. Prognostic Indicators in Hepatocellular Carcinoma: A Systematic Review of 72 Studies. Liver Int. 2009, 29, 502–510. Available online: https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1478-3231.2008.01957.x (accessed on 7 January 2024). [CrossRef]
  14. Hu, X.; Bao, M.; Huang, J.; Zhou, L.; Zheng, S. Identification and Validation of Novel Biomarkers for Diagnosis and Prognosis of Hepatocellular Carcinoma. Front. Oncol. 2020, 10, 541479. Available online: https://www.frontiersin.org/articles/10.3389/fonc.2020.541479 (accessed on 7 January 2024). [CrossRef]
  15. de Lima, L.T.F.; Broszczak, D.; Zhang, X.; Bridle, K.; Crawford, D.; Punyadeera, C. The use of minimally invasive biomarkers for the diagnosis and prognosis of hepatocellular carcinoma. Biochim. Biophys. Acta Rev. Cancer 2020, 1874, 188451. [Google Scholar] [CrossRef]
  16. Bai, D.-S.; Zhang, C.; Chen, P.; Jin, S.-J.; Jiang, G.-Q. The prognostic correlation of AFP level at diagnosis with pathological grade, progression, and survival of patients with hepatocellular carcinoma. Sci. Rep. 2017, 7, 12870. [Google Scholar] [CrossRef]
  17. Piñero, F.; Dirchwolf, M.; Pessôa, M.G. Biomarkers in Hepatocellular Carcinoma: Diagnosis, Prognosis and Treatment Response Assessment. Cells 2020, 9, 1370. [Google Scholar] [CrossRef]
  18. Piñero, F.; Chagas, A.; Boin, e.I. Latinoamérica: En busca del mejor modelo predictivo de recurrencia del hepatocarcinoma después del trasplante. Clin. Liver Dis. 2019, 13 (Suppl. 1), S12–S16. [Google Scholar] [CrossRef] [PubMed]
  19. Mirbabaie, M.; Stieglitz, S.; Frick, N.R.J. Artificial intelligence in disease diagnostics: A critical review and classification on the current state of research guiding future direction. Heal. Technol. 2021, 11, 693–731. [Google Scholar] [CrossRef]
  20. Pedrero, V.; Reynaldos-Grandón, K.; Ureta-Achurra, J.; Cortez-Pinto, E. Generalidades del Machine Learning y su aplicación en la gestión sanitaria en Servicios de Urgencia. Rev. Méd. Chile 2021, 149, 248–254. [Google Scholar] [CrossRef] [PubMed]
  21. Suárez, M.; Martínez, R.; Torres, A.M.; Ramón, A.; Blasco, P.; Mateo, J. A Machine Learning-Based Method for Detecting Liver Fibrosis. Diagnostics 2023, 13, 2952. [Google Scholar] [CrossRef] [PubMed]
  22. Yang, J.D.; Hainaut, P.; Gores, G.J.; Amadou, A.; Plymoth, A.; Roberts, L.R. A global view of hepatocellular carcinoma: Trends, risk, prevention and management. Nat. Rev. Gastroenterol. Hepatol. 2019, 16, 589–604. [Google Scholar] [CrossRef]
  23. Stroffolini, T.; Stroffolini, G. A Historical Overview on the Role of Hepatitis B and C Viruses as Aetiological Factors for Hepatocellular Carcinoma. Cancers 2023, 15, 2388. [Google Scholar] [CrossRef]
  24. Zhang, C.; Cheng, Y.; Zhang, S.; Fan, J.; Gao, Q. Changing epidemiology of hepatocellular carcinoma in Asia. Liver Int. 2022, 42, 2029–2041. [Google Scholar] [CrossRef]
  25. Petrick, J.L.; Florio, A.A.; Znaor, A.; Ruggieri, D.; Laversanne, M.; Alvarez, C.S.; Ferlay, J.; Valery, P.C.; Bray, F.; McGlynn, K.A. International trends in hepatocellular carcinoma incidence, 1978–2012. Int. J. Cancer 2019, 147, 317–330. [Google Scholar] [CrossRef]
  26. Renne, S.L.; Sarcognato, S.; Sacchi, D.; Guido, M.; Roncalli, M.; Terracciano, L.; Di Tommaso, L. Hepatocellular carcinoma: A clinical and pathological overview. Pathologica 2021, 113, 203–217. [Google Scholar] [CrossRef]
  27. Wen, N.; Cai, Y.; Li, F.; Ye, H.; Tang, W.; Song, P.; Cheng, N. The clinical management of hepatocellular carcinoma worldwide: A concise review and comparison of current guidelines: 2022 update. Biosci. Trends 2022, 16, 20–30. [Google Scholar] [CrossRef] [PubMed]
  28. Li, H. Angiogenesis in the progression from liver fibrosis to cirrhosis and hepatocelluar carcinoma. Expert Rev. Gastroenterol. Hepatol. 2020, 15, 217–233. [Google Scholar] [CrossRef] [PubMed]
  29. Yao, C.; Wu, S.; Kong, J.; Sun, Y.; Bai, Y.; Zhu, R.; Li, Z.; Sun, W.; Zheng, L. Angiogenesis in hepatocellular carcinoma: Mechanisms and anti-angiogenic therapies. Cancer Biol. Med. 2023, 20, 25–43. [Google Scholar] [CrossRef]
  30. Lee, Y.; Wang, J.J.; Zhu, Y.; Agopian, V.G.; Tseng, H.; Yang, J.D. Diagnostic Criteria and LI-RADS for Hepatocellular Carcinoma. Clin. Liver Dis. 2021, 17, 409–413. [Google Scholar] [CrossRef]
  31. Ganesan, P.; Kulik, L.M. Hepatocellular Carcinoma: New Developments. Clin. Liver Dis. 2023, 27, 85–102. [Google Scholar] [CrossRef]
  32. Hu, X.; Chen, R.; Wei, Q.; Xu, X. The Landscape Of Alpha Fetoprotein In Hepatocellular Carcinoma: Where Are We? Int. J. Biol. Sci. 2022, 18, 536–551. [Google Scholar] [CrossRef]
  33. Głowska-Ciemny, J.; Szymański, M.; Kuszerska, A.; Malewski, Z.; von Kaisenberg, C.; Kocyłowski, R. The Role of Alpha-Fetoprotein (AFP) in Contemporary Oncology: The Path from a Diagnostic Biomarker to an Anticancer Drug. Int. J. Mol. Sci. 2023, 24, 2539. [Google Scholar] [CrossRef]
  34. Jearth, V.; Patil, P.S.; Mehta, S.; Sundaram, S.; Seth, V.; Goel, M.; Patkar, S.; Bal, M.; Rao, V. Correlation of Clinicopathological Profile, Prognostic Factors, and Survival Outcomes with Baseline Alfa-Fetoprotein Levels in Patients with Hepatocellular Carcinoma: A Biomarker that is Bruised but Not Broken. J. Clin. Exp. Hepatol. 2022, 12, 841–852. [Google Scholar] [CrossRef] [PubMed]
  35. Villarreal-Barranca, A.; Torres-Herrera, U.; Campos-Zamora, M.; Moreno-Verduzco, E.; Espino-Sosa, S.; Reyes-Muñoz, E.; Morales-Montiel, T.M.; Morales-Palomares, M.A. Embarazo posterior a tratamiento conservador de teratoma inmaduro de ovario y comportamiento de los niveles de alfa-fetoproteína. Perinatol. Reprod. Humana 2019, 33, 80–83. [Google Scholar] [CrossRef]
  36. Ocaña, E.R.P.; Vásquez, D.D.R.H.; Anchundia, L.B.R. Tumores malignos de células germinales del ovario. Estudio de caso en paciente adulta. Dilemas Contemp. Educ. Política Valores 2023, 10, 3561. [Google Scholar] [CrossRef]
  37. Manuc, D.; Preda, C.M.; Sandra, I.; Baicus, C.; Cerban, R.; Constantinescu, I.; Olteanu, A.O.; Ciora, C.A.; Manuc, T.; Chiriac, D.E.; et al. Signification of Serum Alpha-Fetoprotein Levels in Cases of Compensated Cirrhosis and Hepatitis C Virus without Hepatocellular Carcinoma. J. Med. Life 2020, 13, 68–74. [Google Scholar] [CrossRef] [PubMed]
  38. Singal, A.G.; Hoshida, Y.; Pinato, D.J.; Marrero, J.; Nault, J.-C.; Paradis, V.; Tayob, N.; Sherman, M.; Lim, Y.S.; Feng, Z.; et al. International Liver Cancer Association (ILCA) White Paper on Biomarker Development for Hepatocellular Carcinoma. Gastroenterology 2021, 160, 2572–2584. [Google Scholar] [CrossRef] [PubMed]
  39. Lu, C.-Y.; Hsiao, C.-Y.; Peng, P.-J.; Huang, S.-C.; Chuang, M.-R.; Su, H.-J.; Huang, K.-W. DNA Methylation Biomarkers as Prediction Tools for Therapeutic Response and Prognosis in Intermediate-Stage Hepatocellular Carcinoma. Cancers 2023, 15, 4465. [Google Scholar] [CrossRef] [PubMed]
  40. Zhang, J.; Chen, G.; Zhang, P.; Zhang, J.; Li, X.; Gan, D.; Cao, X.; Han, M.; Du, H.; Ye, Y. The threshold of alpha-fetoprotein (AFP) for the diagnosis of hepatocellular carcinoma: A systematic review and meta-analysis. PLoS ONE 2020, 15, e0228857. [Google Scholar] [CrossRef]
  41. Colli, A. Abdominal Ultrasound and Alpha-Foetoprotein for the Diagnosis of Hepatocellular Carcinoma in Adults with Chronic Liver Disease. 2021. Available online: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD013346.pub2/full (accessed on 22 November 2023).
  42. Ridder, D.A.; Weinmann, A.; Schindeldecker, M.; Urbansky, L.L.; Berndt, K.; Gerber, T.S.; Lang, H.; Lotz, J.; Lackner, K.J.; Roth, W.; et al. Comprehensive clinicopathologic study of alpha fetoprotein-expression in a large cohort of patients with hepatocellular carcinoma. Int. J. Cancer 2021, 150, 1053–1066. [Google Scholar] [CrossRef]
  43. Oh, J.H.; Lee, J.; Yoon, E.L.; Jeong, S.W.; Kim, S.S.; Chon, Y.E.; Ahn, S.B.; Jun, D.W. Regular Alpha-Fetoprotein Tests Boost Curative Treatment and Survival for Hepatocellular Carcinoma Patients in an Endemic Area. Cancers 2023, 16, 150. [Google Scholar] [CrossRef]
  44. Dominguez, D.A.; Wong, P.; Melstrom, L.G. Existing and emerging biomarkers in hepatocellular carcinoma: Relevance in staging, determination of minimal residual disease, and monitoring treatment response: A narrative review. Hepatobiliary Surg. Nutr. 2023, 13, 39–55. [Google Scholar] [CrossRef]
  45. Baj, J.; Bryliński, Ł.; Woliński, F.; Granat, M.; Kostelecka, K.; Duda, P.; Flieger, J.; Teresiński, G.; Buszewicz, G.; Furtak-Niczyporuk, M.; et al. Biomarkers and Genetic Markers of Hepatocellular Carcinoma and Cholangiocarcinoma—What Do We Already Know. Cancers 2022, 14, 1493. [Google Scholar] [CrossRef]
  46. He, C.; Peng, W.; Liu, X.; Li, C.; Li, X.; Wen, T.-F. Post-treatment alpha-fetoprotein response predicts prognosis of patients with hepatocellular carcinoma. Medicine 2019, 98, e16557. [Google Scholar] [CrossRef]
  47. Schlosser, S.; Tümen, D.; Volz, B.; Neumeyer, K.; Egler, N.; Kunst, C.; Tews, H.C.; Schmid, S.; Kandulski, A.; Müller, M.; et al. HCC biomarkers—State of the old and outlook to future promising biomarkers and their potential in everyday clinical practice. Front. Oncol. 2022, 12, 1016952. [Google Scholar] [CrossRef]
  48. Zhu, A.X.; Kang, Y.-K.; Yen, C.-J.; Finn, R.S.; Galle, P.R.; Llovet, J.M.; Assenat, E.; Brandi, G.; Pracht, M.; Lim, H.Y.; et al. Ramucirumab after sorafenib in patients with advanced hepatocellular carcinoma and increased α-fetoprotein concentrations (REACH-2): A randomised, double-blind, placebo-controlled, phase 3 trial. Lancet Oncol. 2019, 20, 282–296. [Google Scholar] [CrossRef] [PubMed]
  49. Huang, D.Q.; Mathurin, P.; Cortez-Pinto, H.; Loomba, R. Global epidemiology of alcohol-associated cirrhosis and HCC: Trends, projections and risk factors. Nat. Rev. Gastroenterol. Hepatol. 2022, 20, 37–49. [Google Scholar] [CrossRef] [PubMed]
  50. Zhou, J.-M.; Wang, T.; Zhang, K.-H. AFP-L3 for the diagnosis of early hepatocellular carcinoma. Medicine 2021, 100, e27673. [Google Scholar] [CrossRef] [PubMed]
  51. Parikh, N.D.; Tayob, N.; Singal, A.G. Blood-based biomarkers for hepatocellular carcinoma screening: Approaching the end of the ultrasound era? J. Hepatol. 2023, 78, 207–216. [Google Scholar] [CrossRef] [PubMed]
  52. Ido, A.; Oda, K.; Tamai, T.; Matsushita, M.; Kumagai, K.; Mawatari, S.-I.; Saishoji, A.; Kure, T.; Ohno, K.; Toyokura, E.; et al. Highly sensitive lens culinaris agglutinin-reactive α-fetoprotein is useful for early detection of hepatocellular carcinoma in patients with chronic liver disease. Oncol. Rep. 2011, 26, 1227–1233. [Google Scholar] [CrossRef]
  53. Hu, M.; Xia, X.; Chen, L.; Jin, Y.; Hu, Z.; Xia, S.; Yao, X. Emerging biomolecules for practical theranostics of liver hepatocellular carcinoma. Ann. Hepatol. 2023, 28, 101137. [Google Scholar] [CrossRef]
  54. Cagnin, S.; Donghia, R.; Martini, A.; Pesole, P.L.; Coletta, S.; Shahini, E.; Boninsegna, G.; Biasiolo, A.; Pontisso, P.; Giannelli, G. Galad Score as a Prognostic Marker for Patients with Hepatocellular Carcinoma. Int. J. Mol. Sci. 2023, 24, 16485. [Google Scholar] [CrossRef]
  55. Rinella, M.E.; Neuschwander-Tetri, B.A.; Siddiqui, M.S.; Abdelmalek, M.F.; Caldwell, S.; Barb, D.; Kleiner, D.E.; Loomba, R. AASLD Practice Guidance on the clinical assessment and management of nonalcoholic fatty liver disease. Hepatology 2023, 77, 1797–1835. [Google Scholar] [CrossRef]
  56. American Diabetes Association. Standards of Care in Diabetes—2023 Abridged for Primary Care Providers. Clin. Diabetes 2023, 41, 4–31. [Google Scholar] [CrossRef]
  57. Visseren, F.L.; Mach, F.; Smulders, Y.M.; Carballo, D.; Koskinas, K.C.; Bäck, M.; Benetos, A.; Biffi, A.; Boavida, J.M.; Capodanno, D.; et al. Guía ESC 2021 sobre la prevención de la enfermedad cardiovascular en la práctica clínica. Rev. Esp. Cardiol. 2022, 75, 429.e1–429.e104. [Google Scholar] [CrossRef]
  58. Vaamonde, J.G.; Álvarez-Món, M. Obesidad y sobrepeso. Med. Programa Form. Médica Contin. Acreditado 2020, 13, 767–776. [Google Scholar] [CrossRef]
  59. Higgins, M.I.; Master, V.A. Who really knows the performance status: The physician or the patient? Cancer 2020, 127, 339–341. [Google Scholar] [CrossRef] [PubMed]
  60. Fortea, J.; Carrera, I.G.; Puente, A.; Crespo, J. Cirrosis hepática. Med. Programa Form. Médica Contin. Acreditado 2020, 13, 297–307. [Google Scholar] [CrossRef]
  61. De Franchis, R.; Bosch, J.; Garcia-Tsao, G.; Reiberger, T.; Ripoll, C.; Abraldes, J.G.; Albillos, A.; Baiges, A.; Bajaj, J.; Bañares, R.; et al. Baveno VII—Renewing consensus in portal hypertension. J. Hepatol. 2021, 76, 959–974. [Google Scholar] [CrossRef] [PubMed]
  62. Chen, L.-J.; Chang, Y.-J.; Chang, Y.-J. Survival Predictability Between the American Joint Committee on Cancer 8th Edition Staging System and the Barcelona Clinic Liver Cancer Classification in Patients with Hepatocellular Carcinoma. Oncologist 2020, 26, e445–e453. [Google Scholar] [CrossRef]
  63. Chen, T.; Guestrin, C. XGBoost: A Scalable Tree Boosting System. In Proceedings of the KDD ’16: 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; Association for Computing Machinery: New York, NY, USA, 2016; pp. 785–794. [Google Scholar] [CrossRef]
  64. Mateo, J.; Rius-Peris, J.; Maraña-Pérez, A.; Valiente-Armero, A.; Torres, A. Extreme gradient boosting machine learning method for predicting medical treatment in patients with acute bronchiolitis. Biocybern. Biomed. Eng. 2021, 41, 792–801. [Google Scholar] [CrossRef]
  65. Egbert, J.; Plonsky, L. Bootstrapping Techniques. In A Practical Handbook of Corpus Linguistics; Paquot, M., Gries, S.T., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 593–610. [Google Scholar] [CrossRef]
  66. Maharana, K.; Mondal, S.; Nemade, B. A review: Data pre-processing and data augmentation techniques. Glob. Transit. Proc. 2022, 3, 91–99. [Google Scholar] [CrossRef]
  67. Suárez, M.; Martínez, R.; Torres, A.M.; Torres, B.; Mateo, J. A Machine Learning Method to Identify the Risk Factors for Liver Fibrosis Progression in Nonalcoholic Steatohepatitis. Dig. Dis. Sci. 2023, 68, 3801–3809. [Google Scholar] [CrossRef]
  68. Fu, S.; Yu, X.; Tian, Y. Cost sensitive ν support vector machine with LINEX loss. Inf. Process. Manag. 2021, 59, 102809. [Google Scholar] [CrossRef]
  69. Rivera-Lopez, R.; Canul-Reich, J.; Mezura-Montes, E.; Cruz-Chávez, M.A. Induction of decision trees as classification models through metaheuristics. Swarm Evol. Comput. 2021, 69, 101006. [Google Scholar] [CrossRef]
  70. Shahab, M.; Zheng, G.; Khan, A.; Wei, D.; Novikov, A.S. Machine Learning-Based Virtual Screening and Molecular Simulation Approaches Identified Novel Potential Inhibitors for Cancer Therapy. Biomedicines 2023, 11, 2251. [Google Scholar] [CrossRef] [PubMed]
  71. Wang, Y.; Pan, Z.; Dong, J. A new two-layer nearest neighbor selection method for kNN classifier. Knowl.-Based Syst. 2022, 235, 107604. [Google Scholar] [CrossRef]
  72. Rivera-Lopez, R.; Canul-Reich, J. Construction of Near-Optimal Axis-Parallel Decision Trees Using a Differential-Evolution-Based Approach. IEEE Access 2018, 6, 5548–5563. [Google Scholar] [CrossRef]
  73. Han, J.; Pei, J.; Tong, H. Data Mining: Concepts and Techniques; Morgan Kaufmann: Burlington, MA, USA, 2022. [Google Scholar]
Figure 1. Representation of the weight of each variable within the machine learning predictive model. BCLC: Barcelona Clinic Liver Cancer, ECOG: Eastern Cooperative Oncology Group, TNM: tumor nodes metastases, AST: aspartate aminotransferase, MELD: model for end-stage liver disease.
Figure 1. Representation of the weight of each variable within the machine learning predictive model. BCLC: Barcelona Clinic Liver Cancer, ECOG: Eastern Cooperative Oncology Group, TNM: tumor nodes metastases, AST: aspartate aminotransferase, MELD: model for end-stage liver disease.
Ijms 25 01996 g001
Figure 2. ROC curves for the six machine learning algorithms. ROC: receiver operating characteristic, XGB: eXtreme gradient boosting, KNN: K-nearest neighbors, DT: decision tree, SVM: support vector machine, BLDA: Bayesian linear discriminant analysis, GNB: Gaussian naïve Bayes.
Figure 2. ROC curves for the six machine learning algorithms. ROC: receiver operating characteristic, XGB: eXtreme gradient boosting, KNN: K-nearest neighbors, DT: decision tree, SVM: support vector machine, BLDA: Bayesian linear discriminant analysis, GNB: Gaussian naïve Bayes.
Ijms 25 01996 g002
Figure 3. Radar plot of the training phase (above) and validation (below) to establish the importance of the different prognostic factors in hepatocellular carcinoma within the predictive model. SVM: support vector machine, BLDA: Bayesian linear discriminant analysis, DT: decision tree, GNB: Gaussian naïve Bayes, KNN: K-nearest neighbors, XGB: eXtreme gradient boosting.
Figure 3. Radar plot of the training phase (above) and validation (below) to establish the importance of the different prognostic factors in hepatocellular carcinoma within the predictive model. SVM: support vector machine, BLDA: Bayesian linear discriminant analysis, DT: decision tree, GNB: Gaussian naïve Bayes, KNN: K-nearest neighbors, XGB: eXtreme gradient boosting.
Ijms 25 01996 g003aIjms 25 01996 g003b
Figure 4. Axial image depicting the typical behavior of HCC on contrast-enhanced liver magnetic resonance imaging (MRI). It shows a hyperenhancing subcapsular focal lesion in the arterial phase (left), with isoattenuation and washout in the portal phase (right). The red arrow indicates the lesion in both phases. This is observed in a patient exhibiting signs of chronic liver disease. Additionally, a cyst is evident in segment II of the left hepatic lobe.
Figure 4. Axial image depicting the typical behavior of HCC on contrast-enhanced liver magnetic resonance imaging (MRI). It shows a hyperenhancing subcapsular focal lesion in the arterial phase (left), with isoattenuation and washout in the portal phase (right). The red arrow indicates the lesion in both phases. This is observed in a patient exhibiting signs of chronic liver disease. Additionally, a cyst is evident in segment II of the left hepatic lobe.
Ijms 25 01996 g004
Figure 5. The figure shows the processes followed in this study for the development of machine learning models.
Figure 5. The figure shows the processes followed in this study for the development of machine learning models.
Ijms 25 01996 g005
Table 1. Set of results of the mean values and standard deviations of accuracy, AUC, precision and recall obtain of the different machine learning models and XGB method in the study. SVM: support vector machine, BLDA: Bayesian linear discriminant analysis, DT: decision tree, GNB: Gaussian naïve Bayes, KNN: K-nearest neighbors, XGB: eXtreme gradient boosting, AUC: area under the curve.
Table 1. Set of results of the mean values and standard deviations of accuracy, AUC, precision and recall obtain of the different machine learning models and XGB method in the study. SVM: support vector machine, BLDA: Bayesian linear discriminant analysis, DT: decision tree, GNB: Gaussian naïve Bayes, KNN: K-nearest neighbors, XGB: eXtreme gradient boosting, AUC: area under the curve.
Methods
SVMBLDADTGNBKNNXGB
Accuracy86.72 ± 0.8482.03 ± 0.9384.65 ± 0.8180.52 ± 0.9589.34 ± 0.5795.68 ± 0.36
AUC0.87 ± 0.020.82 ± 0.020.85 ± 0.020.81 ± 0.020.89 ± 0.010.95 ± 0.01
Precision86.10 ± 0.8281.45 ± 0.8984.05 ± 0.7979.94 ± 0.9388.71 ± 0.5594.97 ± 0.33
Recall86.82 ± 0.7982.13 ± 0.8784.75 ± 0.7780.61 ± 0.9189.45 ± 0.5495.70 ± 0.32
Table 2. Set of results of the mean values and standard deviations of F1 score, kappa, DYI and MCC obtain of the different machine learning models and XGB method in the study. SVM: support vector machine, BLDA: Bayesian linear discriminant analysis, DT: decision tree, GNB: Gaussian naïve Bayes, KNN: K-nearest neighbors, XGB: eXtreme gradient boosting, MCC: Matthews correlation coefficient, DYI: degenerated Youden index.
Table 2. Set of results of the mean values and standard deviations of F1 score, kappa, DYI and MCC obtain of the different machine learning models and XGB method in the study. SVM: support vector machine, BLDA: Bayesian linear discriminant analysis, DT: decision tree, GNB: Gaussian naïve Bayes, KNN: K-nearest neighbors, XGB: eXtreme gradient boosting, MCC: Matthews correlation coefficient, DYI: degenerated Youden index.
Methods
SVMBLDADTGNBKNNXGB
F1 score86.46 ± 0.8181.78 ± 0.8984.40 ± 0.7780.28 ± 0.9189.08 ± 0.5495.06 ± 0.33
Kappa77.21 ± 0.5773.03 ± 0.6175.36 ± 0.5271.68 ± 0.6579.54 ± 0.4284.74 ± 0.29
DYI86.72 ± 0.8382.03 ± 0.9084.65 ± 0.8080.52 ± 0.9489.34 ± 0.5695.18 ± 0.34
MCC76.95 ± 0.5572.79 ± 0.6075.11 ± 0.5171.45 ± 0.6379.28 ± 0.4184.46 ± 0.28
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Gil-Rojas, S.; Suárez, M.; Martínez-Blanco, P.; Torres, A.M.; Martínez-García, N.; Blasco, P.; Torralba, M.; Mateo, J. Application of Machine Learning Techniques to Assess Alpha-Fetoprotein at Diagnosis of Hepatocellular Carcinoma. Int. J. Mol. Sci. 2024, 25, 1996. https://doi.org/10.3390/ijms25041996

AMA Style

Gil-Rojas S, Suárez M, Martínez-Blanco P, Torres AM, Martínez-García N, Blasco P, Torralba M, Mateo J. Application of Machine Learning Techniques to Assess Alpha-Fetoprotein at Diagnosis of Hepatocellular Carcinoma. International Journal of Molecular Sciences. 2024; 25(4):1996. https://doi.org/10.3390/ijms25041996

Chicago/Turabian Style

Gil-Rojas, Sergio, Miguel Suárez, Pablo Martínez-Blanco, Ana M. Torres, Natalia Martínez-García, Pilar Blasco, Miguel Torralba, and Jorge Mateo. 2024. "Application of Machine Learning Techniques to Assess Alpha-Fetoprotein at Diagnosis of Hepatocellular Carcinoma" International Journal of Molecular Sciences 25, no. 4: 1996. https://doi.org/10.3390/ijms25041996

APA Style

Gil-Rojas, S., Suárez, M., Martínez-Blanco, P., Torres, A. M., Martínez-García, N., Blasco, P., Torralba, M., & Mateo, J. (2024). Application of Machine Learning Techniques to Assess Alpha-Fetoprotein at Diagnosis of Hepatocellular Carcinoma. International Journal of Molecular Sciences, 25(4), 1996. https://doi.org/10.3390/ijms25041996

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop