Next Article in Journal
COVID-19 and New-Onset Psychosis: A Comprehensive Review
Next Article in Special Issue
Hepatic Venous Occlusion Type of Budd–Chiari Syndrome versus Pyrrolizidine Alkaloid-Induced Hepatic Sinusoidal Obstructive Syndrome: A Multi-Center Retrospective Study
Previous Article in Journal
Additive Potentiation of R334W-CFTR Function by Novel Small Molecules
Previous Article in Special Issue
Predictive Risk Factors of Nonalcoholic Fatty Liver Disease in a Lean Chinese Population
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Nomogram for Predicting Portal Vein Thrombosis in Cirrhotic Patients: A Retrospective Cohort Study

1
Department of Infectious Diseases, The First Affiliated Hospital of Soochow University, No. 188 Shizi Street, Gusu District, Suzhou 215000, China
2
Department of Stomach Surgery, Sichuan Cancer Hospital & Institute, Chengdu 610041, China
3
Department of Infectious Diseases, The Third Affiliated Hospital of Nantong University, Nantong 226006, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
J. Pers. Med. 2023, 13(1), 103; https://doi.org/10.3390/jpm13010103
Submission received: 18 November 2022 / Revised: 16 December 2022 / Accepted: 25 December 2022 / Published: 1 January 2023
(This article belongs to the Special Issue Towards Personalized Medicine for Chronic Liver Disease)

Abstract

:
Aim: Portal vein thrombosis (PVT) is a common complication in cirrhotic patients and will aggravate portal hypertension, thus leading to a series of severe complications. The aim of this study was to develop a nomogram based on a simple and effective model to predict PVT in cirrhotic patients. Methods: Clinical data of 656 cirrhotic patients with or without PVT in the First Affiliated Hospital of Soochow University and The Third Affiliated Hospital of Nantong University from January 2017 to March 2022 were retrospectively collected, and all patients were divided into training, internal and external validation cohorts. SPSS and R software were used to identify the independent risk factors and construct a predictive model. We evaluated the predictive value of the model by receiver operating characteristic (ROC) curve, calibration curve, and decision curve analyses. The feasibility of the model was further validated in the internal and external cohorts. All enrolled patients were followed up to construct the survival curves and calculate the incidence of complications. Results: The predictors of PVT included serum albumin, D-dimer, portal vein diameter, splenectomy, and esophageal and gastric varices. Based on the clinical and imaging findings, the final model served as a potential tool for predicting PVT in cirrhotic patients, with an AUC of 0.806 (0.766 in the internal validation cohort and 0.845 in the external validation cohort). The decision curve analysis revealed that the model had a high level of concordance between different medical centers. There was a significant difference between the PVT and non-PVT groups in survival analyses, with p values of 0.0477 and 0.0319 in the training and internal validation groups, respectively, along with p value of 0.0002 in the external validation group according to log-rank test; meanwhile, the median survival times of the PVT group were 54, 43, and 40 months, respectively. The incidence of recurrent esophageal and gastric variceal bleeding (EGVB) during the follow-up showed significant differences among the three cohorts (p = 0.009, 0.048, and 0.001 in the training, internal validation, and external validation cohorts, respectively). Conclusion: The nomogram based on our model provides a simple and convenient method for predicting PVT in cirrhotic patients. Cirrhotic patients with PVT had a shorter survival time and were prone to recurrent EGVB compared with those in the non-PVT group.

1. Introduction

Portal vein thrombosis (PVT) refers to the presence of a thrombus in the main lumen of the portal vein, which can extend to the intrahepatic or extrahepatic vein branches such as the splenic vein and superior mesenteric vein. PVT is a common complication in cirrhotic patients, especially in advanced cirrhosis. The morbidity of PVT varies in different studies. A prospective study showed that the cumulative incidence of PVT during the first year and third year was 3.7% and 7.6%, respectively, and it increased with the progression of cirrhosis [1].
Recent studies have focused on the reasons why cirrhotic patients would undergo PVT, with consideration given to the decreased coagulation factors and platelet counts. Patients with cirrhosis have an unbalanced coagulation system, which can vary to promote bleeding or thrombotic tendency in different disease stages [2]. At present, the main mechanism of PVT involves decreased portal vein flow, hypercoagulation status, and damage to the vessel wall [3]. Various etiologies cause hepatocyte injury, inflammation, and edema, thus leading to pseudolobule formation and collection in connective tissues. When liver sclerosis deteriorates, the portal vein blood flow slows, and its pressure is consequently increased. Continuous high pressure will damage the vascular endothelium and cause local vascular injury. In addition, due to deficiency in immune modulation, patients with cirrhosis always have alterations in their intestinal flora and experience inflammatory injury, which will aggravate the prethrombotic state. A combination of the above factors may contribute to portal vein system thrombosis.
According to a recent study, the risk factors for PVT in cirrhosis include cryptogenic and metabolic-associated fatty liver disease-related cirrhosis; Child-Pugh grade B and C; esophageal varices grade equal to or greater than grade II; portal vein blood flow < 15 cm/s; large portosystemic collateral circulation with high blood flow; local vascular damage; previous splanchnic vein thrombosis; sclerotherapy of esophageal varices and splenectomy; inflammation of the portal vein, abdominal cavity, and intestinal tract; and partial splenic embolization. Most of these risk factors are associated with portal hypertension [3,4,5]. However, most clinicians have only focused on the most frequent complications of cirrhosis, such as esophageal and gastric variceal bleeding (EGVB), ascites, and hepatic encephalopathy (HE); however, PVT development and its potential damage to these individuals during their disease progression have not been paid much attention to.
Patients with PVT present with the absence of specific clinical manifestations and sometimes experience only mild abdominal pain or even no symptoms at all. PVT is usually discovered incidentally by imaging during a physical examination. However, if the thrombus obstructs not only the main trunk and branches of the portal vein but also spreads to the splenic vein and superior mesenteric vein, it will lead to a series of related complications, such as massive gastrointestinal bleeding, cavernous transformation of portal vein, intestinal ischemia and necrosis, multiple organ failure, and even death [3]. In addition, the current imaging techniques only detect the existing PVT. Although many prospective, retrospective, and cross-sectional studies have identified some high-risk factors for the formation of PVT [5,6,7,8], a simple and effective measure to predict PVT formation in cirrhotic patients is still lacking.
Therefore, considering the occult nature and severity of the disease, we aimed to construct a predictive model for PVT and design a nomogram to help clinicians identify the high-risk population of PVT among cirrhotic patients to improve their prognosis.

2. Materials and Methods

2.1. Patients

Clinical data of 700 patients with cirrhosis treated in the Department of Infectious Diseases at the First Affiliated Hospital of Soochow University and The Third Affiliated Hospital of Nantong University from January 2017 to March 2022 were collected retrospectively. Forty-four patients were excluded from the study due to the missing data, and finally, there were 656 patients enrolled in the study. We used randomized assignment to divide the 510 patients from The First Affiliated Hospital of Soochow University into two groups: the training and internal validation cohorts (ratio 2:1). The training cohort contained 340 patients, and the internal validation cohort contained 170 patients. A total of 146 patients from The Third Affiliated Hospital of Nantong University were selected as the external validation cohort. The flow diagram is shown in Figure 1.

2.2. Inclusion and Exclusion Criteria

The inclusion and exclusion criteria were based on the consensus and guidelines for the diagnosis and treatment of chronic viral hepatitis, alcoholic liver disease, autoimmune hepatitis, cirrhosis, and portal vein thrombosis in cirrhotic patients [4]. The diagnosis of PVT is mainly based on ultrasound, computed tomography (CT), and magnetic resonance imaging (MRI), while esophageal gastric varices are interpreted according to gastroscopy, CT, and MRI. The inclusion criteria are described below (1) Patients were older than 18 years of age. (2) Patients were diagnosed with cirrhosis according to the liver histology, imaging material, and laboratory examinations related to the guidelines of diagnosis of cirrhosis [9], with the specific criteria being as follows: i: histology consistent with cirrhosis; ii: endoscopic evidence of esophageal and gastric varices (except non-cirrhotic portal hypertension); iii: ultrasound, liver stiffness measurement, CT, and other imaging examinations suggesting liver cirrhosis or portal hypertension characteristics, such as splenomegaly, portal vein diameter ≥ 13 mm; iv: in the absence of histological, endoscopic, or imaging data, any 2 abnormalities suggesting cirrhosis (i.e., any 2 of platelet (PLT)< 100 × 109/L with no clear explanation, serum albumin (Alb) < 35 g/L, excluding malnutrition or kidney disease, international normalized ratio (INR) > 1.3 or prolonged prothrombin time (PT) (suspend thrombolytic or anticoagulant drugs for more than 7 days), and APRI (AST/PLT) score > 2). (3) Imaging examinations indicated thrombosis in the portal vein system, including the main trunk and branches, with or without the splenic vein and superior mesenteric vein, in the PVT group, and imaging examinations showed that blood flow was unobstructed in the portal vein system without filling defects in the non-PVT group. CT/MRI combined with ultrasound were used to diagnose PVT: CT or MRI was used as a confirmative technique when thrombus was suspected by ultrasound.. The exclusion criteria are as follows: (1) chronic liver diseases that did not progress to cirrhosis, such as liver fibrosis; (2) patients with liver failure, hemorrhagic shock, septic shock, and other serious complications; (3) patients with hematological diseases (such as leukemia, multiple myeloma, lymphoma, idiopathic thrombocytopenic purpura); (4) patients with BudChiari syndrome; and (5) patients with hepatocellular carcinoma and any other types of cancers, whether or not they had cancer thrombus formation; (6) patients with primary thrombosis in the portal vein without cirrhosis, such as hepatic sinus obstruction syndrome, and thrombophilia; (7) patients with previous thrombosis events, such as pulmonary embolism and deep vein thrombosis; (8) patients taking anticoagulation or thrombolytic drugs within the previous three months. The study protocol was reviewed by the Ethics Committee of the First Affiliated Hospital of Soochow University, and ethical approval was obtained (2021 Ethics approval No. 249).

2.3. Data Collection

We retrospectively collected the enrolled patients’ clinical data, including gender, age, etiology of liver diseases, liver disease course, and Child-Pugh score; routine blood tests, such as white blood cell (WBC) count, hemoglobin (Hb) levels, PLT count, mean platelet volume (MPV), and platelet distribution width (PDW); routine biochemical tests on blood, such as alanine aminotransferase (ALT), Alb, and triglycerides (TG); routine blood coagulation tests, such as PT, D-dimer, and antithrombin Ⅲ activity (AT-Ⅲ a); routine imaging data, such as the main portal vein diameter (PVD), absence of spleen, length and thickness of the spleen, esophageal and gastric varices, and ascites; and endoscopy data for esophageal and gastric varices. All clinical data were obtained when PVT was first detected or when the patient was first hospitalized for cirrhosis.

2.4. Follow-Up

The time to death was chosen as the main endpoint of the follow-up. In addition, we also counted the incidence of recurrent EGVB, refractory ascites (RA), HE, and liver failure during the follow-up. According to continuous enrolled patients, all patients were followed up by clinical inpatient data, outpatient information, and telephone contact from July to August 2022. The follow-up time was defined as the time from the first hospitalization or first detection of PVT to the time at which the outcome occurred. Recurrent EGVB means that hematemesis or melena occurred after hospitalization with transjugular intrahepatic portosystemic shunt, endoscopic ligation, or conservative treatment to reduce portal pressure. RA is defined as ascites that cannot be eliminated or its early recurrence after paracentesis or that cannot be satisfactorily prevented with sodium restriction and diuretic therapy. [10] The definitions of HE and liver failure were based on the clinical guidelines [11].

2.5. Statistical Analysis

SPSS (version 25.0, IBM, Armonk, NY, USA), R software (V.4.2.0, R Foundation for Statistical Computing, Vienna, Austria), and GraphPad Prism 9 (V.9.0.2, GraphPad Software, San Diego, CA, USA) were used for statistical analysis. If the measurement data conformed to a normal distribution, they are expressed as the mean ± standard deviation. If they did not conform to a normal distribution, they are expressed as median and quartile ranges. For the comparison of measurement data between the two groups, the t-test or Mann-Whitney U test was used according to whether the data conformed to a normal distribution. Count data are expressed as frequencies and percentages, and the Pearson χ2 test or Fisher’s exact probability test was used for comparisons between the two groups. R software was used to construct a nomogram to predict the occurrence of PVT in cirrhosis. The performance of the nomogram was assessed by discrimination and calibration curves. The discriminative ability of the model was determined by the area under the receiver operating characteristic curve (ROC), which ranged from 0.5 to 1 (no discrimination to perfect discrimination). The calibration of the prediction model was carried out by a visual curve comparing the predicted and actual probability of PVT. GraphPad Prism 9 was used to construct the survival curve. Unless otherwise stated, all tests were performed at a two-tailed significance level of 0.05. p < 0. 05 was considered statistically significant.

3. Results

3.1. Patient Characteristics

The clinical characteristics of the three cohorts were listed in Table 1. There were no significant differences in gender, age, or etiology between the two groups in the training cohort, while there were significant differences in disease course, Child-Pugh score, Hb, Alb, PT, D-dimer, PVD, spleen length, spleen thickness, splenectomy, esophageal and gastric varices, and ascites between the two groups (p < 0.05). Through univariate regression analysis, we chose some significant indicators (p < 0. 05) to input into the multivariate regression analysis and found that Alb, D-dimer, splenectomy, esophageal and gastric varices, and PVD were independent risk factors for PVT in cirrhosis (Table 2). In addition, we analyzed the position of PVT among the three cohorts (Table 3). The most common positions of PVT were the main trunk and the left and right branches of the portal vein. There was no significant difference among the groups, with a p value of 0.630.

3.2. Nomogram Construction

Based on the results of the multivariate analysis, we constructed a nomogram to predict the risk of PVT formation (Figure 2). The nomogram exhibited powerful diagnostic ability in the three cohorts. We used ROC curves to assess the different independent risk factors which were used to construct the predictive model (Figure 3A). With the cutoff value 0.240, the nomogram yielded an accuracy of 0.806 (95% CI, 0.759–0.853; sensitivity, 0.839; specificity, 0.614) in the training cohort. When the cutoff value was 0.404, the nomogram yielded an accuracy of 0.766 (95% CI, 0.688–0.844; sensitivity, 0.638; specificity, 0.812) in the internal validation cohort, and when the cutoff value was 0.240, the nomogram yielded an accuracy of 0.845 (95% CI 0.777–0.913; sensitivity 0.860, specificity 0.787) in the external validation cohort (Figure 3B). The calibration curves revealed good predictive accuracy between the actual probability and predicted probability among the three cohorts (Figure 4A–C). In decision curve analyses, we found that the prediction model had a good clinical benefit compared to the default strategies of treating none or all patients in the three cohorts (Figure 4D–F). In the training cohort, the net benefit of the prediction model showed a superior risk threshold probability compared with the baseline, ranging from 2% to 98%, and in internal and external validation cohorts, both of the net benefits ranged from 4–96%.

3.3. Outcome of Follow-Up

The enrolled patients were followed up from July to August 2022. The Kaplan-Meier survival curves are shown in Figure 5. The median follow-up times of the training, internal validation, and external validation cohorts were 12, 11, and 12 months, respectively. The survival time in the PVT group was shorter than that in the non-PVT group, with log-rank p values of 0.0477, 0.0319, and 0.0002 in the training, internal validation, and external validation cohorts, respectively; meanwhile, the median survival times of the PVT group were 54, 43, and 40 months, respectively. We also calculated the incidence of severe complications in all patients during the follow-up, and there was a significant difference between the PVT group and the non-PVT group in recurrent EGVB, with p values of 0.009, 0.048, and 0.001 in the three cohorts, respectively. In addition, RA and HE also showed significant differences in the external validation group between the two groups (Table 4).

4. Discussion

PVT is one of the common complications of liver cirrhosis. It is commonly believed that patients with liver diseases, especially with advanced cirrhosis, have a tendency to bleed due to deficiency of coagulation factors and hypersplenism. In contrast to previous results, cirrhotic patients are actually more likely to have thromboembolic events due to hypercoagulability with a prothrombotic state and systemic inflammation [3,12]. In our study, we retrospectively analyzed the clinical data from 656 patients and constructed a model to predict PVT formation. The model incorporated laboratory data, imaging features, and endoscopy performance and successfully distinguished high-risk cirrhotic PVT patients from normal cirrhosis patients. Furthermore, the nomogram based on the model had better predictive accuracy than did any of the individual risk factors alone, and it is easy to use in the clinic.
As mentioned above, there are many risk factors for PVT formation in cirrhotic patients. In the present study, we selected five independent risk factors, including Alb, D-dimer, splenectomy, esophageal and gastric varices, and PVD, to build our model. The level of serum albumin can reflect liver synthesis function. A low serum albumin can indicate poor prognosis in patients with liver diseases [13]. Previous studies have shown that serum albumin was negatively correlated with vein thrombosis [14], and decreased albumin levels are associated with an increased risk of venous thromboembolism (VTE) in a linear dose-response manner; this association is independent of the inflammation influence [15]. We found that serum albumin was significantly lower in the PVT group among the three cohorts, and the difference was statistically significant (p < 0.001, 0.010, 0.020). Multivariate regression analysis showed that it could be a powerful independent risk factor (p = 0.013). Our results are consistent with previous studies which showed that serum albumin was independently associated with PVT after adjustment for several factors, such as Child-Pugh score [6,8,16,17]. However, the underlying mechanism is still unknown. A previous study showed that lower serum albumin would decrease the bioavailability of prostacyclin, which is a potent inhibitor of platelet aggregation [18]. Due to the heparin-like activity of albumin, the anticoagulant effect of antithrombin may be also impaired with the decreased level [19]. Basili’s study showed that low serum albumin was associated with PVT in patients with liver cirrhosis and found that albumin could inhibit agonist-induced platelet activation, which plays an important role in thrombosis formation. Thus, decreased serum albumin may perform as a regulator of the hemostatic system by inhibiting Nox2-mediated oxidative stress and interfering with the platelet activation mechanism [16].
D-dimer is produced during fibrinolysis. It has been widely used for the diagnosis of suspected VTE in clinical practice. A negative D-dimer in combination with clinical manifestations can rule out the diagnosis of deep vein thrombosis and pulmonary embolism, which reduces the need for ultrasound or CT scanning [20,21]. However, there are few articles clarifying the application of D-dimer in cirrhotic patients with PVT. Dai et al. analyzed 21 studies and found that cirrhotic patients with PVT had a significantly higher D-dimer than those without PVT [22], suggesting that D-dimer might be a diagnostic marker for PVT in cirrhosis. Similarly, a large multicenter retrospective cohort analysis showed that PVT had a significantly higher level of D-dimer (2.07 vs. 1.25; p < 0.001) in patients with acute worsening of chronic liver disease [23]. In our study, we found that D-dimer was higher in the PVT group than in the non-PVT group, with a significant difference among the three cohorts, which could be an independent risk factor for diagnosis. However, a D-dimer test alone is not specific enough to predict PVT. After analyzing thrombosis in different sites, such as upper extremity thrombosis, cerebral vein thrombosis, and splanchnic vein thrombosis, Ordieres et al. also suggested that D-dimer could not be recommended as a first-line diagnostic tool for thrombosis in unusual sites due to the poorly documented articles [24]. In addition, many pathophysiological processes may lead to increased D-dimer levels. For example, infection will also induce fibrinolysis, and we can find a higher D-dimer level in systemic or local infections, which is regarded as an indicator of a poor prognosis [25]. Patients with tumors, pregnancy, surgery, and other stress reactions usually have hypercoagulable states and elevated D-dimer levels. Thus, we should combine D-dimer with other clinical tools to increase the diagnostic value of PVT.
PVD is considered the best indicator for portal hypertension. The wider the portal vein is, the more likely it is to cause damage to the venous vessel wall due to the extended high pressure in the lumen, and when combined with slow blood flow, the blood easily forms a vortex, promoting coagulation and eventually promoting the formation of PVT [26,27]. Dong et al. found that PVD was the strongest independent risk factor for predicting PVT development (OR: 3.96, AUC: 0.88; p < 0.01), with a cutoff of >12.5 mm [7]. Increased PVD is associated with an increased risk of PVT development. From examining patients from two medical centers, Yuan et al. found that PVD and splenic diameter could predict PVT after splenectomy [27]. This is consistent with the results of the present study. PVT is also a complication of intra-abdominal surgery, especially splenectomy. Postsurgical PVT is currently limited to a few small descriptive case series, and a recent study conducted by the Mayo Clinic reported an occurrence rate of PVT after splenectomy was for approximately 8.1% after reviewing datasets from 1745 patients [28]. The mechanism of surgery-associated PVT may be thrombosis provoked by intraoperative vascular manipulation or local postoperative inflammation [29]. In the study of Zhang et al., splenectomy was an independent risk factor for PVT in patients with cirrhosis and acute decompensation [23]. In a retrospective analysis of 113 liver cirrhosis patients without malignancy, splenectomy was identified associated with a 10-fold increased risk of PVT, which was independent to the severity of liver dysfunction [30]. In addition, in our study, we also found that esophageal and gastric varices was independent risk factor for PVT. A prospective trial to identify the impact of PVT in patients with cirrhosis showed that the development of PVT was independently associated with baseline esophageal varices (p = 0.01) [8], which is in accordance with our research. Esophageal and gastric varices is considered to be another sign of portal hypertension. A slowed blood velocity could result from increased pressure in the portal vein induced by varicosity. PVT would be more feasible when combined with damage to the endothelium of blood vessels.

5. Prognosis and Complications

Cirrhotic patients with PVT tend to have severe complications and poor prognosis. It is generally assumed that PVT contributes to portal hypertension complications, subsequently increasing the risk of mortality. Patients with PVT have more portal hypertension signs, such as EGVB, splenomegaly, and thrombocytopenia. In the present study, we compared the incidence of complications in two groups among three cohorts during the follow-up and found that the occurrence of recurrent EGVB both in the training and validation cohorts showed significant differences (Table 4). In the external validation cohort, we also found that patients with PVT were more prone to HE and RA, suggesting that cirrhotic patients with PVT had severe portal hypertension. From the survival curves, we found that the survival time of the PVT group was shorter than that of the non-PVT group. We assume that patients with PVT have high short-term mortality, which may be caused by severe gastrointestinal bleeding with extremely elevated portal vein pressure, septic shock due to immunosuppression, dysregulation of the intestinal microbiota, and intestinal ischemic necrosis due to complete obstruction of the portal vein and mesenteric vein, eventually leading to multiple organ failure. The same was found in the study of Cool et al., who reported that PVT was associated with increased mortality, implying that PVT has a significant impact on the cirrhotic prognosis [31]. However, recent findings suggested that the development of PVT was an indicator but not a direct cause of the progression of liver disease [8,32]. PVT was not independently associated with the progression of liver disease or death, and thus other factors may also be involved. It is difficult to determine whether the presence of PVT causes greater portal hypertension and an exacerbation of cirrhosis, or whether with the progression of liver cirrhosis, the portal vein pressure increases and leads to a higher probability of PVT, eventually causing death in PVT patients. The contribution of PVT to hepatic decompensation and overall mortality in cirrhosis is less clear.
There are some limitations in our study. First, this study retrospectively collected the patients’ data; thus, the reliability and completeness of the data are limited. In addition, the enrolled patients came from one region, and the etiology of cirrhosis and lifestyle factors, such as diet and alcohol consumption, may also affect the development of PVT. Third, considering the changes in the clotting system, inflammatory response, and platelet function in PVT, coagulation factors, fibrinolysis markers, inflammation biomarkers, and activation markers of platelets could also be used to predict PVT. Finally, the sample size of our research is small, and we only included patients from two medical centers. Research with a large sample size and patients from additional medical centers should be carried out in the near future.

6. Conclusions

The model we constructed to predict PVT in cirrhotic patients has good diagnostic value. Patients with PVT have poor prognosis due to portal hypertension. With this prediction model, clinicians can evaluate patients with cirrhosis for their risk of developing PVT and apply the appropriate interventions as early as possible. For example, for patients with high scores on the nomogram, the lumen and blood flow of the portal vein should be assessed periodically by ultrasound. Symptomatic supportive treatment such as albumin infusion, the reduction of portal hypertension, or even prophylactic anticoagulation could be given after evaluation of the hemorrhage risk and systemic status. The proper management of PVT requires early detection, diagnosis, treatment, and follow-up. We expect that this nomogram based on laboratory tests and imaging findings will be a useful tool to guide individual care for high-risk cirrhotic patients.

Author Contributions

Conceptualization, J.D. and W.Z.; Data curation, J.D., F.Z., Y.L. and H.Z.; Formal analysis, J.D., F.Z. and Y.M.; Methodology, J.D. and F.Z.; Supervision, F.Z., Y.M. and W.Z.; Writing—original draft, J.D.; Writing—review & editing, F.Z., Y.M. and W.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of the First Affiliated Hospital of Soochow University (protocol code 2021 Ethics approval No. 249).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data are within the manuscript.

Conflicts of Interest

The authors have no relevant financial or nonfinancial interest to disclose.

References

  1. Noronha Ferreira, C.; Marinho, R.T.; Cortez-Pinto, H.; Ferreira, P.; Dias, M.S.; Vasconcelos, M.; Alexandrino, P.; Serejo, F.; Pedro, A.J.; Goncalves, A.; et al. Incidence, predictive factors and clinical significance of development of portal vein thrombosis in cirrhosis: A prospective study. Liver Int. 2019, 39, 1459–1467. [Google Scholar] [CrossRef] [PubMed]
  2. Tripodi, A.; Mannucci, P.M. The coagulopathy of chronic liver disease. N. Engl. J. Med. 2011, 365, 147–156. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Senzolo, M.; Garcia-Tsao, G.; Garcia-Pagan, J.C. Current knowledge and management of portal vein thrombosis in cirrhosis. J. Hepatol. 2021, 75, 442–453. [Google Scholar] [CrossRef] [PubMed]
  4. Hepatobiliary Disease Study Group; Chinese Society of Gastroenterology, Chinese Medical Association. Consensus for management of portal vein thrombosis in liver cirrhosis (2020, Shanghai). J. Dig. Dis. 2021, 22, 176–186. [Google Scholar] [CrossRef] [PubMed]
  5. Turon, F.; Driever, E.G.; Baiges, A.; Cerda, E.; Garcia-Criado, A.; Gilabert, R.; Bru, C.; Berzigotti, A.; Nunez, I.; Orts, L.; et al. Predicting portal thrombosis in cirrhosis: A prospective study of clinical, ultrasonographic and hemostatic factors. J. Hepatol. 2021, 75, 1367–1376. [Google Scholar] [CrossRef]
  6. Lopez-Gomez, M.; Llop, E.; Puente, A.; Hernandez Conde, M.; Ruiz, P.; Alvarez, S.; Martinez, J.L.; Abad, J.; Fernandez, N.; Perello, C.; et al. Non-malignant portal vein thrombosis in a cohort of cirrhotic patients: Incidence and risk factors. Hepatol. Res. 2021, 51, 1064–1072. [Google Scholar] [CrossRef]
  7. Dong, G.; Huang, X.Q.; Zhu, Y.L.; Ding, H.; Li, F.; Chen, S.Y. Increased portal vein diameter is predictive of portal vein thrombosis development in patients with liver cirrhosis. Ann. Transl. Med. 2021, 9, 289. [Google Scholar] [CrossRef]
  8. Nery, F.; Chevret, S.; Condat, B.; de Raucourt, E.; Boudaoud, L.; Rautou, P.E.; Plessier, A.; Roulot, D.; Chaffaut, C.; Bourcier, V.; et al. Causes and consequences of portal vein thrombosis in 1,243 patients with cirrhosis: Results of a longitudinal study. Hepatology 2015, 61, 660–667. [Google Scholar] [CrossRef]
  9. Chinese Society of Hepatology. Chinese guidelines on the management of liver cirrhosis. Chin. J. Hepatol. 2019, 27, 846–865. [Google Scholar] [CrossRef]
  10. Salerno, F.; Guevara, M.; Bernardi, M.; Moreau, R.; Wong, F.; Angeli, P.; Garcia-Tsao, G.; Lee, S.S. Refractory ascites: Pathogenesis, definition and therapy of a severe complication in patients with cirrhosis. Liver Int. 2010, 30, 937–947. [Google Scholar] [CrossRef]
  11. Chinese Society of Hepatology, C.M.A.; Xu, X.; Duan, Z.; Ding, H.; Li, W.; Jia, J.; Wei, L.; Linghu, E.; Zhuang, H. Chinese guidelines on the management of ascites and its related complications in cirrhosis. Hepatol. Int. 2019, 13, 1–21. [Google Scholar] [CrossRef] [Green Version]
  12. Violi, F.; Ferro, D. Clotting activation and hyperfibrinolysis in cirrhosis: Implication for bleeding and thrombosis. Semin. Thromb. Hemost. 2013, 39, 426–433. [Google Scholar] [CrossRef] [PubMed]
  13. Carr, B.I.; Guerra, V.; Donghia, R.; Farinati, F.; Giannini, E.G.; Muratori, L.; Rapaccini, G.L.; Di Marco, M.; Caturelli, E.; Zoli, M.; et al. Identification of Clinical Phenotypes and Related Survival in Patients with Large HCCs. Cancers 2021, 13, 592. [Google Scholar] [CrossRef] [PubMed]
  14. Folsom, A.R.; Lutsey, P.L.; Heckbert, S.R.; Cushman, M. Serum albumin and risk of venous thromboembolism. Thromb. Haemost. 2010, 104, 100–104. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Kunutsor, S.K.; Seidu, S.; Katechia, D.T.; Laukkanen, J.A. Inverse association between serum albumin and future risk of venous thromboembolism: Interrelationship with high sensitivity C-reactive protein. Ann. Med. 2018, 50, 240–248. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Basili, S.; Carnevale, R.; Nocella, C.; Bartimoccia, S.; Raparelli, V.; Talerico, G.; Stefanini, L.; Romiti, G.F.; Perticone, F.; Corazza, G.R.; et al. Serum Albumin Is Inversely Associated With Portal Vein Thrombosis in Cirrhosis. Hepatol. Commun. 2019, 3, 504–512. [Google Scholar] [CrossRef] [Green Version]
  17. Cagin, Y.F.; Bilgic, Y.; Berber, I.; Yildirim, O.; Erdogan, M.A.; Firat, F.; Arslan, A.K.; Colak, C.; Seckin, Y.; Harputluoglu, M. The risk factors of portal vein thrombosis in patients with liver cirrhosis. Exp. Ther. Med. 2019, 17, 3189–3194. [Google Scholar] [CrossRef] [Green Version]
  18. Mikhailidis, D.P.; Mikhailidis, A.M.; Dandona, P. Effect of human plasma proteins on stabilisation of platelet anti-aggregatory activity of prostacyclin. Ann. Clin. Biochem. 1982, 19 (Pt 4), 241–244. [Google Scholar] [CrossRef] [Green Version]
  19. Joorgensen, K.A.; Stoffersen, E. Heparin like activity of albumin. Thromb. Res. 1979, 16, 569–574. [Google Scholar] [CrossRef]
  20. van Belle, A.; Buller, H.R.; Huisman, M.V.; Huisman, P.M.; Kaasjager, K.; Kamphuisen, P.W.; Kramer, M.H.; Kruip, M.J.; Kwakkel-van Erp, J.M.; Leebeek, F.W.; et al. Effectiveness of managing suspected pulmonary embolism using an algorithm combining clinical probability, D-dimer testing, and computed tomography. JAMA 2006, 295, 172–179. [Google Scholar] [CrossRef]
  21. Tritschler, T.; Kraaijpoel, N.; Le Gal, G.; Wells, P.S. Venous Thromboembolism: Advances in Diagnosis and Treatment. JAMA 2018, 320, 1583–1594. [Google Scholar] [CrossRef] [PubMed]
  22. Dai, J.; Qi, X.; Li, H.; Guo, X. Role of D-dimer in the Development of Portal Vein Thrombosis in Liver Cirrhosis: A Meta-analysis. Saudi J. Gastroenterol. 2015, 21, 165–174. [Google Scholar] [CrossRef] [PubMed]
  23. Zhang, Y.; Xu, B.Y.; Wang, X.B.; Zheng, X.; Huang, Y.; Chen, J.; Meng, Z.J.; Gao, Y.H.; Qian, Z.P.; Liu, F.; et al. Prevalence and Clinical Significance of Portal Vein Thrombosis in Patients With Cirrhosis and Acute Decompensation. Clin. Gastroenterol. Hepatol. 2020, 18, 2564–2572.e1. [Google Scholar] [CrossRef] [PubMed]
  24. Ordieres-Ortega, L.; Demelo-Rodriguez, P.; Galeano-Valle, F.; Kremers, B.M.M.; Ten Cate-Hoek, A.J.; Ten Cate, H. Predictive value of D-dimer testing for the diagnosis of venous thrombosis in unusual locations: A systematic review. Thromb. Res. 2020, 189, 5–12. [Google Scholar] [CrossRef]
  25. Gris, J.C.; Bouvier, S.; Cochery-Nouvellon, E.; Faillie, J.L.; Lissalde-Lavigne, G.; Lefrant, J.Y. Fibrin-related markers in patients with septic shock: Individual comparison of D-dimers and fibrin monomers impacts on prognosis. Thromb. Haemost. 2011, 106, 1228–1230. [Google Scholar] [CrossRef]
  26. Fujinaga, A.; Ohta, M.; Endo, Y.; Tada, K.; Kawamura, M.; Nakanuma, H.; Ogawa, K.; Watanabe, K.; Kawasaki, T.; Masuda, T.; et al. Clinical Significance of Splenic Vessels and Anatomical Features in Laparoscopic Splenectomy. J. Laparoendosc. Adv. Surg. Tech. A 2021, 31, 632–637. [Google Scholar] [CrossRef]
  27. Yuan, H.L.; Wang, M.; Chu, W.W.; Li, F.X.; Lu, J.J.; Li, Y. Nomogram Model for Prediction of Portal Vein Thrombosis in Patients with Liver Cirrhosis After Splenectomy: A Retrospective Analysis of 2 Independent Cohorts. Med. Sci. Monit. 2021, 27, e929844. [Google Scholar] [CrossRef]
  28. Tsamalaidze, L.; Stauffer, J.A.; Brigham, T.; Asbun, H.J. Postsplenectomy thrombosis of splenic, mesenteric, and portal vein (PST-SMPv): A single institutional series, comprehensive systematic review of a literature and suggested classification. Am. J. Surg. 2018, 216, 1192–1204. [Google Scholar] [CrossRef]
  29. Naymagon, L. Venous thrombosis of the liver: Current and emerging concepts in management. Transl. Res. 2020, 225, 54–69. [Google Scholar] [CrossRef]
  30. Qi, X.; Han, G.; Ye, C.; Zhang, Y.; Dai, J.; Peng, Y.; Deng, H.; Li, J.; Hou, F.; Ning, Z.; et al. Splenectomy Causes 10-Fold Increased Risk of Portal Venous System Thrombosis in Liver Cirrhosis Patients. Med. Sci. Monit. 2016, 22, 2528–2550. [Google Scholar] [CrossRef]
  31. Cool, J.; Rosenblatt, R.; Kumar, S.; Lucero, C.; Fortune, B.; Crawford, C.; Jesudian, A. Portal vein thrombosis prevalence and associated mortality in cirrhosis in a nationally representative inpatient cohort. J. Gastroenterol. Hepatol. 2019, 34, 1088–1092. [Google Scholar] [CrossRef] [PubMed]
  32. Berry, K.; Taylor, J.; Liou, I.W.; Ioannou, G.N. Portal vein thrombosis is not associated with increased mortality among patients with cirrhosis. Clin. Gastroenterol. Hepatol. 2015, 13, 585–593. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Flow diagram of the present study, PVT—portal vein thrombosis. Randomization was performed with R software.
Figure 1. Flow diagram of the present study, PVT—portal vein thrombosis. Randomization was performed with R software.
Jpm 13 00103 g001
Figure 2. Nomogram of predicting PVT formation based on the independent risk factors. Each variable value has a score on the upper scale axis. The total score can be calculated by summing up each score, then projecting the total score onto the lower total scale axis, and finding the risk probability corresponding to the total score.
Figure 2. Nomogram of predicting PVT formation based on the independent risk factors. Each variable value has a score on the upper scale axis. The total score can be calculated by summing up each score, then projecting the total score onto the lower total scale axis, and finding the risk probability corresponding to the total score.
Jpm 13 00103 g002
Figure 3. The ROC curves of independent risk factors based on multivariate analysis and nomogram model in the training cohort (A). The ROC curves of nomogram used in the three different cohorts (B).
Figure 3. The ROC curves of independent risk factors based on multivariate analysis and nomogram model in the training cohort (A). The ROC curves of nomogram used in the three different cohorts (B).
Jpm 13 00103 g003
Figure 4. Calibration curves in the training cohort (A), internal validation cohort (B), and external validation cohort (C). The X-axis represents the predicted probability, and the Y-axis represents the actual probability of PVT. The black solid line indicates the bias correction with bootstrapping (1000 repetitions), and the dotted line represents the training, internal validation, and external validation cohort. The perfect prediction corresponds to the 45° dashed line. The decision curve analysis and 95% CI in training cohort (D), internal validation cohort (E), and external validation cohort (F). The horizontal black line represents the treatment of no patients, the slash gray solid line represents the treatment of all patients, and the red solid line represents the net benefit of the prediction model.
Figure 4. Calibration curves in the training cohort (A), internal validation cohort (B), and external validation cohort (C). The X-axis represents the predicted probability, and the Y-axis represents the actual probability of PVT. The black solid line indicates the bias correction with bootstrapping (1000 repetitions), and the dotted line represents the training, internal validation, and external validation cohort. The perfect prediction corresponds to the 45° dashed line. The decision curve analysis and 95% CI in training cohort (D), internal validation cohort (E), and external validation cohort (F). The horizontal black line represents the treatment of no patients, the slash gray solid line represents the treatment of all patients, and the red solid line represents the net benefit of the prediction model.
Jpm 13 00103 g004
Figure 5. Kaplan–Meier curves in training cohort (A), internal validation cohort (B), and external validation cohort (C). The red line represents the PVT group, and the green line represents the non-PVT group. The X-axis indicates the survival time, and the Y-axis indicates the probability of survival.
Figure 5. Kaplan–Meier curves in training cohort (A), internal validation cohort (B), and external validation cohort (C). The red line represents the PVT group, and the green line represents the non-PVT group. The X-axis indicates the survival time, and the Y-axis indicates the probability of survival.
Jpm 13 00103 g005
Table 1. Basic characteristic in training and validation cohorts.
Table 1. Basic characteristic in training and validation cohorts.
Training CohortInternal Validation CohortExternal Validation Cohort
Total
(n = 340)
Non-PVT
(n = 228)
PVT
(n = 112)
p ValueTotal
(n = 170)
Non-PVT
(n = 112)
PVT
(n = 58)
p
Value
Total
(n = 146)
Non-PVT
(n = 89)
PVT
(n = 57)
p
Value
Male193127660.57210570350.7849961380.813
Age(year)59.06 ± 13.4258.86 ± 14.1759.49 ± 11.780.66360.74 ± 13.1260.96 ± 13.8660.31 ± 11.650.75956.90 ± 12.1655.38 ± 12.1959.26 ± 11.830.060
Disease course(year)6.00
(1.00, 10.00)
5.00
(1.00, 10.00)
8.00
(3.00, 10.00)
0.0058.50
(1.00, 10.00)
6.00
(1.00, 10.00)
10.00
(4.75, 10.00)
0.0042.00
(1.00, 5.25)
1.00
(1.00, 4.00)
4.00
(1.00, 8.00)
0.002
Etiology
Viral hepatitis149104450.3426440240.4709758390.685
Schistosoma hepatitis4827210.08632 2480.227----
Autoimmune hepatitis4328150.77225 1780.80915960.936
Alcohol hepatitis25 1960.32315 1050.947181170.989
Others 17550250.9353421130.571161150.498
Child–Pugh Score8.00
(6.00, 9.00)
8.00
(6.00, 9.00)
8.00
(7.00, 10.00)
0.0088.00
(7.00, 9.00)
8.00
(6.00, 9.00)
8.00
(7.00, 9.25)
0.6728.00
(6.00, 9.00)
7.00
(5.00, 8.00)
8.00
(7.00, 10.00)
0.001
WBC (×109/L)5.8 ± 3.95.63 ± 3.776.15 ± 4.150.2485.75 ± 3.755.37 ± 3.026.50 ± 4.800.1064.34 ± 2.523.94 ± 1.584.95 ± 3.440.042
PLT (×109/L)78.50
(50.00, 129.25)
78.50
(51.00, 122.75)
78.00
(45.25, 146.75)
0.81477.5
(50.00, 117.00)
75.50
(50.00, 103.50)
86.50
(47.25, 161.25)
0.16677.50
(51.00, 152.75)
75.00
(48.50, 124.50)
86.00
(54.50, 191.00)
0.124
PDW (%)15.83 ± 2.4615.86 ± 14.1715.77 ± 2.120.77115.61 ± 2.1415.85 ± 2.0515.17 ± 2.240.05714.53 ± 3.0314.69 ± 2.7614.29 ± 3.420.495
MPV (fL)11.35 ± 1.6911.35 ± 1.6811.34 ± 1.730.97711.17 ± 1.5211.21 ± 1.5611.09 ± 2.240.63911.26 ± 1.3411.35 ± 1.3011.12 ± 1.410.372
Hb (g/L)97.24 ± 29.0799.78 ± 29.8192.08 ± 26.890.021100.57 ± 29.95102.37 ± 30.7197.10 ± 28.360.278112.10 ± 33.07119.63 ± 33.60100.33 ± 28.74<0.001
ALT (U/L)24.10
(16.33, 38.28)
25.00
(17.25, 39.18)
22.75
(14.45, 37.15)
0.17722.85
(15.55, 33.80)
22.75
(15.78, 39.00)
23.55
(15.38, 30.65)
0.64330.50
(21.00, 61.00)
38.00
(24.00, 99.00)
25.00
(18.50, 37.50)
<0.001
Alb (g/L)31.18 ± 5.6232.07 ± 5.8729.38 ± 4.58<0.00130.64 ± 5.8631.36 ± 6.5229.24 ± 4.000.01033.20 ± 6.2233.56 ± 6.9831.42 ± 3.930.020
TG (μmol/L)1.04 ± 0.661.06 ± 0.690.99 ± 0.600.3121.08 ± 0.691.13 ± 0.700.97 ± 0.780.1471.10 ± 0.731.28 ± 0.830.78 ± 0.32<0.001
PT (s)15.96 ± 3.1915.64 ± 2.8916.62 ± 3.660.00715.84 ± 4.1316.01 ± 4.7115.51 ± 2.700.45913.96 ± 2.6413.61 ± 2.7214.50 ± 2.420.046
AT-IIIa (%)59.15 ± 19.4160.14 ± 2.8957.13 ± 18.230.17859.67 ± 19.5961.38 ± 20.2756.36 ± 17.890.11365.04 ± 21.9566.81 ± 21.6962.26 ± 22.260.222
D-dimer
(μg/mL)
1.88
(0.72, 4.09)
1.20
(0.55, 3.03)
3.40
(1.47, 8.60)
<0.0011.99
(0.69, 4.23)
1.33
(0.54, 3.11)
3.25
(1.71, 6.67)
<0.0011.35
(0.39, 3.39)
0.58
(0.21, 2.27)
3.16
(1.62, 6.46)
<0.001
PVD (mm)13.56 ± 3.0913.02 ± 2.5614.67 ± 3.74<0.00113.91 ± 3.3713.08 ± 2.8915.51 ± 3.65<0.00114.03 ± 2.8413.27 ± 2.0915.22 ± 3.42<0.001
Ascites189 112770.001104 64400.134783048<0.001
Esophageal gastric varices216 12888<0.001107 62450.004843252<0.001
Splenectomy64 2836<0.00126 12140.02121120<0.001
Spleen thickness(mm)51.75 ± 14.1250.06 ± 13.1756.18 ± 15.580.00151.03 ± 11.4449.78 ± 11.4453.89 ± 11.050.04743.69 ± 12.7841.70 ± 12.6047.49 ± 12.420.025
Spleen length(mm)140.88 ± 36.12136.15 ± 35.32153.32 ± 35.45<0.001141.94 ± 33.32140.32 ± 30.68145.61 ± 38.780.382140.71 ± 34.90137.65 ± 33.62146.59 ± 37.000.208
1 Others: steatohepatitis cirrhosis, cholestatic liver disease, combined two or more etiology cirrhosis, and unexplained cirrhosis.
Table 2. Univariate and multivariate regression analysis in the training cohort.
Table 2. Univariate and multivariate regression analysis in the training cohort.
Univariate Regression AnalysisMultivariate Regression Analysis
Wald Valuep ValueOR95% CIWald Valuep ValueOR95% CI
Child–Pugh Score7.3420.0071.1631.043, 1.2980.2900.5900.9390.747, 1.180
PT6.7780.0091.0091.024, 1.1800.8310.3621.0470.948, 1.157
Hb5.2100.0220.9910.983, 0.9990.2830.5941.0030.992, 1.014
Alb16.286<0.0010.9080.867, 0.9526.1580.0130.9110.847, 0.981
D-dimer23.328<0.0011.1361.079, 1.19713.607<0.0011.1161.053, 1.184
PVD19.205<0.0011.1951.103, 1.29420.350<0.0011.2411.130, 1.363
Splenectomy18.196<0.0013.3831.933, 5.92423.658<0.0015.5122.771, 10.966
Spleen length11.8230.0011.0141.006, 1.0210.9090.3401.0060.994, 1.018
Spleen thickness9.7790.0021.0301.011, 1.0500.0550.8151.0040.974, 1.034
Ascites11.4750.0012.2791.415, 3.6700.5800.4461.3000.662, 2.553
Esophageal gastric varices15.635<0.0012.8651.700, 4.8266.7080.0102.4241.240, 4.738
Table 3. The comparison of position of thrombosis in the different cohorts.
Table 3. The comparison of position of thrombosis in the different cohorts.
Training CohortInternal Validation CohortExternal Validation Cohortχ2p Value
Total11258576.1880.630
Main trunk and branches of portal vein74 (66.07%)37 (63.79%)31 (54.39%)
Portal vein and splenic vein5 (4.46%)6 (10.34%)4 (7.02%)
Portal vein and superior mesenteric vein22 (19.64%)11 (18.97%)13 (22.80%)
Splenic vein or superior mesenteric vein3 (2.68%)1 (1.72%)4 (7.02%)
All 18 (7.12%)3 (5.17%)5 (8.77%)
1 All: The whole portal vein system including main trunk and branches of portal vein, along with the splenic vein and superior mesenteric vein being filled with thrombosis.
Table 4. Incidence of severe complications during the follow-up.
Table 4. Incidence of severe complications during the follow-up.
Training CohortInternal Validation CohortExternal Validation Cohort
TotalNon-PVTPVTp ValueTotalNon-PVTPVTp ValueTotalNon-PVTPVTp Value
Recurrent EGVB (n=)6735320.0093819190.0482910190.001
RA (n=)5935240.17228 18100.8505225270.016
HE (n=)251780.52818990.269228140.009
Liver failure (n=)9540.2866510.59013670.259
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ding, J.; Zhao, F.; Miao, Y.; Liu, Y.; Zhang, H.; Zhao, W. Nomogram for Predicting Portal Vein Thrombosis in Cirrhotic Patients: A Retrospective Cohort Study. J. Pers. Med. 2023, 13, 103. https://doi.org/10.3390/jpm13010103

AMA Style

Ding J, Zhao F, Miao Y, Liu Y, Zhang H, Zhao W. Nomogram for Predicting Portal Vein Thrombosis in Cirrhotic Patients: A Retrospective Cohort Study. Journal of Personalized Medicine. 2023; 13(1):103. https://doi.org/10.3390/jpm13010103

Chicago/Turabian Style

Ding, Jingnuo, Fazhi Zhao, Youhan Miao, Yunnuo Liu, Huiting Zhang, and Weifeng Zhao. 2023. "Nomogram for Predicting Portal Vein Thrombosis in Cirrhotic Patients: A Retrospective Cohort Study" Journal of Personalized Medicine 13, no. 1: 103. https://doi.org/10.3390/jpm13010103

APA Style

Ding, J., Zhao, F., Miao, Y., Liu, Y., Zhang, H., & Zhao, W. (2023). Nomogram for Predicting Portal Vein Thrombosis in Cirrhotic Patients: A Retrospective Cohort Study. Journal of Personalized Medicine, 13(1), 103. https://doi.org/10.3390/jpm13010103

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop