Comparison of Performance between ARC-HBR Criteria and PRECISE-DAPT Score in Patients Undergoing Percutaneous Coronary Intervention
by
, ,
Sun Young Choi
1,2
,
Moo-Hyun Kim
1,*,
Kwang-Min Lee
1,
Yeo-Gyeong Ko
1,
Chan-Ho Yoon
1,
Min-Kyeong Jo
1 and
Sung-Cheol Yun
3 1
Department of Cardiology, Dong-A University Hospital, Busan 49201, Korea
2
Department of Biomedical Laboratory Science, Daegu Health College, Daegu 41453, Korea
3
Department of Clinical Epidemiology and Biostatistics, University of Ulsan College of Medicine, Asan Medical Center, Seoul 05505, Korea
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2021, 10(12), 2566; https://doi.org/10.3390/jcm10122566
Submission received: 18 April 2021
/
Revised: 13 May 2021
/
Accepted: 15 May 2021
/
Published: 10 June 2021
(This article belongs to the Special Issue Myths and Realities of Current Cardiovascular Diseases and Therapy)
Abstract
:The proper management of bleeding risk in patients undergoing percutaneous coronary intervention (PCI) is critical. Recently, the Academic Research Consortium for High Bleeding Risk (ARC-HBR) criteria have been proposed as a standardized tool for predicting bleeding risk. We sought to compare the predictive performance of ARC-HBR criteria and the PRECISE-DAPT score for bleeding in Korean patients undergoing PCI. We recruited 1418 consecutive patients undergoing PCI from January 2012 through December 2018 (Dong-A University Medical Center, Busan, Korea). The ARC-HBR and PRECISE-DAPT scores showed a high AUC for three bleeding definitions (AUC 0.75 and 0.77 for BARC 3 to 5; AUC 0.68 and 0.71 for TIMI minor to major; AUC 0.81 and 0.82 for GUSTO moderate to severe, respectively) and all-cause death (AUC 0.82 and 0.82, respectively). When compared with the ARC-HBR score, the discriminant ability of the PRECISE-DAPT score was not significantly different for bleeding events and all-cause death. The ARC-HBR criteria and PRECISE-DAPT scores demonstrated reasonably good discriminatory capacity with respect to 1-year bleeding events in Korean patients treated with DAPT, regardless of the bleeding definition. Our findings also suggest that the simple PRECISE-DAPT score is as useful as ARC-HBR criteria in predicting bleeding and all-cause death after PCI.
1. Introduction
Dual antiplatelet therapy (DAPT) with aspirin and a P2Y12 inhibitor after percutaneous coronary intervention (PCI) reduces ischemic events. However, prolonged DAPT increases bleeding risk, which has been associated with critical adverse events [1,2,3,4]. For this reason, the proper identification and management of patients with high bleeding risk (HBR) is critically important, and several tools have been investigated in randomized trials to predict bleeding risk [5,6,7,8]. However, standardization of a tool for this purpose has not been achieved to date, due to differences in the characteristics of the derivation cohorts, the timing after PCI, and genetic differences associating with ethnicity.
In 2017, a simple five-item risk score called the Predicting Bleeding Complication in Patients Undergoing Stent Implantation and Subsequent Dual Antiplatelet Therapy (PRECISE-DAPT) score was created as a standardized tool for patients treated with DAPT after PCI in a large, pooled dataset of contemporary, randomized clinical trials, implementing different DAPT duration strategies [9]. Recently, the Academic Research Consortium for HBR (ARC-HBR) criteria have been proposed to standardize the definition of HBR in patients undergoing PCI, based on consensus from an expert panel [10,11,12]. To date, assessments of the performance of the ARC-HBR criteria in clinical practice have been limited. We sought to measure the performance of the ARC-HBR criteria in Asian patients undergoing PCI and to draw a comparison with the PRECISE-DAPT score.
2. Materials and Methods
2.1. Study Population
Between January 2012 and December 2018, a total of 1418 post-PCI patients (Dong-A University Medical Center, Busan, Republic of Korea) receiving maintenance DAPT were recruited for our prospective observational cross-sectional study. Written informed consent was obtained from all patients, and the study protocol was approved by the Ethical Review Board of Dong-A University Hospital. We excluded patients with active bleeding or those who had undergone major surgery within the prior 4 weeks, and those receiving treatment with oral anticoagulants.
2.2. Definition
The PRECISE-DAPT scores and ARC-HBR criteria were assessed using the patients’ clinical characteristics. The PRECISE-DAPT score was determined using an online calculator with five variables (age, creatinine clearance, hemoglobin, white blood cell count and previous spontaneous bleeding) [9]. The individual rating for variables, established for each score, was assigned. The total scores for each patient were calculated by summing the individual result for each prognostic variable included in the score. Patients were classified as belonging to the HBR group if at least 1 major or 2 minor ARC-HBR criteria were met, and patients with 1 minor criterion were classified as no-HBR [10]. The ARC-HBR criteria are as follows: major criteria such as oral anticoagulation, severe chronic kidney disease (estimated glomerular filtration [eGFR] < 30 mL/min), thrombocytopenia (platelet count < 100 × 109/L), severe anemia (hemoglobin < 11 g/dL), liver cirrhosis, active malignancy within 12 months and/or ongoing requirement for treatment (excluding nonmelanoma skin cancer) or prior hemorrhagic stroke, and minor criteria such as age ≥ 75 years, moderate chronic kidney disease (eGFR 30–59 mL/min), mild anemia (hemoglobin 11–12.9 g/dL for men and 11–11.9 g/dL for women) or prior ischemic stroke. Additionally, the ARC-HBR criteria required modification for the ARC-HBR scores, which can be compared with the PRECISE-DAPT score [13]. The ARC-HBR score was calculated by adding 1 point for any major criterion and 0.5 points for any minor criterion.
2.3. Clinical Endpoint
The primary endpoint for the analysis was all-cause death and bleeding complications defined according to three different bleeding severity scales: Bleeding Academic Research Consortium (BARC) 3 to 5 bleeding [14], Thrombolysis in Myocardial Infarction (TIMI) minor or major [15] and Global Use of Strategies To Open coronary arteries (GUSTO) moderate or severe [16].
2.4. Statistical Analysis
Continuous variables are expressed as mean values with standard deviations, and categorical variables are presented as frequencies (percentages). Comparisons between two mean values for continuous variables were analyzed by Student’s t-test. Categorical variables were compared with Pearson’s chi-square or Fisher’s exact test. The PRECISE-DAPT scores were stratified into three risk categories of bleeding (low, moderate and high). The predictive values of the PRECISE-DAPT and ARC-HBR scores were assessed using a Cox regression model and receiver operating characteristics (ROC) curve analysis (using MedCalc Version 12.2.1, MedCalc software, Mariakerke, Belgium) [17]. The prognostic utility of the risk models for major bleeding was assessed by deriving their C-statistics, using ROC curves. In general, a model with a C-statistic above 0.70 is considered to have acceptable discriminatory capacity [18]. The C-statistics for the three risk models were compared to each other using a nonparametric test [19]. The calibration of the models was evaluated using the Hosmer–Lemeshow goodness-of-fit statistical analysis. Net reclassification improvement (NRI) represents the average weighted improvement in discrimination, while integrated discrimination improvement (IDI) takes into account the change in the estimated prediction probabilities as a continuous variable and represents the average improvement in predictive probability. The impact of the reclassification procedure using the superior score was assessed using the NRI approach. Positive values of NRI indicate the predominance for correct reclassification, while negative values indicate a predominance of incorrect reclassification. p-values < 0.05 were considered to indicate significance. Statistical analyses were performed using SPSS Version 18.0 (SPSS Inc., Chicago, IL, USA).
3. Results
3.1. Baseline Characteristics
The study cohort comprised 1418 patients who were treated with DAPT. The baseline demographics and clinical characteristics are shown in Table 1. Of the total patients, 502 patients (35.4%) were classified as belonging to the HBR group and 916 patients (64.6%) in the no-HBR group. Compared to their no-HBR counterparts, HBR patients were older (aged ≥ 75 years: 54%) and more frequently female (39.2%). HBR was also associated with diabetes mellitus, hypertension, current smoking and prior stroke history, and differences in renal function, anemia, platelet count, liver function, and cancer.
3.2. Clinical Outcome Risks Associated with HBR
The cumulative incidence of 1-year clinical events, according to HBR, is shown in Table 2. The incidence of BARC 3 or 5 bleeding, TIMI minor or major bleeding, and GUSTO moderate or severe bleeding, were significantly higher in the HBR group than in the no-HBR group (31.1% vs. 6.9%, 21.9% vs. 6.6%, and 18.9% vs. 2.5%, p < 0.001, respectively). The cumulative incidence of all-cause death was significantly higher in patients with HBR, compared to those without HBR (Table 2). HBR patients had a significantly higher risk of BARC 3 or 5 bleeding (hazard ration [HR] 5.21, 95% confidence interval [CI] 4.62–8.20, p < 0.001), TIMI minor or major bleeding (HR 4.15, 95% CI 3.01–5.72, p < 0.001), and GUSTO moderate to severe bleeding (HR 8.49, 95% CI 5.78–12.5, p < 0.001), than no-HBR patients. HBR was also associated with higher risk of all-cause death (HR 9.79, 95% CI 4.97–19.3, p < 0.001) compared to the no-HBR group (Table 2 and Figure 1).
3.3. Effect of Individual ARC-HBR Criteria and ARC-HBR Scores on Clinical Outcomes
The risk of ARC-HBR major and minor criteria is summarized in Table 3. Severe anemia was associated with the highest risk for BARC 3 to 5 (HR 4.37, 95% CI 3.34–5.72, p < 0.001) and GUSTO moderate to severe bleeding (HR 9.17, 95% CI 6.33–13.3, p < 0.001). The factor associated with the highest risk was active malignancy for TIMI minor to major bleeding (HR 2.72, 95 % CI 1.21–6.16) and all-cause death (HR 13.0, 95% CI 5.06–33.4, p < 0.001). However, among the ARC-HBR major criteria, oral anticoagulation was not associated with the risk of three bleeding events (BARC 3 to 5, TIMI minor to major, and GUSTO moderate to severe) and all-cause death, while minor criteria such as old age and moderate chronic kidney disease increased the risk of three bleeding definitions and all-cause death by more than two-fold.
The predictive performance of the ARC-HBR score for 1-year clinical outcomes was greatest for higher scores compared to lower scores (Table 4). The relative risk of three bleeding events and all-cause death continuously increased for the higher scores compared with ARC-HBR scores of <1. The cumulative incidence curve shows that patients with higher ARC-HBR scores had a higher risk of adverse clinical outcomes (Figure 2).
3.4. Comparison of Predictive Performance of ARC-HBR and PRECISE-DAPT Scores
The distribution of the risk categories in the PRECISE-DAPT score according to the different ARC-HBR scores is presented in Figure 3. In total, 58.9% patients with an ARC-HBR score of 0 or 0.5 (no-HBR group) met the threshold for the low-risk category of the PRECISE-DAPT score (≤17). The higher ARC-HBR scores enabled broader inclusion in the high-risk category of the PRECISE-DAPT score (>24). Meanwhile, 78.1% of patients with ARC-HBR scores of 1 (one major or two minor criteria) or 1.5 (one major and one minor criteria, or three minor criteria) and most patients (>95%) with ARC-HBR scores of ≥2 satisfied the high PRECISE-DAPT score criteria. Table 5 presents the discriminatory capacity of the ARC-HBR and PRECISE-DAPT scores in predicting clinical outcomes at one year, including assessing the area under the curve (AUC). In the C-statistics analysis, the ARC-HBR and PRECISE-DAPT scores showed high AUC values for three bleeding definitions (AUC 0.75 and 0.77 for BARC 3 to 5; AUC 0.68 and 0.71 for TIMI minor to major; AUC 0.81 and 0.82 for GUSTO moderate to severe, respectively) and all-cause death (AUC 0.82 and 0.82, respectively). When compared with the ARC-HBR score, the discriminant ability of the PRECISE-DAPT score was not significantly different for predicting three bleeding definitions and all-cause death. When compared with the PRECISE-DAPT, the ARC-HBR was not significantly superior in terms of net reclassification improvement (NRI) or integrated discrimination improvement (IDI) (Table 6).
4. Discussion
We found that the ARC-HBR criteria demonstrated reasonable discriminatory capacity with respect to 1-year bleeding in Korean patients treated with DAPT, regardless of the bleeding definition (BARC 3 to 5, TIMI minor to major, and GUSTO moderate to severe). In addition, the discriminatory ability of the PRECISE-DAPT score, a simple five-item prediction algorithm for bleeding, was similar to the ARC-HBR criteria, a recently developed consensus risk stratification tool. Furthermore, 78.1% patients with ARC-HBR scores of 1 or 1.5 and most patients (>95%) with ARC-HBR scores of ≥2 were stratified into the high PRECISE-DAPT score category. Patients with HBR also carried a six-fold risk of BARC 3 to 5 bleeding, a four-fold increase in TIMI minor to major bleeding, an eight-fold risk of GUSTO moderate to severe bleeding, and a nine-fold higher risk of all-cause death compared with no-HBR patients. An increased number of ARC-HBR criteria being fulfilled was also associated with an incrementally higher incidence of bleeding events and all-cause death.
Major bleeding is one of the most common serious adverse events in acute coronary syndrome [20]. In this clinical setting, there is a strong relationship between bleeding and mortality, with major bleeding associated with a 60% increase in risk of hospital death [21]. Potent DAPT can increase the number of patients at high risk of bleeding complications. Simple standardized risk stratification is therefore needed for clinical decision-making, relating to the intensity and duration of DAPT after PCI, via an accurate bleeding risk assessment.
Recently, ARC-HBR has been proposed as a consensus-based definition for HBR in patients undergoing PCI and comprises 12 clinical criteria identified as major and minor, supported by published evidence [10]. Meanwhile, the PRECISE-DAPT score is a simple prediction algorithm with five risk factors (age, creatinine clearance, hemoglobin, white-blood-cell count, and previous spontaneous bleeding) as a standardized tool for the prediction of 1-year bleeding during DAPT [9]. An additional advantage of PRECISE-DAPT is that it was derived from eight multicenter randomized clinical trials with independent adjudication of the events. The 2017 European Society of Cardiology Focused Update on DAPT recommended the PRECISE-DAPT score for guidance over the duration of DAPT [22]. In the previous study, we validated the performance of this score for predicting bleeding events in Korean patients undergoing PCI [23]. The simplified PRECISE-DAPT score without WBC count has a similar predictive value for bleeding after PCI [24].
To date, investigations of the performance of the ARC-HBR criteria and the PRECISE-DAPT score in real clinical practice have been limited, and so we modified the ARC-HBR criteria to an ARC-HBR score to compare the predictive ability of these two scoring methods. For the C-statistics analysis, the discriminatory ability of PRECISE-DAPT was not inferior to the ARC-HBR criteria in complications. Moreover, more than 95% of patients are considered to be in the high PRECISE-DAPT category if at least two major or four minor criteria are met. We believe the strength of these findings is supported by the incorporation of various bleeding definitions (BARC, TIMI and GUSTO criteria), which capture the different bleeding complications.
Study Limitations
We note several limitations to our study design. As a single-center retrospective study, the results provided are hypothesis-generating, and the scores evaluated have not yet been validated in an all-comer population, being designed primarily to predict events within one year after the index procedure. It should also be emphasized that there may be confounders to our analysis that could impact the conclusions, including potentially missed bleeding events. Among the ARC-HBR major criteria, oral anticoagulation was not associated with the risk of three bleeding definitions (BARC 3 to 5, TIMI minor to major, and GUSTO moderate to severe) or all-cause death, because a small percentage of patients were included in this study. Furthermore, we did not evaluate ischemic risk. Ischemia and bleeding share overlapping risk factors (e.g., older age, renal dysfunction) and ACS patients have a higher risk of death/ischemia and bleeding complications.
5. Conclusions
The ARC-HBR criteria and PRECISE-DAPT risk scores demonstrated reasonably good discriminatory capacity with respect to 1-year bleeding in Korean patients treated with DAPT, regardless of the bleeding definition. Our findings suggest that the relatively simple PRECISE-DAPT score is as accurate as ARC-HBR criteria in predicting bleeding and all-cause death after PCI. Most HBR patients defined by the ARC-HBR criteria were stratified into the high-risk category of the PRECISE-DAPT score.
Author Contributions
Conceptualization, S.Y.C. and M.-H.K.; methodology, K.-M.L. and S.-C.Y.; software, K.-M.L.; validation, S.Y.C. and M.-H.K.; formal analysis, Y.-G.K., C.-H.Y. and M.-K.J.; investigation, K.-M.L., Y.-G.K., C.-H.Y. and M.-K.J.; resources, S.Y.C. and M.-H.K.; data curation, K.-M.L. and S.-C.Y.; writing—original draft preparation, S.Y.C.; writing—review and editing, S.Y.C. and M.-H.K.; visualization, S.Y.C.; supervision, M.-H.K.; project administration, M.-H.K.; funding acquisition, S.Y.C. and M.-H.K. All authors have read and agreed to the published version of the manuscript.
Funding
This research was supported by a grant from the Ministry of Education, Science and Technology (NRF- 2018R1D1A1A09083902) to M.H.K., and also received support from the Ministry of Education, Science and Technology (NRF-2017R1D1A3B03035713) to S.Y.C.
Institutional Review Board Statement
Written informed consent was obtained from all patients, and the study protocol was approved by the Ethical Review Board of Dong-A University Hospital (15-130).
Informed Consent Statement
Not applicable.
Data Availability Statement
Data are the property of the authors and are available by contacting the corresponding author.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Montalescot, G.; Brieger, D.; Dalby, A.J.; Park, S.J.; Mehran, R. Duration of dual antiplatelettherapy after coronary stenting: A review of the evidence. J. Am. Coll. Cardiol. 2015, 66, 832–847. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Navarese, E.P.; Andreotti, F.; Schulze, V.; Kołodziejczak, M.; Buffon, A.; Brouwer, M.; Costa, F.; Kowalewski, M.; Parati, G.; Lip, G.Y.; et al. Optimal duration of dual antiplatelet therapy after percutaneous coronary intervention with drug eluting stents: Meta-analysis of randomised controlled trials. BMJ 2015, 350, h1618. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Rao, S.V.; O’Grady, K.; Pieper, K.S.; Granger, C.B.; Newby, L.K.; Van de Werf, F.; Mahaffey, K.W.; Califf, R.M.; Harrington, R.A. Impact of bleeding severity on clinical outcomes among patients with acute coronary syndromes. Am. J. Cardiol. 2005, 96, 1200–1206. [Google Scholar] [CrossRef] [PubMed]
- Généreux, P.; Giustino, G.; Witzenbichler, B.; Weisz, G.; Stuckey, T.D.; Rinaldi, M.J.; Neumann, F.J.; Metzger, D.C.; Henry, T.D.; Cox, D.A.; et al. Incidence, predictors, and impact of post-discharge bleeding after percutaneous coronary intervention. J. Am. Coll. Cardiol. 2015, 66, 1036–1045. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Subherwal, S.; Bach, R.G.; Chen, A.Y.; Gage, B.F.; Rao, S.V.; Newby, L.K.; Wang, T.Y.; Gibler, W.B.; Ohman, E.M.; Roe, M.T.; et al. Baseline risk of major bleeding in non-ST-segment-elevation myocardial infarction: The CRUSADE (Can Rapid risk stratification of Unstable angina patients Suppress ADverse outcomes with Early implementation of the ACC/AHA Guidelines) Bleeding Score. Circulation 2009, 119, 1873–1882. [Google Scholar] [CrossRef] [Green Version]
- Mehran, R.; Pocock, S.J.; Nikolsky, E.; Clayton, T.; Dangas, G.D.; Kirtane, A.J.; Parise, H.; Fahy, M.; Manoukian, S.V.; Feit, F.; et al. A risk score to predict bleeding in patients with acute coronary syndromes. J. Am. Coll. Cardiol. 2010, 55, 2556–2566. [Google Scholar] [CrossRef] [Green Version]
- Yeh, R.W.; Secemsky, E.A.; Kereiakes, D.J.; Normand, S.L.; Gershlick, A.H.; Cohen, D.J.; Spertus, J.A.; Steg, P.G.; Cutlip, D.E.; Rinaldi, M.J.; et al. DAPT Study Investigators. Development and validation of a prediction rule for benefit and harm of dual antiplatelet therapy beyond 1 year after percutaneous coronary intervention. JAMA 2016, 315, 1735–1749. [Google Scholar] [CrossRef] [Green Version]
- Baber, U.; Mehran, R.; Giustino, G.; Cohen, D.J.; Henry, T.D.; Sartori, S.; Ariti, C.; Litherland, C.; Dangas, G.; Gibson, C.M.; et al. Coronary thrombosis and major bleeding after PCI with drug-eluting stents: Risk scores from PARIS. J. Am. Coll. Cardiol. 2016, 67, 2224–2234. [Google Scholar] [CrossRef]
- Costa, F.; van Klaveren, D.; James, S.; Heg, D.; Räber, L.; Feres, F.; Pilgrim, T.; Hong, M.K.; Kim, H.S.; Colombo, A.; et al. PRECISE-DAPT Study Investigators. Derivation and validation of the predicting bleeding complications in patients undergoing stent implantation and subsequent dual antiplatelet therapy (PRECISE-DAPT) score: A pooled analysis of individual-patient datasets from clinical trials. Lancet 2017, 389, 1025–1034. [Google Scholar]
- Urban, P.; Mehran, R.; Colleran, R.; Angiolillo, D.J.; Byrne, R.A.; Capodanno, D.; Cuisset, T.; Cutlip, D.; Eerdmans, P.; Eikelboom, J.; et al. Defining high bleeding risk in patients undergoing percutaneous coronary intervention: A consensus document from the academic research consortium for high bleeding risk. Circulation 2019, 140, 240–261. [Google Scholar] [CrossRef]
- Nakamura, M.; Kadota, K.; Nakao, K.; Nakagawa, Y.; Shite, J.; Yokoi, H.; Kozuma, K.; Tanabe, K.; Iijima, R.; Harada, A.; et al. High bleeding risk and clinical outcomes in East Asian patients undergoing percutaneous coronary intervention: The PENDULUM registry. EuroIntervention 2021, 16, 1154–1162. [Google Scholar] [CrossRef] [PubMed]
- Cao, D.; Mehran, R.; Dangas, G.; Baber, U.; Sartori, S.; Chandiramani, R.; Stefanini, G.G.; Angiolillo, D.J.; Capodanno, D.; Urban, P.; et al. Validation of the Academic Research Consortium High Bleeding Risk Definition in Contemporary PCI Patients. J. Am. Coll. Cardiol. 2020, 75, 2711–2722. [Google Scholar] [CrossRef] [PubMed]
- Ueki, Y.; Bär, S.; Losdat, S.; Otsuka, T.; Zanchin, C.; Zanchin, T.; Gragnano, F.; Gargiulo, G.; Siontis, G.C.M.; Praz, F.; et al. Validation of Bleeding Risk Criteria (ARC-HBR) in Patients Undergoing Percutaneous Coronary Intervention and Comparison with Contemporary Bleeding Risk Scores. EuroIntervention 2020, 16, 371–379. [Google Scholar] [CrossRef]
- Mehran, R.; Rao, S.V.; Bhatt, D.L.; Gibson, C.M.; Caixeta, A.; Eikelboom, J.; Kaul, S.; Wiviott, S.D.; Menon, V.; Nikolsky, E.; et al. Standardized bleeding definitions for cardiovascular clinical trials: A consensus report from the Bleeding Academic Research Consortium. Circulation 2011, 123, 2736–2747. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Rao, A.K.; Pratt, C.; Berke, A.; Jaffe, A.; Ockene, I.; Schreiber, T.L.; Bell, W.R.; Knatterud, G.; Robertson, T.L.; Terrin, M.L. Thrombolysis in Myocardial Infarction (TIMI) Trial—phase I: Hemorrhagic manifestations and changes in plasma fibrinogen and the fibrinolytic system in patients treated with recombinant tissue plasminogen activator and streptokinase. J. Am. Coll. Cardiol. 1988, 11, 1–11. [Google Scholar] [CrossRef] [Green Version]
- The GUSTO Investigators. An international randomized trial comparing four thrombolytic strategies for acute myocardial infarction. N. Engl. J. Med. 1993, 329, 673–682. [Google Scholar] [CrossRef] [Green Version]
- Pencina, M.J.; D’Agostino, R.B.; D’Agostino, R.B.; Vasan, R.S.; D’Agostino, R.B., Sr.; D’Agostino, R.B., Jr.; Vasan, R.S. Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Stat. Med. 2008, 27, 157–172. [Google Scholar] [CrossRef]
- Núñez, E.; Steyerberg, E.W.; Núñez, J. Regression modeling strategies. Rev. Esp. Cardiol. 2011, 64, 501–507. [Google Scholar] [CrossRef]
- DeLong, E.R.; DeLong, D.M.; Clarke-Pearson, D.L. Comparing the areas under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics 1988, 44, 837–845. [Google Scholar] [CrossRef]
- Hoekstra, J.W.; Pollack, C.V., Jr.; Roe, M.T.; Peterson, E.D.; Brindis, R.; Harrington, R.A.; Christenson, R.H.; Smith, S.C.; Ohman, E.M.; Gibler, W.B. Improving the care of patients with non-ST-elevation acute coronary syndromes in the emergency department: The CRUSADE initiative. Acad. Emerg. Med. 2002, 9, 1146–1155. [Google Scholar] [CrossRef]
- Moscucci, M.; Fox, K.A.; Cannon, C.P.; Klein, W.; López-Sendón, J.; Montalescot, G.; White, K.; Goldberg, R.J. Predictors of major bleeding in acute coronary syndromes: The Global Registry of Acute Coronary Events (GRACE). Eur. Heart J. 2003, 24, 1815–1823. [Google Scholar] [CrossRef]
- Valgimigli, M.; Bueno, H.; Byrne, R.A.; Collet, J.P.; Costa, F.; Jeppsson, A.; Jüni, P.; Kastrati, A.; Kolh, P.; Mauri, L.; et al. 2017 ESC focused update on dual antiplatelet therapy in coronary artery disease developed in collaboration with EACTS. Eur. J. Cardio-Thorac. Surg. 2018, 53, 34–78. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Choi, S.Y.; Kim, M.H.; Cho, Y.R.; Sung Park, J.; Min Lee, K.; Park, T.H.; Yun, S.C. Performance of PRECISE-DAPT Score for Predicting Bleeding Complication During Dual Antiplatelet Therapy. Circ. Cardiovasc Interv. 2018, 11, e006837. [Google Scholar] [CrossRef]
- Choi, S.Y.; Kim, M.H.; Yun, S.C.; Serebruany, V. Predicting bleeding risk by simplified PRECISE-DAPT score. Thromb Res. 2020, 195, 72–73. [Google Scholar] [CrossRef]
Figure 1.
Cumulative incidence curve of clinical outcomes in HBR and no-HBR groups. BARC, Bleeding Academic Research Consortium; CI, confidence interval; GUSTO, Global Use of Strategies To Open coronary arteries; HBR, high bleeding risk; HR, hazard ration; TIMI, Thrombolysis in Myocardial Infarction.
Figure 1.
Cumulative incidence curve of clinical outcomes in HBR and no-HBR groups. BARC, Bleeding Academic Research Consortium; CI, confidence interval; GUSTO, Global Use of Strategies To Open coronary arteries; HBR, high bleeding risk; HR, hazard ration; TIMI, Thrombolysis in Myocardial Infarction.
Figure 2.
Cumulative incidence curve of clinical outcomes for different ARC-HBR scores. ARC-HBR, Academic Research Consortium for High Bleeding Risk criteria; BARC, Bleeding Academic Research Consortium; GUSTO, Global Use of Strategies To Open coronary arteries; TIMI, Thrombolysis in Myocardial Infarction.
Figure 2.
Cumulative incidence curve of clinical outcomes for different ARC-HBR scores. ARC-HBR, Academic Research Consortium for High Bleeding Risk criteria; BARC, Bleeding Academic Research Consortium; GUSTO, Global Use of Strategies To Open coronary arteries; TIMI, Thrombolysis in Myocardial Infarction.
Figure 3.
Distribution of risk categories for the PRECISE-DAPT score according to different ARC-HBR scores. ARC-HBR, Academic Research Consortium for High Bleeding Risk criteria; PRECISE-DAPT, Predicting Bleeding Complication in Patients Undergoing Stent Implantation and Subsequent Dual Antiplatelet therapy.
Figure 3.
Distribution of risk categories for the PRECISE-DAPT score according to different ARC-HBR scores. ARC-HBR, Academic Research Consortium for High Bleeding Risk criteria; PRECISE-DAPT, Predicting Bleeding Complication in Patients Undergoing Stent Implantation and Subsequent Dual Antiplatelet therapy.
Table 1.
Baseline characteristics.
| Variable | Overall (n = 11,418) | HBR Group (n = 502) | No-HBR Group (n = 916) | p-Value a |
|---|---|---|---|---|
| Age, year | 66.2 ± 24.3 | 73.2 ± 9.3 | 62.3 ± 9.5 | <0.001 |
| Age ≥ years | 346 (24.4) | 271 (54.0) | 75 (8.2) | <0.001 |
| Female gender | 395 (27.9) | 197 (39.2) | 198 (21.6) | <0.001 |
| BMI, kg/m2 | 24.3 ± 3.2 | 23.3 ± 3.2 | 24.8 ± 3.0 | <0.001 |
| Diabetes mellitus | 613 (43.2) | 274 (54.6) | 339 (37.0) | <0.001 |
| Hypertension | 916 (64.6) | 378 (75.3) | 538 (58.7) | <0.001 |
| Dyslipidemia | 659 (46.5) | 233 (46.6) | 462 (50.4) | 0.141 |
| Current smoking | 368 (26.0) | 67 (13.3) | 301 (32.9) | <0.001 |
| Diagnosis | <0.001 | |||
| Angina | 855 (60.3) | 261 (52.0) | 594 (64.8) | |
| NSTEMI | 449 (31.7) | 211 (42.0) | 238 (26.0) | |
| STEMI | 114 (8.0) | 30 (6.0) | 84 (9.2) | |
| Previous myocardial infarction | 354 (25.0) | 139 (27.7) | 215 (23.5) | 0.100 |
| Previous hemorrhagic stroke | 17 (1.2) | 17 (1.3) | 0 (0) | <0.001 |
| Previous ischemic stroke | 131 (9.2) | 94 (18.7) | 37 (4.0) | <0.001 |
| Previous antiplatelet therapy | 554 (50.5) | 213 (57.1) | 341 (47.0) | 0.002 |
| Previous oral anticoagulation | 8 (0.6) | 8 (1.6) | 0 (0) | <0.001 |
| Moderate CKD (eGFR 30–59) | 246 (17.3) | 198 (39.4) | 48 (5.2) | <0.001 |
| Severe CKD (eGFR < 30) | 85 (6.0) | 85 (16.9) | 0 (0) | <0.001 |
| Mild anemia (Hb 11–12.9 g/dL for male, 11–11.9 g/dL for female) | 346 (24.4) | 178 (35.5) | 168 (18.3) | <0.001 |
| Severe anemia (Hb < 11 g/dL) | 236 (16.6) | 236 (47.0) | 0 (0) | <0.001 |
| Platelet < 100 × 109/L | 22 (1.6) | 22 (4.4) | 0 (0) | <0.001 |
| Liver cirrhosis | 27 (1.9) | 27 (5.4) | 0 (0) | <0.001 |
| Malignancy | 19 (1.3) | 19 (3.8) | 0 (0) | <0.001 |
| Medication | <0.001 | |||
| Clopidogrel | 1208 (85.2) | 453 (90.2) | 755 (82.4) | |
| New P2Y12 inhibitor | 180 (12.7) | 38 (7.6) | 142 (15.5) |
Values are n (%) or mean ± standard deviation. a Between HBR and no-HBR group. BMI, body mass index; CKD, chronic kidney disease; eGFR, estimated glomerular filtration rate; Hb, hemoglobin; HBR, high bleeding risk; NSTEMI, non-ST elevation myocardial infarction; STEMI, ST elevation myocardial infarction.
Table 2.
Event rates in the HBR group.
| Event | HBR Group No. of Events (n = 502) | No-HBR Group No. of Events (n = 916) | p-Value | HR (95%CI) | p-Value |
|---|---|---|---|---|---|
| BARC ≥ 3 bleeding (n = 219) | 156 (31.1%) | 63 (6.9%) | <0.001 | 6.12 (4.62–8.20) | <0.001 |
| TIMI ≥ minor bleeding (n = 170) | 110 (21.9%) | 60 (6.6%) | <0.001 | 4.15 (3.01–5.72) | <0.001 |
| GUSTO ≥ mod bleeding (n = 118) | 95 (18.9%) | 23 (2.5%) | <0.001 | 8.49 (5.78–12.5) | <0.001 |
| All-cause death (n = 37) | 32 (6.4%) | 5 (0.5%) | <0.001 | 9.79 (4.97–19.3) | <0.001 |
Values are n (%) compared to the no-HBR group as the reference. BARC, Bleeding Academic Research Consortium; CI, confidence interval; GUSTO, Global Use of Strategies To Open coronary arteries; HBR, high bleeding risk; HR, hazard ratio; TIMI, Thrombolysis in Myocardial Infarction.
Table 3.
Risk of clinical events according to Academic Research Consortium for High Bleeding Risk (ARC-HBR) criteria.
Table 3.
Risk of clinical events according to Academic Research Consortium for High Bleeding Risk (ARC-HBR) criteria.
| Variables | BARC > 3a No. of Events (n = 219) | HR (95% CI) | p-Value | TIMI ≥ Minor No. of Events (n = 170) | HR (95% CI) | p-Value | GUSTO ≥ Mod No. of Events (n = 118) | HR (95% CI) | p-Value | Death No. of Events (n = 37) | HR (95% CI) | p-Value | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Minor criteria | Age ≥ 75 | 93 (26.9%) | 2.49 (1.90–3.26) | <0.001 | 67 (19.4%) | 2.13 (1.56–2.89) | <0.001 | 53 (15.3%) | 2.66 (1.85–3.83) | <0.001 | 23 (6.6%) | 5.24 (2.70–10.2) | <0.001 |
| Moderate CKD | 67 (27.2%) | 2.28 (1.71–3.05) | <0.001 | 52 (21.1%) | 2.24 (1.62–3.11) | <0.001 | 37 (15.0%) | 2.27 (1.54–3.35) | <0.001 | 17 (6.9%) | 4.18 (2.19–7.98) | <0.001 | |
| Mild Anemia | 61 (17.6%) | 1.22 (0.91–1.64) | 0.198 | 57 (16.5%) | 1.62 (1.18–2.23) | 0.003 | 21 (6.1%) | 0.66 (0.42–1.06) | 0.084 | 10 (2.9%) | 1.15 (0.56–2.37) | 0.712 | |
| Prior IS | 34 (26.0%) | 1.93 (1.34–2.79) | <0.001 | 23 (13.5%) | 1.58 (1.02–2.45) | 0.042 | 15 (11.5%) | 1.48 (0.86–2.55) | 0.156 | 5 (3.8%) | 1.55 (0.60–3.97) | 0.364 | |
| Major criteria | Severe CKD | 39 (45.9%) | 4.06 (2.86–5.74) | <0.001 | 19 (22.4%) | 2.05 (1.27–3.31) | 0.003 | 32 (37.6%) | 7.00 (4.66–10.5) | <0.001 | 8 (9.4%) | 4.38 (2.00–9.59) | <0.001 |
| Severe Anemia | 92 (39.0%) | 4.37 (3.34–5.72) | <0.001 | 50 (21.2%) | 2.26 (1.63–3.14) | <0.001 | 72 (30.5%) | 9.17 (6.33–13.3) | <0.001 | 18 (7.6%) | 4.90 (2.57–9.34) | <0.001 | |
| Thrombocytopenia | 8 (36.4%) | 2.75 (1.36–5.57) | 0.005 | 3 (13.6%) | 1.16 (0.37–3.62) | 0.804 | 8 (36.4%) | 5.51 (2.68–11.3) | <0.001 | 3 (13.6%) | 5.89 (1.81–19.2) | 0.003 | |
| Prior ICH | 5 (29.4%) | 2.11 (0.87–5.12) | 0.099 | 2 (11.8%) | 0.92 (0.24–3.87) | 0.962 | 4 (23.5%) | 3.15 (1.16–8.53) | 0.024 | 0 (0%) | - | - | |
| Liver cirrhosis | 9 (33.3%) | 2.50 (1.28–4.88) | 0.007 | 6 (22.2%) | 2.04 (0.90–4.61) | 0.086 | 7 (25.9%) | 3.65 (1.70–7.83) | 0.001 | 2 (7.4%) | 3.08 (0.74–12.8) | 0.122 | |
| Active malignancy | 10 (52.6%) | 3.78 (2.01–7.14) | <0.001 | 6 (31.6%) | 2.72 (1.21–6.16) | 0.016 | 8 (42.1%) | 5.95 (2.90–12.2) | <0.001 | 5 (26.3%) | 13.0 (5.06–33.4) | <0.001 | |
| OAC | 1 (12.5%) | 0.83 (1.12–5.93) | 0.850 | 1 (12.5%) | 1.10 (0.15–7.83) | 0.928 | 0 (0%) | - | - | 0 (0%) | - | - | |
Values are n (%). BARC, Bleeding Academic Research Consortium; CI, confidence interval; CKD, chronic kidney disease; GUSTO, Global Use of Strategies To Open coronary arteries; HR, hazard ration; ICH, intracranial hemorrhage; IS, ischemic stroke; OAC, oral anticoagulation; TIMI, Thrombolysis in Myocardial Infarction.
Table 4.
Risk of clinical events according to Academic Research Consortium for High Bleeding Risk (ARC-HBR) score.
Table 4.
Risk of clinical events according to Academic Research Consortium for High Bleeding Risk (ARC-HBR) score.
| Variable | BARC ≥ 3 (n = 219) | TIMI ≥ Minor (n = 170) | GUSTO ≥ Moderate (n = 118) | All-Cause Death (n = 37) | ||||
|---|---|---|---|---|---|---|---|---|
| ARC-HBR score < 1 (n = 916) | 63 (6.9%) | 60 (6.6%) | 23 (2.5%) | 5 (0.6%) | ||||
| ARC-HBR score = 1,1.5 (n = 334) | 87 (26.1%) | 76 (22.8%) | 40 (12.0%) | 16 (4.8%) | ||||
| ARC-HBR score = 2,2.5 (n = 146) | 53 (36.3%) | 29 (19.9%) | 41 (28.1%) | 13 (9.1%) | ||||
| ARC-HBR score = 3,3.5 (n = 22) | 16 (72.7%) | 5 (22.7%) | 14 (63.6%) | 3 (13.6%) | ||||
| BARC ≥ 3 | TIMI ≥ Minor | GUSTO ≥ Moderate | All-Cause Death | |||||
| HR (95%CI) | p-Value | HR (95%CI) | p-Value | HR (95%CI) | p-Value | HR (95%CI) | p-Value | |
| ARC-HBR score < 1 | Reference | <0.001 | Reference | <0.001 | Reference | <0.001 | Reference | <0.001 |
| ARC-HBR score = 1,1.5 | 4.24 (3.07–5.87) | 3.82 (2.64–5.52) | 5.04 (3.26–7.81) | 8.91 (4.14–19.4) | ||||
| ARC-HBR score = 2,2.5 | 6.13 (3.86–9.75) | 3.22 (1.93–5.37) | 12.6 (6.73–23.6) | 17.1 (5.70–51.3) | ||||
| ARC-HBR score = 3,3.5 | 18.1 (4.60–70.9) | 4.00 (1.10–14.5) | 40.8 (6.59–252.4) | 26.7 (1.81–395.5) | ||||
Values are n (%). BARC, Bleeding Academic Research Consortium; CI, confidence interval; GUSTO, Global Use of Strategies To Open coronary arteries; HBR, high bleeding risk; HR, hazard ration; TIMI, Thrombolysis in Myocardial Infarction.
Table 5.
Discriminative power of the ARC-HBR score and PRECISE-DAPT score for predicting 1-year bleeding according to definition.
Table 5.
Discriminative power of the ARC-HBR score and PRECISE-DAPT score for predicting 1-year bleeding according to definition.
| ARC-HBR Score | PRECISE-DAPT Score | |||
|---|---|---|---|---|
| AUC (95% CI) | p-Value | AUC (95% CI) | p-Value | |
| BARC ≥ 3 bleeding | 0.75 (0.73–0.78) | <0.001 | 0.77 (0.75–0.80) | <0.001 |
| TIMI ≥ minor bleeding | 0.68 (0.66–0.71) | <0.001 | 0.71 (0.68–0.73) | <0.001 |
| GUSTO ≥ moderate bleeding | 0.81 (0.79–0.83) | <0.001 | 0.82 (0.80–0.84) | <0.001 |
| All-cause death | 0.82 (0.80–0.84) | <0.001 | 0.82 (0.80–0.84) | <0.001 |
| z Statistics (95% CI) | p-Value | |||
| BARC ≥ 3 bleeding | 1.589 (−0.005–0.047) | 0.112 | ||
| TIMI ≥ minor bleeding | 1.530 (−0.007–0.053) | 0.126 | ||
| GUSTO ≥ moderate bleeding | 0.816 (−0.019–0.472) | 0.414 | ||
| All-cause death | 0.178 (−0.049–0.058) | 0.859 | ||
ARC-HBR, Academic Research Consortium for High Bleeding Risk criteria; AUC, area under the curve; BARC, Bleeding Academic Research Consortium; CI, confidence interval; GUSTO, Global Use of Strategies To Open coronary arteries; PRECISE-DAPT, Predicting Bleeding Complication in Patients Undergoing Stent Implantation and Subsequent Dual Antiplatelet Therapy; TIMI, Thrombolysis in Myocardial Infarction.
Table 6.
Net reclassification improvement and integrated discriminatory improvement for 1-year bleeding.
Table 6.
Net reclassification improvement and integrated discriminatory improvement for 1-year bleeding.
| Comparison | Event | Bleeding Correctly Reclassified, P (n1) | No Bleeding Correctly Reclassified, P (n2) | NRI | p | IDI | p |
|---|---|---|---|---|---|---|---|
| PRECISE-DAPT vs. ARC-HBR | BARC ≥ 3a | 0.10 (17) | 0.09 (111) | 0.006 | 0.938 | −0.004 | 0.662 |
| TIMI ≥ minor | 0.14 (24) | 0.11 (141) | 0.028 | 0.736 | −0.015 | 0.001 | |
| GUSTO ≥ mod | 0.15 (17) | 0.13 (165) | 0.025 | 0.795 | −0.009 | 0.597 |
NRI, net reclassification improvement; IDI, integrated discrimination improvement; other abbreviations as in Table 5.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
MDPI and ACS Style
Choi, S.Y.; Kim, M.-H.; Lee, K.-M.; Ko, Y.-G.; Yoon, C.-H.; Jo, M.-K.; Yun, S.-C. Comparison of Performance between ARC-HBR Criteria and PRECISE-DAPT Score in Patients Undergoing Percutaneous Coronary Intervention. J. Clin. Med. 2021, 10, 2566. https://doi.org/10.3390/jcm10122566
AMA Style
Choi SY, Kim M-H, Lee K-M, Ko Y-G, Yoon C-H, Jo M-K, Yun S-C. Comparison of Performance between ARC-HBR Criteria and PRECISE-DAPT Score in Patients Undergoing Percutaneous Coronary Intervention. Journal of Clinical Medicine. 2021; 10(12):2566. https://doi.org/10.3390/jcm10122566
Chicago/Turabian StyleChoi, Sun Young, Moo-Hyun Kim, Kwang-Min Lee, Yeo-Gyeong Ko, Chan-Ho Yoon, Min-Kyeong Jo, and Sung-Cheol Yun. 2021. "Comparison of Performance between ARC-HBR Criteria and PRECISE-DAPT Score in Patients Undergoing Percutaneous Coronary Intervention" Journal of Clinical Medicine 10, no. 12: 2566. https://doi.org/10.3390/jcm10122566
APA StyleChoi, S. Y., Kim, M. -H., Lee, K. -M., Ko, Y. -G., Yoon, C. -H., Jo, M. -K., & Yun, S. -C. (2021). Comparison of Performance between ARC-HBR Criteria and PRECISE-DAPT Score in Patients Undergoing Percutaneous Coronary Intervention. Journal of Clinical Medicine, 10(12), 2566. https://doi.org/10.3390/jcm10122566
Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.
