Comparative Assessment of Percutaneous Left-Atrial Appendage Occlusion (LAAO) Devices—A Single Center Cohort Study
Abstract
:1. Introduction
2. Materials and Methods
2.1. Study Design and Population
2.2. Data Collection
2.3. LAA Closure Procedure
2.4. Outcome Measures
2.5. Statistical Analysis
3. Results
3.1. Patient Characteristics
3.2. Device Evolution
3.3. Procedural Outcomes and Complications
3.4. Peridevice Leak (PDL)
3.5. Endpoints
4. Discussion
Limitation
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Fukunaga, W.M.; Isotani, A.; Shirai, S.; Murakami, N.; Nakamura, M.; Morinaga, T.; Ishizu, K.; Kitano, K.; Kataoka, T.; Hayashi, M.; et al. Initial practice of left atrial appendage closure device in Japan; single-center experience. J. Cardiol. 2022, 79, 752–758. [Google Scholar] [CrossRef]
- Cresti, A.; Garcia-Fernandez, M.A.; Sievert, H.; Mazzone, P.; Baratta, P.; Solari, M.; Geyer, A.; De Sensi, F.; Limbruno, U. Prevalence of extra-appendage thrombosis in non-valvular atrial fibrillation and atrial flutter in patients undergoing cardioversion: A large transoesophageal echo study. EuroIntervention 2019, 15, E225–E230. [Google Scholar] [CrossRef]
- Glikson, M.; Wolff, R.; Hindricks, G.; Mandrola, J.; Camm, A.J.; Lip, G.Y.H.; Fauchier, L.; Betts, T.R.; Lewalter, T.; Saw, J.; et al. EHRA/EAPCI expert consensus statement on catheter-based left atrial appendage occlusion—An update. Europace 2020, 22, 184. [Google Scholar] [CrossRef]
- Galea, R.; De Marco, F.; Aminian, A.; Meneveau, N.; Anselme, F.; Gräni, C.; Huber, A.T.; Teiger, E.; Iriart, X.; Angelillis, M.; et al. Design and Rationale of the Swiss-Apero Randomized Clinical Trial: Comparison of Amplatzer Amulet vs Watchman Device in Patients Undergoing Left Atrial Appendage Closure. J. Cardiovasc. Transl. Res. 2021, 14, 930–940. [Google Scholar] [CrossRef]
- Mehran, R.; Rao, S.V.; Bhatt, D.L.; Gibson, C.M.; Caixeta, A.; Eikelboom, J.; Kaul, S.; Wiviott, S.D.; Menon, V.; Nikolsky, E.; et al. Standardized bleeding definitions for cardiovascular clinical trials: A consensus report from the Bleeding Academic Research Consortium. Circulation 2011, 123, 2736–2747. [Google Scholar] [CrossRef]
- Galea, R.; Mahmoudi, K.; Gräni, C.; Elhadad, S.; Huber, A.T.; Heg, D.; Siontis, G.C.M.; Brugger, N.; Sebag, F.; Windecker, S.; et al. Watchman FLX vs. Watchman 2.5 in a Dual-Center Left Atrial Appendage Closure Cohort: The WATCH-DUAL study. Europace 2022, 24, 1441–1450. [Google Scholar] [CrossRef]
- Holmes, D.R., Jr.; Kar, S.; Price, M.J.; Whisenant, B.; Sievert, H.; Doshi, S.K.; Huber, K.; Reddy, V.Y. Prospective randomized evaluation of the Watchman Left Atrial Appendage Closure device in patients with atrial fibrillation versus long-term warfarin therapy: The PREVAIL trial. J. Am. Coll. Cardiol. 2014, 64, 1–12. [Google Scholar] [CrossRef]
- Tzikas, A.; Shakir, S.; Gafoor, S.; Omran, H.; Berti, S.; Santoro, G.; Kefer, J.; Landmesser, U.; Nielsen-Kudsk, J.E.; Cruz-Gonzalez, I.; et al. Left atrial appendage occlusion for stroke prevention in atrial fibrillation: Multicentre experience with the AMPLATZER Cardiac Plug. EuroIntervention 2016, 11, 1170–1179. [Google Scholar] [CrossRef]
- Chen, C.; Chen, Y.; Qu, L.; Su, X.; Chen, Y. 3-Year outcomes after left atrial appendage closure in patients with nonvalvular atrial fibrillation: Cardiomyopathy related with increased death and stroke rate. BMC Cardiovasc. Disord. 2023, 23, 1–9. [Google Scholar] [CrossRef]
- Whitlock, R.P.; Belley-Cote, E.P.; Paparella, D.; Healey, J.S.; Brady, K.; Sharma, M.; Reents, W.; Budera, P.; Baddour, A.J.; Fila, P.; et al. Left Atrial Appendage Occlusion during Cardiac Surgery to Prevent Stroke. New Engl. J. Med. 2021, 384, 2081–2091. [Google Scholar] [CrossRef]
- Osmancik, P.; Herman, D.; Neuzil, P.; Hala, P.; Taborsky, M.; Kala, P.; Poloczek, M.; Stasek, J.; Haman, L.; Branny, M.; et al. 4-Year Outcomes After Left Atrial Appendage Closure Versus Nonwarfarin Oral Anticoagulation for Atrial Fibrillation. J. Am. Coll. Cardiol. 2022, 79, 1–14. [Google Scholar] [CrossRef]
- Alkhouli, M.; Du, C.; Killu, A.; Simard, T.; Noseworthy, P.A.; Friedman, P.A.; Curtis, J.P.; Freeman, J.V.; Holmes, D.R. Clinical impact of residual leaks following left atrial appendage occlusion: Insights from the NCDR LAAO registry. Clin. Electrophysiol. 2022, 8, 766–778. [Google Scholar] [CrossRef]
- Price, M.J.; Ellis, C.R.; Nielsen-Kudsk, J.E.; Thaler, D.; Gupta, N.; Koulogiannis, K.; Anderson, J.A.; Gage, R.; Lakkireddy, D. Peridevice leak after transcatheter left atrial appendage occlusion: An analysis of the Amulet IDE trial. Cardiovasc. Interv. 2022, 15, 2127–2138. [Google Scholar]
- Dukkipati, S.R.; Holmes, D.R., Jr.; Doshi, S.K.; Kar, S.; Singh, S.M.; Gibson, D.; Price, M.J.; Natale, A.; Mansour, M.; Sievert, H.; et al. Impact of Peridevice Leak on 5-Year Outcomes After Left Atrial Appendage Closure. J. Am. Coll. Cardiol. 2022, 80, 469–483. [Google Scholar] [CrossRef]
- Korsholm, K.; Kramer, A.; Andersen, A.; Saw, J.; Nørgaard, B.L.; Jensen, J.M.; Nielsen-Kudsk, J.E. Left atrial appendage sealing performance of the Amplatzer Amulet and Watchman FLX device. J. Interv. Card. Electrophysiol. 2023, 66, 391–401. [Google Scholar] [CrossRef]
- Simard, T.S.; Hibbert, B.; Alkhouli, M.A.; Abraham, N.A.; Holmes, D.H. Device-related thrombus following left atrial appendage occlusion. EuroIntervention 2022, 18, 224–232. [Google Scholar] [CrossRef]
- Simard, T.; Jung, R.G.; Lehenbauer, K.; Piayda, K.; Pracoń, R.; Jackson, G.G.; Flores-Umanzor, E.; Faroux, L.; Korsholm, K.; Chun, J.K.; et al. Predictors of Device-Related Thrombus Following Percutaneous Left Atrial Appendage Occlusion. J. Am. Coll. Cardiol. 2021, 78, 297–313. [Google Scholar] [CrossRef]
- Pracon, R.; Bangalore, S.; Dzielinska, Z.; Konka, M.; Kepka, C.; Kruk, M.; Kaczmarska-Dyrda, E.; Petryka-Mazurkiewicz, J.; Bujak, S.; Solecki, M.; et al. Device Thrombosis After Percutaneous Left Atrial Appendage Occlusion Is Related to Patient and Procedural Characteristics but Not to Duration of Postimplantation Dual Antiplatelet Therapy. Circ. Cardiovasc. Interv. 2018, 11, e005997. [Google Scholar] [CrossRef]
- Reddy, V.Y.; Holmes, D.; Doshi, S.K.; Neuzil, P.; Kar, S. Safety of percutaneous left atrial appendage closure: Results from the Watchman Left Atrial Appendage System for Embolic Protection in Patients with AF (PROTECT AF) clinical trial and the Continued Access Registry. Circulation 2011, 123, 417–424. [Google Scholar] [CrossRef]
- Fauchier, L.; Cinaud, A.; Brigadeau, F.; Lepillier, A.; Pierre, B.; Abbey, S.; Fatemi, M.; Franceschi, F.; Guedeney, P.; Jacon, P.; et al. Device-Related Thrombosis After Percutaneous Left Atrial Appendage Occlusion for Atrial Fibrillation. J. Am. Coll. Cardiol. 2018, 71, 1528–1536. [Google Scholar] [CrossRef]
- Lempereur, M.; Aminian, A.; Freixa, X.; Gafoor, S.; Kefer, J.; Tzikas, A.; Legrand, V.; Saw, J. Device-associated thrombus formation after left atrial appendage occlusion: A systematic review of events reported with the Watchman, the Amplatzer Cardiac Plug and the Amulet. Catheter. Cardiovasc. Interv. 2017, 90, E111–E121. [Google Scholar] [CrossRef] [PubMed]
- Reddy, V.Y.; Doshi, S.K.; Kar, S.; Gibson, D.N.; Price, M.J.; Huber, K.; Horton, R.P.; Buchbinder, M.; Neuzil, P.; Gordon, N.T.; et al. 5-Year Outcomes After Left Atrial Appendage Closure: From the PREVAIL and PROTECT AF Trials. J. Am. Coll. Cardiol. 2017, 70, 2964–2975. [Google Scholar] [CrossRef] [PubMed]
- Lakkireddy, D.; Thaler, D.; Ellis, C.R.; Swarup, V.; Gambhir, A.; Hermiller, J.; Nielsen-Kudsk, J.E.; Worthley, S.; Nair, D.; Schmidt, B.; et al. 3-Year Outcomes from the Amplatzer Amulet Left Atrial Appendage Occluder Randomized Controlled Trial (Amulet IDE). JACC: Cardiovasc. Interv. 2023, 16, 1902–1913. [Google Scholar] [CrossRef] [PubMed]
- Agasthi; Arsanjani, R. Catheter Management of Left Atrial Appendage Closure Devices; StatPearls: Treasure Island, FL, USA, 2024. [Google Scholar]
Watchman 2.5 (n = 169) | Watchman FLX (n = 27) | ACP (n = 28) | Amulet (n = 41) | All (n = 265) | p-Value | |
---|---|---|---|---|---|---|
Age, mean (SD), years | 75.4 ± 8.1 | 77.1 ± 7.1 | 74.6 ± 6.3 | 75.8 ± 7.3 | 75.5 ± 7.7 | 0.58 |
Males, n (%) | 104 (61.5) | 15 (55.6) | 18 (64.3) | 34 (82.9) | 171 (64.5) | 0.05 |
BMI, mean (SD), kg/m2 | 26.9 ± 4.9 | 26.1 ± 4.1 | 26.1 ± 4.5 | 26.7 ± 3.2 | 26.7 ± 4.6 | 0.86 |
Atrial fibrillation/flutter | ||||||
Paroxysmal, n (%) | 78 (46.2) | 18 (66.7) | 8 (28.6) | 24 (58.5) | 128 (48.3) | 0.018 |
Persistent, n (%) | 16 (9.5) | 0 | 8 (28.6) | 2 (4.9) | 26 (9.8) | 0.004 |
Long-standing persistent n, (%) | 42 (24.9) | 6 (22.2) | 11 (39.3) | 6 (14.6) | 65 (24.5) | 0.14 |
Atrial flutter, n (%) | 2 (1.2) | 0 | 0 | 0 | 2 (0.8) | 1.00 |
CHA2DS2-VASc Score, mean (SD) | 4.8 ± 1.5 | 5.1 ± 1.5 | 4.8 ± 1.3 | 4.5 ± 1.6 | 4.8 ± 1.5 | 0.36 |
HAS-BLED Score, mean (SD) | 3.7 ± 1.0 | 3.9 ± 1.0 | 3.9 ± 0.7 | 3.6 ± 1.1 | 3.8 ± 1.0 | 0.52 |
Arterial hypertension, n (%) | 161 (95.3) | 26 (96.3) | 27 (96.4) | 37 (90.2) | 251 (94.7) | 0.61 |
Coronary artery disease, n (%) | 107 (63.3) | 17 (63.0) | 10 (35.7) | 22 (53.7) | 156 (58.9) | 0.042 |
ACI stenosis, n (%) | 12 (7.1) | 1 (3.7) | 2 (7.1) | 2 (4.9) | 17 (6.4) | 1.00 |
Diabetes mellitus, n (%) | 54 (32.0) | 10 (37.0) | 7 (25.0) | 15 (36.6) | 86 (32.5) | 0.73 |
Dyslipidemia, n (%) | 95 (56.2) | 19 (70.4) | 10 (35.7) | 25 (61.0) | 149 (56.2) | 0.06 |
History of syncope, n (%) | 19 (11.2) | 2 (7.4) | 1 (3.6) | 2 (4.9) | 24 (9.1) | 0.50 |
Peripheral arterial occlusive disease, n (%) | 49 (29.0) | 10 (37.0) | 4 (14.3) | 12 (29.3) | 75 (28.3) | 0.29 |
Smoking, n (%) | 57 (33.7) | 13 (48.1) | 5 (17.9) | 18 (43.9) | 93 (35.1) | 0.07 |
COPD, n (%) | 18 (10.7) | 4 (14.8) | 1 (3.6) | 4 (9.8) | 27 (10.2) | 0.60 |
Dyspnoea, n (%) | ||||||
NYHA ≤ II | 128 (76.2) | 24 (88.9) | 26 (96.3) | 35 (85.4) | 213 (81.0) | 0.042 |
NYHA > II | 40 (23.8) | 3 (11.1) | 1 (3.7) | 6 (14.6) | 50 (19.0) | 0.042 |
LV-EF (2D-TTE), mean (SD), % | 51.5 ± 9.7 | 51.1 ± 9.9 | NA | 51.6 ± 6.0 | 51.4 ± 8.8 | 0.70 |
Chronic kidney disease | 51 (30.2) | 5 (18.5) | 7 (25.0) | 12 (29.3) | 75 (28.3) | 0.63 |
Serum creatinine, mean (SD), mg/dL | 1.3 ± 1.0 | 1.0 ± 0.6 | 1.1 ± 0.4 | 1.4 ± 1.5 | 1.3 ± 1.1 | 0.36 |
hsTnT, median (IQR), pg/mL | 16.0 (11.0–27.7) | 22.3 (16.05–31.6) | 17.0 (11.0–25.5) | 50.0 (15.8–58.5) | 17.45 (11.0–34.6) | 0.026 |
NT-proBNP, median (IQR), ng/L | 1231 (404–2523.7) | 784 (531–1298) | 1784 (1401–2101) | 812 (356–2512.7) | 1185.5 (390.2–2209.5) | 0.630 |
Watchman 2.5 (n = 169) | Watchman FLX (n = 27) | ACP (n = 28) | Amulet (n = 41) | All (n = 265) | p-Value | |
---|---|---|---|---|---|---|
Past bleeding, n (%) | ||||||
Gastrointestinal | 65 (38.5) | 14 (51.9) | 3 (10.7) | 20 (48.8) | 102 (38.5) | 0.005 |
Intracranial/intraspinal | 65 (38.5) | 7 (25.9) | 19 (67.9) | 12 (29.3) | 103 (38.5) | 0.004 |
Spontaneous intramuscular/intracutaneous | 5 (3.0) | 3 (11.1) | 4 (14.3) | 1 (2.4) | 13 (4.9) | 0.024 |
Severe epistaxis | 6 (3.6) | 3 (11.1) | 2 (7.1) | 2 (4.9) | 13 (4.9) | 0.23 |
Hematuria | 10 (5.9) | 0 | 0 | 1 (2.4) | 11 (4.2) | 0.46 |
Ocular | 3 (1.8) | 0 | 1 (3.6) | 0 | 4 (1.5) | 0.67 |
Others | 2 (1.2) | 0 | 1 (3.6) | 1 (2.4) | 4 (1.5) | 0.46 |
Elevated risk of bleeding, n (%) | ||||||
HAS-BLED ≥ 3 | 6 (3.6) | 1 (3.7) | 0 | 0 | 7 (2.6) | 0.57 |
Pronounced propensity to fall | 4 (2.4) | 0 | 0 | 2 (4.9) | 6 (2.3) | 0.54 |
Hemophilia | 1 (0.6) | 0 | 0 | 2 (4.9) | 3 (1.1) | 0.17 |
Thrombocytopenia or compromised platelet function | 2 (1.2) | 0 | 0 | 0 | 2 (0.8) | 1.00 |
Intracerebral cavernoma | 0 | 0 | 0 | 1 (2.4) | 1 (0.4) | 0.37 |
Oral anticoagulant | 2 (1.2) | 0 | 2 (7.1) | 1 (2.4) | 5 (1.9) | 0.15 |
Stroke despite OAC | 4 (2.4) | 0 | 0 | 1 (2.4) | 5 (1.9) | 1.00 |
Watchman 2.5 (n = 178) | Watchman FLX (n = 28) | ACP (n = 28) | Amulet (n = 42) | All (n = 277 ∞) | p-Value | |
---|---|---|---|---|---|---|
Successful implantation, n (%) | 169 (94.9) | 27 (96.4) | 28 (100) | 40 (95.2) | 265 (95.7) | 0.9 |
Failed Implantation, n (%) | 8 (4.5) | 1 (3.6) | 0 | 2 (4.8) | 12 (4.3) | 0.9 |
Successful after intraprocedural device change, n (%) | 1 (0.6) | NA | NA | NA | 1 (0.4) | |
Procedure duration, min | 61.0 ± 22.2 | 59.6 ± 20.4 | 66.9 ± 21.3 | 67.7 ± 27.1 | 62.5 ± 22.8 | 0.3 |
Duration of fluoroscopy, min | 11.5 ± 6.4 | 11.6 ± 5.4 | 14.4 ± 8.4 | 12.5 ± 8.1 | 12.0 ± 6.8 | 0.4 |
Radiation dose, Gy × cm2 | 51.1 ± 38.0 | 27.0 ± 23.5 | 49.6 ± 34.0 | 39.3 ± 44.0 | 46.6 ± 37.9 | <0.0001 |
Amount of contrast medium, mL | 59.7 ± 41.4 | 59.8 ± 33.5 | 45.9 ± 24.2 | 55.5 ± 30.3 | 57.7 ± 37.7 | 0.5 |
Sinus rhythm at admission, n (%) | 73 (41.0) | 12 (42.9) | 6 (21.4) | 18 (42.9) | 109 (39.6) | 0.2 |
Mean left atrial pressure at implantation, mmHg | 19.3 ± 8.3 | 15.9 ± 5.3 | 17.2 ± 6.0 | 15.8 ± 9.0 | 18.1 ± 8.0 | 0.2 |
Hospital stay > 1 night, n (%) | 59 (33.1) | 7 (25.0) | 17 (60.7) | 6 (14.3) | 90 (32.5) | 0.0007 |
Watchman 2.5 (n = 178) | Watchman FLX (n = 28) | ACP (n = 28) | Amulet (n = 42) | All (n = 277 ∞) | p-Value | |
---|---|---|---|---|---|---|
Pericardial effusion, n (%) | 5 (2.8) | 0 | 0 | 1 (2.4) | 6 (2.2) | 1.0 |
Clinically relevant, n (%) | 1 (0.6) | 0 | 0 | 1 (2.4) | 2 (0.7) | 0.58 |
Pericardial tamponade, n (%) | 0 | 0 | 0 | 1 (2.4) | 1 (0.4) | 0.35 |
Device embolism, n (%) | 0 | 0 | 0 | 0 | 0 | NA |
LCX occlusion, n (%) | 0 | 0 | 0 | 0 | 0 | NA |
TIA, n (%) | 1 (0.6) | 0 | 0 | 0 | 1 (0.4) | 1.0 |
Myocardial infarction, n (%) | 0 | 0 | 0 | 0 | 0 | NA |
Thromboembolism, n (%) | 0 | 0 | 0 | 0 | 0 | NA |
Air embolism, n (%) | 1 (0.6) | 0 | 0 | 0 | 1 (0.4) | 1.0 |
Death, n (%) | 0 | 0 | 0 | 0 | 0 | NA |
Bleeding at puncture site, n (%) | 19 (10.7) | 0 | 4 (14.3) | 0 | 24 (8.7) | 0.014 |
Aneurysma spurium | 7 (3.9) | 0 | 2 (7.1) | 0 | 9 (3.2) | 0.27 |
BARC classification of bleeding | ||||||
Minor | 13 (7.3) | 0 | 2 (7.1) | 0 | 15 (5.4) | 0.14 |
1 | 0 | 0 | 0 | 0 | 0 | |
2 | 13 (7.3) | 0 | 2 (7.1) | 0 | 15 (5.4) | 0.14 |
Major | 6 (3.4) | 0 | 2 (7.1) | 0 | 9 (3.2) | 0.31 |
3a | 4 (2.2) | 0 | 2 (7.1) | 0 | 7 (2.5) | 0.29 |
3b | 2 (1.1) | 0 | 0 | 0 | 2 (0.7) | 1.0 |
3c | 0 | 0 | 0 | 0 | 0 | NA |
4 | 0 | 0 | 0 | 0 | 0 | NA |
5a | 0 | 0 | 0 | 0 | 0 | NA |
5b | 0 | 0 | 0 | 0 | 0 | NA |
AV fistula without bleeding | 3 (1.7) | 0 | 0 | 0 | 3 (1.1) | 1.0 |
Watchman 2.5 | Watchman FLX | ACP | Amulet | All | p-Value | |
---|---|---|---|---|---|---|
Ischemic stroke, n (%) | 2 (2.1) | 0 | 0 | 1 (5.9) | 3 (2.1) | 0.481 |
TIA, n (%) | 1 (1.0) | 0 | 0 | 0 | 1 (0.7) | 1.000 |
Thromboembolic events, n (%) | 1 (1.0) | 0 | 0 | 0 | 1 (0.7) | 1.000 |
Thrombi on device, n (%) | 2 (2.1) | 1 (14.3) | 2 (8.7) | 1 (5.9) | 6 (4.2) | 0.116 |
Death, n (%) | 3 (3.1) | 0 | 0 | 0 | 3 (2.1) | 1.000 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Kayvanpour, E.; Kothe, M.; Kaya, Z.; Pleger, S.; Frey, N.; Meder, B.; Sedaghat-Hamedani, F. Comparative Assessment of Percutaneous Left-Atrial Appendage Occlusion (LAAO) Devices—A Single Center Cohort Study. J. Cardiovasc. Dev. Dis. 2024, 11, 158. https://doi.org/10.3390/jcdd11060158
Kayvanpour E, Kothe M, Kaya Z, Pleger S, Frey N, Meder B, Sedaghat-Hamedani F. Comparative Assessment of Percutaneous Left-Atrial Appendage Occlusion (LAAO) Devices—A Single Center Cohort Study. Journal of Cardiovascular Development and Disease. 2024; 11(6):158. https://doi.org/10.3390/jcdd11060158
Chicago/Turabian StyleKayvanpour, Elham, Max Kothe, Ziya Kaya, Sven Pleger, Norbert Frey, Benjamin Meder, and Farbod Sedaghat-Hamedani. 2024. "Comparative Assessment of Percutaneous Left-Atrial Appendage Occlusion (LAAO) Devices—A Single Center Cohort Study" Journal of Cardiovascular Development and Disease 11, no. 6: 158. https://doi.org/10.3390/jcdd11060158
APA StyleKayvanpour, E., Kothe, M., Kaya, Z., Pleger, S., Frey, N., Meder, B., & Sedaghat-Hamedani, F. (2024). Comparative Assessment of Percutaneous Left-Atrial Appendage Occlusion (LAAO) Devices—A Single Center Cohort Study. Journal of Cardiovascular Development and Disease, 11(6), 158. https://doi.org/10.3390/jcdd11060158