Comparison of Clinical Characteristics and Outcomes of Younger and Elderly Patients with Severe COVID-19 in Korea: A Retrospective Multicenter Study
Abstract
:1. Introduction
2. Materials and Methods
2.1. Definition
2.2. Statistical Analysis
3. Results
3.1. Baseline Characteristics of Patients with Severe COVID-19
3.2. Treatment and Clinical Outcomes of Patients with Severe COVID-19
3.3. Factors Associated with In-Hospital Mortality
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Cucinotta, D.; Vanelli, M. WHO declares COVID-19 a pandemic. Acta Biomed. 2020, 91, 157–160. [Google Scholar]
- WHO. COVID-19, Korea. Available online: https://covid19.who.int/region/wpro/country/kr (accessed on 16 November 2021).
- Baden, L.R.; Sahly, H.M.E.; Essink, B.; Kotloff, K.; Frey, S.; Novak, R.; Diemert, D.; Spector, S.A.; Rouphael, N.; Creech, C.B.; et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N. Engl. J. Med. 2021, 384, 403–416. [Google Scholar] [CrossRef] [PubMed]
- Polack, F.P.; Thomas, S.J.; Kitchin, N.; Absalon, J.; Gurtman, A.; Lockhart, S.; Perez, J.L.; Pérez Marc, G.; Moreira, E.D.; Zerbini, C.; et al. Safety and efficacy of the BNT162b2 mRNA COVID-19 vaccine. N. Engl. J. Med. 2020, 383, 2603–2615. [Google Scholar] [CrossRef] [PubMed]
- Soiza, R.L.; Scicluna, C.; Thomson, E.C. Efficacy and safety of COVID-19 vaccines in older people. Age Ageing 2021, 50, 279–283. [Google Scholar] [CrossRef] [PubMed]
- Javanmardi, F.; Keshavarzi, A.; Akbari, A.; Emami, A.; Pirbonyeh, N. Prevalence of underlying diseases in died cases of COVID-19. A systematic review and meta-analysis. PLoS ONE 2020, 15, e0241265. [Google Scholar]
- Booth, A.; Reed, A.B.; Ponzo, S.; Yassaee, A.; Aral, M.; Plans, D.; Labrique, A.; Mohan, D. Population risk factors for severe disease and mortality in COVID-19: A global systematic review and meta-analysis. PLoS ONE 2021, 16, e0247461. [Google Scholar] [CrossRef]
- Ruan, Q.; Yang, K.; Wang, W.; Jiang, L.; Song, J. Clinical predictors of mortality due to COVID-19 based on an analysis of data of 150 patients from Wuhan, China. Intensive Care Med. 2020, 46, 846–848. [Google Scholar] [CrossRef] [Green Version]
- Zhang, L.; Hou, J.; Ma, F.Z.; Li, J.; Xue, S.; Xu, Z.G. The common risk factors for progression and mortality in COVID-19 patients: A meta-analysis. Arch. Virol. 2021, 166, 2071–2081. [Google Scholar] [CrossRef]
- Huang, C.; Wang, Y.; Li, X.; Ren, L.; Zhao, J.; Hu, Y.; Zhang, L.; Fan, G.; Xu, J.; Gu, X.; et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 2020, 395, 497–506. [Google Scholar] [CrossRef] [Green Version]
- Gan, J.M.; Kho, J.; Akhunbay-Fudge, M.; Choo, H.M.; Wright, M.; Batt, F.; Mandal, A.K.J.; Chauhan, R.; Missouris, C.G. Atypical presentation of COVID-19 in hospitalised older adults. Ir. J. Med. Sci. 2021, 190, 469–474. [Google Scholar] [CrossRef]
- Bavaro, D.F.; Diella, L.; Fabrizio, C.; Sulpasso, R.; Bottalico, I.F.; Calamo, A.; Santoro, C.R.; Brindicci, G.; Bruno, G.; Mastroianni, A.; et al. Peculiar clinical presentation of COVID-19 and predictors of mortality in the elderly. A multicentre retrospective cohort study. Int. J. Infect. Dis. 2021, 105, 709–715. [Google Scholar] [CrossRef]
- Malhotra, V.; Basu, S.; Sharma, N.; Kumar, S.; Garg, S.; Dushyant, K.; Borle, A. Outcomes among 10,314 hospitalized COVID-19 patients at a tertiary care government hospital in Delhi, India. J. Med. Virol. 2021, 93, 4553–4558. [Google Scholar] [CrossRef] [PubMed]
- Li, X.; Xu, S.; Yu, M.; Wang, K.; Tao, Y.; Zhou, Y.; Shi, J.; Zhou, M.; Wu, B.; Yang, Z.; et al. Risk factors for severity and mortality in adult COVID-19 inpatients in Wuhan. J. Allergy Clin. Immunol. 2020, 146, 110–118. [Google Scholar] [CrossRef]
- Ho, F.K.; Petermann-Rocha, F.; Gray, S.R.; Jani, B.D.; Katikireddi, S.V.; Niedzwiedz, C.L.; Foster, H.; Hastie, C.E.; Mackay, D.F.; Gill, J.M.R.; et al. Is older age associated with COVID-19 mortality in the absence of other risk factors? General population cohort study of 470,034 participants. PLoS ONE 2020, 15, e0241824. [Google Scholar] [CrossRef]
- Owen, R.K.; Conroy, S.P.; Taub, N.; Jones, W.; Bryden, D.; Pareek, M.; Faull, C.; Abrams, K.R.; Davis, D.; Banerjee, J. Comparing associations between frailty and mortality in hospitalised older adults with or without COVID-19 infection: A retrospective observational study using electronic health records. Age Ageing 2021, 50, 307–316. [Google Scholar] [CrossRef]
- Berlin, D.A.; Gulick, R.M.; Martinez, F.J. Severe Covid-19. N. Engl. J. Med. 2020, 383, 2451–2460. [Google Scholar] [CrossRef] [PubMed]
- Langford, B.J.; So, M.; Raybardhan, S.; Leung, V.; Westwood, D.; MacFadden, D.R.; Soucy, J.R.; Daneman, N. Bacterial co-infection and secondary infection in patients with COVID-19: A living rapid review and meta-analysis. Clin. Microbiol. Infect. 2020, 26, 1622–1629. [Google Scholar] [CrossRef] [PubMed]
- Tan, X.; Zhang, S.; Xu, J.; Zhou, M.; Huang, Q.; Duan, L.; Lv, Z.; Xia, H.; Xiao, W.; Yin, Z.; et al. Comparison of clinical characteristics among younger and elderly deceased patients with COVID-19: A retrospective study. Aging 2020, 13, 16–26. [Google Scholar] [CrossRef] [PubMed]
- Singhal, S.; Kumar, P.; Singh, S.; Saha, S.; Dey, A.B. Clinical features and outcomes of COVID-19 in older adults: A systematic review and meta-analysis. BMC Geriatr. 2021, 21, 321. [Google Scholar] [CrossRef]
- Neumann-Podczaska, A.; Al-Saad, S.R.; Karbowski, L.M.; Chojnicki, M.; Tobis, S.; Wieczorowska-Tobis, K. COVID 19—Clinical Picture in the Elderly Population: A Qualitative Systematic Review. Aging Dis. 2020, 11, 988–1008. [Google Scholar] [CrossRef]
- Song, J.; Hu, W.; Yu, Y.; Shen, X.; Wang, Y.; Yan, J.; Yang, X.; Gong, S.; Wang, M. A Comparison of Clinical Characteristics and Outcomes in Elderly and Younger Patients with COVID-19. Med. Sci. Monit. Int. Med. J. Exp. Clin. Res. 2020, 26, e925047. [Google Scholar] [CrossRef]
- Pepe, M.; Maroun-Eid, C.; Romero, R.; Arroyo-Espliguero, R.; Fernàndez-Rozas, I.; Aparisi, A.; Becerra-Muñoz, V.M.; Aguado, M.G.; Brindicci, G.; Huang, J.; et al. Clinical presentation, therapeutic approach, and outcome of young patients admitted for COVID-19, with respect to the elderly counterpart. Clin. Exp. Med. 2021, 21, 249–268. [Google Scholar] [CrossRef]
- Li, P.; Chen, L.; Liu, Z.; Pan, J.; Zhou, D.; Wang, H.; Gong, H.; Fu, Z.; Song, Q.; Min, Q.; et al. Clinical features and short-term outcomes of elderly patients with COVID-19. Int. J. Infect. Dis. 2020, 97, 245–250. [Google Scholar] [CrossRef]
- Guo, T.; Shen, Q.; Guo, W.; He, W.; Li, J.; Zhang, Y.; Wang, Y.; Zhou, Z.; Deng, D.; Ouyang, X.; et al. Clinical Characteristics of Elderly Patients with COVID-19 in Hunan Province, China: A Multicenter, Retrospective Study. Gerontology 2020, 66, 467–475. [Google Scholar] [CrossRef]
- Grasselli, G.; Greco, M.; Zanella, A.; Albano, G.; Antonelli, M.; Bellani, G.; Bonanomi, E.; Cabrini, L.; Carlesso, E.; Castelli, G.; et al. Risk Factors Associated With Mortality Among Patients With COVID-19 in Intensive Care Units in Lombardy, Italy. JAMA Intern. Med. 2020, 180, 1345. [Google Scholar] [CrossRef] [PubMed]
- Kim, L.; Garg, S.; O’Halloran, A.; Whitaker, M.; Pham, H.; Anderson, E.J.; Armistead, I.; Bennett, N.M.; Billing, L.; Como-Sabetti, K.; et al. Risk Factors for Intensive Care Unit Admission and In-hospital Mortality Among Hospitalized Adults Identified through the US Coronavirus Disease 2019 (COVID-19)-Associated Hospitalization Surveillance Network (COVID-NET). Clin. Infect. Dis. 2021, 72, e206–e214. [Google Scholar] [CrossRef] [PubMed]
- Giannasi, S.E.; Venuti, M.S.; Midley, A.D.; Roux, N.; Kecskes, C.; San Román, E. Mortality risk factors in elderly patients in intensive care without limitation of therapeutic effort. Med. Intensiva 2018, 42, 482–489. [Google Scholar] [CrossRef] [PubMed]
- Wang, C.H.; Lin, H.C.; Chang, Y.C.; Maa, S.H.; Wang, J.S.; Tang, W.R. Predictive factors of in-hospital mortality in ventilated intensive care unit: A prospective cohort study. Medicine 2017, 96, e9165. [Google Scholar] [CrossRef]
- Vrillon, A.; Hourregue, C.; Azuar, J.; Grosset, L.; Boutelier, A.; Tan, S.; Roger, M.; Mourman, V.; Mouly, S.; Sène, D.; et al. COVID -19 in Older Adults: A Series of 76 Patients Aged 85 Years and Older with COVID-19. J. Am. Geriatr. Soc. 2020, 68, 2735–2743. [Google Scholar] [CrossRef]
- Herrmann, M.L.; Hahn, J.-M.; Walter-Frank, B.; Bollinger, D.M.; Schmauder, K.; Schnauder, G.; Bitzer, M.; Malek, N.P.; Eschweiler, G.W.; Göpel, S. COVID-19 in persons aged 70+ in an early affected German district: Risk factors, mortality and post-COVID care needs—A retrospective observational study of hospitalized and non-hospitalized patients. PLoS ONE 2021, 16, e0253154. [Google Scholar] [CrossRef] [PubMed]
- Knopp, P.; Miles, A.; Webb, T.E.; McLoughlin, B.C.; Mannan, I.; Raja, N.; Wan, B.; Davis, D. Presenting features of COVID-19 in older people: Relationships with frailty, inflammation and mortality. Eur. Geriatr. Med. 2020, 11, 1089–1094. [Google Scholar] [CrossRef]
- Lee, J.Y.; Kim, H.A.; Huh, K.; Hyun, M.; Rhee, J.-Y.; Jang, S.; Kim, J.-Y.; Peck, K.R.; Chang, H.-H. Risk Factors for Mortality and Respiratory Support in Elderly Patients Hospitalized with COVID-19 in Korea. J. Korean Med Sci. 2020, 35, e223. [Google Scholar] [CrossRef] [PubMed]
- Leung, C. Risk factors for predicting mortality in elderly patients with COVID-19: A review of clinical data in China. Mech. Ageing Dev. 2020, 188, 111255. [Google Scholar] [CrossRef] [PubMed]
- Gao, S.; Jiang, F.; Jin, W.; Shi, Y.; Yang, L.; Xia, Y.; Jia, L.; Wang, B.; Lin, H.; Cai, Y.; et al. Risk factors influencing the prognosis of elderly patients infected with COVID-19: A clinical retrospective study in Wuhan, China. Aging 2020, 12, 12504–12516. [Google Scholar] [CrossRef]
- Wernly, B.; Beil, M.; Bruno, R.R.; Binnebössel, S.; Kelm, M.; Sigal, S.; van Heerden, P.V.; Boumendil, A.; Artigas, A.; Cecconi, M.; et al. Provision of critical care for the elderly in Europe: A retrospective comparison of national healthcare frameworks in intensive care units. BMJ Open 2021, 11, e046909. [Google Scholar] [CrossRef] [PubMed]
- Baldwin, M.R.; Sell, J.L.; Heyden, N.; Javaid, A.; Berlin, D.A.; Gonzalez, W.C.; Bach, P.B.; Maurer, M.S.; Lovasi, G.; Lederer, D. Race, Ethnicity, Health Insurance, and Mortality in Older Survivors of Critical Illness. Crit. Care Med. 2017, 45, e583–e591. [Google Scholar] [CrossRef]
Variables | All Patients (n = 488) | Younger Patients (n = 170) | Older Patients (n = 318) | p-Value |
---|---|---|---|---|
Age | 70 (62–80) | 58 (51–62) | 78 (71–84) | <0.001 |
Male (%) | 234 (48.0) | 98 (57.6) | 136 (42.8) | 0.002 |
Smoking (%) | 87 (17.8) | 30 (17.6) | 57 (17.9) | 0.939 |
Symptom at admission (%) | 398 (81.6) | 154 (90.6) | 244 (76.7) | <0.001 |
Symptom to admission, days | 4.0 (1.0–8.0) | 5.0 (2.0–8.0) | 3.0 (1.0–7.0) | 0.860 |
Body mass index | 24.3 (21.8–27.1) | 26.0 (24.0–28.9) | 23.1 (20.7–25.9) | <0.001 |
Resident of a nursing facilities | 81 (16.6) | 5 (2.9) | 76 (23.9) | <0.001 |
Scoring systems | ||||
APACHE II score | 10.0 (7.0–13.3) | 7.0 (5.0–10.0) | 11.5 (9.0–15.0) | <0.001 |
Clinical Frailty Scale | 3.0 (2.0–6.0) | 2.0 (1.0–3.0) | 4.0 (3.0–7.0) | <0.001 |
Charlson Comorbidity Index | 3.0 (2.0–5.0) | 2.0 (1.0–2.0) | 4.0 (3.0–5.0) | <0.001 |
Comorbidity (%) | ||||
Hypertension | 266 (54.5) | 65 (38.2) | 201 (63.2) | <0.001 |
DM | 150 (30.7) | 34 (20.0) | 116 (36.5) | <0.001 |
COPD | 13 (2.7) | 1 (0.6) | 12 (3.8) | 0.037 |
Cerebrovascular disease | 49 (10.0) | 7 (4.1) | 42 (13.2) | 0.001 |
Heart failure | 17 (3.5) | 1 (0.6) | 16 (5.0) | 0.011 |
Liver cirrhosis | 5 (1.0) | 1 (0.6) | 4 (1.3) | 0.484 |
Chronic kidney disease | 5 (1.0) | 0 (0) | 5 (1.6) | 0.100 |
Malignancy | 27 (5.5) | 9 (5.3) | 18 (5.7) | 0.866 |
Organ transplantation | 1 (0.2) | 1 (0.6) | 0 (0) | 0.171 |
Vital signs | ||||
SBP, mmHg | 121 (108–138) | 122 (108–137) | 121 (108–140) | 0.906 |
DBP, mmHg | 72 (63–83) | 76 (66–86) | 71 (61–81) | 0.019 |
HR,/min | 87 (75–100) | 88 (80–102) | 86 (73–99) | 0.009 |
RR,/min | 20 (20–22) | 20 (20–22) | 20 (19–24) | 0.345 |
Body Temperature, ℃ | 36.8 (36.4–37.8) | 37.4 (36.5–38.2) | 36.7 (36.4–37.4) | <0.001 |
SpO2, % | 96.0 (93.0–98.0) | 96.0 (94.0–98.0) | 95.0 (92.0–98.0) | 0.129 |
GCS | 15 (15–15) | 15 (15–15) | 15 (14–15) | 0.002 |
Duration of fever | 2.0 (0.0–5.0) | 3.0 (1.0–5.3) | 2.0 (0.0–4.3) | 0.760 |
Laboratory data | ||||
White cell count, 1000/mm3 | 5.87 (4.32–8.04) | 5.77 (4.32–8.48) | 5.91 (4.36–7.98) | 0.767 |
Neutrophil-to-lymphocyte ratio | 4.63 (2.71–8.88) | 4.65 (2.62–7.79) | 4.56 (2.75–9.60) | 0.013 |
Hemoglobin, g/dL | 12.9 (11.6–14.1) | 13.8 (12.3–14.8) | 12.6 (11.2–13.8) | <0.001 |
Platelet count, 1000/mm3 | 182 (136–229) | 189 (150–237) | 179 (134–228) | 0.106 |
Total bilirubin, mg/dL | 0.5 (0.4–0.7) | 0.5 (0.4–0.8) | 0.5 (0.3–0.7) | 0.089 |
Albumin, g/dL | 3.5 (3.1–4.0) | 3.7 (3.3–4.2) | 3.5 (3.1–3.8) | <0.001 |
BUN, mg/dL | 15 (11–22) | 13 (10–17) | 16 (12–24) | 0.003 |
Creatinine, mg/dL | 0.76 (0.60–0.95) | 0.73 (0.61–0.89) | 0.78 (0.60–1.00) | 0.992 |
C-reactive protein, mg/dL | 5.93 (2.10–11.67) | 6.40 (2.10–13.20) | 5.70 (2.07–10.58) | 0.322 |
Chest X-ray | ||||
Normal | 74 (15.2) | 23 (13.5) | 51 (16.0) | 0.462 |
Unilateral | 67 (13.7) | 15 (8.8) | 52 (16.4) | 0.021 |
Bilateral | 217 (44.5) | 79 (46.5) | 138 (43.4) | 0.515 |
Multifocal | 130 (26.6) | 53 (31.2) | 77 (24.2) | 0.097 |
Variables | All Patients (n = 488) | Younger Patients (n = 170) | Older Patients (n = 318) | p-Value |
---|---|---|---|---|
Treatment (%) | ||||
Remdesivir | 244 (50.0) | 76 (44.7) | 168 (52.8) | 0.087 |
Antibiotics | 294 (60.2) | 83 (48.8) | 211 (66.4) | <0.001 |
Vasopressor | 61 (12.5) | 13 (7.6) | 48 (15.1) | 0.018 |
CRRT | 24 (4.9) | 4 (2.4) | 20 (6.3) | 0.055 |
Corticosteroid | 369 (75.6) | 125 (73.5) | 244 (76.7) | 0.433 |
Oxygen supply device | ||||
Nasal prong | 408 (83.6) | 151 (88.8) | 257 (80.8) | 0.023 |
HFNC | 157 (32.2) | 47 (27.6) | 110 (34.6) | 0.118 |
Invasive mechanical ventilation | 120 (24.6) | 40 (23.5) | 80 (25.2) | 0.691 |
ECMO | 19 (3.9) | 9 (5.3) | 10 (3.1) | 0.242 |
Tracheostomy (%) | 37 (7.6) | 10 (5.9) | 27 (8.5) | 0.300 |
Outcomes | ||||
In-hospital mortality (%) | 89 (18.2) | 8 (4.7) | 81 (25.5) | <0.001 |
Length of hospital stay (days) | 16.0 (12.0–25.0) | 16.0 (12.0–22.0) | 17.0 (12.0–26.0) | 0.396 |
Secondary infection | 143 (29.3) | 40 (23.5) | 103 (32.4) | 0.040 |
DNR order | 81 (16.6) | 5 (2.9) | 76 (23.9) | <0.001 |
Univariate Analysis | Multivariate Analysis | |||||
---|---|---|---|---|---|---|
HR | 95% CI | p-Value | HR | 95% CI | p-Value | |
Age | 1.055 | 1.035–1.075 | <0.001 | 1.031 | 1.008–1.054 | 0.008 |
Scoring systems | ||||||
APACHE II score | 1.092 | 1.062–1.123 | <0.001 | 1.038 | 1.006–1.071 | 0.018 |
Frailty scale | 1.289 | 1.173–1.417 | <0.001 | 1.022 | 0.887–1.178 | 0.764 |
Comorbidity (%) | ||||||
DM | 2.115 | 1.391–3.214 | <0.001 | 1.622 | 1.029–2.559 | 0.037 |
COPD | 4.507 | 2.063–9.844 | <0.001 | 4.294 | 1.874–9.837 | 0.001 |
Cerebrovascular disease | 1.739 | 0.942–3.212 | 0.077 | 1.491 | 0.780–2.848 | 0.227 |
Liver cirrhosis | 4.551 | 1.431–14.469 | 0.010 | 1.287 | 0.270–6.147 | 0.752 |
Laboratory findings | ||||||
White blood cell count, 1000/mm3 | 1.058 | 1.017–1.100 | 0.005 | 1.104 | 1.056–1.153 | <0.001 |
Neutrophil lymphocyte ratio | 1.020 | 1.007–1.032 | 0.002 | 0.984 | 0.968–1.000 | 0.044 |
Platelet count, 1000/mm3 | 0.994 | 0.991–0.998 | 0.001 | 0.996 | 0.993–0.999 | 0.024 |
Albumin, g/dL | 0.451 | 0.312–0.652 | <0.001 | 0.794 | 0.481–1.310 | 0.366 |
Creatinine, mg/dL | 1.112 | 1.019–1.212 | 0.017 | 0.944 | 0.813–1.095 | 0.446 |
DNR order | 9.618 | 6.102–15.159 | <0.001 | 6.260 | 3.792–10.333 | <0.001 |
Treatment | ||||||
Invasive mechanical ventilation | 1.754 | 1.104–2.785 | 0.017 | 1.824 | 1.070–3.107 | 0.027 |
Vasopressor use | 2.416 | 1.536–3.800 | <0.001 | 1.069 | 0.583–1.961 | 0.829 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Seong, G.M.; Baek, A.-R.; Baek, M.S.; Kim, W.-Y.; Kim, J.H.; Lee, B.Y.; Na, Y.S.; Lee, S.-I. Comparison of Clinical Characteristics and Outcomes of Younger and Elderly Patients with Severe COVID-19 in Korea: A Retrospective Multicenter Study. J. Pers. Med. 2021, 11, 1258. https://doi.org/10.3390/jpm11121258
Seong GM, Baek A-R, Baek MS, Kim W-Y, Kim JH, Lee BY, Na YS, Lee S-I. Comparison of Clinical Characteristics and Outcomes of Younger and Elderly Patients with Severe COVID-19 in Korea: A Retrospective Multicenter Study. Journal of Personalized Medicine. 2021; 11(12):1258. https://doi.org/10.3390/jpm11121258
Chicago/Turabian StyleSeong, Gil Myeong, Ae-Rin Baek, Moon Seong Baek, Won-Young Kim, Jin Hyoung Kim, Bo Young Lee, Yong Sub Na, and Song-I Lee. 2021. "Comparison of Clinical Characteristics and Outcomes of Younger and Elderly Patients with Severe COVID-19 in Korea: A Retrospective Multicenter Study" Journal of Personalized Medicine 11, no. 12: 1258. https://doi.org/10.3390/jpm11121258
APA StyleSeong, G. M., Baek, A. -R., Baek, M. S., Kim, W. -Y., Kim, J. H., Lee, B. Y., Na, Y. S., & Lee, S. -I. (2021). Comparison of Clinical Characteristics and Outcomes of Younger and Elderly Patients with Severe COVID-19 in Korea: A Retrospective Multicenter Study. Journal of Personalized Medicine, 11(12), 1258. https://doi.org/10.3390/jpm11121258