Next Article in Journal
Long Term Findings Concerning the Mental and Physical Condition, Quality of Life and Sexuality after Laparoscopically Assisted Creation of a Neovagina (Modified Vecchietti Technique) in Young MRKHS (Mayer-Rokitansky-Küster-Hauser-Syndrome) Patients
Next Article in Special Issue
Corticosteroid Resistance in Smokers—A Substudy Analysis of the CORTICO-COP Randomised Controlled Trial
Previous Article in Journal
Oxidative Stress and Endoplasmic Reticulum Stress in Rare Respiratory Diseases
Previous Article in Special Issue
Four Decades of COPD Mortality Trends: Analysis of Trends and Multiple Causes of Death
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Management Challenges in Chronic Obstructive Pulmonary Disease in the COVID-19 Pandemic: Telehealth and Virtual Reality

by
Sebastian Rutkowski
Department of Physical Education and Physiotherapy, Opole University of Technology, 45-758 Opole, Poland
J. Clin. Med. 2021, 10(6), 1261; https://doi.org/10.3390/jcm10061261
Submission received: 19 February 2021 / Revised: 16 March 2021 / Accepted: 17 March 2021 / Published: 18 March 2021

Abstract

:
For the treatment of chronic obstructive pulmonary disease (COPD), early diagnosis and unconditionally correct management at the initial stage of the disease are very important when the symptoms are not yet too worrying. In this way, the progress of the disease can be slowed down, as can the occurrence of late, life-threatening symptoms. Pulmonary rehabilitation is an essential component of the management of COPD. The selection of appropriate exercises, which are determined during the classification of patients into a suitable improvement program, is of key importance in the process of rehabilitation. The coronavirus disease 2019 (COVID-19) pandemic has resulted in major limitations to public health care. Health systems were largely unprepared for an outbreak of this magnitude. Searching for new, attractive technologies that help patients with chronic diseases seems to be justified. This may be driven by telehealth platforms, likewise with the use of virtual reality (VR). Analysis of the available literature indicates promising effectiveness, high patient acceptance, and high motivations to undertake physical activity with the use of such a solution. Thus, the management of patients with COPD during the COVID-19 pandemic should include options for remote delivery of pulmonary rehabilitation, including home-based, telerehabilitation, and computer-based virtual programs.

1. Introduction

Coronavirus disease 2019 (COVID-19), which is caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), appeared for the first time in Wuhan, Hubei Province, China, in early December 2019. On 31 December 2019, an outbreak of atypical pneumonia was announced in Wuhan [1,2]. The COVID-19 infection has quickly spread to many other countries around the world, triggering the reaction of the World Health Organization (WHO), which on 11 March 2020 declared a pandemic status.
Over recent months, SARS-CoV-2 infection has been confirmed in millions of people around the world. Clinical symptoms of patients with COVID-19 infection include fever, sore throat, coughing, fatigue, or gastrointestinal infections, which can appear in a smaller population of patients. In more severe cases, respiratory failure symptoms, as well as heart and kidney damage, may occur. This can happen especially in the elderly and in people with other concomitant chronic diseases [3]. About 60 days after onset of the first COVID-19 symptom, only 13% of the patients previously hospitalized for COVID-19 were completely free of any COVID-19-related symptoms, while 32% had one or two symptoms and 55% had three or more symptoms [4]. Goërtz et al. assessed multiple relevant symptoms recovery following the onset of symptoms in hospitalized and non-hospitalized patients with COVID-19. Fatigue and dyspnoea were the most prevalent symptoms during the infection and at follow-up (fatigue: 95% versus 87%; dyspnoea: 90% versus 71%). It was concluded that there was only a partial recovery in symptoms about 3 months after the onset of symptoms in a survey of a large sample of previously hospitalized and non-hospitalized patients with confirmed or suspected COVID-19. Survivors of severe COVID-19 are significantly impaired in all activities of daily living and are in need of multimodal rehabilitation, with particular knowledge in cardiovascular and pulmonary medicine [5]. It is highly anticipated that some patients with COVID-19 will have a need for rehabilitation interventions during and immediately after hospitalization [6,7]. It is assumed that many rehabilitation programs for this patient group will be based on pulmonary rehabilitation programs.
Thus, the purpose of this review was to assess the challenges that the COVID-19 outbreak has on the management of chronic obstructive pulmonary disease (COPD). It would seem that identifying the potential for the use of new technologies, which can be highly applied remotely, may contribute to the optimizing of the health care system for broad availability of pulmonary rehabilitation. In the opinion of the author, it remains apparent that despite widely available evidence, the use of technology is being downplayed, and the belief that only face-to-face therapy can provide benefits is misguided.

2. An Overview on COPD Management

Chronic obstructive pulmonary disease (COPD) is a major threat to public health and is recognized as one of the most impactful common chronic diseases, making it the second most common cause of disability [8]. For the treatment of COPD, early diagnosis and unconditionally correct management at the initial stage of the disease are very important when the symptoms are not yet too worrying. In this way, the progress of the disease can be slowed down and the occurrence of late, life-threatening symptoms like dyspnea, reduced exercise tolerance, and finally respiratory disability can be delayed; these symptoms significantly reduce the quality of life of patients. A “stable” COPD condition has been defined when symptoms are well controlled and deterioration of lung function is minimized, whereas managing “unstable” COPD (when patients have frequent or severe exacerbations) can be more difficult. COPD exacerbations are a major economic burden and can result in emergency department admission and hospitalizations [9]. Severe exacerbations are associated with a significant increase in mortality, therefore prevention of exacerbations is one of the key goals in the management of COPD [10]. The remaining key issues include assessment of the severity of airflow obstruction, exposure of risk factors, and comorbidities, as well as other symptoms. Treatment can be escalated/de-escalated based on the presence of the predominant symptoms of breathlessness and exercise limitation, and the continued occurrence of exacerbations whilst on maintenance therapy [10]. An obligatory element of the elimination of risk factors by patients is smoking cessation. Initial pharmacotherapy should be based on the patient’s Global Initiative for Obstructive Lung Disease (GOLD) group. Due to the chronic nature of the disease, patients should be educated in self-management at the initial stage. This should include risk factor management, inhaler technique, breathlessness, and a written action plan. Patient awareness of current symptom levels (either the CAT or mMRC scores) and exacerbation frequency assessments have also been found to be very important. Thus, the existing management models for patients with COPD have assumed pharmacological-oriented management for “unstable” COPD and non-pharmacological (rehabilitation-oriented) management for stable COPD. The Task Force co-chairs (J.A. Wedzicha and J.A. Krishnan) were selected by the European Respiratory Society and American Thoracic Society, established to develop recommendations for prevention of exacerbations [11]. The Task Force made recommendations for mucolytic, long-acting muscarinic antagonist, phosphodiesterase-4 inhibitor (roflumilast), and macrolide therapy, as well as a conditional recommendation against fluoroquinolone therapy. Thus, it seems that the management of patients with unstable COPD lies with the physicians who provide a treatment and action plan for dealing with exacerbations. Therefore, a form of telemonitoring and teleconsultation may have a practical application in this regard. However, there is much more adaptability in the management approach of stable COPD. Pulmonary rehabilitation (PR) is an essential component of the management of COPD. The selection of appropriate exercises, which are determined during the classification of patients into a suitable improvement program, is of key importance in the process of rehabilitation. The adopted models of PR vary in terms of intensity, duration, and the form of physical activity taken by the patients. Many research studies and systematic literature reviews show the beneficial effect of PR in patients with chronic respiratory diseases on exercise capacity [12], lung function [13], respiratory muscle strength [14], and quality of life [15]. The effects of PR programs are described in detail in the available literature. There are probably already enough observational studies linking physical inactivity with poor outcomes in COPD. However, increasing exercise tolerance facilitates, but does not necessarily yield, increases in physical activity. Troosters et al. had compared effects on the exercise tolerance benefit of a bronchodilator (19 studies, 1847 individuals) vs. PR (11 studies, 559 individuals) showed 3 times more effectiveness of PR programs on increases in endurance time in constant work rate exercise testing [16]. However, international estimates posit that only 1–2% of COPD patients receive PR. In contrast, other COPD therapies, bronchodilators and oxygen therapy in particular, are much more widely available [17]. With the already low availability of rehabilitation programs, the current situation makes this aspect even worse. Therefore, as a next step, it was decided to assess the impact of the pandemic on the healthcare modalities as well as to propose possible solutions, re-orienting the focus on the use of new technologies.

3. Management of COPD’s Patients in the COVID-19 Pandemic

The COVID-19 pandemic has resulted in major limitations to public health care. The healthcare systems were highly unprepared for an outbreak of this magnitude. The impact of the COVID-19 pandemic on health systems resilience was the subject of an Organization for Economic Co-operation and Development (OECD) and WHO report. Prominent crisis response measures included securing medical supply chains, ensuring the availability of health workers, mobilizing additional financing, reorganizing non-COVID-19 related health services, using digital solutions to monitor and manage COVID-19 cases as well as providing medical services online (e.g., teleconsultations). Many governments and information services have developed mHealth initiatives. The humanitarian and economic demands of COVID-19 have been driving both the rise and adoption of new digital technologies. The pandemic has raised many issues regarding the management of patients with COPD and the appropriateness of modifying their therapy. Questions have arisen about recognizing and differentiating COVID-19 from COPD because of the similarity of symptoms [18]. It is unclear whether patients with COPD are at increased risk of becoming infected with SARS-CoV-2. However, it is worth noting that some of the elements related to the management of patients with COPD can be conducted remotely, which may reduce the risk of potential infection.

3.1. Telehealth

Remote care or telehealth services application has accelerated. Telehealth services have now been used in the large-scale screening of patients, for remote clinical encounters, or supervising patient care by experts [19,20]. Telehealth provides higher convenience and a better patient-centered approach, helping to improve the flow of healthcare systems [21]. Telehealth refers to the delivery of different health care services for patients through the technologies of telecommunication, and includes (1) telemedicine and (2) telehealthcare. The telehealthcare area covers: telehomecare, telenursing, telecoaching, and telerehabilitation. Meanwhile, telemedicine can be applied with the help of teleservices in the field of: teleradiology, teledermatology, telepsychiatrists, telecardiology, and telerehabilitation. Telemedicine can be defined, according to the European Commission, as “the provision of healthcare services, through the use of ICT, in situations where the health professional and the patient (or two health professionals) are not in the same location. It can be utilized to securely transmit medical data necessary for the prevention, diagnosis, treatment, and follow-up of patients” [22]. In 2002, an official telerehabilitation was recognized to provide access to a collection of rehabilitation services for the disabled “at a distance” through telecommunication sites and the Internet. Nowadays, with a computer, webcam, and appropriate software, it is possible to create a videoconference enabling the physiotherapist to give advice and practice at a distance. The systematic reviews suggest that telerehabilitation is becoming increasingly popular due to the need to provide equitable access to rehabilitation for populations with barriers to accessing traditional models of care [23], likewise it can be considered as an alternative approaches to reduce outpatient resource utilization and improve quality of life [24].
The telehealth services in pulmonary rehabilitation have been successfully carried out so far via telemonitoring and telerehabilitation [25,26,27]. Home telehealth services in this field were found to reduce rates of hospitalization and emergency department visits. Most studies found home telehealth to be cost-saving from healthcare system and insurance provider perspectives [28], and to be equally effective for hospital-based outpatients [29]. The telerehabilitation program was proven to be particularly effective in monitoring disease exacerbations. This has been driven by two activities: (1) telespirometry for remote measurement of lung function, initially to diagnose COPD and periodically to ascertain clinical status; and (2) teleconsultations between primary care providers (physicians and nurses) and pulmonary specialists for the care and treatment of patients at remote sites [27]. With regard to the present situation, the advisability of teleconsultation seems particularly important, as it provides access to expert consultants in areas lacking these resources and also reduces unnecessary hospitalization. Moreover, it have been also stated that during periods of high community prevalence of COVID-19, spirometry should only be used when it is essential for COPD diagnosis and/or to assess lung function status for interventional procedures or surgery [18]. Therefore, the use of remote diagnostic techniques appears to be of great practical importance. Data analysis of the study of 937 Italian general physicians who, over a 2-year period, received the results of 20,757 telespirometries tests, revealed that 70% of the tests met the criteria for good or partial co-operation, allowing spirometric abnormalities to be detected in more than 40% of the tracings [30]. Vitacca et al. investigated the change in the patient population, mortality, and staff utilization/costs during the first 5-year activity of a teleassistance program. The results showed a shift in costs, with an overall decrease in physician time and an increase in nurse time, thereby resulting in cost savings of 39% [31]. Sorknaes et al. investigated the effect of daily teleconsultations for one week between in-hospital nurses and patients with severe COPD discharged after an acute exacerbation. Teleconferences were conducted via computer with a web camera and a microphone along with measurement equipment for about 7 days. A total of 266 patients were allocated to either intervention (n = 132) or control (n = 134). Data analysis showed no significant difference in the unconditional total mean number of hospital readmissions after 26 weeks or effects on mortality [32]. Another multicenter randomized controlled trial study was investigated by Pinnock et al. on a sample of 256 COPD patients in the UK. The intervention consisted of daily patient responses entered on a touchscreen device or conventional self-monitoring to questions about symptoms and the use of treatment and oxygen saturation. The authors stated that in participants with a history of admission for exacerbations of COPD, telemonitoring was not effective in postponing admissions and did not improve quality of life [33]. In contrast, Pare et al. found reductions in home visits and hospitalizations in patients with COPD who were treated with the telehomecare model and significant cost savings after 6 months of follow-up [34]. Alrajab et al. likewise reported a reduction in the frequency of COPD exacerbations with the use of a telemonitoring program [35]. Cordova et al. in their randomized study showed that a telemedicine-based symptom reporting program facilitated early symptom management and improved lung function and functional status in patients previously hospitalized for exacerbations. Thus, it seems that the use of telemonitoring systems for patients with COPD may have practical applications in unstable COPD. However, it is important to note that some studies appear to present small sample sizes and limited follow-up time as factors that must be addressed before telemedicine interventions can be considered as the standard of care for COPD patients.
Regarding the telerehabilitation interventions, the recent literature has suggested that telerehab is as effective as in-hospital PR programs, and confirmed its safety and feasibility [36,37,38]. Advantages of telerehabilitation include a reduced caregiver burden, lower costs, adherence to recommendations, exercise progression, home environment, and objective physical activity monitoring [39]. The major benefits were demonstrated in reduced dyspnea, improved functional capacity, quality of life, and high adherence to the exercise programs. Similar to traditional PR, implementation of telerehabilitation leads to improvement in dyspnea, exercise capacity, and lung function, as well as reductions in hospitalization and mortality [40,41,42]. The programs were mostly based on videoconferencing (online face-to-face) or phone calls to run supervised training using performance training equipment (treadmill or cycling) and/or free exercise (fitness-, aerobic-, strength-, yoga- training) [43,44,45]. Therapies were delivered to patients in moderate to severe stages of disease. The second group of interventions consists of unsupervised trainings through the use of a virtual trainer or pre-recorded video demonstrations. The studies by Bourne et al. [44] and Chaplin et al. [46] compared the effect of unsupervised web-based or video-demonstrated individual exercise with the conventional group PR. They found comparable effects on walking tests that exceeded the minimal clinically important difference for 6MWD and ESWT but not for ISWT. There is an ever-growing and complex body of empirical evidence that attests to the potential of telemedicine for addressing problems of access to care, quality of care, and healthcare costs in the management of pulmonary chronic diseases [27]. Recently, the focus has shifted towards unsupervised or AI-supervised (workloads planned based on initial qualification) training programs. This, opens up possibilities for the use of virtual reality (VR) for patients with pulmonary disease.

3.2. Virtual Reality

Virtual Reality is the technology that provides almost real and/or believable experiences in a synthetic or virtual way. In practice, virtual reality is a combination of specialized hardware and software [47]. This technology continues to develop rapidly and gain a growing number of enthusiasts in different age categories. It is most often associated with entertainment, but it applies much more widely in other fields. The literature describes the use of the so-called “Virtual Rehabilitation” in the therapy of patients, using the audiovisual biofeedback system [48]. The literature contains publications describing the possibility of using VR as a diagnostic and therapeutic tool. The majority of the research on virtual rehabilitation focuses on neurorehabilitation. However, interest in this technology increases and extends to orthopedic, pediatric, and psychiatric oncology as well as pulmonary rehabilitation [49]. Jacobson described four types of VR: immersive virtual reality, desktop virtual reality (i.e., low-cost game console) also called a non-immersive, augmented virtual reality (where computer-generated data merge into a real-world image), and simulation (mixed) virtual reality (a combination of real objects and environments with virtual people or places, either controlled by humans or by artificial intelligence) [50]. The essence of immersion seems to presents a great practical significance in pulmonary rehabilitation, where the patient can become more involved. Building involving scenarios can facilitate a “shift in attention,” distracting the patient from negative sensations (e.g., fatigue, dyspnea) during physical activity [51]. Moreover, it has been shown that the use of virtual reality in the rehabilitation process changes patient engagement in therapy [52]. Patients become motivated to exercise by having the opportunity to experience an interesting world, in contrast to monotonous workouts. This component seems to be crucial in the case of chronic patients such as COPD patients. It is well known that the basis of rehabilitation in this group of patients lies in endurance training, which often accompanies patients throughout their lives in order to prevent disease progression. Thus, the use of an attractive, engaging approach seems justified. The use of mixed virtual reality, on the other hand, makes it possible to generate a projection/image of the trainer which can be used as a source of free exercises, like group gymnastics, where the instructor demonstrates a movement, which the patients should copy [53]. Yet, the application of virtual reality with pulmonary rehabilitation is limited. The latest systematic review and meta-analysis of the effectiveness of virtual reality for patients with the respiratory disease was published in November 2020. Twenty-two articles were analyzed: seven were identified as pilot or feasibility studies, four as systematic reviews, six as randomized controlled trials, and five as observational studies. Six studies recruited individuals with CF, one article analyzed asthma, and four articles analyzed subjects with COPD. The benefits of interventions delivered in VR have been categorized into several aspects. The authors stated that exergaming-based interventions compared with conventional PR demonstrated an insignificant effect (SMD −0.17 [−0.43–0.09]) on mean HR. Next, a weak effect was found of SpO2 (SMD 0.22, 95% [CI, −0.25–0.69]), as VR interventions resulted in a lower level of oxygen depletion. Furthermore, VR interventions induced a lower level of dyspnea [54]. The previous meta-analysis of Wang et al. investigated the effectiveness of active video games for patients with COPD [55]. Analysis of results showed that less technologically-advanced game consoles used in addition to PR can be useful and enjoyable. However, this review included only 7 studies (3 RCT), suggesting the need for further development of this technology. A technological analysis of VR systems was also attempted. Colombo et al. analyzed a technological perspective of VR for COPD rehabilitation [56]. In the first part of the study, the team conducted a scoping review, identifying 21 articles: 10 journal papers, five conference proceedings papers, five abstracts, and one book chapter. The authors noted that most of these studies (68%) used active video games as an intervention for physical and breathing exercises, six systems considered VR systems, and two studies provided intervention through mobile applications. Analysis of the effectiveness of such systems has shown. Rehabilitation programs varied in duration (2 to 8 weeks) and the evaluated parameters (mainly focused on physical training). The reviewed papers suggested that VR-based training is feasible for patients with COPD. Authors concluded that further research should focus on physiological interaction during such training to provide more objective data.
The possibility of implementing VR for the rehabilitation of patients with COPD is also of interest to the authors personally. Among the first clinical experiments, effectiveness of fitness using non-immersive VR training was analyzed. The study consisted of 68 patients with COPD to a 2-week, five times a week in-hospital PR [57]. This appears to be the first study to evaluate the effectiveness of VR system implementation in patients with moderate to severe COPD undergoing an intensive 2-week inpatient rehabilitation program. Analysis of the results showed that patients who participated in the VR sessions achieved significant improvement in physical fitness in all attempts of the Senior Fitness Test. The second clinical experiment conducted under the scientific supervision of Professor Richard Casaburi aimed to assess the influence of immersive VR on the exercise responses during a submaximal exercise test (ET) on a cycle ergometer, with a future goal to implement this type of test for patients with COPD. The study enrolled 70 healthy volunteers. Each participant performed an ET with and without VR. Both tests consisted of incrementing the work rate every 3 min and were terminated when the subject reached 85% of the predicted heart rate (HR). VR was created with an HTC Vive Pro head-mounted display, along with VR healthcare (aerobic exercise) cycling software. Data analysis showed that HR was consistently lower in the VR tests over a wide range of work rates, particularly within the first 3 min of testing, and likewise in the last 3 min of testing. Moreover, there were distinct differences in the number of HRV variables between the two modes of testing. In the initial phase of the exercise, the tests with VR compared to those without VR demonstrated significantly higher values for all HRV parameters (except LF/HF) (i.e., SDNN, RMSSD, TP, LF, and HF). Since these parameters as a majority reflect the parasympathetic activity, it is apparent that VR activated the parasympathetic portion of the autonomic nervous system, which also yielded lower values of HR throughout the exercise; consequently, the submaximal exercise lasted longer. This confirms the hypothesis that therapy conducted in VR is safer for the cardiovascular system compared to that conducted in the traditional form [58]. Furthermore, the STIIMA research group carried out, in cooperation with the IRCCS INRCA (an Italian clinical center specialized in the rehabilitation of elderly with respiratory diseases), a clinical study evaluating the effectiveness of a VR-based pulmonary rehabilitation program in a group of patients with COPD. Preliminary results showed that an endurance training program based on semi-immersive (i.e., wide projected screen) VR, called the “Virtual Park”, is feasible, safe, and well accepted by patients, who felt more motivated when following the prescribed cycling protocol [59]. The third clinical experiment aimed to evaluate the efficacy of VR therapy on depressive and anxiety symptoms and stress levels in patients with COPD during in-hospital pulmonary rehabilitation [60]. The study consisted of 50 patients diagnosed as having COPD, who were randomly assigned to one of two groups. Both participated in the traditional PR program, whereas the VR group completed 10 sessions of immersive VR therapy, while the control group engaged in 10 sessions of Schultz Autogenic Training. As a VR source, the VR Tier One device (Stolgraf®) was used. The results of the experiment showed a reduction in stress levels only within the VR group. Moreover, a reduction in depressive and anxiety symptoms was also reported only in the VR group for both parameters with a strong effect size. VR therapy was revealed to be more effective than the traditionally used Schultz Autogenic Training to reduce stress, anxiety, and depression symptoms. Among other reports evaluating the effectiveness of VR in patients with COPD, a common conclusion indicated patients’ confidence in the attractive form of exercise, building high motivation to undertake physical activity but also the need for further research on the possibilities of such training [61,62,63].
Thus, it appears that in stable COPD, the use of modern technology in the form of real-time telemedicine interventions or the transfer to computerized programs in the form of virtual trainers or video games is useful. Scientific evidence shows that therapy delivered in a virtual world is highly effective. The virtual world also allows the creation of a new environment for the patient, resulting in increased patient engagement, which can lead to behavioral changes and therefore to increased levels of physical activity. Also, it may be important in the situation of further lockdowns to have an alternative to in-hospital rehabilitation programs to combat the long-term effects of interrupted training.

4. Conclusions

The “Global Initiative for Obstructive Lung Disease (GOLD)” included PR in the standard treatment of COPD patients in 2001 [64]. The main goal of pulmonary rehabilitation is to improve the patient’s psycho-somatic state, as well as to facilitate the patient’s return to family and society. Broadly evidenced benefits include improvements in exercise tolerance, muscle strength, lung function, quality of life, likewise reduced dyspnea, hospital admissions, and length of hospital stay [65]. Despite limited access to specialized medical centers, an opportunity for appropriate management of COPD patients with new technologies seems to be available. The three major components of the medical system—prevention, treatment, and rehabilitation—are equally important. This may be driven by telehealth platforms, as well as by the use of VR. Digital communication platforms support adherence to social-distancing measures [66]. Further evidence of the clinical effectiveness of digital technologies being incorporated into public health systems or tested by the National Institute for Health and Care Excellence remains needed [67]. In the opinion of worldwide experts, “novel” forms of pulmonary rehabilitation may be relevant. Professor Richard Casaburi stated: “With the coronavirus disease 2019 crisis, in-center programs have become nearly unavailable. Remote programs are an alternative we have to explore and promote. The debate over whether or not they are equivalent (or even superior) can wait until the pandemic is in the rearview mirror” [68]. Professor believes that the key issue in the future of pulmonary rehabilitation will be its availability: “Improved access will require a fair reimbursement for this therapy by governmental agencies and third-party payors. It will also require training of a new generation of healthcare providers, trained in multiple disciplines, to deliver rehabilitative therapy”.
Thus, it appears that the management of COPD patients during the COVID-19 epidemic should include remote PR management, including telerehabilitation, and virtual reality platforms, as scientific evidence of their effectiveness becomes more widely available.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The author thanks the European Respiratory Society for funding a Fellowship Grant (ERS LTRF202001-00746) in San Camillo Hospital in Venice, Italy—a scientific institute that specializes and is internationally recognized for excellence in virtual reality rehabilitation, which has facilitated the development of this paper.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Ralph, R.; Lew, J.; Zeng, T.; Francis, M.; Xue, B.; Roux, M.; Toloue Ostadgavahi, A.; Rubino, S.; Dawe, N.J.; Al-Ahdal, M.N.; et al. 2019-nCoV (Wuhan virus), a novel Coronavirus: Human-to-human transmission, travel-related cases, and vaccine readiness. J. Infect. Dev. Ctries 2020, 14, 3–17. [Google Scholar] [CrossRef]
  2. Wu, J.T.; Leung, K.; Leung, G.M. Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: A modelling study. Lancet 2020, 395, 689–697. [Google Scholar] [CrossRef] [Green Version]
  3. Guo, Y.R.; Cao, Q.D.; Hong, Z.S.; Tan, Y.Y.; Chen, S.D.; Jin, H.J.; Tan, K.S.; Wang, D.Y.; Yan, Y. The origin, transmission and clinical therapies on coronavirus disease 2019 (COVID-19) outbreak—An update on the status. Mil. Med. Res. 2020, 7, 11. [Google Scholar] [CrossRef] [Green Version]
  4. Carfi, A.; Bernabei, R.; Landi, F.; Gemelli Against COVID-19 Post-Acute Care Study Group. Persistent Symptoms in Patients After Acute COVID-19. JAMA 2020, 324, 603–605. [Google Scholar] [CrossRef] [PubMed]
  5. Spruit, M.A.; Holland, A.E.; Singh, S.J.; Tonia, T.; Wilson, K.C.; Troosters, T. COVID-19: Interim Guidance on Rehabilitation in the Hospital and Post-Hospital Phase from a European Respiratory Society and American Thoracic Society-coordinated International Task Force. Eur. Respir. J. 2020, 56, 2002197. [Google Scholar] [CrossRef] [PubMed]
  6. Polastri, M.; Nava, S.; Clini, E.; Vitacca, M.; Gosselink, R. COVID-19 and pulmonary rehabilitation: Preparing for phase three. Eur. Respir J. 2020, 55, 2001822. [Google Scholar] [CrossRef]
  7. Vitacca, M.; Lazzeri, M.; Guffanti, E.; Frigerio, P.; D’Abrosca, F.; Gianola, S.; Carone, M.; Paneroni, M.; Ceriana, P.; Pasqua, F.; et al. Italian suggestions for pulmonary rehabilitation in COVID-19 patients recovering from acute respiratory failure: Results of a Delphi process. Monaldi Arch. Chest Dis. 2020, 90. [Google Scholar] [CrossRef]
  8. Alfarroba, S.; Rodrigues, F.; Papoila, A.L.; Santos, A.F.; Morais, L. Pulmonary Rehabilitation in COPD According to Global Initiative for Chronic Obstructive Lung Disease Categories. Respir. Care 2016, 61, 1331–1340. [Google Scholar] [CrossRef] [Green Version]
  9. Bollmeier, S.G.; Hartmann, A.P. Management of chronic obstructive pulmonary disease: A review focusing on exacerbations. Am. J. Health Syst. Pharm. 2020, 77, 259–268. [Google Scholar] [CrossRef]
  10. Global Strategy for the Diagnosis, Management, and Prevention of Chronic Obstructive Pulmonary Disease 2020 Report. 2020. Available online: goldcopd.org/gold-reports/ (accessed on 14 January 2021).
  11. Wedzicha, J.A.; Calverley, P.M.A.; Albert, R.K.; Anzueto, A.; Criner, G.J.; Hurst, J.R.; Miravitlles, M.; Papi, A.; Rabe, K.F.; Rigau, D.; et al. Prevention of COPD exacerbations: A European Respiratory Society/American Thoracic Society guideline. Eur. Respir. J. 2017, 50, 1602265. [Google Scholar] [CrossRef] [Green Version]
  12. Li, W.; Pu, Y.; Meng, A.; Zhi, X.; Xu, G. Effectiveness of pulmonary rehabilitation in elderly patients with COPD: A systematic review and meta-analysis of randomized controlled trials. Int J. Nurs. Pract. 2019, 25, e12745. [Google Scholar] [CrossRef]
  13. Salcedo, P.A.; Lindheimer, J.B.; Klein-Adams, J.C.; Sotolongo, A.M.; Falvo, M.J. Effects of Exercise Training on Pulmonary Function in Adults With Chronic Lung Disease: A Meta-Analysis of Randomized Controlled Trials. Arch. Phys. Med. Rehabil. 2018, 99, 2561–2569.e2567. [Google Scholar] [CrossRef]
  14. Neves, L.F.; Reis, M.H.; Plentz, R.D.; Matte, D.L.; Coronel, C.C.; Sbruzzi, G. Expiratory and expiratory plus inspiratory muscle training improves respiratory muscle strength in subjects with COPD: Systematic review. Respir. Care 2014, 59, 1381–1388. [Google Scholar] [CrossRef] [PubMed]
  15. Liao, W.H.; Chen, J.W.; Chen, X.; Lin, L.; Yan, H.Y.; Zhou, Y.Q.; Chen, R. Impact of Resistance Training in Subjects With COPD: A Systematic Review and Meta-Analysis. Respir. Care 2015, 60, 1130–1145. [Google Scholar] [CrossRef]
  16. Troosters, T.; van der Molen, T.; Polkey, M.; Rabinovich, R.A.; Vogiatzis, I.; Weisman, I.; Kulich, K. Improving physical activity in COPD: Towards a new paradigm. Respir. Res. 2013, 14, 115. [Google Scholar] [CrossRef] [Green Version]
  17. Casaburi, R. Pulmonary Rehabilitation: Where We’ve Succeeded and Where We’ve Failed. COPD 2018, 15, 219–222. [Google Scholar] [CrossRef]
  18. Halpin, D.M.G.; Criner, G.J.; Papi, A.; Singh, D.; Anzueto, A.; Martinez, F.J.; Agusti, A.A.; Vogelmeier, C.F. Global Initiative for the Diagnosis, Management, and Prevention of Chronic Obstructive Lung Disease. The 2020 GOLD Science Committee Report on COVID-19 and Chronic Obstructive Pulmonary Disease. Am. J. Respir. Crit. Care Med. 2021, 203, 24–36. [Google Scholar] [CrossRef]
  19. Greenhalgh, T.; Wherton, J.; Shaw, S.; Morrison, C. Video consultations for covid-19. BMJ 2020, 368, m998. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Hollander, J.E.; Carr, B.G. Virtually Perfect? Telemedicine for Covid-19. N. Engl. J. Med. 2020, 382, 1679–1681. [Google Scholar] [CrossRef] [PubMed]
  21. Jazieh, A.R.; Kozlakidis, Z. Healthcare Transformation in the Post-Coronavirus Pandemic Era. Front. Med. 2020, 7, 429. [Google Scholar] [CrossRef]
  22. Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions on Telemedicine for the Benefit of Patients, Healthcare Systems and Society. Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52008DC0689&from=EN (accessed on 14 January 2021).
  23. Subedi, N.; Rawstorn, J.C.; Gao, L.; Koorts, H.; Maddison, R. Implementation of Telerehabilitation Interventions for the Self-Management of Cardiovascular Disease: Systematic Review. JMIR Mhealth Uhealth 2020, 8, e17957. [Google Scholar] [CrossRef]
  24. Velayati, F.; Ayatollahi, H.; Hemmat, M. A Systematic Review of the Effectiveness of Telerehabilitation Interventions for Therapeutic Purposes in the Elderly. Methods Inf. Med. 2020, 59, 104–109. [Google Scholar] [CrossRef] [PubMed]
  25. Bedra, M.; McNabney, M.; Stiassny, D.; Nicholas, J.; Finkelstein, J. Defining patient-centered characteristics of a telerehabilitation system for patients with COPD. Stud. Health Technol. Inform. 2013, 190, 24–26. [Google Scholar]
  26. Polisena, J.; Tran, K.; Cimon, K.; Hutton, B.; McGill, S.; Palmer, K.; Scott, R.E. Home telehealth for chronic obstructive pulmonary disease: A systematic review and meta-analysis. J. Telemed. Telecare 2010, 16, 120–127. [Google Scholar] [CrossRef]
  27. Bashshur, R.L.; Shannon, G.W.; Smith, B.R.; Alverson, D.C.; Antoniotti, N.; Barsan, W.G.; Bashshur, N.; Brown, E.M.; Coye, M.J.; Doarn, C.R.; et al. The empirical foundations of telemedicine interventions for chronic disease management. Telemed. J. E Health 2014, 20, 769–800. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Polisena, J.; Coyle, D.; Coyle, K.; McGill, S. Home telehealth for chronic disease management: A systematic review and an analysis of economic evaluations. Int. J. Technol. Assess. Health Care 2009, 25, 339–349. [Google Scholar] [CrossRef]
  29. Vasilopoulou, M.; Papaioannou, A.I.; Kaltsakas, G.; Louvaris, Z.; Chynkiamis, N.; Spetsioti, S.; Kortianou, E.; Genimata, S.A.; Palamidas, A.; Kostikas, K.; et al. Home-based maintenance tele-rehabilitation reduces the risk for acute exacerbations of COPD, hospitalisations and emergency department visits. Eur. Respir. J. 2017, 49, 1602129. [Google Scholar] [CrossRef]
  30. Bonavia, M.; Averame, G.; Canonica, W.; Cricelli, C.; Fogliani, V.; Grassi, C.; Moretti, A.M.; Ferri, P.; Rossi, A.; Paggiaro, P.L. Feasibility and validation of telespirometry in general practice: The Italian “Alliance” study. Respir. Med. 2009, 103, 1732–1737. [Google Scholar] [CrossRef] [Green Version]
  31. Vitacca, M.; Bazza, A.; Bianchi, L.; Gile, S.; Assoni, G.; Porta, R.; Bertella, E.; Fiorenza, D.; Barbano, L.; Comini, L.; et al. Tele-assistance in chronic respiratory failure: Patients’ characterization and staff workload of 5-year activity. Telemed. J. E Health 2010, 16, 299–305. [Google Scholar] [CrossRef]
  32. Sorknaes, A.D.; Jest, P.; Bech, M.; Hounsgaard, L.; Olesen, F.; Ostergaard, B. The effects of real-time telemedicine consultations between hospital-based nurses and severe COPD patients discharged after exacerbation admissions. Eur. Respir. J. 2013, 42, P1385. [Google Scholar] [CrossRef] [Green Version]
  33. Pinnock, H.; Hanley, J.; McCloughan, L.; Todd, A.; Krishan, A.; Lewis, S.; Stoddart, A.; van der Pol, M.; MacNee, W.; Sheikh, A.; et al. Effectiveness of telemonitoring integrated into existing clinical services on hospital admission for exacerbation of chronic obstructive pulmonary disease: Researcher blind, multicentre, randomised controlled trial. BMJ 2013, 347, f6070. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Pare, G.; Sicotte, C.; St-Jules, D.; Gauthier, R. Cost-minimization analysis of a telehomecare program for patients with chronic obstructive pulmonary disease. Telemed. J. E Health 2006, 12, 114–121. [Google Scholar] [CrossRef] [PubMed]
  35. Alrajab, S.; Smith, T.R.; Owens, M.; Areno, J.P.; Caldito, G. A home telemonitoring program reduced exacerbation and healthcare utilization rates in COPD patients with frequent exacerbations. Telemed. J. E Health 2012, 18, 772–776. [Google Scholar] [CrossRef] [PubMed]
  36. Holland, A.E.; Cox, N.S. Telerehabilitation for COPD: Could pulmonary rehabilitation deliver on its promise? Respirology 2017, 22, 626–627. [Google Scholar] [CrossRef] [Green Version]
  37. Tsai, L.L.; McNamara, R.J.; Moddel, C.; Alison, J.A.; McKenzie, D.K.; McKeough, Z.J. Home-based telerehabilitation via real-time videoconferencing improves endurance exercise capacity in patients with COPD: The randomized controlled TeleR Study. Respirology 2017, 22, 699–707. [Google Scholar] [CrossRef] [Green Version]
  38. Zanaboni, P.; Hoaas, H.; Aaroen Lien, L.; Hjalmarsen, A.; Wootton, R. Long-term exercise maintenance in COPD via telerehabilitation: A two-year pilot study. J. Telemed. Telecare 2017, 23, 74–82. [Google Scholar] [CrossRef]
  39. Bairapareddy, K.C.; Chandrasekaran, B.; Agarwal, U. Telerehabilitation for Chronic Obstructive Pulmonary Disease Patients: An Underrecognized Management in Tertiary Care. Indian J. Palliat. Care 2018, 24, 529–533. [Google Scholar] [CrossRef] [PubMed]
  40. Hoaas, H.; Andreassen, H.K.; Lien, L.A.; Hjalmarsen, A.; Zanaboni, P. Adherence and factors affecting satisfaction in long-term telerehabilitation for patients with chronic obstructive pulmonary disease: A mixed methods study. BMC Med. Inform. Decis. Mak. 2016, 16, 26. [Google Scholar] [CrossRef] [Green Version]
  41. Tousignant, M.; Marquis, N.; Page, C.; Imukuze, N.; Metivier, A.; St-Onge, V.; Tremblay, A. In-home Telerehabilitation for Older Persons with Chronic Obstructive Pulmonary Disease: A Pilot Study. Int. J. Telerehabil. 2012, 4, 7–14. [Google Scholar] [CrossRef] [Green Version]
  42. Paneroni, M.; Colombo, F.; Papalia, A.; Colitta, A.; Borghi, G.; Saleri, M.; Cabiaglia, A.; Azzalini, E.; Vitacca, M. Is Telerehabilitation a Safe and Viable Option for Patients with COPD? A Feasibility Study. COPD 2015, 12, 217–225. [Google Scholar] [CrossRef]
  43. Lundell, S.; Holmner, A.; Rehn, B.; Nyberg, A.; Wadell, K. Telehealthcare in COPD: A systematic review and meta-analysis on physical outcomes and dyspnea. Respir. Med. 2015, 109, 11–26. [Google Scholar] [CrossRef] [Green Version]
  44. Bourne, S.; DeVos, R.; North, M.; Chauhan, A.; Green, B.; Brown, T.; Cornelius, V.; Wilkinson, T. Online versus face-to-face pulmonary rehabilitation for patients with chronic obstructive pulmonary disease: Randomised controlled trial. BMJ Open 2017, 7, e014580. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Rayce, K.; Minet, L.R.; Kidholm, K.; Vestbo, J.; Pedersen, C.D.; Huniche, L. Telemediated Training in the Home as a Part of the Everyday Life and Practice With Very Severe Chronic Obstructive Pulmonary Disease. Qual. Health Res. 2020, 30, 2132–2145. [Google Scholar] [CrossRef] [PubMed]
  46. Chaplin, E.; Hewitt, S.; Apps, L.; Bankart, J.; Pulikottil-Jacob, R.; Boyce, S.; Morgan, M.; Williams, J.; Singh, S. Interactive web-based pulmonary rehabilitation programme: A randomised controlled feasibility trial. BMJ Open 2017, 7, e013682. [Google Scholar] [CrossRef] [PubMed]
  47. Bohil, C.J.; Alicea, B.; Biocca, F.A. Virtual reality in neuroscience research and therapy. Nat. Rev. Neurosci. 2011, 12, 752–762. [Google Scholar] [CrossRef] [PubMed]
  48. Mazurek, J.; Kiper, P.; Cieslik, B.; Rutkowski, S.; Mehlich, K.; Turolla, A.; Szczepanska-Gieracha, J. Virtual reality in medicine: A brief overview and future research directions. Hum. Mov. 2019, 20, 16–22. [Google Scholar] [CrossRef] [Green Version]
  49. Rutkowski, S.; Kiper, P.; Cacciante, L.; Cieslik, B.; Mazurek, J.; Turolla, A.; Szczepanska-Gieracha, J. Use of virtual reality-based training in different fields of rehabilitation: A systematic review and meta-analysis. J. Rehabil. Med. 2020, 52, jrm00121. [Google Scholar] [CrossRef]
  50. Jacobson, L. Welcome to the virtual world. In On the Cutting Edge of Technology; Swadley, R., Ed.; Sams: Carmel, IN, USA, 1993; pp. 69–79. [Google Scholar]
  51. Matsangidou, M.; Ang, C.S.; Mauger, A.R.; Intarasirisawat, J.; Otkhmezuri, B.; Avraamides, M.N. Is your virtual self as sensational as your real? Virtual Reality: The effect of body consciousness on the experience of exercise sensations. Psychol. Sport Exerc. 2019, 41, 218–224. [Google Scholar] [CrossRef] [Green Version]
  52. Palazzo, C.; Klinger, E.; Dorner, V.; Kadri, A.; Thierry, O.; Boumenir, Y.; Martin, W.; Poiraudeau, S.; Ville, I. Barriers to home-based exercise program adherence with chronic low back pain: Patient expectations regarding new technologies. Ann. Phys. Rehabil Med. 2016, 59, 107–113. [Google Scholar] [CrossRef] [PubMed]
  53. Cerdan, J.; Catalan-Matamoros, D.; Berg, S.W. Online communication in a rehabilitation setting: Experiences of patients with chronic conditions using a web portal in Denmark. Patient Educ. Couns. 2017, 100, 2283–2289. [Google Scholar] [CrossRef] [PubMed]
  54. Condon, C.; Lam, W.T.; Mosley, C.; Gough, S. A systematic review and meta-analysis of the effectiveness of virtual reality as an exercise intervention for individuals with a respiratory condition. Adv. Simul. 2020, 5, 33. [Google Scholar] [CrossRef]
  55. Wang, Y.Q.; Liu, X.; Ma, R.C.; Yin, Y.Y.; Yang, Z.; Cao, H.P.; Xie, J. Active Video Games as an Adjunct to Pulmonary Rehabilitation of Patients With Chronic Obstructive Pulmonary Disease A Systematic Review and Meta-Analysis. Am. J. Phys. Med. Rehabil. 2020, 99, 372–380. [Google Scholar] [CrossRef] [PubMed]
  56. Colombo, V.; Aliverti, A.; Sacco, M. Virtual reality for COPD rehabilitation: A technological perspective. Pulmonology 2020. [Google Scholar] [CrossRef] [PubMed]
  57. Rutkowski, S.; Rutkowska, A.; Jastrzebski, D.; Racheniuk, H.; Pawelczyk, W.; Szczegielniak, J. Effect of Virtual Reality-Based Rehabilitation on Physical Fitness in Patients with Chronic Obstructive Pulmonary Disease. J. Hum. Kinet. 2019, 69, 149–157. [Google Scholar] [CrossRef] [Green Version]
  58. Rutkowski, S.; Szary, P.; Rutkowska, A.; Sacha, J.; Casaburi, R. Implementation of immersive virtual reality influences outcomes of exercise test. Eur. Respir. J. 2020, 56. [Google Scholar] [CrossRef]
  59. Colombo, V.; Mondellini, M.; Gandolfo, A.; Fumagalli, A.; Sacco, M. Usability and Acceptability of a Virtual Reality-Based System for Endurance Training in Elderly with Chronic Respiratory Diseases. In Virtual Reality and Augmented Reality. EuroVR 2019. Lecture Notes in Computer Science; Bourdot, P., Interrante, V., Nedel, L., Magnenat-Thalmann, N., Zachmann, G., Eds.; Springer: Cham, Switzerland, 2019; Volume 11883, pp. 87–96. [Google Scholar] [CrossRef]
  60. Rutkowski, S.; Szczegielniak, J.; Szczepanska-Gieracha, J. Evaluation of the efficacy of immersive virtual reality therapy as a method supporting pulmonary rehabilitation: A randomized controlled trial. J. Clin. Med. 2021, 10, 352. [Google Scholar] [CrossRef]
  61. Wardini, R.; Dajczman, E.; Yang, N.; Baltzan, M.; Prefontaine, D.; Stathatos, M.; Marciano, H.; Watson, S.; Wolkove, N. Using a virtual game system to innovate pulmonary rehabilitation: Safety, adherence and enjoyment in severe chronic obstructive pulmonary disease. Can. Respir. J. 2013, 20, 357–361. [Google Scholar] [CrossRef] [Green Version]
  62. LeGear, T.; LeGear, M.; Preradovic, D.; Wilson, G.; Kirkham, A.; Camp, P.G. Does a Nintendo Wii exercise program provide similar exercise demands as a traditional pulmonary rehabilitation program in adults with COPD? Clin. Respir. J. 2016, 10, 303–310. [Google Scholar] [CrossRef] [PubMed]
  63. Albores, J.; Marolda, C.; Haggerty, M.; Gerstenhaber, B.; ZuWallack, R. The Use of a Home Exercise Program Based on a Computer System in Patients With Chronic Obstructive Pulmonary Disease. J. Cardiopulm. Rehabil. 2013, 33, 47–52. [Google Scholar] [CrossRef] [PubMed]
  64. Pauwels, R.A.; Buist, A.S.; Calverley, P.M.; Jenkins, C.R.; Hurd, S.S.; Committee, G.S. Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease. NHLBI/WHO Global Initiative for Chronic Obstructive Lung Disease (GOLD) Workshop summary. Am. J. Respir. Crit. Care Med. 2001, 163, 1256–1276. [Google Scholar] [CrossRef] [Green Version]
  65. Yang, L.L.; Yang, T. Pulmonary rehabilitation for patients with coronavirus disease 2019 (COVID-19). Chronic Dis. Transl. Med. 2020, 6, 79–86. [Google Scholar] [CrossRef] [PubMed]
  66. Budd, J.; Miller, B.S.; Manning, E.M.; Lampos, V.; Zhuang, M.; Edelstein, M.; Rees, G.; Emery, V.C.; Stevens, M.M.; Keegan, N.; et al. Digital technologies in the public-health response to COVID-19. Nat. Med. 2020, 26, 1183–1192. [Google Scholar] [CrossRef] [PubMed]
  67. National Institute for Health and Care Excellence. Evidence Standards Framework for Digital Health Technologies. Available online: https://www.nice.org.uk/about/what-we-do/our-programmes/evidence-standards-framework-for-digital-health-technologies (accessed on 14 January 2021).
  68. Troosters, T.; Casaburi, R. Interview with Prof. Dr Richard Casaburi, Presidential Awardee 2020. Breathe 2020, 16, 200249. [Google Scholar] [CrossRef] [PubMed]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Rutkowski, S. Management Challenges in Chronic Obstructive Pulmonary Disease in the COVID-19 Pandemic: Telehealth and Virtual Reality. J. Clin. Med. 2021, 10, 1261. https://doi.org/10.3390/jcm10061261

AMA Style

Rutkowski S. Management Challenges in Chronic Obstructive Pulmonary Disease in the COVID-19 Pandemic: Telehealth and Virtual Reality. Journal of Clinical Medicine. 2021; 10(6):1261. https://doi.org/10.3390/jcm10061261

Chicago/Turabian Style

Rutkowski, Sebastian. 2021. "Management Challenges in Chronic Obstructive Pulmonary Disease in the COVID-19 Pandemic: Telehealth and Virtual Reality" Journal of Clinical Medicine 10, no. 6: 1261. https://doi.org/10.3390/jcm10061261

APA Style

Rutkowski, S. (2021). Management Challenges in Chronic Obstructive Pulmonary Disease in the COVID-19 Pandemic: Telehealth and Virtual Reality. Journal of Clinical Medicine, 10(6), 1261. https://doi.org/10.3390/jcm10061261

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop