Next Article in Journal
Thermally Coupled NTC Chip Thermistors: Their Properties and Applications
Previous Article in Journal
Three-Dimensional Segmentation of Equine Paranasal Sinuses in Multidetector Computed Tomography Datasets: Preliminary Morphometric Assessment Assisted with Clustering Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Technological Features of Immersive Virtual Reality Systems for Upper Limb Stroke Rehabilitation: A Systematic Review

by
Chala Diriba Kenea
1,2,*,
Teklu Gemechu Abessa
2,3,
Dheeraj Lamba
4 and
Bruno Bonnechère
2,5,6
1
Department of Information Science, Faculty of Computing and Informatics, Jimma Institute of Technology, Jimma University, Jimma P.O. Box 378, Oromia, Ethiopia
2
REVAL Rehabilitation Research Center, Technology-Supported and Data-Driven Rehabilitation, Data Science Institute, Faculty of Rehabilitation Sciences, University of Hasselt, 3590 Diepenbeek, Belgium
3
Department of Special Needs & Inclusive Education, Jimma University, Jimma P.O. Box 378, Oromia, Ethiopia
4
Department of Physiotherapy, Faculty of Medical Sciences, Institute of Health, Jimma University, Jimma P.O. Box 378, Oromia, Ethiopia
5
Technology-Supported and Data-Driven Rehabilitation, Data Sciences Institute, Hasselt University, 3590 Diepenbeek, Belgium
6
Department of PXL—Healthcare, PXL University of Applied Sciences and Arts, 3500 Hasselt, Belgium
*
Author to whom correspondence should be addressed.
Sensors 2024, 24(11), 3546; https://doi.org/10.3390/s24113546
Submission received: 5 May 2024 / Revised: 24 May 2024 / Accepted: 28 May 2024 / Published: 31 May 2024
(This article belongs to the Special Issue Sensors in mHealth Applications)

Abstract

:
Stroke is the second most common cause of death worldwide, and it greatly impacts the quality of life for survivors by causing impairments in their upper limbs. Due to the difficulties in accessing rehabilitation services, immersive virtual reality (IVR) is an interesting approach to improve the availability of rehabilitation services. This systematic review evaluates the technological characteristics of IVR systems used in the rehabilitation of upper limb stroke patients. Twenty-five publications were included. Various technical aspects such as game engines, programming languages, headsets, platforms, game genres, and technical evaluation were extracted from these papers. Unity 3D and C# are the primary tools for creating IVR apps, while the Oculus Quest (Meta Platforms Technologies, Menlo Park, CA, USA) is the most often used headset. The majority of systems are created specifically for rehabilitation purposes rather than being readily available for purchase (i.e., commercial games). The analysis also highlights key areas for future research, such as game assessment, the combination of hardware and software, and the potential integration incorporation of biofeedback sensors. The study highlights the significance of technological progress in improving the effectiveness and user-friendliness of IVR. It calls for additional research to fully exploit IVR’s potential in enhancing stroke rehabilitation results.

1. Introduction

Stroke is a leading cause of death and long-term disability worldwide, responsible for approximately 12% of all deaths [1]. It ranks as the second most common cause of death globally [2]. The incidence of stroke is escalating in both developed and developing countries, presenting a global health challenge [3].
At the onset of a stroke, survivors experience a wide array of symptoms, including motor, mental, lingual, sensory, and cognitive impairments. These impairments lead to substantial functional challenges in daily life and a decreased quality of life. Upper limb impairments are the most prevalent consequence, and the more disabling post-stroke conditions [4]. Rehabilitating upper limb function is critical for stroke patients, significantly affecting their perceived disability and quality of life [5].
However, access to rehabilitation services is often limited, which is a significant barrier to recovery identified by the World Health Organization [6]. It is, therefore, crucial to develop innovative solutions to enhance the availability of rehabilitation services for stroke survivors. The rapid advancements in technology and computer science have significantly altered our environment and lifestyle, introducing new technologies to augment physiotherapy and rehabilitation processes, termed technology-supported rehabilitation [7].
One technology in particular, the Virtual Reality (VR), is becoming increasingly tested and implemented in the healthcare sector. This popularity has increased significantly in the past decade, with a particularly rapid acceleration since 2016. This spike can be attributed to the production of affordable and user-friendly VR hardware by various firms, which has made the technology more accessible to a wider range of people [8]. It is a three-dimensional computer-generated simulated environment, which attempts to replicate real world or imaginary environments and interactions, thereby supporting work, education, recreation, and health [9].
Immersive Virtual Reality (IVR) is one of the computer applications used to visualize virtual environments, including their surrounding objects. It also allows us to observe, listen to the sounds around us, and interact with people in virtual environments by acting like we are in the real world [10,11]. IVR provides an opportunity to create a sense of immersion, simulating the feeling of being in the real world. However, this immersion varies across different degrees, leading to the categorization of VR into three main types: non- IVR, semi-IVR, and fully IVR.
In non-IVR, users engage with virtual environments via traditional displays, such as smartphone screens or computer monitors, without a sense of physical presence within the virtual world. Semi-IVR facilitates interaction with virtual content while allowing users to remain cognizant of the real world, often employing large (incurved) screens or projection systems. Fully IVR provides an experience wherein the user perceives themselves to be present within the virtual environment, typically with minimal or no awareness of their actual physical surroundings, primarily through the utilization of head-mounted displays [12].
Within VR setups, users primarily engage with the virtual environment via various input devices such as controllers, joysticks, or motion capture cameras. Thanks to technological developments, VR is becoming more and more used in diverse sectors such as healthcare, education, entertainment, military, etc. In healthcare, IVR can be used for training medical professionals, pain management, treating mental health conditions, and rehabilitation. IVR for rehabilitation is an emerging field, experiencing rapid development and research progress.
Recent research has highlighted multiple benefits of IVR in rehabilitation, including for example, increased engagement and motivation, immediate feedback, improved patient outcomes, 3D motions and activities mimicking daily living activities, and customizable dual or triple tasks [13,14]. Compared to non-IVR, IVR not only enhances motivation and adherence [15] to treatment but also offers greater clinical efficacy [16]. This improvement is attributed to the immersive experience and sense of presence provided by IVR, which facilitate more challenging dual-task scenarios and elevated cognitive stimulation. Consequently, these factors lead to increased brain activation during rehabilitation exercises, as suggested by current evidence [17].
Consequently, IVR is currently being applied across a broad spectrum of rehabilitation areas, encompassing neurological rehabilitation for postural balance [18], motor functions [19,20], physical therapy [21,22], and cognitive rehabilitation [19,23]. Additionally, it has shown potential for providing pain relief compared to conventional therapy in various pathologies [24]. IVR emerges thus as a promising tool in the healthcare sector and more particularly in rehabilitation.
IVR interventions have proven effective in stroke rehabilitation [25]. Studies indicate significant improvements in the upper limb function of stroke patients, highlighting its potential as a therapeutic tool in rehabilitation and neurorehabilitation fields [26]. The immersive and interactive nature of IVR facilitates the creation of controlled environments that support intensive, repetitive, and task-oriented practice, offering advantages over conventional therapy.
The adoption of technology-supported rehabilitation, such as IVR, is also increasingly being used for its capacity to provide objective assessments that can be automated, thereby saving time and facilitating the precise evaluation of motor functions [7]. This approach may take into consideration various patient-specific factors, including kinematics, activity levels, intensity of movements, muscle activity, co-contraction patterns, posture, motion fluidity during exercises, heart rate, and stress levels, among others. It also allows for tracking adherence to therapy. IVR’s immersive nature not only enhances patient engagement but also supports adjustments related to the body (for instance, alterations in the size and length of body segments and body composition), the environment, and social interactions. A notable feature of IVR is its ability to capture a wide range of measurements, referred to as biomarkers, during rehabilitation exercises [27]. Defined by Wagner, rehabilomics is an innovative approach that discusses biomarkers within research and clinical contexts to address the gaps and needs of clinical treatments specific to physical medicine and rehabilitation [28]. This concept merges the systematic gathering of data on phenotypes relevant to rehabilitation and a multidisciplinary analysis of biomarkers, aiming to deepen our understanding of the biological aspects, functionality, prognosis, complications, treatment options, adaptation processes, and recovery in individuals with disabilities [29].
Specifically, IVR can monitor the mobility and function of the upper limbs during the rehabilitation exercises without the necessity for external sensors, making it a less intrusive and more user-friendly option for both patients and clinicians [24,25]. Additionally, IVR systems have the capability to gather more physiological data, including autonomic responses, through techniques such as pupillometry to inform about pain and stress level of the patients [30].
Despite these advancements, the application of IVR in the rehabilitation of upper limb stroke both from a rehabilitation perspective and from the assessment (i.e., rehabilomics) remains an area that requires further research.
Therefore, this study aims to systematically review current literature in this domain to outline the technical aspects of IVR systems from both software and hardware perspectives. This study will also discuss current limitations and future challenges, contributing valuable insights into the potential and further development of IVR for stroke rehabilitation.

2. Materials and Methods

The review protocol has been registered on the Open Science Framework (OSF) [31].

2.1. Search Strategy

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) was used [32]. A predefined search strategy was employed to search Scopus, PubMed, and Web of Science databases for relevant papers (last update: 20 March 2024). In total, 154 papers were retrieved, with 28 from PubMed, 72 from Web of Science, and 54 from Scopus (Table 1).

2.2. Study Selection

The review adhered to the PRISMA guidelines to ensure strictness, replicability, reliability, and accuracy. Initially, one reviewer conducted searches on the PubMed, Web of Science, and Scopus platforms using the defined search strategy. Subsequently, the retrieved papers were imported into Zotero to eliminate duplicate results. All references and citation details from the chosen electronic databases were consolidated and exported from Zotero 6.0.26 into Rayyan, version 6.0.26.
The authors systematically screened and selected papers through a three-step process involving titles, abstracts, and full-text screening, utilizing Rayyan. The first author screened papers based on titles, followed by independent abstract screening by two screeners. Full-text screening was then conducted by the last two screeners. This three-step process ensured screening reliability, with the inclusion of relevant papers determined by the consensus of both screeners. During the screening process, we applied various inclusion and exclusion criteria. There were no limitations on the publication year of articles; however, only English-language articles published in peer-reviewed journals were considered for inclusion. The selection focused solely on stroke, excluding articles on other diseases causing upper limb impairment. Non- and semi-IVR, as well as review papers, were excluded.

2.3. Data Extraction

The data extraction process involved the use of the following parameters: country, methodology adopted, software used, virtual reality headset, platforms (standalone IVR headset, mobile, tablet, laptop, or desktop), game types (open source, commercial, custom, or developed), IVR game scenarios, technical evaluation, and clinical evaluation. To ensure reliability, the two researchers worked independently to extract the data. To ease the visualization of the different parameters of the included studies (i.e., type of IVR, localization), we used network analysis to plot the results. The distribution of the available evidence was assessed using a network geometry graph in which the width of the continuous line connecting nodes corresponding to the number of trials directly comparing the interventions [33].

2.4. Quality Assessment

We evaluated the quality of each study included in the review by utilizing the Critical Appraisal Skills Program (CASP) Qualitative Studies Checklist [34]. The CASP was assessed by two researchers.

3. Results

In total, 159 papers were screened following the PRISMA guidelines, and 25 were finally included in this review (Figure 1).

3.1. Quality Assessment

The CASP assessment results revealed that the mean score of individual studies was 8.9 out of 10. This outcome affirms the relevance and appropriateness of the papers for the study. However, it is noteworthy that the relationship between researchers and participants was never explicitly stated in the included studies (Figure 2).

3.2. Patients and Interventions

In total, 566 participants were included in this review: 337 patients in the intervention group and 229 controls. The mean age was 53.8 (standard deviation: 10.4) years old. There were more males than females (58.62%). Most of the studies were performed in the chronic phase (n = 16, 64%), or subacute (n = 6, 24%); note that some studies included patients in various phases.
Concerning the intervention, the median duration was 3 weeks [p25 = 2; p75 = 4.75], with a median of 3 [1 ; 5] sessions per week with a median duration of 30 [25 ; 45] minutes. The vast majority of the studies were performed in the hospital, with only one study being performed at home [5]. As presented in Figure 3, most of the studies are focusing on the upper limb globally (including mostly shoulder, elbow, and wrist mobility), but there are also a significant number of systems focusing only on the hand function.
Complete characteristics of the patients are presented in Table 2.

3.3. Country: IVR Games Developed and Validated

The findings of the review revealed that in all selected studies, the countries where IVR games for ULSR were developed and validated were the same. The studies were mostly conducted in Korea (n = 4, 16%), the USA (n = 3, 12%), Spain (n = 3, 12%), China (n = 3, 12%), Taiwan (n = 3, 12%), Belgium (n = 2, 8%), the UK (n = 2, 8%), and in Italy, India, Brazil, Poland, and Germany.

3.4. Software

The common software-related technological aspects of IVR games include game engines and programming languages. The findings of this review show that the Unity 3D engine (n = 13, 52%) was the predominant game engine used, with Unreal Engine (n = 2, 8%) being the second most employed.
The C# was the most extensively utilized programming language, while Java script was mentioned in only one paper. Notably, the Unity 3D engine was frequently paired with the C# programming language.
The finding pointed out that most of the systems (n = 19, 76%) were custom-developed, either from scratch or by customizing already-developed games, while only (n = 2, 8%) studies were performed with commercial games and (n = 1, 4%) with open-source games. However, (n = 3, 12%) of the studies did not specify the type of games used (see Table 3 for complete results).
Table 4 presents a comprehensive overview of the main game scenarios now used in rehabilitative environments, categorized according to the specific skills they aim to improve. These scenarios encompass a variety of exercises that target both fine motor skills and exact manipulations, as well as exercises that aim to enhance gross motor abilities and general body mobility. In addition, the table outlines the technological features of these games, emphasizing the use of VR combined with motion tracking and real-time feedback mechanisms that enable these therapeutic interventions. The current overview seeks to offer a thorough understanding of how various games contribute to distinct rehabilitation objectives. The methodology adopted for the development of IVR games for ULSR was explicitly mentioned in only two papers screened. They are the VR2 clinical study design and user center design. There are three phases of VR clinical study designs. The VR2 study concentrates on assessing feasibility, acceptability, tolerability, and initial clinical efficacy, while in user-centered design (UCD) methodology, designers consider users’ demands at every stage of the IVR game design process. To produce an IVR game that is highly usable and accessible for users, UCD design teams incorporate users throughout the entire design process. This design approach is user targeted.

3.5. Hardware

First, concerning the headsets, our results show that Oculus Quest (n = 12, 48%), HTC Vive (n = 7, 28%), and Oculus Rift (n = 2, 8%) were the most used system. Note that for three studies, the type of headset was not specified.
The study’s findings revealed that IVR games for ULSR were primarily played on standalone headsets (n = 8, 32%), desktops (n = 8, 32%), laptops (n = 3, 12%), and mobile devices 1 (n = 1, 4%). Again, here, we noticed that in five studies (n = 5, 20%), the type of platform was not specified.
To better visualize the relationship between the different headsets commonly used and the type of IVR solutions (i.e., specially develop, commercial or open access), we performed network analysis with the stroke’s stage and the targeted localization. Results are presented in Figure 4. Concerning the headset, as already seen, the most common in the Oculus Quest used in the chronic phase, targeting the hand and arm function. Concerning the type of IVR the most commonly used are specifically developed ones, also used in the chronic phase to target upper limb function globally.

3.6. Technical Evaluation

In this review, none of the IVR games utilized for ULSR were evaluated by the game developers and/or rehabilitation specialists by using different game evaluation parameters, commonly used to evaluated system, such as the graphic rendering of games, quality and appropriateness of audio used, haptic feedback, use of biofeedback sensors, whether or not there can be customizable environments for different level patients, a scoring system, levels and progression, virtual rewards and incentives, and motion tracking.

4. Discussion

The aim of this review was to summarize the technologies currently being used to create IVR rehabilitation. These technical features include game engine, programming language, adopted methodology, headsets, platform, technical evaluation, and clinical validation. The specifics of each discussion are outlined below.

4.1. Game Engine and Programming Language

The study results emphasize that C# is the most widely used programming language for developing applications for IVR serious games. Furthermore, the C# programming language is the most adaptable programming language for creating IVR apps [59] and for developing IVR games with the Unity 3D game engine [60]. The Unity 3D game engine is widely recognized as the most used tool for IVR game development. This point is further supported by another study showing that Unity 3D is a powerful tool enabling programmers to create IVR game applications [61,62]. Unity simplifies the process of developing VR applications for popular operating systems such as Windows, iOS, and Android, as well as for most top gaming consoles and the web. Furthermore, it is available in both free and professional licenses, facilitating quick prototyping and the distribution of created applications across various IVR platforms.

4.2. Methodologies Adopted in IVR Games

One striking result of this study was that the adopted methodology was only outlined in two papers. They are VR2 clinical study design [57] and user-centered design [44]. There are three phases to the VR clinical trial designs [63]: VR1, VR2, and VR3. The production of content using the principles of human-centered design in collaboration with patients and providers is the main emphasis of VR1 studies. Early testing in VR2 trials is focused on first clinical efficacy, acceptability, tolerability, and feasibility. Randomized controlled trials, or VR3 trials, assess effectiveness in comparison to a control group.
User-centered design, on the other hand, is an iterative design approach where designers prioritize users and their needs at every stage of the design process. But there are methodologies that can be adopted in the development of IVR games, such as experience design [64], iterative design [65,66], experimental design [67], rapid prototyping methodology [68], and participatory design or co-design [69,70]. Participatory design, which involves professionals from different disciplines, has been employed by many scholars in healthcare for IVR game development [71,72] and could be particularly relevant for the development of rehabilitation solutions but has not been investigated yet in this particular field.

4.3. Types of IVR Headsets

Various companies have developed different headsets, including but not limited to Oculus Quest, HTC Vive, Apple Vision Pro, HoloLens, and Google Cardboard. However, in this review, only four distinct IVR headsets were used, namely the Oculus Quest (n = 12, 48%), HTC Vive (n = 7, 28%), Oculus Rift (n = 2, 8%), and Rusu Play VR (n = 1, 4%). These results are confirmed by different other studies showing that the Oculus Quest and HTC Vive are among the most popular IVR headsets [73,74]. Both of these systems have pros and cons. The Oculus Quest is a standalone device, eliminating the need for a connection to a computer or mobile phone. Moreover, it facilitates casting to a TV or smartphone and supports wireless streaming from a PC via Air Link or Virtual Desktop. Conversely, the HTC Vive requires additional hardware (computer with good graphical card) or software and is restricted to the SteamVR library. While the Oculus Quest is recognized for its convenience, versatility, and affordability, the HTC Vive is lauded for its power, immersion, and customization capabilities. Notably, many scholars have used the Oculus Quest in several studies focusing on shoulder, hand, balance, and arm motor rehabilitation [75,76,77].

4.4. Platform for Implement IVR for ULSR

IVR platforms encompass devices that enable users to immerse themselves in and interact with virtual environments in a realistic and engaging manner. Various types of immersive VR platforms exist, differing in hardware and software requirements, level of immersion, and content availability. Common types of platforms include standalone, desktop, laptop, and smartphone.
Standalone VR utilizes a standalone VR headset (e.g., Oculus Quest 2, Meta Quest 2 without Link Cable, and Meta Quest Pro) with its own processing power, graphics, storage, battery, speakers, cameras, and sensors for the IVR experience. Different studies also support the idea that standalone VR is the most commonly used and effective platform [78,79,80].
Desktop VR involves using a desktop computer paired with a tethered VR headset (such as the HTC Vive) to run VR applications. In this study, desktop VR accounted for (n = 8, 32%) of the usage which also its suitability was mentioned in different papers [73], while laptops and smartphones were not much utilized.

4.5. IVR Game Types

IVR games can be effectively employed by ULSR, offering enjoyable and motivating exercises. Depending on their purpose, IVR games for stroke rehabilitation can be classified as open, commercial, or developed. The study’s findings revealed that the majority of IVR games for ULSR were specific solutions (n = 19, 76%) rather than commercially available solutions or open source. This result also supported the fact that in several studies, they used their own games by developing them from the scratch [61,81]. Such types of solutions are of course more adapted to the patients and the rehabilitation process but are more costly to develop and maintain in comparison with commercially available solutions.

4.6. IVR Game Evaluation

As presented in the result section, the IVR games used for ULSR were not evaluated by game developers or rehabilitation professionals while multiple studies recommended the need for serious game evaluation before using it, since it is for a specific purpose [82,83,84]. There are several aspects of game evaluation, such as graphic rendering of games, quality and appropriateness of audio used, haptic feedback, use of biofeedback sensors, whether there can be customizable environments for different level patients, a scoring system, levels and progression, and virtual rewards and incentives. These aspects have more detail elements; for instance, graphics rendering has dimensionality, perspective, color, presentation, and realism [85].
The audio system can contribute to a more immersive experience in games played on screens [86]. The haptic feedback has been shown to enhance user performance and enhance interaction in a fully IVR environment [87,88]. In addition, haptic feedback may support immersion and presence in IVR environments [89]. Moreover, the use of biofeedback sensors within IVR environments has also been stated in different studies that it can improve user performance [90,91].
Furthermore, in relation to whether there can be customizable environments for different levels of patients, a scoring system with levels and progression, virtual rewards and incentives, and motion tracking, much needs to be evaluated before IVR game utilization.

4.7. Technical Implications

Technological advancements in IVR encompass both hardware and software. The evidence demonstrates a consistent increase in the development and utilization of IVR for ULSR over the years. The degree of immersion has also progressed from non-IVR to semi-IVR and now fully IVR, owing to enhancements in VR headsets, controllers, powerful computers, and game engine technologies.
This evolution presents opportunities for further improvement in technological aspects, such as immersion level, state of engagement and motivation, graphical enhancements, simplified immersive game development, a general framework for development and validation, headsets without controllers, feedback mechanisms, and notifications. Additionally, the study suggests that widely adopted elements in the realm of IVR for ULSR include the Unity 3D game engine, C# programming language, preference for developed games over open or commercial ones, and the utilization of the Oculus Quest standalone headset in terms of technical aspects.

4.8. Clinical Implications of Technical Means and Metrics in IVR

The adaptation of IVR to various stages of stroke rehabilitation (acute, subacute, and chronic), as presented in Table 3 and Figure 4, has the potential to greatly impact patient outcomes. For example, in the initial phase of rehabilitation, it may be more advantageous to use systems that provide controlled and gradual movements to avoid muscular tension. In later stages, more demanding tasks can be introduced to assist with muscle rebuilding and neuroplasticity.
Similarly, the differentiation in the implementation of IVR systems for various body parts highlights specific requirements needed to develop specific and adapted IVR systems. For example, the hand rehabilitation process requires a higher level of sensor integration and feedback precision compared to the strengthening of gross motor abilities in the upper limb. This level of precision has the potential to result in more focused and efficient rehabilitation protocols, which are essential for addressing the intricate requirements of stroke recovery.
Our findings have an important clinical implication regarding the criteria used to assess the quality of rehabilitation. Using the data collected during the rehabilitation process [92] (i.e., speed, ranges of motion, smoothness) offers a quantitative foundation for evaluating patient advancement. These parameters are crucial for evaluating the clinical effectiveness of IVR systems. Furthermore, comprehending these technical aspects aids in enhancing VR applications to more effectively fulfill therapeutic requirements, potentially resulting in personalized rehabilitation plans based on individual progress indicators.

4.9. Current Limitations

Various technological factors have been evaluated in this review, but additional inquiries are required before fully apprehending the potential of IVR in rehabilitation. The analysis of the various VR headset types and development environments yields valuable insights into current practices. However, a more significant and insightful understanding can be gained by considering the clinical implications of how these technologies are utilized, taking into account the specific requirements of stroke rehabilitation stages and targeted limb functionalities. This technique not only meets the requirements of clinical demands but also advances the boundaries of how immersive technology may be used for health benefits. It highlights the need for more technical examination in future VR research in the field of rehabilitation.
Areas that need more consideration encompass the degree of immersion and the differences between semi-immersive, IVR and augmented reality, for example, the dimensions and weight of the headset, the use of controllers or marker less camera to track upper limb’s motion, and the potential problem related to VR sickness according to the different game’s scenarios. As we have seen, there are different options to integrate IVR into care. These include developing and testing different games specifically designed for this purpose, which is currently and by far the most commonly used practice or used commercially available solutions. Nevertheless, in both cases, it is essential to conduct a comprehensive examination of the technological components, encompassing the stages of development, validation, and customization for various contexts. This analysis should take into account crucial elements such as motivation [93,94,95], flow [96], usability [39,44], skill [97], judgment [98], technological adoption and acceptance [99,100,101,102], safety and comfort [46], satisfaction [39,44,45,46,94], immersion [103], and sense of presence and emotion [104].
Another crucial aspect requiring further investigation is the utilization of data gathered during the rehabilitation process (i.e., rehabilomics). These data are essential not only for analyzing patient progress [25] but also for automatically adjusting the settings of rehabilitation exercises [7]. Despite their clear potential and added value [105], systems that comprise both hardware and software components must undergo comprehensive validation before they are employed in clinical assessments.
This requirement might be ascribed to the newness and continuous use of IVR games for ULSR. Furthermore, the research has not yet examined the use of IVR for ULSR in low- or middle-income countries, despite the increasing number of stroke patients in developing areas. The majority of the reported studies have been conducted in high-income countries.

5. Conclusions

This systematic review provided a comprehensive analysis of the technological aspects of IVR systems for ULSR. Through examining 25 different systems, this study highlights Unity 3D and C# as the predominant tools for developing immersive applications, with Oculus Quest being the most used headset. Another important finding is that most of the systems used have been specifically developed, highlighting future challenges in sustainably implementing such systems in daily care. Despite significant advancements in IVR technology, which include customizable environments, we identified several areas needing further exploration such as the validation of game scenarios, the choice of the best combination of hardware and software, and the integration of biofeedback sensors. Overall, these findings suggest a promising future for IVR in rehabilitation, urging continued innovation and research to enhance the efficacy and user-friendliness of these systems. The expansion of technological capabilities in IVR is crucial for advancing rehabilitation practices and improving patient outcomes in stroke recovery.

Author Contributions

Conceptualization, C.D.K., B.B., T.G.A. and D.L.; methodology, C.D.K., B.B., T.G.A. and D.L.; software, C.D.K. and B.B.; validation, C.D.K., B.B., T.G.A. and D.L.; formal analysis, C.D.K. and B.B.; investigation, C.D.K., B.B., T.G.A. and D.L.; data curation, C.D.K., B.B., T.G.A. and D.L.; writing—original draft preparation, C.D.K.; writing—review and editing, B.B., T.G.A. and D.L.; visualization, C.D.K. and B.B.; supervision, B.B., T.G.A. and D.L.; project administration, B.B.; funding acquisition, B.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the NASCERE project, a joint PhD program between Jimma University and Hasselt University.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The dataset analyzed in the current study is available from the corresponding author on reasonable request.

Acknowledgments

The authors would like to express appreciation to all the NASCERE project coordinators and their teams, at Ghent University, Hasselt University and Jimma University, for the funding and other facilities.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Vos, T.; Lim, S.S.; Abbafati, C.; Abbas, K.M.; Abbasi, M.; Abbasifard, M.; Abbasi-Kangevari, M.; Abbastabar, H.; Abd-Allah, F.; Abdelalim, A. Global Burden of 369 Diseases and Injuries in 204 Countries and Territories, 1990–2019: A Systematic Analysis for the Global Burden of Disease Study 2019. Lancet 2020, 396, 1204–1222. [Google Scholar] [CrossRef]
  2. Vahdati, S.S.; Ala, A.; Hejazian, S.; Hokmabadi, E.S.; Majidi, T.; Ghanbari, F.; Hosseinzadeh, N. Factors Affecting Complications and Mortality of Stroke Patients in Stroke Care Unit. Erciyes Med. J. 2022, 44, 136–141. [Google Scholar] [CrossRef]
  3. Feigin, V.L.; Stark, B.A.; Johnson, C.O.; Roth, G.A.; Bisignano, C.; Abady, G.G.; Abbasifard, M.; Abbasi-Kangevari, M.; Abd-Allah, F.; Abedi, V. Global, Regional, and National Burden of Stroke and Its Risk Factors, 1990–2019: A Systematic Analysis for the Global Burden of Disease Study 2019. Lancet Neurol. 2021, 20, 795–820. [Google Scholar] [CrossRef]
  4. Pollock, A.; Farmer, S.E.; Brady, M.C.; Langhorne, P.; Mead, G.E.; Mehrholz, J.; Van Wijck, F. Interventions for Improving Upper Limb Function after Stroke. Cochrane Database Syst. Rev. 2014, 11, CD010820. [Google Scholar] [CrossRef] [PubMed]
  5. Phelan, I.; Carrion-Plaza, A.; Furness, P.J.; Dimitri, P. Home-Based Immersive Virtual Reality Physical Rehabilitation in Paediatric Patients for Upper Limb Motor Impairment: A Feasibility Study. Virtual Real. 2023, 27, 3505–3520. [Google Scholar] [CrossRef]
  6. Rehabilitation. Available online: https://www.who.int/news-room/fact-sheets/detail/rehabilitation (accessed on 29 March 2024).
  7. Bonnechère, B.; Timmermans, A.; Michiels, S. Current Technology Developments Can Improve the Quality of Research and Level of Evidence for Rehabilitation Interventions: A Narrative Review. Sensors 2023, 23, 875. [Google Scholar] [CrossRef] [PubMed]
  8. Helou, S.; Khalil, N.; Daou, M.; El Helou, E. Virtual Reality for Healthcare: A Scoping Review of Commercially Available Applications for Head-Mounted Displays. Digit. Health 2023, 9, 20552076231178619. [Google Scholar] [CrossRef] [PubMed]
  9. Abbas, J.R.; O’Connor, A.; Ganapathy, E.; Isba, R.; Payton, A.; McGrath, B.; Tolley, N.; Bruce, I.A. What Is Virtual Reality? A Healthcare-Focused Systematic Review of Definitions. Health Policy Technol. 2023, 12, 100741. [Google Scholar] [CrossRef]
  10. Cortés-Pérez, I.; Zagalaz-Anula, N.; Ibancos-Losada, M.d.R.; Nieto-Escámez, F.A.; Obrero-Gaitán, E.; Osuna-Pérez, M.C. Virtual Reality-Based Therapy Reduces the Disabling Impact of Fibromyalgia Syndrome in Women: Systematic Review with Meta-Analysis of Randomized Controlled Trials. J. Pers. Med. 2021, 11, 1167. [Google Scholar] [CrossRef]
  11. Gonzalez Garza, I.A. GPS-MIV: The General Purpose System for Multi-Display Interactive Visualization. Master’s Thesis, University of Texas-Pan American, Edinburg, TX, USA, 2014. [Google Scholar]
  12. Perez-Marcos, D. Virtual Reality Experiences, Embodiment, Videogames and Their Dimensions in Neurorehabilitation. J. Neuroeng. Rehabil. 2018, 15, 113. [Google Scholar] [CrossRef]
  13. Wu, X.; Liu, H.; Zhang, J.; Chen, W. Virtual Reality Training System for Upper Limb Rehabilitation. In Proceedings of the 2019 14th IEEE Conference on Industrial Electronics and Applications (ICIEA), Xi’an, China, 19–21 June 2019; pp. 1969–1974. [Google Scholar]
  14. Zuki, F.S.M.; Merienne, F.; Sulaiman, S.; Ricca, A.; Rambli, D.R.A.; Saad, M.N.M. Gamification, Sensory Feedback, Adaptive Function on Virtual Reality Rehabilitation: A Brief Review. In Proceedings of the 2022 International Conference on Digital Transformation and Intelligence (ICDI), Kuching, Malaysia, 1–2 December 2022; pp. 330–335. [Google Scholar]
  15. Chen, J.; Or, C.K.; Chen, T. Effectiveness of Using Virtual Reality-Supported Exercise Therapy for Upper Extremity Motor Rehabilitation in Patients With Stroke: Systematic Review and Meta-Analysis of Randomized Controlled Trials. J. Med. Internet Res. 2022, 24, e24111. [Google Scholar] [CrossRef] [PubMed]
  16. Bedar, K.; Bubanovich, C.; Rosemore, J.; Radford, K.; Taylor, K.L. Virtual Reality Intervention and Its Impact on Upper Extremity Function in the Stroke Population: A Scoping Review. Games Health J. 2023, 12, 429–439. [Google Scholar] [CrossRef] [PubMed]
  17. Feitosa, J.A.; Fernandes, C.A.; Casseb, R.F.; Castellano, G. Effects of Virtual Reality-Based Motor Rehabilitation: A Systematic Review of fMRI Studies. J. Neural Eng. 2022, 19. [Google Scholar] [CrossRef] [PubMed]
  18. Lima Rebêlo, F.; de Souza Silva, L.F.; Doná, F.; Sales Barreto, A.; de Souza Siqueira Quintans, J. Immersive Virtual Reality Is Effective in the Rehabilitation of Older Adults with Balance Disorders: A Randomized Clinical Trial. Exp. Gerontol. 2021, 149, 111308. [Google Scholar] [CrossRef] [PubMed]
  19. Demir, O.; Gokbel, T.; Baydemir, C.; Dursun, E. Effects of Immersive Virtual Reality-Based Movement Therapy on Upper Extremity Functions and Cognitive Functions in Stroke Patients. Int. J. Health Stud. 2024, 9, 37–42. [Google Scholar] [CrossRef]
  20. Lee, G.-H. Improving Cognition and Motor Performances Through Fully Immersive Virtual Reality Using on a Head Mount Device Among Patients with Chronic Stroke. APJCRI 2023, 9, 579–588. [Google Scholar] [CrossRef]
  21. Elor, A.; Powell, M.; Mahmoodi, E.; Teodorescu, M.; Kurniawan, S. Gaming beyond the Novelty Effect of Immersive Virtual Reality for Physical Rehabilitation. IEEE Trans. Games 2022, 14, 107–115. [Google Scholar] [CrossRef]
  22. Altukhaim, S.; Sakabe, N.; Nagaratnam, K.; Mannava, N.; Kondo, T.; Hayashi, Y. Immersive Virtual Reality Enhanced Reinforcement Induced Physical Therapy (EVEREST) A Pilot Case–Control Study of Virtual Reality-Enhanced Upper Limb Rehabilitation for Stroke Survivors. Res. Sq. 2023. [Google Scholar] [CrossRef]
  23. Liu, Z.; He, Z.; Yuan, J.; Lin, H.; Fu, C.; Zhang, Y.; Wang, N.; Li, G.; Bu, J.; Chen, M.; et al. Application of Immersive Virtual-Reality-Based Puzzle Games in Elderly Patients with Post-Stroke Cognitive Impairment: A Pilot Study. Brain Sci. 2023, 13, 79. [Google Scholar] [CrossRef]
  24. Rutkowski, S.; Kiper, P.; Cacciante, L.; Cieslik, B.; Mazurek, J.; Turolla, A.; Szczepanska-Gieracha, J. Use of Virtual Reality-Based Training in Different Fields of Rehabilitation: A Systematic Review and Meta-Analysis. J. Rehabil. Med. 2020, 52, 1–16. [Google Scholar] [CrossRef]
  25. Bonnechère, B.; Jansen, B.; Haack, I.; Omelina, L.; Feipel, V.; Van Sint Jan, S.; Pandolfo, M. Automated Functional Upper Limb Evaluation of Patients with Friedreich Ataxia Using Serious Games Rehabilitation Exercises. J. NeuroEng. Rehabil. 2018, 15, 87. [Google Scholar] [CrossRef] [PubMed]
  26. Zanatta, F.; Farhane-Medina, N.Z.; Adorni, R.; Steca, P.; Giardini, A.; D’Addario, M.; Pierobon, A. Combining Robot-Assisted Therapy with Virtual Reality or Using It Alone? A Systematic Review on Health-Related Quality of Life in Neurological Patients. Health Qual. Life Outcomes 2023, 21, 18. [Google Scholar] [CrossRef] [PubMed]
  27. Biomarkers and Surrogate Endpoints: Preferred Definitions and Conceptual Framework. Clin. Pharmacol. Ther. 2001, 69, 89–95. [CrossRef] [PubMed]
  28. Wagner, A.K. TBI Translational Rehabilitation Research in the 21st Century: Exploring a Rehabilomics Research Model. Eur. J. Phys. Rehabil. Med. 2010, 46, 549–556. [Google Scholar] [PubMed]
  29. Wagner, A.K. A Rehabilomics Framework for Personalized and Translational Rehabilitation Research and Care for Individuals with Disabilities: Perspectives and Considerations for Spinal Cord Injury. J. Spinal Cord Med. 2014, 37, 493–502. [Google Scholar] [CrossRef] [PubMed]
  30. Pielage, H.; Zekveld, A.A.; van de Ven, S.; Kramer, S.E.; Naber, M. The Pupil near Response Is Short Lasting and Intact in Virtual Reality Head Mounted Displays. J. Eye Mov. Res. 2022, 15, 1–11. [Google Scholar] [CrossRef]
  31. OSF. Development Tools and Validation Methods of Immersive Virtual Reality for Upper Limb Stroke Rehabilitation: A Systematic Review. Available online: https://osf.io/6g27u (accessed on 4 May 2024).
  32. Liberati, A. The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. Ann. Intern. Med. 2009, 151, W. [Google Scholar] [CrossRef]
  33. Salanti, G.; Ades, A.E.; Ioannidis, J.P. Graphical Methods and Numerical Summaries for Presenting Results from Multiple-Treatment Meta-Analysis: An Overview and Tutorial. J. Clin. Epidemiol. 2011, 64, 163–171. [Google Scholar] [CrossRef]
  34. Long, H.A.; French, D.P.; Brooks, J.M. Optimising the Value of the Critical Appraisal Skills Programme (CASP) Tool for Quality Appraisal in Qualitative Evidence Synthesis. Res. Methods Med. Health Sci. 2020, 1, 31–42. [Google Scholar] [CrossRef]
  35. Burton, Q.; Lejeune, T.; Dehem, S.; Lebrun, N.; Ajana, K.; Edwards, M.G.; Everard, G. Performing a Shortened Version of the Action Research Arm Test in Immersive Virtual Reality to Assess Post-Stroke Upper Limb Activity. J. NeuroEngineering Rehabil. 2022, 19, 133. [Google Scholar] [CrossRef]
  36. Chen, J.; Or, C.K.; Li, Z.; Yeung, E.H.K.; Zhou, Y.; Hao, T. Effectiveness, Safety and Patients’ Perceptions of an Immersive Virtual Reality–Based Exercise System for Poststroke Upper Limb Motor Rehabilitation: A Proof-of-Concept and Feasibility Randomized Controlled Trial. Digit. Health 2023, 9, 20552076231203599. [Google Scholar] [CrossRef] [PubMed]
  37. Álvarez De La Campa Crespo, M.; Donegan, T.; Amestoy-Alonso, B.; Just, A.; Combalía, A.; Sanchez-Vives, M.V. Virtual Embodiment for Improving Range of Motion in Patients with Movement-Related Shoulder Pain: An Experimental Study. J. Orthop. Surg. Res. 2023, 18, 729. [Google Scholar] [CrossRef] [PubMed]
  38. Elor, A.; Teodorescu, M.; Kurniawan, S. Project Star Catcher: A Novel Immersive Virtual Reality Experience for Upper Limb Rehabilitation. ACM Trans. Access. Comput. 2018, 11, 1–25. [Google Scholar] [CrossRef]
  39. Everard, G.; Otmane-Tolba, Y.; Rosselli, Z.; Pellissier, T.; Ajana, K.; Dehem, S.; Auvinet, E.; Edwards, M.G.; Lebleu, J.; Lejeune, T. Concurrent Validity of an Immersive Virtual Reality Version of the Box and Block Test to Assess Manual Dexterity among Patients with Stroke. J. NeuroEng. Rehabil. 2022, 19, 7. [Google Scholar] [CrossRef] [PubMed]
  40. Fregna, G.; Schincaglia, N.; Baroni, A.; Straudi, S.; Casile, A. A Novel Immersive Virtual Reality Environment for the Motor Rehabilitation of Stroke Patients: A Feasibility Study. Front. Robot. AI 2022, 9, 906424. [Google Scholar] [CrossRef] [PubMed]
  41. Huang, C.-Y.; Chiang, W.-C.; Yeh, Y.-C.; Fan, S.-C.; Yang, W.-H.; Kuo, H.-C.; Li, P.-C. Effects of Virtual Reality-Based Motor Control Training on Inflammation, Oxidative Stress, Neuroplasticity and Upper Limb Motor Function in Patients with Chronic Stroke: A Randomized Controlled Trial. BMC Neurol. 2022, 22, 21. [Google Scholar] [CrossRef] [PubMed]
  42. Huang, Q.; Jiang, X.; Jin, Y.; Wu, B.; Vigotsky, A.; Fan, L.; Gu, P.; Tu, W.; Huang, L.; Jiang, S. Immersive Virtual Reality-Based Rehabilitation for Subacute Stroke: A Randomized Controlled Trial. J. Neurol. 2023, 271, 1256–1266. [Google Scholar] [CrossRef]
  43. Hsu, H.-Y.; Kuo, L.-C.; Lin, Y.-C.; Su, F.-C.; Yang, T.-H.; Lin, C.-W. Effects of a Virtual Reality–Based Mirror Therapy Program on Improving Sensorimotor Function of Hands in Chronic Stroke Patients: A Randomized Controlled Trial. Neurorehabil. Neural Repair. 2022, 36, 335–345. [Google Scholar] [CrossRef] [PubMed]
  44. Juan, M.-C.; Elexpuru, J.; Dias, P.; Santos, B.S.; Amorim, P. Immersive Virtual Reality for Upper Limb Rehabilitation: Comparing Hand and Controller Interaction. Virtual Real. 2023, 27, 1157–1171. [Google Scholar] [CrossRef]
  45. Kamatchi, K.; Paul, J.; Alagesan, J.; Harikrishnan, N. The Impact of Virtual Reality on Upper Extremity Function In Stroke Patients: A Pilot Study. J. Popul. Ther. Clin. Pharmacol. 2023, 30, 312–320. [Google Scholar]
  46. Lee, S.H.; Jung, H.; Yun, S.J.; Oh, B.; Seo, H.G. Upper Extremity Rehabilitation Using Fully Immersive Virtual Reality Games with a Head Mount Display: A Feasibility Study. PM R 2020, 12, 257–262. [Google Scholar] [CrossRef] [PubMed]
  47. Lim, D.Y.; Hwang, D.M.; Cho, K.H.; Moon, C.W.; Ahn, S.Y. A Fully Immersive Virtual Reality Method for Upper Limb Rehabilitation in Spinal Cord Injury. Ann. Rehabil. Med. 2020, 44, 311–319. [Google Scholar] [CrossRef] [PubMed]
  48. Lin, C.-W.; Kuo, L.-C.; Lin, Y.-C.; Su, F.-C.; Lin, Y.-A.; Hsu, H.-Y. Development and Testing of a Virtual Reality Mirror Therapy System for the Sensorimotor Performance of Upper Extremity: A Pilot Randomized Controlled Trial. IEEE Access 2021, 9, 14725–14734. [Google Scholar] [CrossRef]
  49. Matamala-Gomez, M.; Slater, M.; Sanchez-Vives, M.V. Impact of Virtual Embodiment and Exercises on Functional Ability and Range of Motion in Orthopedic Rehabilitation. Sci. Rep. 2022, 12, 5046. [Google Scholar] [CrossRef] [PubMed]
  50. Mekbib, D.B.; Debeli, D.K.; Zhang, L.; Fang, S.; Shao, Y.; Yang, W.; Han, J.; Jiang, H.; Zhu, J.; Zhao, Z.; et al. A Novel Fully Immersive Virtual Reality Environment for Upper Extremity Rehabilitation in Patients with Stroke. Ann. N. Y. Acad. Sci. 2021, 1493, 75–89. [Google Scholar] [CrossRef] [PubMed]
  51. Ögün, M.N.; Kurul, R.; Yaşar, M.F.; Turkoglu, S.A.; Avci, Ş.; Yildiz, N. Effect of Leap Motion-Based 3D Immersive Virtual Reality Usage on Upper Extremity Function in Ischemic Stroke Patients. Arq. Neuropsiquiatr. 2019, 77, 681–688. [Google Scholar] [CrossRef] [PubMed]
  52. Park, W.; Kim, J.; Kim, M. Efficacy of Virtual Reality Therapy in Ideomotor Apraxia Rehabilitation: A Case Report. Medicine 2021, 100, e26657. [Google Scholar] [CrossRef] [PubMed]
  53. Phelan, I.; Furness, P.J.; Dunn, H.D.; Carrion-Plaza, A.; Matsangidou, M.; Dimitri, P.; Lindley, S. Immersive Virtual Reality in Children with Upper Limb Injuries: Findings from a Feasibility Study. J. Pediatr. Rehabil. Med. 2021, 14, 401–414. [Google Scholar] [CrossRef] [PubMed]
  54. Sip, P.; Kozłowska, M.; Czysz, D.; Daroszewski, P.; Lisiński, P. Perspectives of Motor Functional Upper Extremity Recovery with the Use of Immersive Virtual Reality in Stroke Patients. Sensors 2023, 23, 712. [Google Scholar] [CrossRef]
  55. Song, Y.-H.; Lee, H.-M. Effect of Immersive Virtual Reality-Based Bilateral Arm Training in Patients with Chronic Stroke. Brain Sci. 2021, 11, 1032. [Google Scholar] [CrossRef]
  56. Tokgöz, P.; Wähnert, D.; Elsner, A.; Schack, T.; Cienfuegos Tellez, M.A.; Conrad, J.; Vordemvenne, T.; Dockweiler, C. Virtual Reality for Upper Extremity Rehabilitation—A Prospective Pilot Study. Healthcare 2023, 11, 1498. [Google Scholar] [CrossRef] [PubMed]
  57. Tran, J.E.; Fowler, C.A.; Delikat, J.; Kaplan, H.; Merzier, M.M.; Schlesinger, M.R.; Litzenberger, S.; Marszalek, J.M.; Scott, S.; Winkler, S.L. Immersive Virtual Reality to Improve Outcomes in Veterans with Stroke: Protocol for a Single-Arm Pilot Study. JMIR Res. Protoc. 2021, 10, e26133. [Google Scholar] [CrossRef] [PubMed]
  58. Huang, Q.; Wu, W.; Chen, X.; Wu, B.; Wu, L.; Huang, X.; Jiang, S.; Huang, L. Evaluating the Effect and Mechanism of Upper Limb Motor Function Recovery Induced by Immersive Virtual-Reality-Based Rehabilitation for Subacute Stroke Subjects: Study Protocol for a Randomized Controlled Trial. Trials 2019, 20, 104. [Google Scholar] [CrossRef] [PubMed]
  59. Tastan, H.; Tuker, C.; Tong, T. Using Handheld User Interface and Direct Manipulation for Architectural Modeling in Immersive Virtual Reality: An Exploratory Study. Comput. Appl. Eng. Educ. 2022, 30, 415–434. [Google Scholar] [CrossRef]
  60. Durojaye, A.; Kolahdooz, A.; Nawaz, A.; Moshayedi, A.J. Immersive Horizons: Exploring the Transformative Power of Virtual Reality across Economic Sectors. EAI Endorsed Trans. AI Robot. 2023, 2, e6. [Google Scholar] [CrossRef]
  61. Sweidan, S.Z.; Darabkh, K.A. VREG: A Virtual Reality Educational Game with Arabic Content Using Android Smart Phone. J. Softw. Eng. Appl. 2018, 11, 500–520. [Google Scholar] [CrossRef]
  62. Akbulut, A.; Güngör, F.; Tarakcı, E.; Çabuk, A.; Aydin, M.A. Immersive Virtual Reality Games for Rehabilitation of Phantom Limb Pain. In Proceedings of the 2019 Medical Technologies Congress (TIPTEKNO), Izmir, Turkey, 3–5 October 2019; pp. 1–4. [Google Scholar]
  63. Birckhead, B.; Khalil, C.; Liu, X.; Conovitz, S.; Rizzo, A.; Danovitch, I.; Bullock, K.; Spiegel, B. Recommendations for Methodology of Virtual Reality Clinical Trials in Health Care by an International Working Group: Iterative Study. JMIR Ment. Health 2019, 6, e11973. [Google Scholar] [CrossRef] [PubMed]
  64. Kauhanen, O.; Väätäjä, H.; Turunen, M.; Keskinen, T.; Sirkkunen, E.; Uskali, T.; Lindqvist, V.; Kelling, C.; Karhu, J. Assisting Immersive Virtual Reality Development with User Experience Design Approach. In Proceedings of the 21st International Academic Mindtrek Conference, Tampere, Finland, 20 September 2017; ACM: New York, NY, USA, 2017; pp. 127–136. [Google Scholar]
  65. Wang, A.; Thompson, M.; Roy, D.; Pan, K.; Perry, J.; Tan, P.; Eberhart, R.; Klopfer, E. Iterative User and Expert Feedback in the Design of an Educational Virtual Reality Biology Game. Interact. Learn. Environ. 2022, 30, 677–694. [Google Scholar] [CrossRef]
  66. Gagnon Shaigetz, V.; Proulx, C.; Cabral, A.; Choudhury, N.; Hewko, M.; Kohlenberg, E.; Segado, M.; Smith, M.S.; Debergue, P. An Immersive and Interactive Platform for Cognitive Assessment and Rehabilitation (bWell): Design and Iterative Development Process. JMIR Rehabil. Assist. Technol. 2021, 8, e26629. [Google Scholar] [CrossRef]
  67. Makransky, G.; Petersen, G.B.; Klingenberg, S. Can an Immersive Virtual Reality Simulation Increase Students’ Interest and Career Aspirations in Science? Br. J. Educ. Technol. 2020, 51, 2079–2097. [Google Scholar] [CrossRef]
  68. Mondragón Bernal, I.F.; Lozano-Ramírez, N.E.; Puerto Cortés, J.M.; Valdivia, S.; Muñoz, R.; Aragón, J.; García, R.; Hernández, G. An Immersive Virtual Reality Training Game for Power Substations Evaluated in Terms of Usability and Engagement. Appl. Sci. 2022, 12, 711. [Google Scholar] [CrossRef]
  69. Paraense, H.; Marques, B.; Amorim, P.; Dias, P.; Santos, B.S. Whac-A-Mole: Exploring Virtual Reality (VR) for Upper-Limb Post-Stroke Physical Rehabilitation Based on Participatory Design and Serious Games. In Proceedings of the 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Christchurch, New Zealand, 12–16 March 2022; pp. 716–717. [Google Scholar]
  70. Castillo, J.F.V.; Vega, M.F.M.; Cardona, J.E.M.; Lopez, D.; Quiñones, L.; Gallo, O.A.H.; Lopez, J.F. Design of Virtual Reality Exergames for Upper Limb Stroke Rehabilitation Following Iterative Design Methods: Usability Study. JMIR Serious Games 2024, 12, e48900. [Google Scholar] [CrossRef]
  71. Eisapour, M.; Cao, S.; Domenicucci, L.; Boger, J. Participatory Design of a Virtual Reality Exercise for People with Mild Cognitive Impairment. In Proceedings of the Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada, 21–26 April 2018; Association for Computing Machinery: New York, NY, USA, 2018; pp. 1–9. [Google Scholar]
  72. Tao, G.; Garrett, B.; Taverner, T.; Cordingley, E.; Sun, C. Immersive Virtual Reality Health Games: A Narrative Review of Game Design. J. NeuroEng. Rehabil. 2021, 18, 31. [Google Scholar] [CrossRef] [PubMed]
  73. Angelov, V.; Petkov, E.; Shipkovenski, G.; Kalushkov, T. Modern Virtual Reality Headsets. In Proceedings of the 2020 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA), Ankara, Turkey, 26–27 June 2020; pp. 1–5. [Google Scholar]
  74. Nagta, A.; Sharma, B.; Sheena; Sharma, A. Oculus: A New Dimension to Virtual Reality. In Proceedings of the 2022 International Conference on Automation, Computing and Renewable Systems (ICACRS), Pudukkottai, India, 13–15 December 2022; pp. 1169–1172. [Google Scholar]
  75. Chaplin, E.; Karatzios, C.; Benaim, C. Clinical Applications of Virtual Reality in Musculoskeletal Rehabilitation: A Scoping Review. Healthcare 2023, 11, 3178. [Google Scholar] [CrossRef]
  76. Shah, S.H.H.; Karlsen, A.S.T.; Solberg, M.; Hameed, I.A. A Social VR-Based Collaborative Exergame for Rehabilitation: Codesign, Development and User Study. Virtual Real. 2023, 27, 3403–3420. [Google Scholar] [CrossRef] [PubMed]
  77. Goumopoulos, C.; Drakakis, E.; Gklavakis, D. Feasibility and Acceptance of Augmented and Virtual Reality Exergames to Train Motor and Cognitive Skills of Elderly. Computers 2023, 12, 52. [Google Scholar] [CrossRef]
  78. Sadek Hosny, Y.S.; Salem, M.A.-M.; Wahby, A. Performance Optimization for Standalone Virtual Reality Headsets. In Proceedings of the 2020 IEEE Graphics and Multimedia (GAME), Kota Kinabalu, Malaysia, 17–19 November 2020; pp. 13–18. [Google Scholar]
  79. Duval, J.; Thakkar, R.; Du, D.; Chin, K.; Luo, S.; Elor, A.; El-Nasr, M.S.; John, M. Designing Spellcasters from Clinician Perspectives: A Customizable Gesture-Based Immersive Virtual Reality Game for Stroke Rehabilitation. ACM Trans. Access. Comput. 2022, 15, 26. [Google Scholar] [CrossRef]
  80. Salisbury, J.P.; Aronson, T.M.; Simon, T.J. At-Home Self-Administration of an Immersive Virtual Reality Therapeutic Game for Post-Stroke Upper Limb Rehabilitation. In Proceedings of the Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play, Virtual Event, Canada, 2–4 November 2020; Association for Computing Machinery: New York, NY, USA, 2020; pp. 114–121. [Google Scholar]
  81. AlMousa, M.; Al-Khalifa, H.S.; AlSobayel, H. Move-IT: A Virtual Reality Game for Upper Limb Stroke Rehabilitation Patients. In Computers Helping People with Special Needs; Miesenberger, K., Manduchi, R., Covarrubias Rodriguez, M., Peňáz, P., Eds.; Lecture Notes in Computer Science; Springer International Publishing: Cham, Switzerland, 2020; Volume 12376, pp. 184–195. ISBN 978-3-030-58795-6. [Google Scholar]
  82. Kourtesis, P.; Collina, S.; Doumas, L.A.A.; MacPherson, S.E. Validation of the Virtual Reality Neuroscience Questionnaire: Maximum Duration of Immersive Virtual Reality Sessions without the Presence of Pertinent Adverse Symptomatology. Front. Hum. Neurosci. 2019, 13, 417. [Google Scholar] [CrossRef]
  83. Kourtesis, P.; Korre, D.; Collina, S.; Doumas, L.A.A.; MacPherson, S.E. Guidelines for the Development of Immersive Virtual Reality Software for Cognitive Neuroscience and Neuropsychology: The Development of Virtual Reality Everyday Assessment Lab (VR-EAL), a Neuropsychological Test Battery in Immersive Virtual Reality. Front. Comput. Sci. 2020, 1, 497368. [Google Scholar] [CrossRef]
  84. Alves, S.; Callado, A.; Jucá, P. Evaluation of Graphical User Interfaces Guidelines for Virtual Reality Games. In Proceedings of the 2020 19th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames), Recife, Brazil, 7 November 2020; pp. 71–79. [Google Scholar]
  85. Masuch, M.; Röber, N. Game Graphics beyond Realism: Then, Now and Tomorrow. In Proceedings of the Level UP: Digital Games Research Conference, Utrecht, The Netherlands, 4–6 November 2004. [Google Scholar]
  86. Rogers, K.; Ribeiro, G.; Wehbe, R.R.; Weber, M.; Nacke, L.E. Vanishing Importance: Studying Immersive Effects of Game Audio Perception on Player Experiences in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada, 21–26 April 2018; Association for Computing Machinery: New York, NY, USA, 2018; pp. 1–13. [Google Scholar]
  87. Wu, C.-M.; Hsu, C.-W.; Lee, T.-K.; Smith, S. A Virtual Reality Keyboard with Realistic Haptic Feedback in a Fully Immersive Virtual Environment. Virtual Real. 2017, 21, 19–29. [Google Scholar] [CrossRef]
  88. Gani, A.; Pickering, O.; Ellis, C.; Sabri, O.; Pucher, P. Impact of Haptic Feedback on Surgical Training Outcomes: A Randomised Controlled Trial of Haptic versus Non-Haptic Immersive Virtual Reality Training. Ann. Med. Surg. 2022, 83, 104734. [Google Scholar] [CrossRef] [PubMed]
  89. Kreimeier, J.; Hammer, S.; Friedmann, D.; Karg, P.; Bühner, C.; Bankel, L.; Götzelmann, T. Evaluation of Different Types of Haptic Feedback Influencing the Task-Based Presence and Performance in Virtual Reality. In Proceedings of the PETRA ‘19: The 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Rhodes, Greece, 5–7 June 2019; Association for Computing Machinery: New York, NY, USA, 2019; pp. 289–298. [Google Scholar]
  90. Guillen-Sanz, H.; Checa, D.; Miguel-Alonso, I.; Bustillo, A. A Systematic Review of Wearable Biosensor Usage in Immersive Virtual Reality Experiences. Virtual Real. 2024, 28, 74. [Google Scholar] [CrossRef]
  91. Powell, M.O.; Elor, A.; Teodorescu, M.; Kurniawan, S. Openbutterfly: Multimodal Rehabilitation Analysis of Immersive Virtual Reality for Physical Therapy. Am. J. Sports Sci. Med. 2020, 8, 23–35. [Google Scholar]
  92. Bonnechère, B. Integrating Rehabilomics into the Multi-Omics Approach in the Management of Multiple Sclerosis: The Way for Precision Medicine? Genes 2022, 14, 63. [Google Scholar] [CrossRef] [PubMed]
  93. Bodzin, A.; Junior, R.A.; Hammond, T.; Anastasio, D. Investigating Engagement and Flow with a Placed-Based Immersive Virtual Reality Game. J. Sci. Educ. Technol. 2021, 30, 347–360. [Google Scholar] [CrossRef]
  94. Huang, W.; Roscoe, R.D.; Johnson-Glenberg, M.C.; Craig, S.D. Motivation, Engagement, and Performance across Multiple Virtual Reality Sessions and Levels of Immersion. J. Comput. Assist. Learn. 2021, 37, 745–758. [Google Scholar] [CrossRef]
  95. Parong, J.; Mayer, R.E. Learning Science in Immersive Virtual Reality. J. Educ. Psychol. 2018, 110, 785–797. [Google Scholar] [CrossRef]
  96. Geijtenbeek, T.; Steenbrink, F.; Otten, B.; Even-Zohar, O. D-Flow: Immersive Virtual Reality and Real-Time Feedback for Rehabilitation. In Proceedings of the VRCAI ‘11: The 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, Hong Kong, China, 11–12 December 2011; Association for Computing Machinery: New York, NY, USA, 2011; pp. 201–208. [Google Scholar]
  97. Kizony, R.; Katz, N.; Weiss, P.L. Adapting an Immersive Virtual Reality System for Rehabilitation. J. Vis. Comput. Animat. 2003, 14, 261–268. [Google Scholar] [CrossRef]
  98. Meldrum, D.; Glennon, A.; Herdman, S.; Murray, D.; McConn-Walsh, R. Virtual Reality Rehabilitation of Balance: Assessment of the Usability of the Nintendo Wii® Fit Plus. Disabil. Rehabil. Assist. Technol. 2012, 7, 205–210. [Google Scholar] [CrossRef]
  99. Vaezipour, A.; Aldridge, D.; Koenig, S.; Theodoros, D.; Russell, T. “It’s Really Exciting to Think Where It Could Go”: A Mixed-Method Investigation of Clinician Acceptance, Barriers and Enablers of Virtual Reality Technology in Communication Rehabilitation. Disabil. Rehabil. 2022, 44, 3946–3958. [Google Scholar] [CrossRef]
  100. Glegg, S.M.N.; Holsti, L.; Velikonja, D.; Ansley, B.; Brum, C.; Sartor, D. Factors Influencing Therapists’ Adoption of Virtual Reality for Brain Injury Rehabilitation. Cyberpsychol. Behav. Soc. Netw. 2013, 16, 385–401. [Google Scholar] [CrossRef] [PubMed]
  101. Huygelier, H.; Schraepen, B.; van Ee, R.; Vanden Abeele, V.; Gillebert, C.R. Acceptance of Immersive Head-Mounted Virtual Reality in Older Adults. Sci. Rep. 2019, 9, 4519. [Google Scholar] [CrossRef] [PubMed]
  102. Specht, J.; Schroeder, H.; Krakow, K.; Meinhardt, G.; Stegmann, B.; Meinhardt-Injac, B. Acceptance of Immersive Head-Mounted Display Virtual Reality in Stroke Patients. Comput. Hum. Behav. Rep. 2021, 4, 100141. [Google Scholar] [CrossRef]
  103. Cheng, K.; Cairns, P.A. Behaviour, Realism and Immersion in Games. In Proceedings of the CHI ’05 Extended Abstracts on Human Factors in Computing Systems, Portland, OR, USA, 2–7 April 2005; Association for Computing Machinery: New York, NY, USA, 2005; pp. 1272–1275. [Google Scholar]
  104. Morina, N.; Ijntema, H.; Meyerbröker, K.; Emmelkamp, P.M. Can Virtual Reality Exposure Therapy Gains Be Generalized to Real-Life? A Meta-Analysis of Studies Applying Behavioral Assessments. Behav. Res. Ther. 2015, 74, 18–24. [Google Scholar] [CrossRef] [PubMed]
  105. Cao, W.; Zhang, X.; Qiu, H. Rehabilomics: A State-of-the-Art Review of Framework, Application, and Future Considerations. Front. Neurol. 2023, 14, 1103349. [Google Scholar] [CrossRef]
Figure 1. PRISMA flow diagram of study selection.
Figure 1. PRISMA flow diagram of study selection.
Sensors 24 03546 g001
Figure 2. Overall quality of the studies (CASP assessment).
Figure 2. Overall quality of the studies (CASP assessment).
Sensors 24 03546 g002
Figure 3. Most frequent targeted joints in the included IVR systems.
Figure 3. Most frequent targeted joints in the included IVR systems.
Sensors 24 03546 g003
Figure 4. Network of investigated associations between VR headset, IVR type, stroke’s stage, and intervention. The line width corresponds to the number of patients directly associating the different modalities.
Figure 4. Network of investigated associations between VR headset, IVR type, stroke’s stage, and intervention. The line width corresponds to the number of patients directly associating the different modalities.
Sensors 24 03546 g004
Table 1. Systematic review sources: search databases, strings, and numbers of results.
Table 1. Systematic review sources: search databases, strings, and numbers of results.
DatabasesStringsNumbers Results
PubMed(((“immersive virtual reality”[Title/Abstract]) AND (“upper limb”[Title/Abstract] OR “upper extremity”[MeSH Terms])) AND (stroke[Title/Abstract])) AND (rehabilitat*[Title/Abstract])28
Web of ScienceTI = ((“immersive virtual reality” OR “serious gam*”) AND (“cyber*”)) and TS = ((“immersive virtual reality” OR “serious gam*”) AND (“cyber*”))72
ScopusTITLE-ABS (“immersive virtual reality” OR “serious gam*”) AND (“cyber*)54
Table 2. Characteristics of the patients.
Table 2. Characteristics of the patients.
StudyParticipantsAge (Mean)Stroke StageTargetSettingDuration of the Intervention (Week)Number of Sessions Per WeekDuration of One Session (Minute)Clinical Evaluation
InterventionControl
Burton et al., 2022 [35]253060Acute, subacute, and chronicHandHospital2NSNSARAT, SUS
Chen et al., 2023 [36]252558SubacuteUpper limbHospital2630FMA-UE
Crepo et al., 2023 [37]21NS59ChronicShoulderHospital1115ROM
Elor et al., 2018 [38]6NS26ChronicArmHospital115Questionnaire
Elor et al., 2022 [21]5525ChronicShoulderHospital8245ROM
Everard et al., 2022 [39]222364Subacute and chronicHandHospital1145BBT
Fregna et al., 2022 [40]16NS62Subacute and chronicHandHospital1150FMA-UE
Huang et al., 2022 [41]181755ChronicUpper limbHospital9330FMA_UE
Huang et al., 2023 [42]181764SubacuteUpper limbHospital3530FMA-UE, BI
Hsu et al., 2022 [43]151555ChronicUpper limbHospital52.6760FMA-UE
Juan et al., 2022 [44]14NS41ChronicHandHospitalNSNSNSLMS
Kamatchi et al., 2023 [45]8857SubacuteUpper limbHospital8545FMA-UE
Lee et al., 2020 [46]12NS40ChronicHandHospital32.530ARAT
Lim et al., 2020 [47]101060ChronicHandHospital4430BBT, ARAT
Lin et al., 2020 [48]9922ChronicUpper limbHospital2245FMA-UE
Matamala-Gomez et al., 2022 [49]20NS60ChronicArmHospital5320FMA-UE, DASH, ROM
Mekbib et al., 2021 [50]111255SubacuteUpper limbHospital2460BI, FMA-UE
Ogun et al., 2019 [51]333261ChronicUpper limbHospital6360FMA-UE, ARAT
Park et al., 2021 [52]1NS56SubacuteHandHospital4520TULIA
Phelan et al., 2021 [53]10NS11ChronicUpper limbHospital1115ROM
Phelan et al., 2023 [5]8NS13ChronicShoulderHome-BasedNSNSNSROM
Sip et al., 2022 [54]101057SubacuteUpper limbHospital3630FMA-UE
Song and Lee 2021 [55]6664ChronicArmHospital4530EMG and MFT
Tokgöz et al., 2023 [56]4NSNSChronicShoulderHospital3NS30ROM
Tran et al., 2021 [57]101049ChronicArmHospital4730ARAT
ARAT: Action Research Arm Test; BBT: Box and Block Test; BI: Barthel Index; DASH: Disability of Arm-Shoulder-Hand; EMG: Electromyography; FMA-UE: Fugl-Meyer Assessment for Upper Extremity; LMS: Leap Motion Sensor; MFT: Manual Function Test; NS: Not Specified; ROM: Range of Motion; TULIA: Test of Upper Limb Apraxia; SUS: System Usability Scale.
Table 3. Technological aspects of IVR systems.
Table 3. Technological aspects of IVR systems.
StudyCountryMethodology Adopted for DevelopmentGame EngineProgramming LanguageVR HeadsetPlatformGame Types
Burton et al., 2022 [35]BelgiumNSUnity 3DC#Oculus QuestStandalone HeadsetDeveloped
Chen et al., 2023 [36]ChinaNSUnity 3DNSNSNSDeveloped
Crepo et al., 2023 [37]SpainNSUnity 3DNSOculus QuestStandalone headsetDeveloped
Elor et al., 2018 [38]USAUser center designUnity 3DC# and JavascriptHTC ViveDesktopDeveloped
Elor et al., 2022 [21]USANSUnity 3DNSHTC ViveDesktopDeveloped
Everard et al., 2022 [39]BelgiumNSUnity 3DC#Oculus QuestStandalone HeadsetDeveloped
Fregna et al., 2022 [40]ItalyNSUnity 3DC#Oculus QuestStandalone HeadsetDeveloped
Huang et al., 2022 [41]TaiwanNSNANSHTC ViveDesktopDeveloped
Huang et al., 2023 [42]TaiwanNSUnity 3DNSOculus RiftLaptopDeveloped
Hsu et al., 2022 [43]ChinaNSNSNSNSNSNS
Juan et al., 2022 [44]SpainNSUnity 3DC#Oculus QuestStandalone HeadsetDeveloped
Kamatchi et al., 2023 [45]IndiaNSNSNSRUSU PLAY VRMobileOpen
Lee et al., 2020 [46]KoreaNSNSNSHTC ViveDesktopCommercial
Lim et al., 2020 [47]KoreaNSNSNSHTC ViveDesktopNS
Lin et al., 2020 [48]TaiwanNSUnity 3DNSOculus RiftDesktopDeveloped
Matamala-Gomez et al., 2022 [49]SpainNSUnity 3DC#Oculus QuestDesktopDeveloped
Mekbib et al., 2021 [50]ChinaNSUnity 3DC#HTC ViveLaptopDeveloped
Ogun et al., 2019 [51]BrazilNSNSNSNSNSDeveloped
Park et al., 2021 [52]KoreaNSNSNSHTC ViveDesktopDeveloped
Phelan et al., 2021 [53]UKNSUnrealNSOculus QuestStandalone HeadsetDeveloped
Phelan et al., 2023 [5]UKNSUnrealNSOculus QuestStandalone HeadsetDeveloped
Sip et al., 2022 [54]PolandNSNSNSOculus QuestStandalone HeadsetNS
Song and Lee 2021 [55]KoreaNSNSNSOculus QuestLaptopDeveloped
Tokgöz et al., 2023 [56]GermanyNSUnity 3DC#Oculus QuestNSDeveloped
Tran et al., 2021 [57]USAVR2 clinical study designNSNSOculus QuestDesktopCommercial
NS: Not specified.
Table 4. Description of the games’ scenarios.
Table 4. Description of the games’ scenarios.
CategoryGame ScenariosDetailed DescriptionTechnical Details
Fine Motor SkillsGrasp, Grip, Pinch, and Gross Movement [35]Involves tasks such as lifting, pouring, and pinching various objects. Aimed at improving fine motor skills crucial for daily tasks.Utilizes high-precision motion tracking to monitor and adapt to the user’s specific motor capabilities.
Grasping Cube Object [39]Requires precise manipulation of a cube within a box, simulating real-world object handling, enhancing hand-eye coordination and spatial understanding.Employs 3D spatial mapping and real-time feedback to ensure accurate hand positioning and movement tracking.
Hammering, Ball Catch, Cup Pour, Bubble Touch, Xylophone [46]Engages users in activities that require various precision movements, enhancing dexterity, and coordination. Each activity targets different motor skills from grip strength to touch sensitivity.Features adaptive difficulty settings and haptic feedback to reinforce proper hand movements.
Grasping, Transporting, and Releasing Ball [50]Focuses on the detailed task of moving objects with precision. This game helps in refining motor control and enhancing cognitive planning associated with hand movements.Incorporates real-time error correction and motion analysis to tailor exercises to patient needs.
Gross Motor Skills and Body MovementCatching Falling Stars [38]Players interact with objects descending along various trajectories, which promotes full-body movement and spatial awareness.Full-body motion capture technology is used to evaluate and enhance body coordination and reflexes.
Ball in Hole, Cloud Glasses, Rolling Pin [40]Tasks involve pushing and rolling motions that engage major muscle groups, ideal for restoring gross motor skills and improving physical coordination.Combines VR environments with physical props to enhance the realism of interactions.
Climbing [53]Climbing simulation that involves extensive upper body movement, enhancing strength, and flexibility. Includes safety features to prevent virtual “falls” and encourage risk-free practice.Dynamic difficulty adjustment and safety algorithms to simulate realistic climbing challenges safely.
Virtual Reality and Full ImmersionShooting Gallery, Playground, Basketball Court, Boxing Arena, Fencing Hall [58]A variety of physically interactive VR scenarios ranging from sports to cooking, designed to engage cognitive functions and physical stamina.Advanced VR systems with immersive audiovisual environments and interactive gameplay mechanics.
Living Room, Kitchen, Veranda, Convenience Store [55]Simulates daily life activities within a household, enabling patients to practice routine tasks in a controlled, virtual environment. Helps in cognitive recovery and independence training.Lifelike VR settings with detailed object interactions to mimic real-life scenarios and movements.
Simulated Daily ActivitiesLifting and Eating an Apple [44]Simulates the action of eating an apple to coordinate arm lifting with mouth movements, useful for patients recovering from upper limb impairments.Utilizes biomechanical models to simulate realistic arm and hand movements.
Dressing, Eating, Drinking, Washing, Brushing Teeth, Combing Hair [52]Activities designed to mimic essential daily tasks, each targeting specific motor and cognitive skills needed for self-care and independence.Tailored scenarios that adjust in complexity based on the patient’s progress and capabilities.
Grasping Object Game [49]Focuses on mental planning and execution of complex hand movements, with visuo-tactile feedback enhancing the sense of touch and motor planning.Combines auditory instructions with visual stimuli to guide movement and enhance mental engagement.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Diriba Kenea, C.; Gemechu Abessa, T.; Lamba, D.; Bonnechère, B. Technological Features of Immersive Virtual Reality Systems for Upper Limb Stroke Rehabilitation: A Systematic Review. Sensors 2024, 24, 3546. https://doi.org/10.3390/s24113546

AMA Style

Diriba Kenea C, Gemechu Abessa T, Lamba D, Bonnechère B. Technological Features of Immersive Virtual Reality Systems for Upper Limb Stroke Rehabilitation: A Systematic Review. Sensors. 2024; 24(11):3546. https://doi.org/10.3390/s24113546

Chicago/Turabian Style

Diriba Kenea, Chala, Teklu Gemechu Abessa, Dheeraj Lamba, and Bruno Bonnechère. 2024. "Technological Features of Immersive Virtual Reality Systems for Upper Limb Stroke Rehabilitation: A Systematic Review" Sensors 24, no. 11: 3546. https://doi.org/10.3390/s24113546

APA Style

Diriba Kenea, C., Gemechu Abessa, T., Lamba, D., & Bonnechère, B. (2024). Technological Features of Immersive Virtual Reality Systems for Upper Limb Stroke Rehabilitation: A Systematic Review. Sensors, 24(11), 3546. https://doi.org/10.3390/s24113546

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop