Quantifying Spatiotemporal Gait Parameters with HoloLens in Healthy Adults and People with Parkinson’s Disease: Test-Retest Reliability, Concurrent Validity, and Face Validity
Abstract
:1. Introduction
2. Materials and Methods
2.1. Subjects
2.2. Experimental Set-Up and Procedure
2.3. Data Pre-Processing and Analysis
2.4. Statistical Analysis
3. Results
3.1. Test-Retest Reliability
3.2. Concurrent Validity
3.3. Face Validity
4. Discussion
5. Conclusions
Supplementary Materials
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- Pratt, P.; Ives, M.; Lawton, G.; Simmons, J.; Radev, N.; Spyropoulou, L.; Amiras, D. Through the HoloLens™ looking glass: Augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels. Eur. Radiol. Exp. 2018, 2, 2. [Google Scholar] [CrossRef] [PubMed]
- Tepper, O.M.; Rudy, H.L.; Lefkowitz, A.; Weimer, K.A.; Marks, S.M.; Stern, C.S.; Garfein, E.S. Mixed reality with HoloLens: Where virtual reality meets augmented reality in the operating room. Plast Reconstr. Surg. 2017, 140, 1066–1070. [Google Scholar] [CrossRef] [PubMed]
- Sun, R.; Aldunate, R.G.; Sosnoff, J.J. The validity of a mixed reality-based automated functional mobility assessment. Sensors 2019, 19, 2183. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Wang, S.; Parsons, M.; Stone-McLean, J.; Rogers, P.; Boyd, S.; Hoover, K.; Meruvia-Pastor, O.; Gong, M.; Smith, A. Augmented reality as a telemedicine platform for remote procedural training. Sensors 2017, 17, 2294. [Google Scholar] [CrossRef]
- Coolen, B.; Beek, P.J.; Geerse, D.J.; Roerdink, M. Avoiding 3D obstacles in mixed reality: Does it differ from negotiating real obstacles? Sensors 2020, 20, 1095. [Google Scholar] [CrossRef] [Green Version]
- Hübner, P.; Clintworth, K.; Liu, Q.; Weinmann, M.; Wursthorn, S. Evaluation of HoloLens tracking and depth sensing for indoor mapping applications. Sensors 2020, 20, 1021. [Google Scholar] [CrossRef] [Green Version]
- Ju, Y. Footstep detection with HoloLens. AJER 2018, 7, 223–233. [Google Scholar]
- Ginis, P.; Heremans, E.; Ferrari, A.; Dockx, K.; Canning, C.G.; Nieuwboer, A. Prolonged Walking with a Wearable System Providing Intelligent Auditory Input in People with Parkinson’s Disease. Front. Neurol. 2017, 8, 128. [Google Scholar] [CrossRef] [Green Version]
- Nasreddine, Z.S.; Phillips, N.A.; Bédirian, V.; Charbonneau, S.; Whitehead, V.; Collin, I.; Cummings, J.L.; Chertkow, H. The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. J. Am. Geriatr. Soc. 2005, 53, 695–699. [Google Scholar] [CrossRef]
- Hughes, A.J.; Daniel, S.E.; Kilford, L.; Lees, A.J. Accuracy of clinical diagnosis of idiopathic Parkinson’s disease. A clinico-pathological study of 100 cases. JNNP 1992, 55, 181–184. [Google Scholar] [CrossRef] [Green Version]
- Hoehn, M.M.; Yahr, M.D. Parkinsonism: Onset, progression and mortality. Neurology 1967, 17, 427–442. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Geerse, D.J.; Coolen, B.H.; Roerdink, M. Kinematic validation of a multi-Kinect v2 instrumented 10-meter walkway for quantitative gait assessments. PLoS ONE 2015, 10, e0139913. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Geerse, D.J.; Roerdink, M.; Marinus, J.; van Hilten, J.J. Assessing walking adaptability in Parkinson’s disease: “The Interactive Walkway”. Front. Neurol. 2018, 9, 1096. [Google Scholar] [CrossRef] [PubMed]
- Geerse, D.J.; Coolen, B.H.; Roerdink, M. Walking-adaptability assessments with the Interactive Walkway: Between-systems agreement and sensitivity to task and subject variations. Gait Posture 2017, 54, 194–201. [Google Scholar] [CrossRef] [PubMed]
- Geerse, D.J.; Roerdink, M.; Marinus, J.; van Hilten, J.J. Assessing walking adaptability in stroke patients. Disabil. Rehabil. 2020, 1–9. [Google Scholar] [CrossRef] [PubMed]
- Baker, R.; Esquenazi, A.; Benedetti, M.G.; Desloovere, K. Gait analysis: Clinical facts. Eur. J. Phys. Rehabil. Med. 2016, 52, 560–574. [Google Scholar] [PubMed]
- Mirelman, A.; Shema, S.; Maidan, I.; Hausdorff, J.M. Gait. Handb. Clin. Neurol. 2018, 159, 119–134. [Google Scholar] [CrossRef]
- Petraglia, F.; Scarcella, L.; Pedrazzi, G.; Brancato, L.; Puers, R.; Costantino, C. Inertial sensors versus standard systems in gait analysis: A systematic review and meta-analysis. Eur. J. Phys. Rehabil. Med. 2019, 55, 265–280. [Google Scholar] [CrossRef]
- Dolatabadi, E.; Taati, B.; Mihailidis, A. Concurrent validity of the Microsoft Kinect for Windows v2 for measuring spatiotemporal gait parameters. Med. Eng. Phys. 2016, 38, 952–958. [Google Scholar] [CrossRef]
- Eltoukhy, M.; Kuenze, C.; Oh, J.; Jacopetti, M.; Wooten, S.; Signorile, J. Microsoft Kinect can distinguish differences in over-ground gait between older persons with and without Parkinson’s disease. Med. Eng. Phys. 2017, 44, 1–7. [Google Scholar] [CrossRef]
- Müller, B.; Ilg, W.; Giese, M.A.; Ludolph, N. Validation of enhanced kinect sensor based motion capturing for gait assessment. PLoS ONE 2017, 12, e0175813. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Springer, S.; Yogev Seligmann, G. Validity of the Kinect for Gait Assessment: A Focused Review. Sensors 2016, 16, 194. [Google Scholar] [CrossRef] [PubMed]
- Zeni, J.A.; Richards, J.G.; Higginson, J.S. Two simple methods for determining gait events during treadmill and overground walking using kinematic data. Gait Posture 2008, 27, 710–714. [Google Scholar] [CrossRef] [Green Version]
- McGraw, K.O.; Wong, S.P. Forming inferences about some intraclass correlation coefficients. Psychol. Methods 1996, 1, 30–46. [Google Scholar] [CrossRef]
- Cicchetti, D.V. Guidelines, criteria, and rules of the thumb for evaluating normed and standardized assessment instruments in psychology. Psychol. Assess. 1994, 6, 284–290. [Google Scholar] [CrossRef]
- Bland, J.M.; Altman, D.G. Measuring agreement in method comparison studies. Stat. Methods Med. Res. 1999, 8, 135–160. [Google Scholar] [CrossRef]
- Girden, E.R. ANOVA: Repeated Measures; Sage University Paper Series on Quantitative Applications in the Social Sciences: Newbury Park, CA, USA, 1992. [Google Scholar]
- Alcock, L.; Galna, B.; Perkins, R.; Lord, S.; Rochester, L. Step length determines minimum toe clearance in older adults and people with Parkinson’s disease. J. Biomech. 2018, 71, 30–36. [Google Scholar] [CrossRef]
- Nieuwboer, A.; Dom, R.; De Weerdt, W.; Desloovere, K.; Fieuws, S.; Broens-Kaucsik, E. Abnormalities of the spatiotemporal characteristics of gait at the onset of freezing in Parkinson’s disease. Mov. Disord. 2001, 16, 1066–1075. [Google Scholar] [CrossRef] [Green Version]
- Sofuwa, O.; Nieuwboer, A.; Desloovere, K.; Willems, A.M.; Chavret, F.; Jonkers, I. Quantitative gait analysis in Parkinson’s disease: Comparison with a healthy control group. Arch. Phys. Med. Rehabil. 2005, 86, 1007–1013. [Google Scholar] [CrossRef] [Green Version]
HoloLens | Interactive Walkway | |
---|---|---|
Walking speed (cm/s) | The distance travelled in the anterior-posterior direction between the 1-m and 7-m lines on the walkway divided by the time, using the position of the HoloLens (i.e., head position). | The distance travelled in the anterior-posterior direction between the 1-m and 7-m lines on the walkway divided by the time, using the data of the spine shoulder. |
Step length (cm) | The mean of the differences in the anterior-posterior direction of consecutive step locations. Time estimates of step locations were defined as the maxima of the head in the vertical direction. Minimal time between maxima was set at 0.6 times the step duration, which was calculated using the highest frequency found in the time series in vertical direction or 0.5 times the highest frequency found in the time series in mediolateral direction in case of small displacements in the vertical direction (mainly for people with Parkinson’s disease). | The median of the differences in the anterior-posterior direction of consecutive step locations. Step locations were determined as the median anterior–posterior position of the ankles during the single-support phase (i.e., between foot off and foot contact of the contralateral foot; [12,13]). Estimates of foot contact and foot off were defined as the maxima and minima of the anterior–posterior time series of the ankles relative to that of the spine base [12,13,23]. |
Cadence (steps/min) | Calculated from the number of steps in the time interval between the first and last estimate of foot contact. Estimates of foot contact were defined as the minima of the head in the vertical direction. Minimal time between minima was set at 0.6 times the step duration, which was calculated using the highest frequency found in the time series in vertical direction or 0.5 times the highest frequency found in the time series in mediolateral direction in case of small displacements in the vertical direction (mainly for people with Parkinson’s disease). | Calculated from the number of steps in the time interval between the first and last estimate of foot contact. Estimates of foot contact were defined as the maxima of the anterior-posterior time series of the ankles relative to that of the spine base [12,13,23]. |
Interactive Walkway | HoloLens | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Trial 1 | Trial 2 | Trial 1 | Trial 2 | |||||||||
Mean ± SD | Mean ± SD | Bias (95% LoA) | t-Statistics | ICC(A,1) | Mean ± SD | Mean ± SD | Bias (95% LoA) | t-Statistics | ICC(A,1) | |||
Walking speed (cm/s) | HYA | SWS | 76.1 ± 13.0 | 78.1 ± 12.5 | −2.0 (−14.8 10.8) | t(21) = −1.42, p = 0.169 | 0.863 | 74.2 ± 12.6 | 76.2 ± 12.2 | −2.0 (−14.6 10.5) | t(21) = −1.49, p = 0.152 | 0.861 |
CWS | 119.6 ± 16.8 | 125.8 ± 17.1 | −6.2 (−19.0 6.6) | t(21) = −4.45, p < 0.001 * | 0.871 | 116.2 ± 16.2 | 122.1 ± 16.4 | −5.9 (−18.4 6.6) | t(21) = −4.33, p < 0.001 * | 0.870 | ||
FWS | 182.3 ± 22.9 | 180.4 ± 23.7 | 1.9 (−14.9 18.8) | t(21) = 1.04, p = 0.310 | 0.932 | 176.3 ± 21.8 | 174.7 ± 22.8 | 1.7 (−14.7 18.1) | t(21) = 0.93, p = 0.362 | 0.930 | ||
PD | CWS | 105.2 ± 21.4 | 106.9 ± 21.4 | −1.7 (−16.8 13.3) | t(22) = −1.09, p = 0.289 | 0.935 | 104.5 ± 20.7 | 106.1 ± 20.8 | −1.6 (−16.2 13.1) | t(22) = −1.01, p = 0.324 | 0.935 | |
Step length (cm) | HYA | SWS | 57.5 ± 6.6 | 58.0 ± 5.6 | −0.5 (−5.9 4.9) | t(21) = −0.83, p = 0.417 | 0.899 | 56.2 ± 6.4 | 56.8 ± 5.4 | −0.6 (−6.2 5.0) | t(21) = −0.95, p = 0.355 | 0.884 |
CWS | 69.6 ± 7.1 | 71.2 ± 6.9 | −1.5 (−6.0 3.0) | t(21) = −3.12, p = 0.005 * | 0.928 | 67.9 ± 7.0 | 69.7 ± 6.6 | −1.8 (−6.4 2.8) | t(21) = −3.64, p = 0.002 * | 0.911 | ||
FWS | 89.1 ± 8.2 | 88.6 ± 9.0 | 0.5 (−5.1 6.2) | t(21) = 0.84, p = 0.411 | 0.945 | 86.2 ± 8.0 | 85.5 ± 8.3 | 0.7 (−5.4 6.7) | t(21) = 0.99, p = 0.334 | 0.928 | ||
PD | CWS | 58.4 ± 11.8 | 58.7 ± 11.4 | −0.3 (−8.2 7.7) | t(22) = −0.34, p = 0.739 | 0.941 | 57.8 ± 11.5 | 57.8 ± 10.9 | 0.0 (−7.9 7.8) | t(22) = −0.03, p = 0.977 | 0.939 | |
Cadence (steps/min) | HYA | SWS | 79.4 ± 10.2 | 80.9 ± 9.9 | −1.4 (−9.9 7.0) | t(21) = −1.57, p = 0.132 | 0.903 | 79.2 ± 9.8 | 80.6 ± 9.6 | −1.4 (−9.6 6.8) | t(21) = −1.58, p = 0.130 | 0.903 |
CWS | 104.3 ± 8.5 | 107.4 ± 8.8 | −3.1 (−8.6 2.4) | t(21) = −5.20, p < 0.001 * | 0.892 | 103.8 ± 8.5 | 106.5 ± 8.7 | −2.7 (−9.0 3.6) | t(21) = −3.90, p < 0.001 * | 0.890 | ||
FWS | 125.7 ± 11.5 | 125.9 ± 10.3 | −0.2 (−9.8 9.4) | t(21) = −0.17, p = 0.867 | 0.903 | 124.1 ± 10.4 | 123.7 ± 9.8 | 0.4 (−5.7 6.5) | t(21) = 0.60, p = 0.553 | 0.953 | ||
PD | CWS | 110.3 ± 7.7 | 111.2 ± 7.3 | −0.9 (−11.1 9.2) | t(22) = −0.87, p = 0.391 | 0.765 | 109.6 ± 7.6 | 110.5 ± 7.0 | −0.9 (−10.4 8.7) | t(22) = −0.87, p = 0.392 | 0.778 |
Interactive Walkway | HoloLens | ||||||
---|---|---|---|---|---|---|---|
Mean ± SD | Mean ± SD | Bias (95% LoA) | t-Statistics | ICC(A,1) | |||
Walking speed | HYA | SWS | 76.1 ± 13.0 | 74.2 ± 12.6 | 1.9 (0.9 2.9) | t(21) = 17.63, p < 0.001 * | 0.988 |
(cm/s) | CWS | 119.6 ± 16.8 | 116.2 ± 16.2 | 3.4 (1.9 5.0) | t(21) = 20.36, p < 0.001 * | 0.978 | |
FWS | 182.3 ± 22.9 | 176.3 ± 21.8 | 6.0 (3.2 8.8) | t(21) = 19.58, p < 0.001 * | 0.963 | ||
PD | CWS | 105.2 ± 21.4 | 104.5 ± 20.7 | 0.7 (−2.0 3.3) | t(22) = 2.32, p = 0.030 * | 0.998 | |
Step length | HYA | SWS | 57.5 ± 6.6 | 56.2 ± 6.4 | 1.3 (−0.2 2.7) | t(21) = 9.08, p < 0.001 * | 0.973 |
(cm) | CWS | 69.6 ± 7.1 | 67.9 ± 7.0 | 1.7 (−0.8 4.2) | t(21) = 6.18, p < 0.001 * | 0.956 | |
FWS | 89.1 ± 8.2 | 86.2 ± 8.0 | 2.9 (0.4 5.4) | t(21) = 10.82, p < 0.001 * | 0.928 | ||
PD | CWS | 58.4 ± 11.8 | 57.8 ± 11.5 | 0.6 (−2.0 3.3) | t(22) = 2.17, p = 0.041 * | 0.992 | |
Cadence | HYA | SWS | 79.4 ± 10.2 | 79.2 ± 9.8 | 0.3 (−1.4 2.0) | t(21) = 1.61, p = 0.123 | 0.996 |
(steps/min) | CWS | 104.3 ± 8.5 | 103.8 ± 8.5 | 0.4 (−1.8 2.7) | t(21) = 1.73, p = 0.097 | 0.990 | |
FWS | 125.7 ± 11.5 | 124.1 ± 10.4 | 1.6 (−3.5 6.7) | t(21) = 2.89, p = 0.009 * | 0.963 | ||
PD | CWS | 110.3 ± 7.7 | 109.6 ± 7.6 | 0.7 (−1.1 2.6) | t(22) = 3.75, p = 0.001* | 0.988 |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Geerse, D.J.; Coolen, B.; Roerdink, M. Quantifying Spatiotemporal Gait Parameters with HoloLens in Healthy Adults and People with Parkinson’s Disease: Test-Retest Reliability, Concurrent Validity, and Face Validity. Sensors 2020, 20, 3216. https://doi.org/10.3390/s20113216
Geerse DJ, Coolen B, Roerdink M. Quantifying Spatiotemporal Gait Parameters with HoloLens in Healthy Adults and People with Parkinson’s Disease: Test-Retest Reliability, Concurrent Validity, and Face Validity. Sensors. 2020; 20(11):3216. https://doi.org/10.3390/s20113216
Chicago/Turabian StyleGeerse, Daphne J., Bert Coolen, and Melvyn Roerdink. 2020. "Quantifying Spatiotemporal Gait Parameters with HoloLens in Healthy Adults and People with Parkinson’s Disease: Test-Retest Reliability, Concurrent Validity, and Face Validity" Sensors 20, no. 11: 3216. https://doi.org/10.3390/s20113216
APA StyleGeerse, D. J., Coolen, B., & Roerdink, M. (2020). Quantifying Spatiotemporal Gait Parameters with HoloLens in Healthy Adults and People with Parkinson’s Disease: Test-Retest Reliability, Concurrent Validity, and Face Validity. Sensors, 20(11), 3216. https://doi.org/10.3390/s20113216