Next Article in Journal
Low-Cost Three-Dimensional Modeling of Crop Plants
Next Article in Special Issue
Neurophysiological Characterization of a Non-Human Primate Model of Traumatic Spinal Cord Injury Utilizing Fine-Wire EMG Electrodes
Previous Article in Journal
Decision Support System for Variable Rate Irrigation Based on UAV Multispectral Remote Sensing
Previous Article in Special Issue
A Sensor Array for the Measurement of Relative Motion in Lower Limb Prosthetic Sockets
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sensors
Volume 19
Issue 13
10.3390/s19132882
sensors-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Dynamic Time Warping Based Algorithm to Evaluate Kinect-Enabled Home-Based Physical Rehabilitation Exercises for Older People

by
Xiaoqun Yu
and
Shuping Xiong
*
Department of Industrial and Systems Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Korea
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(13), 2882; https://doi.org/10.3390/s19132882
Submission received: 9 May 2019 / Revised: 13 June 2019 / Accepted: 24 June 2019 / Published: 28 June 2019
(This article belongs to the Special Issue Sensors for Gait, Posture, and Health Monitoring)
Browse Figures
Versions Notes

Abstract

:
Older people face difficulty engaging in conventional rehabilitation exercises for improving physical functions over a long time period due to the passive nature of the conventional exercise, inconvenience, and cost. This study aims to develop and validate a dynamic time warping (DTW) based algorithm for assessing Kinect-enabled home-based physical rehabilitation exercises, in order to support auto-coaching in a virtual gaming environment. A DTW-based algorithm was first applied to compute motion similarity between two time series from an individual user and a virtual coach. We chose eight bone vectors of the human skeleton and body orientation as the input features and proposed a simple but innovative method to further convert the DTW distance to a meaningful performance score in terms of the percentage (0–100%), without training data and experience of experts. The effectiveness of the proposed algorithm was validated through a follow-up experiment with 21 subjects when playing a Tai Chi exergame. Results showed that the algorithm scores had a strong positive linear relationship (r = 0.86) with experts’ ratings and the calibrated algorithm scores were comparable to the gold standard. These findings suggested that the DTW-based algorithm could be effectively used for automatic performance evaluation of an individual when performing home-based rehabilitation exercises.

1. Introduction

The global healthcare system is under great pressure due to rapid population aging as well as a shortage of healthcare personnel and budget [1]. An increasing proportion of older people is facing serious challenges of impaired physical functions such as muscle strength, balance, and mobility [2]. All these negative changes result in difficulties for older people maintaining independence of daily living, which would further cause anxiety, low self-esteem, and decreased quality of life [3,4]. Epidemiological studies show that a low physical activity level is strongly correlated to functional decline of the elderly. Physical exercise is an effective way to counteract the age-related functional decline [5].
There is strong evidence that appropriate physical rehabilitation exercises can improve physical activity level and activities of daily living of older people [4,6,7]. Conventional exercise therapies for older people are generally conducted in a formal rehabilitation center or clinical setting, which requires direct supervision from a professional therapist. Even though conventional exercise therapies have been shown as effective to increase physical activities as well as improve motor functions and balance, they suffer from low rates of uptake and adherence [8,9] due to a lack of enjoyment, inconvenient transportation, and high cost [10]. For example, Kobayashi et al. [11] examined the effects of physical exercise on fall risks in older people living at home in a rural area. After a 13-week intervention, they reported that the motor functions of the elderly were improved. However, only 31.7% of the participants were fully adherent to the intervention program. Another study by Liu-Ambrose et al. [12] showed that the Otago Exercise Program (OEP) improved functional mobility and executive functioning in older people based on a 26-week experiment. However, they reported that only 19.4% of the participants finished the whole sessions of OEP and only 25.0% of participants just completed the half proportion of sessions in OEP.
Recently, with the emergence of more affordable motion sensors (such as Kinect and inertial sensors) and gaming technologies, the use of home-based exergame (exercise + gaming) for physical rehabilitation appears promising over passive conventional exercise therapies for the elderly with respect to long-term uptake [9,13,14,15]. Such home-based solutions can not only eliminate restrictions of distance and cost to the rehabilitation center, but also allow the elderly to flexibly adjust the training schedule and exercise intensity. Another big advantage of exergame is that it provides auto-coaching to compensate for the lack of global healthcare resources [16]. In this kind of auto-coaching system, there is usually a virtual avatar coach in the game environment. The coaching system will guide end users to follow virtual coach’s motions as well as track and evaluate their reproduced motions. However, because there is no real coach on site during the exercise, the scientific motion comparison for automatic performance evaluation is critical to guarantee the effectiveness of such a system.
Different algorithms have been proposed to assess exercise performance automatically. Lin et al. [17] developed a Kinect-based rehabilitation system utilizing a “seated Tai Chi” exercise to assist patients with movement disorders. They decomposed each form of Tai Chi into four poses and calculated the difference of joint angles between skeletons of standard pose and user’s actual pose, which were tracked by Kinect sensors. Muangmoon et al. [18] adopted a similar method to evaluate Thai dance performance. Even though this kind of motion comparison algorithm is easy to implement due to the simplification of extracting a few discrete poses from continuous motions, the quality of exercise could not be evaluated comprehensively. This is because the simplification has resulted in the loss of some essential exercise information such as motion continuity, pace, and intensity. Another group of researchers proposed to assess motion similarity based on the correlation coefficient between two time series of human motions from a virtual coach (standard motion) and a subject (actual motion) [19,20]. Even though this approach can evaluate the overall performance from the continuous motion data, it fails to take into account the typical time lag and speed variance between the older subject’s actual motion and the virtual coach’s standard motion during the exercise therapy. It is difficult for the older people to exactly follow the pace of standard motion due to the physical and cognitive impairments as well as the lack of exercise skills. Both previously mentioned disadvantages can be elegantly overcome by dynamic time warping.
Dynamic time warping (DTW) is a well-known approach for measuring time-series similarity, which minimizes the effects of time lag and distortion in the time axis due to speed variation [21,22]. DTW outputs the optimal alignment (least matching cost or cumulative distance) between two time series and it is widely applied in speech and gesture recognition [23]. Due to the advantages of DTW, some researchers applied it into the auto-coaching system for physical rehabilitation exercises at home. Saraee et al. [24] applied DTW into developing a remote monitoring system to evaluate home-based physical exercises. Since DTW itself could not generate a meaningful scaled score for performance evaluation, a physical therapist was required to remotely monitor the patient in real time through Webcam and determine whether a patient’s performance was acceptable or not. Semblantes et al. [25] and Saenz-de-Urturi and Garcia-Zapirain Soto [26] used DTW and binary classification to discriminate between correct and incorrect motions. Su et al. [27] utilized DTW and Kinect sensors to evaluate patients’ supplementary exercise at home for shoulder rehabilitation, when compared with the pre-recorded standard motion in the hospital. They integrated DTW with fuzzy logic to convert different DTW matching costs (DTW distances) to three performance levels: bad, good, and excellent. Wei et al. [28] applied DTW to measure the similarity between the motion data of the trainee and the standard motion of the trainer in dance teaching. They utilized existing training data and the experience of experts to determine three boundaries of DTW matching costs for categorizing individual performances into four levels: below average, average, good, and excellent. Most studies require large representative training data of each exercise to convert the matching cost from DTW to the final performance score. This task is resource-intensive and it is difficult to generalize the established conversion criteria for a specific exercise program to different ones. In addition, the final performance evaluation is categorical, and, thus, qualitative and not sensitive to recognize user’s gradual progress of exercise interventions. Chatzitofis et al. [29] and Mocanu et al. [30] developed home-based rehabilitation systems for heart health and physical activity. DTW was used to compute the quantitative performance score. However, how to convert the DTW matching cost to a quantitative score was not described and the quantitative scores were not validated with ground-truth ratings. Osgouei et al. [31] recently proposed an objective method for quantitative performance evaluation of rehabilitation exergames. Using shoulder abduction exercise as an example and two angle features (shoulder angle and arm angle), they presented how DTW was applied to compute the motion similarity between the unknown and reference trajectories of the human skeleton joints. A normalization approach with estimated lower and upper bounds for the DTW distance was utilized to further convert any DTW distance to an objective similarity score (0–100). The proposed method is promising since it does not require any training data. However, the proposed objective similarity score was not validated with physicians’ evaluation of the performances. In addition, it remains questionable whether the proposed method can be extended from simple repetitive exercises to complex whole-body exercises.
This study aims to develop and validate a DTW-based algorithm for a motion similarity evaluation, in order to support effective Kinect-enabled home-based virtual coaching. We proposed a simple but innovative method to directly convert the DTW matching cost to a meaningful performance score in terms of percentage (0–100%), without training data and experience of experts. We further validated the effectiveness of our algorithm through a follow-up experiment with human subjects performing the complex whole-body exercise (Tai Chi) instead of simple, repetitive exercises, which would show good generalization of our proposed method to different exercise programs. The developed algorithm is expected to provide a similar evaluation on user’s performance as domain experts, which could be very promising to apply into home-based physical rehabilitation exercises for better quality of life of the elderly.

2. Methods

2.1. Development of a DTW-Based Algorithm for Performance Evaluation

2.1.1. 3D Pose Comparison

Human motion is the coordinated movement of different body parts, and motion data from the Kinect sensor could be seen as a sequence of frames that comprise 3D coordinates of joint positions of the human skeleton and each bone determined by two connected joints could be seen as a 3D vector in the space. In order to assess the similarity between trainer’s motion (coach) and trainee’s motion (end user), the first step is to quantify the difference between these two 3D poses at a given frame. In this study, we chose the sum of the angle difference between all corresponding bone vectors of the two 3D poses as the distance measure. Eight major bones of the human skeleton (the upper and lower arms, and the upper and lower legs) were chosen for motion comparison since most human motions during the rehabilitation exercises involve the coordination of upper and lower limb movements. The angle difference (Ɵ) between two corresponding bone vectors of trainer and trainee is illustrated in Figure 1, which can be calculated by the law of cosine (see Equation (1)).
θ   =   acos ( A B → · A ′ B ′ → | A B → | · | A ′ B ′ → | )

2.1.2. Motion Comparison

Given two sequences of motion data X and Y, each frame of motion data is a 3D pose. We applied DTW to find the optimal matching between the trainer’s motion and the trainee’s motion while minimizing the effects of shifting and distortion in time [32]. Since we chose eight bone vectors for a motion comparison and the motion of each bone constitutes one dimensional time-series data, both trainer and trainee’s data have eight dimensions. The matrix of each dataset has dimension 8-by-n, where n is the total frames of motion data. To explain how DTW works, let us start with the one-dimensional case. The motion of a body part can be denoted as S = (s1, s2, …, sn) and T = (t1, t2, …, tm), which correspond to the trainer’s motion and trainee’s motion, respectively. The element in S and T is a normalized bone vector of that body part in a certain 3D coordinate system. To compare the similarity of sequence S and T by DTW, an n-by-m cost matrix is constructed where the (ith, jth) element denoted as C(si, tj) is the angle difference between si and tj (See Equation (1)). A warping path denoted as P defines an alignment between S and T in the cost matrix, which should satisfy three conditions: boundary condition, monotonicity condition, and step size condition [33]. There could be multiple feasible warping paths in the cost matrix and the total matching cost of one warping path P between S and T is defined by the equation below.
c p ( S ,   T )   =   ∑ k   =   1 s C ( s i k ,   t j k ) ,
where s is the length of the warping path P.
The goal of DTW is to find the optimal warping path, which has the minimal cumulative distance among all the possible warping paths. The DTW distance DTW(S, T) is defined as the total matching cost of the optimal warping path. In order to find the optimal warping path, a dynamic programming method is used. The recursive equation is given by the equation below.
D ( i , j )   =   m i n { D ( i − 1 ,   j − 1 ) ,   D ( i − 1 ,   j ) , D ( i ,   j − 1 ) } + C ( s i , t j ) ,
where 1 < i < n and 1 < j < m. D(i, j) represents the matching cost between standard data (S) and testing data (T) from (1, 1) to (i, j).
DTW can be generalized from the one-dimensional case to a multi-dimensional case [34]. For a multidimensional case, si and tj are not single bone vector but multiple bone vectors, which represent whole body motion. Multi-dimensional DTW(S, T) is calculated in a similar way as the one-dimensional case, except that we need to redefine C(si, tj) as the sum of angle difference among all the dimensions. The output of DTW is the matching cost associated with the cumulative distance along the shortest warping path. Therefore, the lower the matching cost is, the closer the two motion sequences are and the better the motion performance is. In order to quantitatively assess motion performance of a trainee, we further convert the DTW distance (matching cost) to a meaningful performance score in terms of the percentage (0–100%) using the following equation.
P e r f o r m a n c e   s c o r e   =   ∑ k   =   1 s [ 1 − C ( s i k ,   t j k ) 90 × 8 ] s   =   1 − D T W ( S ,   T ) 90 × 8 × s ,
where s is the length of optimal warping path, 8 stands for eight bone vectors selected for motion evaluation, and C(sik, tjk) is the element of optimal warping path in the cost matrix, which is the summation of angle differences for eight bone vectors, and DTW distance-DTW(S, T) is a summation of elements (C(sik, tjk)) along the optimal path. We assume the angle difference between two corresponding bone vectors is within 90 degrees based on an earlier study [18], which results in the maximum DTW(S, T) along the optimal path, which would be 90 × 8 × s. Because the output distance (DTW(S, T)) is a measure of dissimilarity between the two motion time series (the longer the distance, the greater the deviation), the last part of Equation (4) would be a percentage score (0–100%) to measure the level of similarity between the trainee’s motion and trainer’s motion.

2.1.3. Body Orientation Offset

Calculation of bone vectors for both trainee’s motion and trainer’s motion based on the world coordinate system could be problematic if the trainee is not oriented as exactly as the trainer. The difference (error) in body orientation would be directly transferred to all eight bone vectors. In order to solve this problem, instead of using the joint position based on the world coordinate system, we calculate the joint position data based on a local coordinate system of the human model, which would be updated in real time. Establishment of the local coordinate system was adopted from Unity3D Mecanim system [35]. The up vector is defined as middle of left/right upper arm and middle of left/right upper leg. The left vector is an average upper body left (a vector defined by the left upper arm and the right upper arm) and lower body left (a vector defined by the left upper leg and the right upper leg). The forward vector is the cross product of the up vector and the left vector. In order to make these three vectors orthogonal to each other, the final left vector is the cross product of the forward vector and the up vector. Then the up vector is aligned to a normal vector of a ground plane as the y-axis. Hence, the final left vector and forward vector would be finalized as the x-axis and z-axis, respectively, based on the rotation matrix. The main purpose of this step is to guarantee that the x-axis and the z-axis would always be in the ground plane. The origin of this local coordinate system is the projection of center of mass on the ground.
As shown in Figure 2, the only difference between motions of two avatars is the body orientation (see z-axis). Under the local coordinate system, all the bone vectors between two avatars are exactly the same. While under the world coordinate system, there are clear angle differences among all corresponding bone vectors of two avatars, which are caused by the different body orientations.
Calculation of angular differences based on the local coordinate system of the human model can remove the accumulative errors on eight bone vectors caused by different body orientations. However, the difference in body orientation between trainee and trainer should also be considered in this case. Hence, we added one more dimension-body orientation into the evaluation of motion similarity. Lastly, we used nine dimensions to calculate the motion similarity: eight bone vectors under the local coordinate system of the human model and the forward vector of the body, which reflects the body (mainly trunk) orientation (z-axis in Figure 2). Then the final performance score can be updated by Equation (5).
F i n a l   p e r f o r m a n c e   s c o r e   =   ∑ k   =   1 s [ 1 − C ( s i k ,   t j k ) 90 × 9 ] s   =   1 − D T W ( S ,   T ) 90 × 9 × s ,
where all the notations are the same as in Equation (4) and where 9 stands for nine dimensions.

2.2. Validation of the Developed DTW-Based Algorithm

In order to validate the developed algorithm, we performed a follow-up experiment where the final performance scores from the algorithm were compared with ratings given by the domain experts. An 8-form Tai Chi exercise was selected to evaluate the proposed algorithm.

2.2.1. Experimental Participants

Twenty-one middle-aged and older subjects (age: 55.2 ± 4.2 years, height: 166.1 ± 7.9 cm, weight: 65.36 ± 8.3 kg) from a local Tai Chi academy participated in the algorithm validation experiment. For the sake of convenience, the experiment was conducted in the same Tai Chi academy instead of each subject’s home. All the subjects were in healthy conditions and without musculoskeletal diseases or injuries that may affect their Tai Chi performance. Prior to the participation of the experiment, each subject signed informed consent on the experiment protocol, which was approved by the KAIST Institutional Review Board (IRB-18-070).

2.2.2. Experimental Setup and Procedure

The Tai Chi exergame was developed with Kinect V2 sensor in Unity3D platform (Unity 5.5.2f1) by C# for the real-world application. The main scene of the exergame is implemented with two avatars: virtual trainer and trainee (Figure 3). The avatar-based rendering of motion preserves the privacy of the user, which is critical for the healthcare systems. The motion of the trainee avatar is updated by the real motion of the user. User’s motion is captured by Kinect V2 (Microsoft Corp, Redmond, WA, USA) and mapped to the trainee avatar using the Kinect V2 asset for Unity3D [36]. The motion of the trainer avatar is retargeted by the pre-recorded standard motion from a certified Tai Chi instructor (Master Level).
The whole experimental setting is illustrated in Figure 4. Both Kinect V2 and Xsens motion capture system were used to capture each subject’s motion. The Kinect sensor was placed at a height of 0.8 m. Since subjects should stretch their arms frequently because of the characteristics of Tai Chi motion, subjects were instructed to stand around 3.0–3.5 m away from the Kinect sensor. Considering that some Tai Chi motion with body rotation may not be well captured by the Kinect due to the self-occlusion [37], a wearable inertial sensor-based motion capture system-Xsens MVN BIOMECH (Xsens Technologies B.V., Enschede, The Netherlands) was also utilized to obtain high-quality motion data for the algorithm validation [38,39].
A smart phone, supported by a tripod, was used to record each subject’s motion when he/she was playing the Tai Chi exergame. The motion videos were distributed to three Tai Chi experts for independent performance evaluation. Each expert was provided a 10-cm visual analog scale (VAS) [40] and asked to place a vertical mark on the scale to indicate the performance level of motion for each subject. The anchor statements for VAS in this study are “cannot follow Tai Chi at all” (score of 0) on the left and “master level with standard Tai Chi motion” (score of 100) on the right. The raw scale score is then converted to a 0–100 scale.

2.2.3. Statistical Analysis

The intraclass correlation coefficient (ICC) was used to check the inter-rater reliability of experts’ subjective ratings [41]. Good consistency and agreement among different experts are the prerequisite to consider experts’ rating as the gold standard for validating the developed DTW-based algorithm. ICC is a widely used reliability index and the general guideline of ICC is as follows: ICC < 0.5, poor reliability, 0.5 < ICC < 0.75, moderate reliability, 0.75 < ICC < 0.9, good reliability, and ICC > 0.9, excellent reliability [42].
More importantly, final performance scores from the developed algorithm were compared with the experts’ ratings (as a gold standard). The Pearson correlation coefficient (r) between final performance scores from the developed algorithm and those from experts was calculated to assess the strength of a linear relationship between those two evaluation methods. In addition, linear regression was used to calibrate performance scores from the algorithm so that the scores from two evaluation methods could be consistent. Differences between algorithm scores after calibration and experts’ ratings were analyzed. The SPSS statistical package version 20 (IBM Corp., Armonk, NY, USA) was used for statistical analysis.

3. Results

3.1. Inter-Rater Reliability of Experts’ Ratings

Figure 5 shows the subjective ratings of 21 subjects from three independent experts. The ICC value for three experts was 0.861 (95% CI: 0.688~0.942), which was within the range of 0.75 to 0.9 [41,42], which indicates the experts’ ratings were consistent and with good inter-rater reliability.

3.2. Evaluation Comparison between Experts and the Developed Algorithm

The subjective ratings from three experts were averaged and regarded as the gold standard to validate the developed DTW-based algorithm. Figure 6 shows the scatter plot of the algorithm’s final performance scores and averaged experts’ ratings for 21 subjects. The Pearson correlation coefficient (r) was 0.86 (t = 7.45, p < 0.001), which indicates a strong positive linear relationship between scores from those two evaluation methods. Additional analysis on performance scores between two evaluation methods showed that, under many circumstances, the algorithm would overestimate the performance when compared with the experts’ rating. Therefore, we calibrated performance scores of the algorithm using the fitted equation from linear regression (see Figure 6) so that the algorithm would generate similar evaluation scores as the domain experts for practical applications. Figure 7 further demonstrates the calibrated performance scores from the algorithm were comparable to experts’ ratings. The score difference between two evaluation methods had a mean of 9.5 and a standard deviation of 7.0 (Maximum: 21.6, Minimum: 0.1).

4. Discussion

We developed a DTW-based algorithm for assessing motion similarity between an individual user and a virtual coach. DTW was designed to handle local changes in timing (due to speed variations) and, therefore, desirable for evaluating rehabilitation exercises for the elderly self-care at home. The effectiveness of the algorithm was validated through a follow-up experiment. In the validation experiment, the Tai Chi exercise was chosen as the representative physical exercise to verify the proposed algorithm due to two major reasons. First, the effectiveness of Tai Chi exercise for improving physical functions has been proven by many previous studies [43,44]. Second, Tai Chi exercise is a complex and whole-body motion. If the algorithm could perform well in terms of evaluating Tai Chi motion, it should be generalizable to other simpler rehabilitation exercises.
Inter-rater reliability analysis revealed that the reliability level of experts’ ratings was “good” (0.75 < ICC = 0.861 < 0.90). However, the 95% confidence interval of ICC was wide (0.688–0.942), which indicates that, in the worst case, the reliability level was just “acceptable” (0.5 < ICC = 0.688 < 0.75). The wide confidence interval warned that, even though the overall agreement were high among three experts, there were non-negligible disagreement on their ratings [45]. Paired t-tests also confirmed the significant difference on performance ratings between the third expert and the other two experts (Figure 5). The inconsistency on subjective ratings from three experts highlighted the potential benefits of applying our developed algorithm to assess the exercise performance automatically and objectively.
Strong linear relationship (r = 0.86) between the algorithm score and experts’ evaluation (gold standard) implied the developed algorithm was sensitive in terms of recognizing the performance levels from different subjects as the domain experts. Unexpectedly, a detailed analysis revealed that the algorithm score was significantly higher than the experts’ rating. This could be mainly due to different baselines for two evaluation methods. The algorithm evaluation was purely based on the sum of angle differences among nine corresponding body vectors and the subjects with all angle differences at 90 degrees were considered as the worst (performance score = 0). Since even the subjects rated by the experts as the worst in terms of motion performance had most of the angle differences within 45 degrees, the algorithm evaluation would overestimate the subject’s performance score due to the ceiling effect [46]. To reduce this overestimation and enable our algorithm to provide similar scores as the domain experts, the linear regression equation (Figure 6) was applied to calibrate the algorithm score. The experimental results showed that the calibrated algorithm scores were comparable to the experts’ ratings. Taken together, these findings demonstrated that, even though the developed DTW-based algorithm could be a good evaluation tool to rank the exercise performance among different subjects objectively, the algorithm score should be calibrated by experts’ ratings on a small number of representative subjects. In this way, the good consistency between algorithm evaluation and experts’ evaluation can be achieved for the practical applications.
Earlier studies used binary classification as well as three-point and four-point Likert scales to obtain experts’ ratings for validating their algorithms [24,25,26,27,28]. This kind of validation is rough and likely results in inflated validation accuracy because of the wide performance range between two consecutive points, especially for binary classification and a 3-point Likert scale. To the best of our knowledge, there was only one reported study, which also used 0–100 score as the experts’ rating as we did to validate the developed algorithm [21]. However, the highest correlation coefficient between their DTW-based algorithm score and expert’s rating was 0.64, which was much lower than ours (r = 0.86). The improved performance from our study could be related to the selection of different motion features. Instead of using simple joint angles as Capecci et al. [21], 3D bone vectors of human skeletons were chosen in our study for better conservation of spatial information of the motion because joint angles could not define spatial information of two bones connected by the same joint. In addition, since there always exist theoretical upper and lower bounds (180 and 0 degrees) for any angle difference between two corresponding bone vectors, converting the DTW matching cost to a final percentage score is straightforward and reasonable in our study. It does not require training data and experience of experts. In this study, we assumed the upper bound was 90 degrees instead of 180 degrees based on an earlier study [18] and our practical exercise scenario.
It is worthwhile to mention that elimination of the confounding effect caused by body orientation offset is a major challenge for the algorithm development. In fact, both bone vector-based and joint position-based algorithms are very sensitive to the body orientation especially when evaluating complex whole-body exercises with rotational motions. Chua et al. [47] also pointed out this issue when they evaluated Tai Chi motion. We calculated the joint positions and bone vectors based on the local coordinate system of the human model instead of the world coordinate system in real-time, which can get rid of the error induced by the body orientation offset during the entire exercise. The compensation of body orientation offset had practical meaning for the elderly because they might not be able to orient themselves precisely as the standard virtual coach during the rehabilitation exercise.
In order to further examine the use and acceptance of exergaming technology for home-based physical rehabilitation by the primary target users (older people), we applied the technology acceptance model [48,49,50,51] and designed a questionnaire with 11 constructs (Appendix A) to evaluate user acceptance of our developed Tai Chi exergaming prototype system (Figure 3). Forty-one older adults (age 77.3 ± 5.4 years, height 159.3 ± 8.5 cm, weight 59.0 ± 9.5 kg) from a local senior welfare center participated in this survey. They were asked to try the prototype system and play the Tai Chi exergame before giving their questionnaire responses in a five-point Likert scale (1 corresponding to “strongly disagree” and 5 corresponding to “strongly agree”). Figure 8 presents a summary of their responses. The results showed that the older people perceived relatively high vulnerability (3.21 out of 5) and severity (3.63) in terms of difficulties in self-care and independent living, and they had high intentions (Behavior intention = 4.08) to use our system in the future. They thought our system was very useful (Perceived usefulness = 4.43), positive (Attitude = 4.29), entertaining (Hedonic motivation = 3.82) and having low privacy risk (Perceived privacy risk = 1.18). Interestingly, even though the older people were somewhat confident in their capabilities to use this system for improving their health conditions (Self-efficacy = 3.75), the expected effort (3.07) and response cost (2.72) were considerably high. Taken all together, these findings implied that our developed Tai Chi exergaming prototype system is useful for the older people performing home-based physical rehabilitation exercises. However, the prototype system needs be improved to make it easy to use and cost-effective. We collected some valuable feedback from the participants to improve our prototype system, which mainly includes the following: (1) Audio effects should be added to make the exergame more entertaining and enjoyable. (2) The standard pace of Tai Chi exergame should slow down and be adjustable by each individual. (3) The size of avatar should be enlarged to be seen clearly and timely feedback for problematic motions should be provided, and (4) social networking functions (such as sharing exergaming performance score with friends) should be further developed.
There were several limitations in the current study. First, the conversion from DTW distance to a percentage score (0–100%) is based on the assumption that the maximum angle difference between two corresponding bone vectors is 90 degrees. Even though this assumption works fine for most body parts, the exact value of 90 is not always appropriate. Second, we focused on motion correctness for the performance evaluation in this study. The rhythm mismatch was not yet considered in the overall performance evaluation [28]. In addition, detailed feedback for problematic motions from certain body parts should be provided in the future study to timely inform the older individual for further improvements in rehabilitation exercises. Third, even though the primary target users for our developed Tai Chi exergaming system are older adults, 21 participants for validating DTW-based algorithm included both middle-aged and older adults, in order to cover a wide range of Tai Chi proficiency levels under practical constraints. Our next step will be to refine the developed prototype system and test it with a large number of older adults at the home environment for verifying practicality of the system. Last but not least, a single Kinect sensor often generates poor skeleton tracking performance for some rotational motions during rehabilitation exercises due to self-occlusion and limited sensing range [37]. Further research on combining data from multiple Kinect sensors to achieve more accurate and robust skeleton tracking performance is needed.

5. Conclusions

We developed a DTW-based algorithm to automatically evaluate user’s performance during physical rehabilitation exercises. We chose eight bones vectors of the human skeleton and body orientation as the input features and proposed a simple but innovative method to further convert the DTW matching cost to a meaningful performance score in terms of percentage (0–100%), without training data and experience of experts. The effectiveness of the proposed algorithm was tested through a follow-up experiment with 21 subjects when playing a complex whole-body exercise (Tai Chi) instead of simple repetitive exercises. Results showed that the algorithm scores had a strong positive linear relationship (r = 0.86) with experts’ ratings and the calibrated algorithm scores were comparable to the gold standard. These findings suggested that our algorithm could be effectively used for automatic performance evaluation of an older individual when performing home-based physical rehabilitation exercises.

Author Contributions

Conceptualization, S.X. Data curation, X.Y. Formal analysis, X.Y. Funding acquisition, S.X. Methodology, X.Y. and S.X. Project administration, S.X. Software, X.Y. Supervision, S.X. Writing—original draft, X.Y. Writing—review & editing, S.X.

Funding

The Basic Science Research Program through the National Research Foundation of Korea (NRF-2017R1C1B2006811) and High Risk High Return Project of KAIST (N1017003) funded this research.

Acknowledgments

The authors would like to thank Taekyoung Kim for his assistance with experimental data acquisition. The authors also acknowledge the strong support from the Tai Chi experts at Jin-Jeong-Loe Chen Style Tai Chi Academy in Daejeon, South Korea.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table
Table A1. Questionnaire for user acceptance evaluation.
Table A1. Questionnaire for user acceptance evaluation.
Construct IDQuestionsStrongly DisagreeDisagreeUndecidedAgreeStrongly Agree
1Perceived Usefulness (PU)
PU1: Using this system will help improve my health quality.12345
PU2: Using this system will make me more effective in my life. 12345
PU3: Overall, I find this system to be useful in my life. 12345
2Hedonic Motivation (HM)
HM1: Using this system is fun.12345
HM2: Using this system is enjoyable.12345
HM3: Using this system is entertaining.12345
3Effort Expectancy (EE)
EE1: Learning how to use this system is easy for me.12345
EE2: I find this system easy to use. 12345
EE3: It is easy for me to become skillful at using this system. 12345
4Social Influence (SI)
SI1: People who are important to me would think that I should use this system.12345
SI2: People who influence me would think that I should use this system.12345
SI3: People whose opinion are valued to me would prefer that I use this system. 12345
5Self-Efficacy (SE)
SE1: It is easy for me to improve my health conditions by using this system.12345
SE2: I have the capability to use this system to improve my health condition.12345
SE3: I am able to use this system to improve my health condition without much effort. 12345
6Perceived Vulnerability (PV): having little knowledge about self-care and improving personal healthcare; suffering falls.
PV1: I am at the risk of suffering from the stated problems. 12345
PV2: It is likely that I will suffer the stated problems.12345
PV3: It is possible for me to suffer the stated problems. 12345
7Perceived Severity (PS): having little knowledge about self-care and improving personal healthcare; suffering falls.
PS1: If I suffered the stated problems, it would be severe. 12345
PS2: If I suffered the stated problems, it would be serious.12345
PS3: If I suffered the stated problems, it would be significant. 12345
8Perceived Privacy Risk (PPR)
PPR1: It would be at risk to disclose my personal health information to the doctor. 12345
PPR2: There would be high potential for loss associated with disclosing my personal health information to the doctor.12345
PPR3: There would be too much uncertainty associated with giving my personal health information to the doctor.12345
9Behavioral Intention (BI)
BI1: I intend to use this system in the future.12345
BI2: I intend to use this system at every opportunity in the future. 12345
BI3: I plan to increase my use of this system in the future. 12345
10Attitude (AT)
AT1: Using this system is a good idea.12345
AT2: Using this system is a wise idea.12345
AT3: I like the idea of using this system.12345
11Response Cost (RC)
RC1: This system is expensive to purchase (the price of Kinect is $150). 12345
RC2: I have to spend effort on learning how to use this system. 12345
RC3: Using this system will change my life style.12345

References

  1. World Health Organization Ageing and Health. Available online: https://www.who.int/news-room/fact-sheets/detail/ageing-and-health (accessed on 9 March 2019).
  2. Weening-Dijksterhuis, E.; de Greef, M.H.; Scherder, E.J.; Slaets, J.P.; van der Schans, C.P. Frail institutionalized older persons: A comprehensive review on physical exercise, physical fitness, activities of daily living, and quality-of-life. Am. J. Phys. Med. Rehabil. 2011, 90, 156–168. [Google Scholar] [CrossRef]
  3. Windle, G.; Hughes, D.; Linck, P.; Russell, I.; Woods, B. Is exercise effective in promoting mental well-being in older age? A systematic review. Aging Ment. Health 2010, 14, 652–669. [Google Scholar] [CrossRef]
  4. Frändin, K.; Grönstedt, H.; Helbostad, J.L.; Bergland, A.; Andresen, M.; Puggaard, L.; Harms-Ringdahl, K.; Granbo, R.; Hellström, K. Long-term effects of individually tailored physical training and activity on physical function, well-being and cognition in Scandinavian nursing home residents: A randomized controlled trial. Gerontology 2016, 62, 571–580. [Google Scholar] [CrossRef]
  5. Brach, J.S.; FitzGerald, S.; Newman, A.B.; Kelsey, S.; Kuller, L.; VanSwearingen, J.M.; Kriska, A.M. Physical activity and functional status in community-dwelling older women: A 14-year prospective study. Arch. Intern. Med. 2003, 163, 2565–2571. [Google Scholar] [CrossRef]
  6. Rydwik, E.; Frändin, K.; Akner, G. Effects of a physical training and nutritional intervention program in frail elderly people regarding habitual physical activity level and activities of daily living—A randomized controlled pilot study. Arch. Gerontol. Geriatr. 2010, 51, 283–289. [Google Scholar] [CrossRef]
  7. Organization, W.H. A guide for population-based approaches to increasing levels of physical activity. In Implementation of the WHO Global Strategy on Diet, Physical Activity and Health; World Health Organization: Geneva, Switzerland, 2007. [Google Scholar]
  8. Lin, S.F.; Lee, J.W.; Modeste, N.; Johnson, E.G. Attitudes and beliefs predicting Taiwanese older adults’ intentions to attend strength and balance training programs. J. Appl. Gerontol. 2012, 31, 260–281. [Google Scholar] [CrossRef]
  9. Choi, S.D.; Guo, L.; Kang, D.; Xiong, S. Exergame technology and interactive interventions for elderly fall prevention: A systematic literature review. Appl. Ergon. 2017, 65, 570–581. [Google Scholar] [CrossRef]
  10. Yardley, L.; Bishop, F.L.; Beyer, N.; Hauer, K.; Kempen, G.I.; Piot-Ziegler, C.; Todd, C.J.; Cuttelod, T.; Horne, M.; Lanta, K. Older people’s views of falls-prevention interventions in six European countries. Gerontologist 2006, 46, 650–660. [Google Scholar] [CrossRef]
  11. Kobayashi, R.; Nakadaira, H.; Ishigami, K.; Muto, K.; Anesaki, S.; Yamamoto, M. Effects of physical exercise on fall risk factors in elderly at home in intervention trial. Environ. Health Prev. Med. 2006, 11, 250–255. [Google Scholar] [CrossRef]
  12. Liu-Ambrose, T.; Donaldson, M.G.; Ahamed, Y.; Graf, P.; Cook, W.L.; Close, J.; Lord, S.R.; Khan, K.M. Otago home-based strength and balance retraining improves executive functioning in older fallers: A randomized controlled trial. J. Am. Geriatr. Soc. 2008, 56, 1821–1830. [Google Scholar] [CrossRef]
  13. Uzor, S.; Baillie, L. Investigating the long-term use of exergames in the home with elderly fallers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada, 26 April–1 May 2014; pp. 2813–2822. [Google Scholar]
  14. Arlati, S.; Colombo, V.; Spoladore, D.; Greci, L.; Pedroli, E.; Serino, S.; Cipresso, P.; Goulene, K.; Stramba-Badiale, M.; Riva, G.; et al. A Social Virtual Reality-Based Application for the Physical and Cognitive Training of the Elderly at Home. Sensors 2019, 19, 261. [Google Scholar] [CrossRef]
  15. Fortino, G.; Gravina, R. A cloud-assisted wearable system for physical rehabilitation. In ICTs for Improving Patients Rehabilitation Research Techniques; Springer: Berlin, Germany, 2014; pp. 168–182. [Google Scholar]
  16. Ofli, F.; Kurillo, G.; Obdržálek, Š.; Bajcsy, R.; Jimison, H.B.; Pavel, M. Design and evaluation of an interactive exercise coaching system for older adults: Lessons learned. IEEE J. Biomed. Health Inform. 2016, 20, 201–212. [Google Scholar] [CrossRef]
  17. Lin, T.Y.; Hsieh, C.H.; Lee, J.D. A kinect-based system for physical rehabilitation: Utilizing Tai Chi exercises to improve movement disorders in patients with balance ability. In Proceedings of the Asia Modelling Symposium 2013: 7th Asia International Conference on Mathematical Modelling and Computer Simulation, Hong Kong, China, 23–25 July 2013; pp. 149–153. [Google Scholar]
  18. Muangmoon, O.-O.; Sureephong, P.; Tabia, K. Dance Training Tool Using Kinect-Based Skeleton Tracking and Evaluating Dancer’s Performance. In International Conference on Industrial, Engineering and other Applications of Applied Intelligent Systems; Springer: Berlin, Germany, 2017; pp. 27–32. [Google Scholar]
  19. Alexiadis, D.S.; Kelly, P.; Daras, P.; O’Connor, N.E.; Boubekeur, T.; Moussa, M.B. Evaluating a dancer’s performance using kinect-based skeleton tracking. In Proceedings of the 19th ACM International Conference on Multimedia, Scottsdale, AZ, USA, 28 November—1 December 2011; pp. 659–662. [Google Scholar]
  20. Ren, W.; Pu, F.; Fan, X.; Li, S.; Sun, L.; Li, D.; Wang, Y.; Fan, Y. Kinect-Based Skeleton-Matching Feedback for Motor Rehabilitation: Transient Performance Effect of Shoulder training. J. Mech. Med. Biol. 2016, 16. [Google Scholar] [CrossRef]
  21. Capecci, M.; Ceravolo, M.G.; Ferracuti, F.; Iarlori, S.; Kyrki, V.; Longhi, S.; Romeo, L.; Verdini, F. Physical rehabilitation exercises assessment based on hidden semi-markov model by kinect v2. In Proceedings of the 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), Las Vegas, NV, USA, 24–27 February 2016; pp. 256–259. [Google Scholar]
  22. Rybarczyk, Y.; Deters, J.K.; Gonzalo, A.A.; Esparza, D.; Gonzalez, M.; Villarreal, S.; Nunes, I.L. Recognition of physiotherapeutic exercises through DTW and low-cost vision-based motion capture. In International Conference on Applied Human Factors and Ergonomics; Springer: Berlin, Germany, 2017; pp. 348–360. [Google Scholar]
  23. Müller, M.; Röder, T. Motion templates for automatic classification and retrieval of motion capture data. In Proceedings of the 2006 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Vienna, Austria, 2–4 September 2006; Eurographics Association: Aire-la-Ville, Switzerland, 2006; pp. 137–146. [Google Scholar]
  24. Saraee, E.; Singh, S.; Hendron, K.; Zheng, M.; Joshi, A.; Ellis, T.; Betke, M. ExerciseCheck: Remote monitoring and evaluation platform for home based physical therapy. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments, Rhodes, Greece, 21–23 June 2017; pp. 87–90. [Google Scholar]
  25. Semblantes, P.A.; Andaluz, V.H.; Lagla, J.; Chicaiza, F.A.; Acurio, A. Visual feedback framework for rehabilitation of stroke patients. Inform. Med. Unlocked 2018, 13, 41–50. [Google Scholar] [CrossRef]
  26. Saenz-de-Urturi, Z.; Garcia-Zapirain Soto, B. Kinect-based virtual game for the elderly that detects incorrect body postures in real time. Sensors 2016, 16, 704. [Google Scholar] [CrossRef]
  27. Su, C.-J.; Chiang, C.-Y.; Huang, J.-Y. Kinect-enabled home-based rehabilitation system using Dynamic Time Warping and fuzzy logic. Appl. Soft Comput. 2014, 22, 652–666. [Google Scholar] [CrossRef]
  28. Wei, Y.; Yan, H.; Bie, R.; Wang, S.; Sun, L. Performance monitoring and evaluation in dance teaching with mobile sensing technology. Pers. Ubiquitous Comput. 2014, 18, 1929–1939. [Google Scholar] [CrossRef]
  29. Chatzitofis, A.; Monaghan, D.; Mitchell, E.; Honohan, F.; Zarpalas, D.; O’Connor, N.E.; Daras, P. HeartHealth: A cardiovascular disease home-based rehabilitation system. Procedia Comput. Sci. 2015, 63, 340–347. [Google Scholar] [CrossRef]
  30. Mocanu, I.; Marian, C.; Rusu, L.; Arba, R. A Kinect based adaptive exergame. In Proceedings of the 2016 IEEE 12th International Conference on Intelligent Computer Communication and Processing, Cluj-Napoca, Romania, 8–10 September 2016; pp. 117–124. [Google Scholar]
  31. Osgouei, R.H.; Soulsbv, D.; Bello, F. An Objective Evaluation Method for Rehabilitation Exergames. In Proceedings of the 2018 IEEE Games, Entertainment, Media Conference (GEM), Galway, Ireland, 15–17 August 2018; pp. 28–34. [Google Scholar]
  32. Salvador, S.; Chan, P. Toward accurate dynamic time warping in linear time and space. Intell. Data Anal. 2007, 11, 561–580. [Google Scholar] [CrossRef] [Green Version]
  33. Müller, M. Information Retrieval for Music and Motion; Springer: Berlin, Germany, 2007; Volume 2. [Google Scholar]
  34. Shokoohi-Yekta, M.; Wang, J.; Keogh, E. On the non-trivial generalization of dynamic time warping to the multi-dimensional case. In Proceedings of the 2015 SIAM International Conference on Data Mining, Vancouver, BC, Canada, 30 April–2 May 2015; pp. 289–297. [Google Scholar]
  35. Lanciault, R. Mecanim Humanoids. Available online: https://blogs.unity3d.com/2014/05/26/mecanim-humanoids/ (accessed on 15 March 2019).
  36. Filkov, R. K2-Asset On-line Documentation. Available online: https://ratemt.com/k2docs/ (accessed on 9 May 2018).
  37. Moon, S.; Park, Y.; Ko, D.W.; Suh, I.H. Multiple kinect sensor fusion for human skeleton tracking using Kalman filtering. Int. J. Adv. Robot. Syst. 2016, 13. [Google Scholar] [CrossRef]
  38. Karatsidis, A.; Bellusci, G.; Schepers, H.M.; de Zee, M.; Andersen, M.S.; Veltink, P.H. Estimation of ground reaction forces and moments during gait using only inertial motion capture. Sensors 2016, 17, 75. [Google Scholar] [CrossRef]
  39. Guo, L.; Xiong, S. Accuracy of base of support using an inertial sensor based motion capture system. Sensors 2017, 17, 2091. [Google Scholar] [CrossRef]
  40. Reips, U.-D.; Funke, F. Interval-level measurement with visual analogue scales in Internet-based research: VAS Generator. Behav. Res. Methods 2008, 40, 699–704. [Google Scholar] [CrossRef]
  41. Shrout, P.E.; Fleiss, J.L. Intraclass correlations: Uses in assessing rater reliability. Psychol. Bull. 1979, 86, 420–428. [Google Scholar] [CrossRef]
  42. Koo, T.K.; Li, M.Y. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef]
  43. Ćwiękała-Lewis, K.J.; Gallek, M.; Taylor-Piliae, R.E. The effects of Tai Chi on physical function and well-being among persons with Parkinson’s Disease: A systematic review. J. Bodyw. Mov. Ther. 2017, 21, 414–421. [Google Scholar] [CrossRef]
  44. Sun, J.; Kanagawa, K.; Sasaki, J.; Ooki, S.; Xu, H.; Wang, L. Tai chi improves cognitive and physical function in the elderly: A randomized controlled trial. J. Phys. Ther. Sci. 2015, 27, 1467–1471. [Google Scholar] [CrossRef]
  45. Kottner, J.; Audigé, L.; Brorson, S.; Donner, A.; Gajewski, B.J.; Hróbjartsson, A.; Roberts, C.; Shoukri, M.; Streiner, D.L. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Int. J. Nurs. Stud. 2011, 48, 661–671. [Google Scholar] [CrossRef]
  46. Kim, T.; Xiong, S. Comparison of seven fall risk assessment tools in community-dwelling Korean older women. Ergonomics 2017, 60, 421–429. [Google Scholar] [CrossRef]
  47. Chua, P.T.; Crivella, R.; Daly, B.; Hu, N.; Schaaf, R.; Ventura, D.; Camill, T.; Hodgins, J.; Pausch, R. Training for physical tasks in virtual environments: Tai Chi. In Proceedings of the IEEE Virtual Reality 2003, Los Angeles, CA, USA, 22–26 March 2003; pp. 87–94. [Google Scholar]
  48. Gao, Y.; Li, H.; Luo, Y. An empirical study of wearable technology acceptance in healthcare. Ind. Manag. Data Syst. 2015, 115, 1704–1723. [Google Scholar] [CrossRef]
  49. Kim, S.S. The integrative framework of technology use: An extension and test. MIS Q. 2009, 33, 513–537. [Google Scholar] [CrossRef]
  50. Bhattacherjee, A.; Hikmet, N. Physicians’ resistance toward healthcare information technologies: A dual-factor model. Proceedings of 2007 40th the Annual Hawaii International Conference on System Sciences, Waikoloa, HI, USA, 3–6 January 2007. [Google Scholar]
  51. Lee, Y.; Larsen, K.R. Threat or coping appraisal: Determinants of SMB executives’ decision to adopt anti-malware software. Eur. J. Inf. Syst. 2009, 18, 177–187. [Google Scholar] [CrossRef]
Sensors 19 02882 g001 550
Figure 1. Angle difference (Ɵ) between corresponding bone vectors for trainer (green) and trainee (red), using the left lower leg as an example.
Figure 1. Angle difference (Ɵ) between corresponding bone vectors for trainer (green) and trainee (red), using the left lower leg as an example.
Sensors 19 02882 g001
Sensors 19 02882 g002 550
Figure 2. Illustration of motion similarity evaluation under the local coordinate system of the human model (bottom) and the world coordinate system (at the top right corner).
Figure 2. Illustration of motion similarity evaluation under the local coordinate system of the human model (bottom) and the world coordinate system (at the top right corner).
Sensors 19 02882 g002
Sensors 19 02882 g003 550
Figure 3. Main scene of the Tai Chi exergame (left: trainer avatar, right: trainee avatar).
Figure 3. Main scene of the Tai Chi exergame (left: trainer avatar, right: trainee avatar).
Sensors 19 02882 g003
Sensors 19 02882 g004 550
Figure 4. Experimental setup for Tai Chi motion evaluation.
Figure 4. Experimental setup for Tai Chi motion evaluation.
Sensors 19 02882 g004
Sensors 19 02882 g005 550
Figure 5. Experts’ ratings on motion performance of 21 subjects.
Figure 5. Experts’ ratings on motion performance of 21 subjects.
Sensors 19 02882 g005
Sensors 19 02882 g006 550
Figure 6. Linear relationship between algorithm scores and experts’ ratings.
Figure 6. Linear relationship between algorithm scores and experts’ ratings.
Sensors 19 02882 g006
Sensors 19 02882 g007 550
Figure 7. Comparison between algorithm evaluation (after calibration) and experts’ evaluation.
Figure 7. Comparison between algorithm evaluation (after calibration) and experts’ evaluation.
Sensors 19 02882 g007
Sensors 19 02882 g008 550
Figure 8. Results of the user acceptance questionnaire for Tai Chi exergaming prototype system. Remarks: (1) Scores from all older participants were averaged for each construct. (2) Except perceived privacy risk and response cost, all constructs are positively associated with user’s intention to adopt the system.
Figure 8. Results of the user acceptance questionnaire for Tai Chi exergaming prototype system. Remarks: (1) Scores from all older participants were averaged for each construct. (2) Except perceived privacy risk and response cost, all constructs are positively associated with user’s intention to adopt the system.
Sensors 19 02882 g008

Share and Cite

MDPI and ACS Style

Yu, X.; Xiong, S. A Dynamic Time Warping Based Algorithm to Evaluate Kinect-Enabled Home-Based Physical Rehabilitation Exercises for Older People. Sensors 2019, 19, 2882. https://doi.org/10.3390/s19132882

AMA Style

Yu X, Xiong S. A Dynamic Time Warping Based Algorithm to Evaluate Kinect-Enabled Home-Based Physical Rehabilitation Exercises for Older People. Sensors. 2019; 19(13):2882. https://doi.org/10.3390/s19132882

Chicago/Turabian Style

Yu, Xiaoqun, and Shuping Xiong. 2019. "A Dynamic Time Warping Based Algorithm to Evaluate Kinect-Enabled Home-Based Physical Rehabilitation Exercises for Older People" Sensors 19, no. 13: 2882. https://doi.org/10.3390/s19132882

APA Style

Yu, X., & Xiong, S. (2019). A Dynamic Time Warping Based Algorithm to Evaluate Kinect-Enabled Home-Based Physical Rehabilitation Exercises for Older People. Sensors, 19(13), 2882. https://doi.org/10.3390/s19132882

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop