Next Article in Journal
Coarse-Fine Convolutional Deep-Learning Strategy for Human Activity Recognition
Next Article in Special Issue
Use of a Single Wireless IMU for the Segmentation and Automatic Analysis of Activities Performed in the 3-m Timed Up & Go Test
Previous Article in Journal
Ag@Au Core–Shell Porous Nanocages with Outstanding SERS Activity for Highly Sensitive SERS Immunoassay
Previous Article in Special Issue
Automated Accelerometer-Based Gait Event Detection During Multiple Running Conditions
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sensors
Volume 19
Issue 7
10.3390/s19071555
sensors-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Validity and Reliability of Wearable Sensors for Joint Angle Estimation: A Systematic Review

by
Isabelle Poitras
1,2,
Frédérique Dupuis
1,2,
Mathieu Bielmann
1,2,
Alexandre Campeau-Lecours
1,3,
Catherine Mercier
1,2,
Laurent J. Bouyer
1,2 and
Jean-Sébastien Roy
1,2,*
1
Centre for Interdisciplinary Research in Rehabilitation and Social Integration and Université Laval, Quebec City, QC G1M 2S8, Canada
2
Department of Rehabilitation, Université Laval, Quebec City, QC G1V 0A6, Canada
3
Department of Mechanical Engineering, Université Laval, Quebec City, QC G1V 0A6, Canada
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(7), 1555; https://doi.org/10.3390/s19071555
Submission received: 9 February 2019 / Revised: 25 March 2019 / Accepted: 27 March 2019 / Published: 31 March 2019
(This article belongs to the Special Issue Wearable Sensors for Gait and Motion Analysis 2018)
Browse Figures
Versions Notes

Abstract

:
Motion capture systems are recognized as the gold standard for joint angle calculation. However, studies using these systems are restricted to laboratory settings for technical reasons, which may lead to findings that are not representative of real-life context. Recently developed commercial and home-made inertial measurement sensors (M/IMU) are potentially good alternatives to the laboratory-based systems, and recent technology improvements required a synthesis of the current evidence. The aim of this systematic review was to determine the criterion validity and reliability of M/IMU for each body joint and for tasks of different levels of complexity. Five different databases were screened (Pubmed, Cinhal, Embase, Ergonomic abstract, and Compendex). Two evaluators performed independent selection, quality assessment (consensus-based standards for the selection of health measurement instruments [COSMIN] and quality appraisal tools), and data extraction. Forty-two studies were included. Reported validity varied according to task complexity (higher validity for simple tasks) and the joint evaluated (better validity for lower limb joints). More studies on reliability are needed to make stronger conclusions, as the number of studies addressing this psychometric property was limited. M/IMU should be considered as a valid tool to assess whole body range of motion, but further studies are needed to standardize technical procedures to obtain more accurate data.

1. Introduction

Physical rehabilitation assessments often require quantification of body movement over an extended period of time during functional or work-related tasks in order to characterize motor dysfunction, to determine task requirement, or to assess the effectiveness of an intervention. This can be performed in a laboratory setting using motion-capture systems [1], as these systems ensure high data quality and are commonly recognized as the gold standard for movement quantification [2]. However, these systems can only be used in controlled environments due to their lack of portability and to the technical expertise required, thereby limiting their potential clinical applications.
The use of wearable sensors has been suggested to overcome this lack of portability, as they are wireless, small, and light [3]. Activity, energy expenditure, and acceleration data collected by accelerometers have been shown to be valid and reliable. However, kinematic data have been shown to lack precision since they are affected by increased segment acceleration or the presence of drifts (algorithms have been developed to decrease the effect of drifting in accelerometers) [4,5,6]. Combining a gyroscope and a magnetometer with an accelerometer in a sensor, which is called an inertial measurement unit (M/IMU; sensors combining accelerometer and gyroscope [IMU] and sensors combining accelerometer, gyroscope, and magnetometer [MIMU]), has been proposed to solve this problem. Gyroscopes are used to estimate sensor orientation by integration of signals (angular velocity relative to the sensor XYZ axis) [7], accelerometers to provide a static orientation measurement relative to gravity by analyzing the acceleration signal, and magnetometers to provide heading using sensor orientation relative to Earth’s magnetic field [8]. By combining the signals of each sensor through intelligent data fusion algorithms, one can obtain a reliable estimate of M/IMU orientation. For example, accelerometers combined with magnetometers properly estimate slow-motion displacements, while the gyroscope provides better results during highly dynamic movements. Therefore, complimentary data are obtained when all three signals are captured [9]. M/IMUs provide more accurate kinematic data than accelerometers alone, while still being wireless, robust, and portable. Several commercial or home-made M/IMU systems are currently available for research and clinical applications, but as highlighted by Fong and Chan, some improvements on data processing, data logging, and fixation need to be made before these systems can be used more extensively. This could explain the growing interest in this research area during the past few years [10].
The psychometric properties, such as validity and reliability, of M/IMUs for orientation and joint kinematics estimation have been extensively studied during the past few years. Two systematic reviews have been conducted to report on the psychometric evidence relating to M/IMU validity [11,12]. The first systematic review published in 2010 concluded that M/IMUs could be a valid tool to measure range of motion, but results were variable across joints and tasks performed [8]. The other systematic review, published in 2018, focused only on the upper limb and provided only scarce details regarding the complexity of the tasks evaluated, a problem highlighted by the first systematic review as being one of the most challenging aspects for clinical evaluation. This highlights the need for a synthesis and an update for whole body kinematics. The aim of this study was therefore to conduct a systematic review of the psychometric evidence related to criterion validity and reliability of M/IMUs for the assessment of joint movement.

2. Materials and Methods

This systematic review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [13] and was prospectively registered with the International Prospective Register of Systematic Reviews (PROSPERO) in August 2018 (CRD42018104775).

2.1. Description of the Systems

An inertial measurement unit (M/IMU) is composed of 9 sensors: 3 accelerometers, 3 gyroscopes, and 3 magnetometers.
Accelerometers: The accelerometer measures the linear acceleration in 3 orthogonal directions (XYZ). It assumes that the Z axis is aligned with gravity and gives X and Y orientations, which are useful to provide static orientation measurements. However, when sensors are moving (i.e., during active movement), the estimated orientation is biased. This is explained by the movement artifacts added to the acceleration signals, which no longer allow consideration of the Z axis as pure gravity acceleration [4]. A method often used to calculate joint kinematics is to perform a double integration of linear acceleration and a simple integration of angular velocity. This method, however, can lead to biased data by adding a drift [6]. Some computational techniques have been proposed to fix this problem such as using filters [14] or performing data realignments [15], but they are not suitable for real-time processing [16].
Gyroscopes: The gyroscopes provide angular velocity around 3 orthogonal axes (yaw, pitch, and roll; XYZ) and, theoretically, signal integration could provide an estimate of sensor orientation by assuming a known initial orientation. As it is impossible to obtain an unbiased angular velocity zero, this integration leads to a drift biasing the resulting orientation estimate [17].
Magnetometers: The magnetometers provide the orientation relative to the Earth’s magnetic field, which is also the sensor orientation around the Z axis. This completes the orientation calculated from accelerometers, but magnetometers are sensitive to magnetic field disturbances which can bias the sensor orientation estimate [8].
Briefly, each sensor unit provides estimation of the orientation of body segments relative to a global reference [18,19]. Alone, each sensor provides biased information under certain circumstance, but putting them together (sensor data fusion) allows their limitations to be overcome and provides more accurate sensor orientation. Then, this can be used to calculate 3D joint angular kinematics. To achieve this, accurate M/IMU orientation has to be obtained by performing an anatomical calibration which allows an accurate joint angle calculation [20]. This procedure ensures quality of the data collected and should be carefully considered when using M/IMU systems. See Figure 1 for an example of a typical M/IMU sensor placement.

2.2. Data Sources

Five databases were screened (PubMed, CinAHL, Ergonomic abstract, Compendex, and EMBASE) using a combination of general keywords and specialized terms for each database. General keywords were: (“psychometric property” OR “reliability” OR “validity” OR “accuracy” OR “precision”) AND (“inertial measurement unit” OR “wearable sensors” OR “inertial sensor” OR “accelerometry”) AND (“joint angle” OR “range of motion” OR “movement” OR “kinematic”). Bibliographical references of the retrieved studies were also searched to identify additional relevant publications. Specialized keywords are presented in Table S1.
Articles were included if they: (1) presented results from human subjects, (2) included participants aged from 18 to 65 years old, (3) compared M/IMUs to a gold standard (motion-capture system for lab systems or goniometer for clinical measures) for the measurement (accelerometer, gyroscope with or without magnetometer) of the range of motion data (e.g., error of measurement, correlation coefficient, numerical value) (criterion validity) or compared data collected from the same M/IMU by two different evaluators and/or during two different sessions (reliability), (4) were written in French or English, and (5) were published after 2005. Older articles were excluded as they were not representative of current technology. Book chapters, congress abstracts, or conference proceedings, systematic reviews, and meta-analysis were excluded. Articles were not considered if they reported only data related to physical activity or energy expenditure. Titles and abstracts of the identified papers were screened independently by two reviewers (IP: Isabelle Poitras and FD: Frédérique Dupuis) to identify eligible articles. Initial data base screening was performed on 1 March, 2018 and an update was done on 15 July, 2018. A full review of the latter was performed independently by both reviewers. Any discrepancy was resolved during a consensus meeting, and a third reviewer (JSR: Jean-Sébastien Roy) was available if needed but turned out not to be required.

2.3. Quality Assessment

All included articles were independently critically appraised by two reviewers (IP and FD) using two different quality assessment tools: consensus-based standards for the selection of health measurement instruments (COSMIN) [21] and the critical appraisal tool by MacDermid (2008) [22]. The COSMIN grid was used to critically appraise how the psychometric properties were evaluated (reliability [box B], measurement errors [box C], and validity [box H]). The critical appraisal assessment by MacDermid was used to evaluate the methodological quality (study questions, study design, measurements, analyses, and recommendations). It gives a score out of 22. These two grids taken together allow a complete assessment of the overall article quality. Firstly, the three reviewers (IP, FD, and JSR) participated in a calibration review meeting in which each critical appraisal item was discussed. Secondly, two of the reviewers (IP and FD) independently reviewed each article. During a second meeting, every item of both grids was openly discussed until consensus on a given score was reached. If reviewers were unable to reach consensus, the third reviewer scored the article (JSR) and a discussion was performed to reach consensus.
For each grid, the score was converted into a percentage. The quality score of both tools was characterized as follows: very low (VLQ) = 0–25%, low (LQ) = 26–50%, moderate (MQ) 51–75%, and high (HQ): 76–100% [23]. Pre-consensus inter-rater agreements were calculated by using weighted Gwet’s coefficient on each individual item of the COSMIN grid. The level of agreement between reviewers was defined as: poor <0.0, slight 0.0 to 0.20, fair 0.21 to 0.40, moderate 0.41 to 0.60, substantial 0.61 to 0.80, and almost perfect 0.81 to 1.00 [24]. An intraclass correlation coefficient (ICC) was calculated on the overall score to assess inter-rater reliability for the MacDermid’s critical appraisal tool. ICC score was defined as: values <0.5 indicate poor reliability, values between 0.5 and 0.75 indicate moderate reliability, values between 0.76 and 0.9 indicate good reliability, and values >0.90 indicate excellent reliability [25].

2.4. Data Extractions

Each of the two reviewers performed a complete data extraction of half of the included articles and the extraction was corroborated or completed by the other reviewer. Targeted variables were extracted with a standard data extraction tool [22]. Extracted variables were: participants’ characteristics, number of participants, instrumented body part, movement performed, sensor brand, gold standard used, reliability, and validity indices. If an article presented results for more than one joint, they were treated separately to simplify data analysis.
Variables extracted for validity were: r (simple correlation coefficient), r2 (coefficient of determination), CMC (coefficient of multiple correlation), intraclass correlation coefficient (ICC), root mean square error (RMSE/RMS; measurement error between the reference system and M/IMU), and lower limit of agreement (LoA; total error of a measurement procedure). Variables extracted for reliability were: CMC (coefficient of multiple correlation), intraclass correlation coefficient (ICC), lower limit of agreement (LoA; total error of a measurement procedure), index of dependability (correlation coefficient), m-estimators (extremum estimators), and standard deviation/standard error of the mean (SD/SEM). ICC, r, CMC, and r2 were considered as poor (<0.5), moderate (between 0.5 and 0.75), good (between 0.75 and 0.9), or excellent (>0.90) [17]. Error (RMSE/RMS, LoA, m-estimators, SD, SEM) of <5° was considered as excellent and between 5 and 10° as good [12].

2.5. Data Analysis

Simple movements were defined as movements performed in one plane of movement (sagittal, frontal, or transverse) and complex movements were characterized as movement performed in more than one plane of movement such as walking, swimming, or sport activities. Due to the heterogeneity of protocols and data acquisition systems used in the selected articles, results of this systematic review could not be pooled in a meta-analysis. For this reason, only a descriptive synthesis of results was performed.
Four domains of concern have been selected to characterize the evidence for each joint: (1) number of studies/participants (imprecision); (2) methodological quality (risk of bias); (3) methodological and outcome similarities (indirectness); and (4) direction of results (inconsistency). Finally, the scale used to identify the level of evidence is defined as follow [26,27]:
  • Strong evidence: multiple HQ studies with consistent results.
  • Moderate evidence: multiple studies, including at least one HQ study, or multiple MQ or LQ studies, presenting consistent results.
  • Conflicting evidence: multiple studies providing inconsistent results, regardless of the methodological quality.
  • Limited evidence: multiple MQ or LQ studies with inconsistent results, or one HQ.
  • Very limited evidence: only one LQ or MQ study.

3. Results

Nine hundred and forty-three articles were retrieved. After removal of duplicates, screening of titles/abstracts, full-text analysis and manual source detection, forty-two articles were included (see Figure 2).

3.1. Characteristics of Studies

Thirty-nine articles addressed M/IMU validity and fifteen reported on reliability. The majority of the studies reported r and RMSE for validity (only one article used m-estimators) and ICC or CMC for reliability [28]. All of the fifteen studies assessing reliability evaluated intra-rater reliability, with four also assessing inter-rater reliability. A total of 556 subjects were tested in the included studies (508 for validity and 184 for reliability). The following body regions were investigated for validity and/or reliability: neck, shoulder, scapula, elbow, wrist, trunk, pelvis, hip, knee, and/or ankle. The knee and the hip were the most investigated joints for validity (respectively 15 and 13 studies). Reliability was only evaluated in one to three studies per joint. Across the 42 studies, the majority focused on complex movements (n = 25) as compared to simple movements (n = 17). Among the studies on complex movements, walking/running was the most frequently investigated (17/25), other movements including kicking, throwing, swimming, and sweeping a table. Ten articles reported results for various complex movements [29,30,31,32,33,34,35,36,37,38,39]. The Xsens was the most studied M/IMU system (15 articles) while other systems were investigated in three or less articles (e.g., Cuela or Physilog). See Supplementary Data Table S2 and Table S3 for detailed psychometric property results.

3.2. Methodological Quality

The scores on the MacDermid critical appraisal tool ranged from 41 to 92% (see Table S4) with a mean of 64.5 ± 12.9%. Eleven articles were classified as HQ studies, twenty-two as MQ, and nine as LQ. COSMIN results are presented by box (Tables S5–S7). Scores for box B (reliability) ranged from 22 to 100% with a mean of 67.4 ± 23.1%. Scores for box C (measurement error) ranged from 50 to 100% with a mean of 71.9 ± 12.8%. Scores for box H ranged from 17 to 100% with a mean of 56.4 ± 20.1%. Six studies were categorized as HQ, six as MQ, and three as LQ for reliability (combined box B and C). Seven articles were classified as HQ studies, seven as MQ, twenty-four as LQ, and one as VLQ for criterion validity. See Table 1 for detailed body evidence by body region and psychometric property. The majority of studies failed to score for sample size and for detailed inclusion/exclusion criteria, thereby partly explaining the low-quality score for both grids.
The pre-consensus inter-rater agreement between reviewers for total scores of the COSMIN grid and MacDermid’s critical appraisal tool was considered excellent (Gwet = 0.85 to 0.96 and ICC = 0.93).

3.3. Criterion Validity and Errors of Measurement by Body Region

3.3.1. Neck

The body of evidence for the neck joint is considered as moderate (five studies, total of 44 participants [one to 20 participants/study], only one HQ study). RMSE results varied between less than 1° and 9°, showing good joint measurement validity [33,34,37,40,41]. Results are similar for the three measurement axes. Two studies reported higher variability in neck joint angle measurements (more than 7°) specifically for rotation and for two complex movements (e.g., sweeping a table, drinking), but their results were collected from only one participant in both studies. Articles presenting small RMSE used simple movements, except Pérez et al. [35] which presented validity for lifting tasks (RMSE ranged from 1.4 to 3°).

3.3.2. Shoulder

The body of evidence for the shoulder joint is considered to be ‘’conflicting’’ (12 studies, total of 87 participants [one to 19 participants/study]). Despite a larger number of studies published for this joint, heterogeneity of results (RMSE between 0.2 and 64.5° and r from 0.69 to 1.00) and movements performed made it difficult to conclude the validity of using M/IMU systems for movement at this joint [31,32,33,34,35,37,38,39,42,43,44,45]. Variability increased with movement complexity, with simple movement protocols showing better concordance between studies (RMSE ranging from 1 to 21° for simple movements and from 5 to 64.5° for complex movements). Articles reported good results for flexion/extension movements (X axis; RMSE of 15° and less). Abduction/adduction movement (Z axis) showed moderate validity (RMSE of less than 20°). Validity for rotation movement in the Y axis was not consistent (high variability from 1 to 60°).

3.3.3. Elbow

The body of evidence for the elbow joint is considered to be ‘’conflicting’’ (10 studies, total 71 participants [one to 19 participants/study]). RMSE and correlation coefficient results range from 0.2 to 30.6° and 0.68 to 0.99, respectively, showing good to excellent validity [28,31,32,33,34,35,37,39,43,45]. Pro-supination (r between 0.68 and 0.99) showed poorer correlations than flexion–extension (r between 0.85 and 0.99) and validity tended to decrease with increasing movement complexity (r ≥ 0.93 compared to r ≥ 0.68 for complex movements). Results should be taken with caution however, due to the heterogeneity of the reported movements (i.e., the validity was highly variable across the movements and planes studied).

3.3.4. Wrist

The body of evidence for the wrist joint is considered to be ‘’conflicting’’ (6 studies, total of 51 participants [one to 19 participants/study]). RMSE and correlation coefficients varied respectively from 2.2 to 30° and from 0.62 to 0.99, showing fair to good validity [28,32,33,35,37,43]. Radial and ulnar deviation showed poorer results than any other movement (RMSE ranging from 3 to 30° for ulnar deviation compared to 3 to 20° for flexion), regardless of the movements performed. Contradictory results were given from one study using home-made sensors which presented poor results for all of the movements performed (RMSE higher than 30° and r as low as 0.62) [43].

3.3.5. Trunk

The body of evidence for the trunk is considered to be strong (11 studies for the lumbar and thoracic spine, total of 167 participants [one to 38 participants/study], four HQ studies). Validity was similar across all movement planes and axes [34,36,37,38,41,46,47,48,49,50,51]. Two studies reported conflicting results for this joint, but they are also the two with the poorest methodological quality (RMSE between 1.4 and 26.2° and r as low as 0.05) [34,49]. RMSE and correlation coefficients varied respectively from 1.8 to 5.9° and from 0.72 to 0.99 when excluding data from these two articles, showing good to excellent validity.

3.3.6. Pelvis

The body of evidence for the pelvis joint (tilt or obliquity) is considered to be strong (6 studies, total of 95 participants [six to 30 Participants/Study], three HQ studies). RMSE and correlation coefficients varied respectively from 0.4 to 8.8° and 0.84 to 1.00, showing good to excellent validity [30,36,38,41,42,52]. Results were similar across movement planes and axes. Two articles reported poorer results (RMSE from 5.0 to 8.8°), but only for complex movements (milking cluster attachment task/sit-to-stand/block step).

3.3.7. Hip

The body of evidence for the hip joint is characterized as strong (13 studies, total of 195 participants [three to 30 participants/study], two HQ studies and eight MQ studies with similar results). RMSE and correlation coefficients varied respectively from 0.2 to 9.3° and 0.53 to 1.00, showing fair to excellent validity [5,30,37,41,42,46,53,54,55,56,57,58,59]. Hip rotation and movements performed in the transverse plane (Y axis) showed higher RMSE and lower correlations (RMSE as high as 11.8° and r as low as 0.35).

3.3.8. Knee

The body of evidence for the knee joint is considered to be strong (15 studies, total of 228 participants [three to 38 participants/study], three HQ and nine MQ studies). RMSE and coefficient correlation varied respectively from 1 to 11.5° and 0.4 to 1.00 [5,30,37,41,43,48,50,53,54,55,57,58,59,60,61]. Knee abduction/adduction, which are movements with very small range of motion (ROM), were less valid (RMSE higher than 5°) than knee flexion and extension, which presented high validity (majority of studies with r ≥ 0.8).

3.3.9. Ankle

The body of evidence for the ankle joint is considered to be strong (11 studies, total of 141 participants [three to 26 participants/study], three HQ and nine MQ studies). RMSE and correlation coefficients varied respectively from 0.4 to 18.8° and 0.33 to 0.99 [29,37,41,43,53,54,55,57,59,62,63]. RMSE results increased with movement speed (different walking speed vs. running; RMSE of 1.2 to 2.0 for a slow walking speed to 15.8° for running). Also, rotation and inversion/eversion showed poorer validity than dorsiflexion/plantar flexion, especially for small ranges of movement (RMSE as high as 18.8 for rotation and 11.2 for inversion/eversion).

3.4. Reliability by Joint

3.4.1. Neck

The body of evidence for the neck is considered to be moderate (three studies, total of 48 participants [10 to 20 participants/study], one HQ study and two MQ). Standard error of the mean (SEM) and ICC for inter-rater reliability ranged respectively from 1.2 to 9.4° and from 0.64 to 0.99 [64,65,66]. Cervical rotation showed poorer ICC (two studies with ICC < 0.8), while flexion/extension and lateral flexion showed excellent reliability (ICC ≥ 0.8).

3.4.2. Shoulder

The body of evidence for the shoulder is considered to be limited (two studies, total of 30 participants (10 to 20 participants/study], one HQ study and one MQ). SEM and ICC for inter-raterreliability ranged respectively from 4.2 to 7.8° and 0.71 to 0.99 [28,66]. Flexion/extension movements showed higher reliability than abduction and rotation (RMSE: flexion–extension: 5.9–7.2°; abduction-adduction: 4.2–5.7°; rotation: 6.6–7.8°; r: flexion–extension: 0.96-0.99; abduction–adduction: 0.72–0.91; rotation: 0.72–0.87).

3.4.3. Scapula

The body of evidence for the scapula is considered to be limited (one study, total of 20 participants, one HQ study). Inter-rater reliability is considered as fair to good for scapular retraction–protraction and scapular mediolateral rotation (r = 0.59 to 0.91), but as poor to fair for anterior–posterior tilt (r = 0.32 to 0.87) [67].

3.4.4. Elbow

The body of evidence for the elbow is considered to be conflicting as the two studies included presented inconsistent results (two studies, total of 30 participants [10 to 20 participants/study]). One study showed excellent reliability in every movement direction (CMC ≥ 0.9) and the other presented poor to good reliability (ICC = 0.2 to 0.77) [28,66].

3.4.5. Wrist

The body of evidence for the wrist is considered to be limited (two studies, total of 30 participants [10 to 20 participants/study], one HQ study and one MQ). Both studies presented good to excellent intra-rater reliability for all joint movements (CMC and ICC between 0.79 to 0.96) [28,66].

3.4.6. Trunk

The body of evidence for the trunk is considered to be moderate (three studies, total of 63 participants [19 to 24 participants/study], two HQ and one MQ study). Results from these three studies are consistent and demonstrate good to excellent intra-rater reliability (ICC ≥ 0.8 except for coronal plane which is fair to excellent (0.67 to 0.93)) [46,66,68].

3.4.7. Pelvis

The body of evidence for the pelvis is considered to be moderate (one study, total of one participant, one HQ study). All pelvis movements showed good reliability with an absolute error of less than 1.2° [42].

3.4.8. Hip

The body of evidence for the hip is considered to be moderate (three studies, total of 70 participants [20 to 26 participants/study], one HQ and two MQ study). Intra-rater reliability is fair to excellent and inter-rater reliability varied across movements performed (good for walking [ICC of 0.4 to 0.74] and poor for jumping [ICC ≤ 0.39] [46,53,66]).

3.4.9. Knee

The body of evidence for the knee is considered to be moderate (three studies, total of 56 participants [10 to 26 participants/study], one HQ and two MQ study). Intra-rater reliability was fair to excellent and inter-rater reliability varied across movements performed (good for walking [ICC from 0.4 to 0.74] and poor for jumping [ICC ≤ 0.39] [45,53,59]).

3.4.10. Ankle

The body of evidence for the ankle is considered to be moderate (three studies, total of 52 participants [12 to 26 participants/study], one HQ and two MQ study). Intra- and inter-rater reliability varied across movements complexity (better for walking [ICC of 0.6 to 0.95] than jumping [ICC of 0.39 to 0.99] or playing soccer [ICC of 0.28 to 0.79] [29,53,62]).

4. Discussion

This systematic review of 42 studies assessed available evidence on psychometric properties of the use of M/IMUs to quantify joint movement. Regarding validity, M/IMUs appear to provide a suitable alternative to motion-capture systems especially for flexion/extension movements at the lower limb joints during simple movements. This systematic review has provided an overview of current knowledge on the validity and reliability of the M/IMU system for the whole body, as an update to a similar past review from Cuesta-Vargas et al. published in 2010 [12] and complements a recent review on the upper limb that focused more on the technical aspects of M/IMU use (calibration, type of sensors) than on clinical applications (movement complexity, more details on specific movement at each joint) [11]. The review from Cuesta-Vargas et al. concluded that validity depended on the joint studied and movement performed. However, they did not report detailed results for each joint separately and only few comments were made on movement complexity [12]. More specifically, they reported that increasing movement complexity decreases the validity, but most of the cited studies they reported used only simple planar movement protocols such as isolated flexion–extensions, which limited the generalizability of their conclusions. Regarding Walmsley et al.’s review, their search was limited to the upper limb [11]. Their results for the upper limbs are in agreement with those presented here. In addition, they included conference proceedings, articles comparing M/IMUs with robotic arms, and studies presenting data without comparison to a “gold standard”. The increasing number of studies in recent years that used complex movements to assess M/IMU validity and the focus made on the upper limb joint partially explain the different conclusions between these two systematic reviews and the present work [12]. Indeed, ecological tasks related to activities of daily living generally require complex movements, the use of both upper and lower limb joints, movements in more than one plane, and irregular movement speed, which all drastically affect system performance (e.g., walking at different speed vs. running [62,63]). For example, studies reporting the worst validity assessed sporting tasks or activities of daily living such as sweeping a table [32,34]. Proper calibration (proper alignment of the M/IMU axes with the anatomical segment axes) is another important factor contributing to better reliability, as different calibration protocols may result in substantially different results [28]. As the initial calibration is the reference to calculate joint angulation during body movement, a poor calibration in which sensors are not aligned with the body segment could interfere with data quality. It was not possible in this systematic review to reach a conclusion on the best calibration procedure for a given movement/context, as many studies did not identify or sufficiently described their calibration procedure.
The previous systematic review on whole body kinematics reported better results for upper limb joints (elbow, wrist, shoulder) than lower limb joints [12]. This is opposite to our results. We considered evidence related to the validity of shoulder, elbow, and wrist movements to be conflicting, particularly when participants were involved in complex movements or when the joint rotation around the Y axis was targeted. Functional upper limb tasks often require performing complex movements around two or three axes (X, Y, Z), which can account for the variability of results. In contrast, lower limb and trunk movements are mostly performed in closed chains and in one plane of movement, providing more consistent results, except for movements with smaller ROM (e.g., knee abduction/adduction or ankle internal/external rotation). Also, as demonstrated by Robert-Lachaine et al. [37], the choice of the biomechanical model used to convert M/IMU orientation data into anatomically meaningful information will also influence validity differently depending on the joint studied. Their results showed that biomechanical models used for the upper limbs are more likely to add variability, leading to larger RMSE. This partly explains the large variability observed at the shoulder joint (RMSE as high as 40° in some articles). According to Robert-Lachaine et al., shoulder rotation is also more influenced by the biomechanical model than shoulder flexion–extension or abduction/adduction. Another important aspect to consider, as discussed in the Materials and Methods section, is that the weaknesses of each sensor in the estimation of joint kinematics could have separately impacted the accuracy/reliability of M/IMUs as sensor fusion does not fully compensate for all sensors limitations [9].
It is important to note here that, recently, several studies have questioned the validity and accuracy of camera-based motion capture systems for certain joints and for complex movements [46,54]. Indeed, errors ranging from 5 to 10° when compared to goniometer, inclinometer, and radiostereometric measurements have been evidenced (same error range as M/IMU systems). Interestingly, and similar to M/IMUs, errors reported for camera-based motion capture systems varied across movement planes and joints. Caution must therefore be taken when using these systems as a gold standard for validating M/IMUs.
The validity of motion capture and M/IMUs for trunk and lower limb joints are similar except for the rotation component, suggesting that M/IMUs could be a good alternative to motion capture systems for movement measurements in the sagittal and frontal planes, but not in the transverse plane. For the upper limbs, flexion/extension movements should be considered valid in every context. However, the complexity of the movement leads to more variability in abduction/adduction, which needs to be considered. For rotation, more studies are required to identify the best approach for the most accurate data. In clinical settings, M/IMUs should be considered as an alternative tool to inclinometers and goniometers, as they provide real-time data in functional tasks within the same error range as these more classical measurement devices (M/IMU: 0.7 to 15°; inclinometer and goniometer: 0.21 to 18°) for lower limb, trunk, wrist, and elbow joints. However, more time and technical resources must be allowed for patient assessment with this technology until the system becomes more user friendly.
Regarding reliability, the small number of studies for each joint did not allow us to make strong conclusions. As mentioned above for validity, reliability is better for movements in the sagittal and frontal planes than in the transverse plane. However, most of the included studies only assessed reliability during simple planar movements and locomotor tasks. Here also, more complex movements would probably show less reliable results. The different types of M/IMU gave similar reliability results (e.g., Xsens, Cuela, and Gait-up Physilog) regardless of the joint studied. Moreover, the absolute error reported for M/IMU ranged from 0.3° to 9.9° which is better than the goniometer and inclinometer reliability (inclinometer: 1° to 32°; goniometer: 1° to 45°) [69]. Reliability results are therefore promising, but more high-quality studies are needed to be able to reach stronger conclusions, especially for complex movements.
Rehabilitation research and health care services could benefit from M/IMUs as they provide valid data to assess range of motion and joint orientation. The present systematic review has focused on healthy subjects to reduce the variability in reported data, but M/IMUs need to ultimately benefit pathological populations and clinicians by guiding clinical decision making (e.g., quantify deficits and determine progress in time) [70]. As the validity has been demonstrated in a majority of body joints for healthy subjects, it opens the possibility to assess psychometric properties in pathological populations. However, special considerations will be needed in pathological populations as most of the calibration procedures require specific posture or movement, which could be challenging for some populations (e.g., cerebral palsy). Also, to be clinically useful these systems should be validated in ecological settings which could prove to be difficult considering the changing environment of the real world and the need for an established gold standard outside of the laboratory settings [8].
Limitations of this research include that the validity and reliability results presented in this systematic review represented the use of M/IMU in controlled environments as all the included studies were performed in laboratory settings. Therefore, they cannot be considered as directly representing M/IMU performance during real-life/outside of laboratory use. More studies in work and home environments need to be performed in order to generalize the findings. In addition, the lack of standardization in protocols such as the use of different biomechanical models for the same joint or of different calibration procedures and sensor placements makes it impossible to identify the main contributing factor to measurement errors. This highlights the need for specific guidelines and standardization for M/IMU, similar to the Seniam guidelines [71] for electromyography, as they could drastically reduce variability between studies. Furthermore, despite the high number of studies included in this review (42 articles), there are only twelve high quality studies, which restricted conclusions. However, the majority of studies had the same limitations: small sample sizes without justification, targeting only one psychometric property, and lack of description of inclusion/exclusion criteria. These factors have lowered study quality but did not interfere with precision of the reported data.
Most of the studies included in this review are of moderate to high quality, suggesting a low risk of bias in conclusions. The overall quality of all articles was reduced by the small sample sizes (see above). Only two articles had a good score on this criterion, but based mainly on the fact that a justification was provided. The sample size used in included studies ranged from one to 38 participants. This is below the recommended sample size for this type of study (50 participants). This could lead to misinterpretation [21]. To lower this risk of bias, we gave less impact to studies performed on only one participant.
Another important risk of bias is the heterogeneity of movements studied across the 42 articles, which did not allow us to perform quantitative analysis. The complexity of the movements assessed varied widely between studies and, as mentioned, M/IMU systems have lower validity in complex movements than in simple movements.

5. Conclusions

In conclusion, results from this systematic review suggest that M/IMUs are an appropriate alternative to motion-capture based systems to study human movement. However, as a restricted number of articles have been conducted on M/IMU reliability it is not possible to reach a conclusion on the best specific procedures (e.g., the calibration) to ensure reliable data. More studies in ecological environments are also needed before using M/IMU extensively outside of the laboratory. The main advantage of M/IMUs is that they can provide accurate data at a lower cost than a motion-capture system. However, M/IMU users should consider movement complexity, sensor placement, joint studied, biomechanical models used, and calibration procedure, before drawing specific conclusions. Further studies are needed to standardize data acquisition protocols with these devices to allow a meta-analysis of the results.

Supplementary Materials

The following are available online at https://www.mdpi.com/1424-8220/19/7/1555/s1: Table S1: Specialized keywords used for each database search; Table S2: Synthesis of criterion validity results; Table S3: Synthesis of reliability results; Table S4: Assessment of methodological quality by an appraisal quality tool (MacDermid et al., 2008); Table S5: Assessment of studies examining measurement errors (absolute measures) using the COSMIN checklist (box B); Table S6: Assessment of studies examining measurement errors (absolute measures) using the COSMIN checklist (box C); Table S7: Assessment of studies examining criterion validity using the COSMIN checklist (box H)

Author Contributions

Data curation: I.P. and F.D.; formal analysis: M.B.; methodology: J.-S.R. and I.P.; writing—original draft: I.P.; writing—review and editing: J.-S.R., L.J.B., C.M., A.C.-L. and M.B.

Acknowledgments

IP is supported by a Master’s student scholarship from the Canadian Institutes of Health Research (CIHR). J-SR is supported by a salary award from the Canadian Institutes of Health Research (CIHR) and CM by a salary award from the Fonds de recherche en santé du Québec (FRQS).

Conflicts of Interest

The authors declare no conflict of interest.

Trial Registration

This systematic review was registered with PROSPERO (CRD42018104775).

References

  1. Valevicius, A.M.; Jun, P.Y.; Hebert, J.S.; Vette, A.H. Use of optical motion capture for the analysis of normative upper body kinematics during functional upper limb tasks: A systematic review. J. Electromyogr. Kinesiol. 2018, 40, 1–15. [Google Scholar] [CrossRef] [PubMed]
  2. Ceseracciu, E.; Sawacha, Z.; Cobelli, C. Comparison of Markerless and Marker-Based Motion Capture Technologies through Simultaneous Data Collection during Gait: Proof of Concept. PLoS ONE 2014, 9, e87640. [Google Scholar] [CrossRef]
  3. Godfrey, A.; Conway, R.; Meagher, D.; Ólaighin, G. Direct measurement of human movement by accelerometry. Med. Eng. Phys. 2008, 30, 1364–1386. [Google Scholar] [CrossRef] [PubMed]
  4. Grimaldi, G.; Manto, M. Neurological tremor: Sensors, signal processing and emerging applications. Sensors 2010, 10, 1399–1422. [Google Scholar] [CrossRef]
  5. Dejnabadi, H.; Jolles, B.M.; Casanova, E.; Fua, P.; Aminian, K. Estimation and visualization of sagittal kinematics of lower limbs orientation using body-fixed sensors. IEEE Trans. Biomed. Eng. 2006, 53, 1385–1393. [Google Scholar] [CrossRef] [PubMed]
  6. Dejnabadi, H.; Jolles, B.M.; Aminian, K. A new approach to accurate measurement of uniaxial joint angles based on a combination of accelerometers and gyroscopes. IEEE Trans. Biomed. Eng. 2005, 52, 1478–1484. [Google Scholar] [CrossRef] [PubMed]
  7. Abyarjoo, F.; Barreto, A.; Cofino, J.; Ortega, F.R. Implementing a Sensor Fusion Algorithm for 3D Orientation Detection with Inertial/Magnetic Sensors. In Innovations and Advances in Computing, Informatics, Systems Sciences, Networking and Engineering; Springer: Cham, Switzerland, 2015; pp. 305–310. [Google Scholar]
  8. Kok, M.; Schon, T.B. Magnetometer Calibration Using Inertial Sensors. IEEE Sens. J. 2016, 16, 5679–5689. [Google Scholar] [CrossRef]
  9. Sabatini, A. Estimating Three-Dimensional Orientation of Human Body Parts by Inertial/Magnetic Sensing. Sensors 2011, 11, 1489–1525. [Google Scholar] [CrossRef] [Green Version]
  10. Fong, D.; Chan, Y. The Use of Wearable Inertial Motion Sensors in Human Lower Limb Biomechanics Studies: A Systematic Review. Sensors 2010, 10, 11556–11565. [Google Scholar] [CrossRef] [Green Version]
  11. Walmsley, C.P.; Williams, S.A.; Grisbrook, T.; Elliott, C.; Imms, C.; Campbell, A. Measurement of Upper Limb Range of Motion Using Wearable Sensors: A Systematic Review. Sports Med. Open 2018, 4, 53. [Google Scholar] [CrossRef] [PubMed]
  12. Cuesta-Vargas, A.I.; Galán-Mercant, A.; Williams, J.M. The use of inertial sensors system for human motion analysis. Phys. Ther. Rev. 2010, 15, 462–473. [Google Scholar] [CrossRef] [Green Version]
  13. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ 2009, 339, b2535. [Google Scholar] [CrossRef] [PubMed]
  14. Tong, K.; Granat, M.H. A practical gait analysis system using gyroscopes. Med. Eng. Phys. 1999, 21, 87–94. [Google Scholar] [CrossRef]
  15. Morris, J.R.W. Accelerometry—A technique for the measurement of human body movements. J. Biomech. 1973, 6, 729–736. [Google Scholar] [CrossRef]
  16. Djurić-Jovičić, M.D.; Jovičić, N.S.; Popović, D.B. Kinematics of Gait: New Method for Angle Estimation Based on Accelerometers. Sensors 2011, 11, 10571–10585. [Google Scholar] [CrossRef] [Green Version]
  17. Pasciuto, I.; Ligorio, G.; Bergamini, E.; Vannozzi, G.; Sabatini, A.; Cappozzo, A. How Angular Velocity Features and Different Gyroscope Noise Types Interact and Determine Orientation Estimation Accuracy. Sensors 2015, 15, 23983–24001. [Google Scholar] [CrossRef] [Green Version]
  18. Foxlin, E. Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter. In Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium, Santa Clara, CA, USA, 30 March–3 April 1996; pp. 185–194. [Google Scholar]
  19. Roetenberg, D.; Baten, C.T.M.; Veltink, P.H. Estimating body segment orientation by applying inertial and magnetic sensing near ferromagnetic materials. IEEE Trans. Neural Syst. Rehabil. Eng. 2007, 15, 469–471. [Google Scholar] [CrossRef]
  20. Picerno, P. 25 years of lower limb joint kinematics by using inertial and magnetic sensors: A review of methodological approaches. Gait Posture 2017, 51, 239–246. [Google Scholar] [CrossRef]
  21. Terwee, C.B.; Bot, S.D.; de Boer, M.R.; van der Windt, D.A.; Knol, D.L.; Dekker, J.; Bouter, L.M.; de Vet, H.C. Quality criteria were proposed for measurement properties of health status questionnaires. J. Clin. Epidemiol. 2007, 60, 34–42. [Google Scholar] [CrossRef] [PubMed]
  22. MacDermid, J.C. Critical appraisal of study design for psychometric articles evaluation form and interpretation guide. In Evidence Based Rehabilitation: A Guide to Practice, 3rd ed.; Slack: Thorofare, NJ, USA, 2008; pp. 387–392. [Google Scholar]
  23. Balshem, H.; Helfand, M.; Schunemann, H.J.; Oxman, A.D.; Kunz, R.; Brozek, J.; Vist, G.E.; Falck-Ytter, Y.; Meerpohl, J.; Norris, S.; et al. GRADE guidelines: 3. Rating the quality of evidence. J. Clin. Epidemiol. 2011, 64, 401–406. [Google Scholar] [CrossRef] [PubMed]
  24. Gwet, K.L. Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement among Raters; Advanced Analytics, LLC: Gaithersburg, MD, USA, 2014. [Google Scholar]
  25. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. van Tulder, M.; Furlan, A.; Bombardier, C.; Bouter, L. Updated method guidelines for systematic reviews in the cochrane collaboration back review group. Spine 2003, 28, 1290–1299. [Google Scholar] [CrossRef]
  27. de Oliveira, F.C.L.; Bouyer, L.J.; Ager, A.L.; Roy, J.S. Electromyographic analysis of rotator cuff muscles in patients with rotator cuff tendinopathy: A systematic review. J. Electromyogr. Kinesiol. 2017, 35, 100–114. [Google Scholar] [CrossRef] [PubMed]
  28. Bouvier, B.; Duprey, S.; Claudon, L.; Dumas, R.; Savescu, A. Upper Limb Kinematics Using Inertial and Magnetic Sensors: Comparison of Sensor-to-Segment Calibrations. Sensors 2015, 15, 18813–18833. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Akins, J.S.; Heebner, N.R.; Lovalekar, M.; Sell, T.C. Reliability and validity of instrumented soccer equipment. J. Appl. Biomech. 2015, 31, 195–201. [Google Scholar] [CrossRef] [PubMed]
  30. Blair, S.; Duthie, G.; Robertson, S.; Hopkins, W.; Ball, K. Concurrent validation of an inertial measurement system to quantify kicking biomechanics in four football codes. J. Biomech. 2018. [Google Scholar] [CrossRef] [PubMed]
  31. Ertzgaard, P.; Öhberg, F.; Gerdle, B.; Grip, H. A new way of assessing arm function in activity using kinematic Exposure Variation Analysis and portable inertial sensors—A validity study. Man. Ther. 2016, 21, 241–249. [Google Scholar] [CrossRef]
  32. Fantozzi, S.; Giovanardi, A.; Magalhaes, F.A.; Di Michele, R.; Cortesi, M.; Gatta, G. Assessment of three-dimensional joint kinematics of the upper limb during simulated swimming using wearable inertial-magnetic measurement units. J. Sports Sci. 2016, 34, 1073–1080. [Google Scholar] [CrossRef]
  33. Gil-Agudo, A.; de Los Reyes-Guzman, A.; Dimbwadyo-Terrer, I.; Penasco-Martin, B.; Bernal-Sahun, A.; Lopez-Monteagudo, P.; Del Ama-Espinosa, A.; Pons, J.L. A novel motion tracking system for evaluation of functional rehabilitation of the upper limbs. Neural Regen. Res. 2013, 8, 1773–1782. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Godwin, A.; Agnew, M.; Stevenson, J. Accuracy of inertial motion sensors in static, quasistatic, and complex dynamic motion. J. Biomech. Eng. 2009, 131, 114501. [Google Scholar] [CrossRef]
  35. Pérez, R.; Costa, Ú.; Torrent, M.; Solana, J.; Opisso, E.; Cáceres, C.; Tormos, J.M.; Medina, J.; Gómez, E.J. Upper Limb Portable Motion Analysis System Based on Inertial Technology for Neurorehabilitation Purposes. Sensors 2010, 10, 10733–10751. [Google Scholar] [CrossRef] [Green Version]
  36. Plamondon, A.; Delisle, A.; Larue, C.; Brouillette, D.; McFadden, D.; Desjardins, P.; Larivière, C. Evaluation of a hybrid system for three-dimensional measurement of trunk posture in motion. Appl. Ergon. 2007, 38, 697–712. [Google Scholar] [CrossRef] [PubMed]
  37. Robert-Lachaine, X.; Mecheri, H.; Larue, C.; Plamondon, A. Validation of inertial measurement units with an optoelectronic system for whole-body motion analysis. Med. Biol. Eng. Comput. 2016. [Google Scholar] [CrossRef] [PubMed]
  38. Schall, M.C.; Fethke, N.B.; Chen, H.; Oyama, S.; Douphrate, D.I. Accuracy and repeatability of an inertial measurement unit system for field-based occupational studies. Ergonomics 2016, 59, 591–602. [Google Scholar] [CrossRef]
  39. Zhou, H.; Hu, H. Reducing drifts in the inertial measurements of wrist and elbow positions. IEEE Trans. Instrum. Meas. 2010, 59, 575–585. [Google Scholar] [CrossRef]
  40. Jasiewicz, J.M.; Treleaven, J.; Condie, P.; Jull, G. Wireless orientation sensors: Their suitability to measure head movement for neck pain assessment. Man. Ther. 2007, 12, 380–385. [Google Scholar] [CrossRef]
  41. Lebel, K.; Boissy, P.; Nguyen, H.; Duval, C. Inertial measurement systems for segments and joints kinematics assessment: Towards an understanding of the variations in sensors accuracy. BioMed. Eng. Online 2017, 16. [Google Scholar] [CrossRef] [PubMed]
  42. Bugane, F.; Benedetti, M.G.; D’Angeli, V.; Leardini, A. Estimation of pelvis kinematics in level walking based on a single inertial sensor positioned close to the sacrum: Validation on healthy subjects with stereophotogrammetric system. Biomed. Eng. Online 2014, 13, 146. [Google Scholar] [CrossRef] [PubMed]
  43. Kumar, Y.; Yen, S.C.; Tay, A.; Lee, W.; Gao, F.; Zhao, Z.; Li, J.; Hon, B.; Tian-Ma Xu, T.; Cheong, A.; et al. Wireless wearable range-of-motion sensor system for upper and lower extremity joints: A validation study. Healthc. Technol. Lett. 2015, 2, 12–17. [Google Scholar] [CrossRef]
  44. Barraza Madrigal, J.A.; Cardiel, E.; Rogeli, P.; Leija Salas, L.; Munoz Guerrero, R. Evaluation of suitability of a micro-processing unit of motion analysis for upper limb tracking. Med. Eng. Phys. 2016, 38, 793–800. [Google Scholar] [CrossRef]
  45. Cutti, A.G.; Giovanardi, A.; Rocchi, L.; Davalli, A.; Sacchetti, R. Ambulatory measurement of shoulder and elbow kinematics through inertial and magnetic sensors. Med. Biol. Eng. Comput. 2008, 46, 169–178. [Google Scholar] [CrossRef] [PubMed]
  46. Bauer, C.M.; Rast, F.M.; Ernst, M.J.; Kool, J.; Oetiker, S.; Rissanen, S.M.; Suni, J.H.; Kankaanpaa, M. Concurrent validity and reliability of a novel wireless inertial measurement system to assess trunk movement. J. Electromyogr. Kinesiol. 2015, 25, 782–790. [Google Scholar] [CrossRef] [PubMed]
  47. Bergamini, E.; Guillon, P.; Camomilla, V.; Pillet, H.; Skalli, W.; Cappozzo, A. Trunk Inclination Estimate During the Sprint Start Using an Inertial Measurement Unit: A Validation Study. J. Appl. Biomech. 2013, 29, 622–627. [Google Scholar] [CrossRef] [PubMed]
  48. Dowling, A.V.; Favre, J.; Andriacchi, T.P. A wearable system to assess risk for anterior cruciate ligament injury during jump landing: Measurements of temporal events, jump height, and sagittal plane kinematics. J. Biomech.Eng. 2011, 133. [Google Scholar] [CrossRef] [PubMed]
  49. Ha, T.H.; Saber-Sheikh, K.; Moore, A.P.; Jones, M.P. Measurement of lumbar spine range of movement and coupled motion using inertial sensors—A protocol validity study. Man. Ther. 2013, 18, 87–91. [Google Scholar] [CrossRef] [PubMed]
  50. Leardini, A.; Lullini, G.; Giannini, S.; Berti, L.; Ortolani, M.; Caravaggi, P. Validation of the angular measurements of a new inertial-measurement-unit based rehabilitation system: Comparison with state-of-the-art gait analysis. J. Neuroeng. Rehabil. 2014, 11. [Google Scholar] [CrossRef] [PubMed]
  51. Mjøsund, H.L.; Boyle, E.; Kjaer, P.; Mieritz, R.M.; Skallgård, T.; Kent, P. Clinically acceptable agreement between the ViMove wireless motion sensor system and the Vicon motion capture system when measuring lumbar region inclination motion in the sagittal and coronal planes. BMC Musculoskelet. Disord. 2017, 18, 1–9. [Google Scholar] [CrossRef]
  52. Bolink, S.A.; Naisas, H.; Senden, R.; Essers, H.; Heyligers, I.C.; Meijer, K.; Grimm, B. Validity of an inertial measurement unit to assess pelvic orientation angles during gait, sit-stand transfers and step-up transfers: Comparison with an optoelectronic motion capture system. Med. Eng. Phys. 2016, 38, 225–231. [Google Scholar] [CrossRef]
  53. Al-Amri, M.; Nicholas, K.; Button, K.; Sparkes, V.; Sheeran, L.; Davies, J.L. Inertial Measurement Units for Clinical Movement Analysis: Reliability and Concurrent Validity. Sensors 2018, 18. [Google Scholar] [CrossRef]
  54. Bergmann, J.H.; Mayagoitia, R.E.; Smith, I.C. A portable system for collecting anatomical joint angles during stair ascent: A comparison with an optical tracking device. Dyn. Med. DM 2009, 8, 3. [Google Scholar] [CrossRef]
  55. Cloete, T.; Scheffer, C. Benchmarking of a full-body inertial motion capture system for clinical gait analysis. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vancouver, BC, Canada, 20–25 August 2008; pp. 4579–4582. [Google Scholar] [CrossRef]
  56. Saber-Sheikh, K.; Bryant, E.C.; Glazzard, C.; Hamel, A.; Lee, R.Y.W. Feasibility of using inertial sensors to assess human movement. Man. Ther. 2010, 15, 122–125. [Google Scholar] [CrossRef] [PubMed]
  57. Saito, H.; Watanabe, T. Kalman-Filtering-Based Joint Angle Measurement with Wireless Wearable Sensor System for Simplified Gait Analysis. IEICE Trans. Inf. Syst. 2011, 94, 1716–1720. [Google Scholar] [CrossRef]
  58. Takeda, R.; Tadano, S.; Natorigawa, A.; Todoh, M.; Yoshinari, S. Gait posture estimation using wearable acceleration and gyro sensors. J. Biomech. 2009, 42, 2486–2494. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  59. Zhang, J.T.; Novak, A.C.; Brouwer, B.; Li, Q. Concurrent validation of Xsens MVN measurement of lower limb joint angular kinematics. Physiol. Meas. 2013, 34, N63–N69. [Google Scholar] [CrossRef] [PubMed]
  60. Favre, J.; Jolles, B.M.; Aissaoui, R.; Aminian, K. Ambulatory measurement of 3D knee joint angle. J. Biomech. 2008, 41, 1029–1035. [Google Scholar] [CrossRef]
  61. Jaysrichai, T.; Suputtitada, A.; Khovidhungij, W. Mobile Sensor Application for Kinematic Detection of the Knees. Ann. Rehabil. Med. 2015, 39, 599–608. [Google Scholar] [CrossRef] [Green Version]
  62. Mifsud, N.L.; Kristensen, N.H.; Villumsen, M.; Hansen, J.; Kersting, U.G. Portable Inertial Motion Unit for Continuous Assessment of In-shoe Foot Movement. Procedia Eng. 2014, 72, 208–213. [Google Scholar] [CrossRef] [Green Version]
  63. Rouhani, H.; Favre, J.; Crevoisier, X.; Aminian, K. Measurement of multi-segment foot joint angles during gait using a wearable system. J. Biomech. Eng. 2012, 134. [Google Scholar] [CrossRef] [PubMed]
  64. Duc, C.; Salvia, P.; Lubansu, A.; Feipel, V.; Aminian, K. A wearable inertial system to assess the cervical spine mobility: Comparison with an optoelectronic-based motion capture evaluation. Med. Eng. Phys. 2014, 36, 49–56. [Google Scholar] [CrossRef] [PubMed]
  65. Kim, H.; Shin, S.-H.; Kim, J.-K.; Park, Y.-J.; Oh, H.-S.; Park, Y.-B. Cervical Coupling Motion Characteristics in Healthy People Using a Wireless Inertial Measurement Unit. Evid.-Based Complement. Altern. Med. 2013, 2013. [Google Scholar] [CrossRef]
  66. Schiefer, C.; Kraus, T.; Ellegast, R.P.; Ochsmann, E. A technical support tool for joint range of motion determination in functional diagnostics—An inter-rater study. J. Occup. Med. Toxicol. 2015, 10, 16. [Google Scholar] [CrossRef] [PubMed]
  67. van den Noort, J.C.; Wiertsema, S.H.; Hekman, K.M.C.; Schonhuth, C.P.; Dekker, J.; Harlaar, J. Reliability and precision of 3D wireless measurement of scapular kinematics. Med. Biol. Eng. Comput. 2014, 52, 921–931. [Google Scholar] [CrossRef] [PubMed]
  68. Yun, W.-S.; Kim, H.; Ahn, J.H.; Park, Y.-B.; Park, Y.-J. Individual characteristics of reliable lumbar coupling motions. Eur. Spine J. 2015, 24, 1917–1925. [Google Scholar] [CrossRef] [PubMed]
  69. Roy, J.-S.; Desmeules, F.; Frémont, P.; Dionne, C.; MacDermid, J. L’évaluation Clinique, les Traitements et le Retour en Emploi de Travailleurs Souffrant D’atteintes de la Coiffe des Rotateurs—Bilan des Connaissances; R-885; Institut de Recherche Robert-Sauvé en Santé et en Sécurité du Travail (IRSST): Montréal, QC, Canada, 2015. [Google Scholar]
  70. Porciuncula, F.; Roto, A.V.; Kumar, D.; Davis, I.; Roy, S.; Walsh, C.J.; Awad, L.N. Wearable Movement Sensors for Rehabilitation: A Focused Review of Technological and Clinical Advances. PM&R 2018, 10, S220–S232. [Google Scholar] [CrossRef]
  71. Hermens, H.J.; Freriks, B.; Merletti, R.; Stegeman, D.; Blok, J.; Rau, G.; Disselhorst-Klug, C.; Hägg, G. SENIAM: European Recommendations for Surface Electromyography: Results of the SENIAM Project; Roessingh Research and Development: Enschede, The Netherlands, 1999. [Google Scholar]
Sensors 19 01555 g001 550
Figure 1. Sensors placement example, (a) front view, (b) back view.
Figure 1. Sensors placement example, (a) front view, (b) back view.
Sensors 19 01555 g001
Sensors 19 01555 g002 550
Figure 2. Flow chart of systematic review process.
Figure 2. Flow chart of systematic review process.
Sensors 19 01555 g002
Table
Table 1. Synthesis of overall quality and body of evidence by joint.
Table 1. Synthesis of overall quality and body of evidence by joint.
JointValidity: Number of ArticlesReliability: Number of ArticlesCOSMIN
Quality Evidence – Validity		COSMIN
Quality Evidence – Reliability		MacDermid Quality Evidence – ValidityMacDermid
Quality Evidence – Reliability		Body of Evidence – ValidityBody of Evidence – Reliability
Neck531 MQ
3 LQ
1 VLQ		1 HQ
1 MQ
1 LQ		1 HQ
2 MQ
2 LQ		1 HQ
2 MQ		ModerateModerate
Scapula01N/A1 HQN/A1 HQN/ALimited
Shoulder1221 HQ
3 MQ
7 LQ
1 VLQ		1 MQ
1 LQ		1 HQ
7 MQ
4 LQ		1 HQ
1 MQ		Conflicting evidenceModerate
Elbow1021 HQ
3 MQ
5 LQ
1 LQ		1 MQ
1 LQ		1 HQ
5 MQ
4 LQ		1 HQ
1 MQ		Conflicting evidenceConflicting evidence
Wrist622 MQ
4 LQ		1 MQ
1 LQ		1 HQ
3 MQ
2 LQ		1 HQ
1 MQ		ModerateModerate
Trunk1131 HQ
4 MQ
5 LQ
1 VLQ		1 MQ
2 LQ		4 HQ
6 MQ
1 LQ		2 HQ
1 MQ		StrongModerate
Pelvis614 MQ
2 LQ		1 HQ3 HQ
3 MQ		1 HQStrongLimited
Hip1332 HQ
3 MQ
8 LQ		1 HQ
1 MQ
1 LQ		2 HQ
8 MQ
3 LQ		1 HQ
2 MQ		StrongModerate
Knee1532 HQ
3 MQ
10 LQ		1 HQ
2 MQ		3 HQ
9 MQ
3 LQ		1 HQ
2 MQ		StrongModerate
Ankle1133 HQ
2 MQ
6 LQ		3 HQ3 HQ
6 MQ
2 LQ		2 HQ
1 MQ		StrongModerate
HQ = high quality; MQ = moderate quality; LQ = low quality; VLQ = very low quality; N/A = not applicable.

Share and Cite

MDPI and ACS Style

Poitras, I.; Dupuis, F.; Bielmann, M.; Campeau-Lecours, A.; Mercier, C.; Bouyer, L.J.; Roy, J.-S. Validity and Reliability of Wearable Sensors for Joint Angle Estimation: A Systematic Review. Sensors 2019, 19, 1555. https://doi.org/10.3390/s19071555

AMA Style

Poitras I, Dupuis F, Bielmann M, Campeau-Lecours A, Mercier C, Bouyer LJ, Roy J-S. Validity and Reliability of Wearable Sensors for Joint Angle Estimation: A Systematic Review. Sensors. 2019; 19(7):1555. https://doi.org/10.3390/s19071555

Chicago/Turabian Style

Poitras, Isabelle, Frédérique Dupuis, Mathieu Bielmann, Alexandre Campeau-Lecours, Catherine Mercier, Laurent J. Bouyer, and Jean-Sébastien Roy. 2019. "Validity and Reliability of Wearable Sensors for Joint Angle Estimation: A Systematic Review" Sensors 19, no. 7: 1555. https://doi.org/10.3390/s19071555

APA Style

Poitras, I., Dupuis, F., Bielmann, M., Campeau-Lecours, A., Mercier, C., Bouyer, L. J., & Roy, J. -S. (2019). Validity and Reliability of Wearable Sensors for Joint Angle Estimation: A Systematic Review. Sensors, 19(7), 1555. https://doi.org/10.3390/s19071555

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop