Next Article in Journal
A Video Summarization Model Based on Deep Reinforcement Learning with Long-Term Dependency
Next Article in Special Issue
Upper Limb Kinematics of Handwriting among Children with and without Developmental Coordination Disorder
Previous Article in Journal
Development of Low Hysteresis, Linear Weft-Knitted Strain Sensors for Smart Textile Applications
Previous Article in Special Issue
Novel Planar Strain Sensor Design for Capturing 3-Dimensional Fingertip Forces from Patients Affected by Hand Paralysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Trunk Posture from Randomly Oriented Accelerometers

by
Aidan R. W. Friederich
1,2,*,
Musa L. Audu
1,2 and
Ronald J. Triolo
1,2
1
Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH 44106, USA
2
Advanced Platform Technology Center, Louis Stokes Veterans Affairs Hospital, Cleveland, OH 44106, USA
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(19), 7690; https://doi.org/10.3390/s22197690
Submission received: 31 August 2022 / Revised: 30 September 2022 / Accepted: 3 October 2022 / Published: 10 October 2022
(This article belongs to the Special Issue Biomedical Sensing for Human Motion Monitoring)

Abstract

:
Feedback control of functional neuromuscular stimulation has the potential to improve daily function for individuals with spinal cord injuries (SCIs) by enhancing seated stability. Our fully implanted networked neuroprosthesis (NNP) can provide real-time feedback signals for controlling the trunk through accelerometers embedded in modules distributed throughout the trunk. Typically, inertial sensors are aligned with the relevant body segment. However, NNP implanted modules are placed according to surgical constraints and their precise locations and orientations are generally unknown. We have developed a method for calibrating multiple randomly oriented accelerometers and fusing their signals into a measure of trunk orientation. Six accelerometers were externally attached in random orientations to the trunks of six individuals with SCI. Calibration with an optical motion capture system resulted in RMSE below 5° and correlation coefficients above 0.97. Calibration with a handheld goniometer resulted in RMSE of 7° and correlation coefficients above 0.93. Our method can obtain trunk orientation from a network of sensors without a priori knowledge of their relationships to the body anatomical axes. The results of this study will be invaluable in the design of feedback control systems for stabilizing the trunk of individuals with SCI in combination with the NNP implanted technology.

1. Introduction

Individuals with paralysis have been able to regain various functions with functional neuromuscular stimulation (FNS), which is the process of applying small electrical currents to peripheral nerves to elicit muscle contraction from the otherwise paralyzed muscles. Through FNS, people with Spinal Cord Injury (SCI) have been given new options to stand and step [1,2], bike [3,4], row [5], maintain upright seated posture [6], and perform reaching activities [7,8]. For review see Karamian et al. [9] or Marquez et al. [10]. Many of these achievements have been accomplished with open loop control where fixed temporal patterns of stimulation parameters are predetermined to realize a specific movement. For example, cycling controllers [11] apply the same set of stimulation pulse amplitudes, durations, and frequencies as a function of crank angle regardless of cadence or number of repetitions. Stereotypical feed-forward controls tend to be blind to internally generated or externally applied disturbances that can destabilize the system. Perturbations, such as trips during walking, bumps while seated, and fatigue while cycling or rowing can degrade performance and user confidence. Incorporating feedback control allows the system to compensate for perturbations by modifying the stimulation commands based on the current system state.
Restoration of trunk stability has been consistently rated highly for those with SCI [12,13,14]. Feedforward control of FNS applied to contract the hip and trunk musculature can expand reaching area [15] and improve wheelchair propulsion efficiency [16]. Yet, seated stability remains an attractive target for feedback control. Incorporating feedback control to maintain seated posture and balance has enabled individuals with SCI to resist both externally applied and internally generated perturbations [17,18,19]. Further advancements for such systems could enable leaning postures that expand the seated workspace and enhance a user’s ability to exert control over objects in the environment otherwise inaccessible from the wheelchair. Incorporating feedback control can provide additional benefits, but requires an accurate measure of the current system state. Inertial measurement units (IMU) are a promising choice for providing this information due to their small size and our ability to accurately infer joint angles from multiple sensors [20]. IMUs are often composed of accelerometers that measure linear accelerations, gyroscopes that measure rotational velocity, and magnetometers to derive heading from the global magnetosphere. All three component signals can then be fused into a measure of sensor orientation [21]. However, these sensor fusion methods are subject to random drift from the integration of the gyroscopic data [22] and ferromagnetic disturbances to the magnetometer readings [23]. Previous integration of IMUs in feedback control of trunk posture has been achieved with an externally-mounted 3-axis accelerometer placed on the chest or the back [18,19,24] to reflect tilt based on the consistent gravity vector compared to the inclined accelerometer coordinate frame. To obtain relevant measures of trunk orientation, the sensor was carefully aligned with the anatomical axes of the body. Such reliance on accurate sensor placement could complicate donning and doffing, thereby making feedback control systems for daily use outside of the laboratory difficult.
Recently, IMUs have been incorporated into a fully implanted neuroprosthesis developed at Case Western Reserve University in Cleveland (Clinical Trial: NCT02329652) [25,26]. Termed the Networked Neuroprosthesis (NNP), it is composed of a network of connected “remote modules” attached to a central “power module” that contains the battery that powers the entire system and the electronic hardware that mediates data processing and radio communication with the outside world. The remote modules can either generate stimulus pulses or record biopotentials through separate electrodes placed near the anatomical targets. Crucially, each remote module also contains a 3-axis accelerometer, allowing the possibility of a fully implanted feedback control system for seated posture without the need to don external sensors. The implanted accelerometers have been shown to be sensitive to trunk tilt [26], and the accuracy of those measurements is currently an ongoing topic of investigation. As an added benefit, the quantitative measures of trunk orientation either from IMUs, motion capture, or other means is valuable for assessing postural control after SCI [27,28,29]. Being able to obtain a reliable measure of postural biomechanics from an implanted system could provide long-term postural information to aid in the rehabilitation and treatment of SCI.
Obtaining relevant tilt information requires knowledge of the orientation of the accelerometer, typically obtained by aligning the coordinate frames of the sensor and the object of interest. Previous studies of trunk posture have placed the IMUs on the lower lumbar spine [30,31], the sternum [32], and various positions on the back, including at the T10 [33], T4 [34], or T1 vertebra [35]. These studies have all attempted to align the sensor with the body anatomic axes, such that its pitch output refers to trunk extension and flexion and roll refers to trunk lateral bending. However, placement of the NNP remote modules is determined by the surgeon during implantation when they suture the remote modules to the underlying tissue and, thus, the orientation of each sensor is not specifically set to meet any anatomic orientation requirements and is unique to each recipient (Figure 1). For surgeons to precisely align and suture the remote modules in specific orientation would require additional time and complicate an already complex and time-consuming surgery. Moreover, there is no guarantee the remote modules would remain aligned with the anatomy post-surgery as the recipient resumes an upright posture and their daily seated activities. Any movement of modules will be minimized once the individual is fully healed, and the modules are encapsulated in the body tissue. Although obtaining module orientation post-implantation through imaging is possible, it would require multiple images across multiple implant sites and sophisticated image processing to relate them to the anatomy in three dimensions. A simpler method of calibrating and fusing the contributions of multiple potentially inaccurate sensors into one global trunk orientation signal is clearly needed to facilitate eventual clinical deployment of the NNP.
In this study, we have developed and verified a method of calibrating and fusing signals from multiple accelerometers with unknown orientations into an accurate measure of trunk posture. The method first aligns the sensor signals with the body anatomic axes, then converts the signals to sensor pitch and roll, and finally fuses them into a single measure of overall trunk orientation. The process can be completed with either a motion capture system for high fidelity or an inexpensive handheld goniometer common in clinical settings for at home applications.

2. Materials and Methods

2.1. Participants

Six individuals with SCI participated in this study. We recruited individuals with SCI to closely reflect the targeted population of potential recipients of the NNP for trunk control applications. Able-bodied subjects were not considered because SCI significantly alters both the active and passive mechanics of the paralyzed muscles and, thus, the biomechanics of the trunk [36]. Subject neurological and anthropometric characteristics are presented in Table 1. Participants were informed of all aspects of the experiment and subsequently signed consent forms approved by the local institutional review board (IRB: VA Northeast Ohio Healthcare System, Protocol Number: 1591730, Approval Date: 7 February 2021).

2.2. Experiment Setup

We placed six 3-axis accelerometers (Trigno Avanti, Delsys Inc., Natick, MA, USA) with double sided tape in the general vicinity to where the NNP remote modules would be implanted in the trunk [26] as informed by the first recipients of the prototype system. These included both right and left sides of the chest and the front and rear abdomen. Figure 2 shows the accelerometer placement. Sensors were placed in random unquantified orientations and their precise locations were not recorded beyond their general vicinity. The case dimensions of the Delsys accelerometer casing is 27 × 37 × 15 mm compared to the remote module casing of 55 × 15 × 5 mm [26]. However, within the casings the accelerometers are roughly 3 × 3 mm. In addition, reflective markers were placed on the C7 vertebrae, sacrum, and bilaterally on the acromion of the scapula, greater trochanter of the femur, middle of the upper arm, the lateral and medial epicondyle of the elbow, and the anterior superior iliac spine of the pelvis. Accelerometer data were transmitted wirelessly to the Trigno Base System that relayed these signals through an analog connection to a Speedgoat real-time computer (Performance real-time target machine, Speedgoat, Switzerland). The Speedgoat system sampled the data at 100 Hz with a custom Simulink model (Mathworks, Natick, MA, USA). At the beginning of each trial the Simulink model sent a +3.3 V pulse through the Speedgoat digital output block to the motion capture system to synchronize the signals from the two systems. Trunk kinematics were obtained from a 16-camera motion capture system sampling the marker positions at 100 Hz (Vicon Motion Systems Ltd., Oxford, UK). Once the sensors and markers were placed, the participant sat on an examination table situated in the middle of the work volume of the motion capture system.

2.3. Motion Capture Calibration

Subjects started in an upright posture for five seconds and proceeded to move to 30° in forward trunk flexion, right bending, trunk extension, and left bending for five seconds each. Each change in posture was separated by returning upright for five seconds. Figure 3 contains a flowchart of the experimental procedure. Subjects were allowed to use their arms or the help of an experimenter to support themselves during these movements. A full completion of the sequence of all movements was considered a single trial. The movement sequence was repeated 10 times, with half intended for the calibration process and the other half for testing. An experimenter first demonstrated the movement pattern, and the subjects were allowed to practice as many times as necessary until they felt comfortable and competent in its performance. During practice, a medical goniometer was set at 30° as a reference. During the recorded movements, the 30° target was not strictly enforced as the motion capture system recorded the true angles.
The computational aspect of the calibration process entailed three main steps shown in Figure 4. These steps were performed separately for each subject, as the sensor orientation was unique to each subject. First, the accelerometer signals were rotated to align the local sensor coordinate frame with the body coordinate frame. Second, the linear accelerations along the three axes of each sensor were converted to sensor pitch and roll angles. Finally, the pitch and roll angles from all six sensors were fused into a single measure of trunk pitch and roll.
Equations (1)–(3) show the conventional rotation matrices which will transform a vector by ϕ , θ , ψ about the axes x, y, and z, respectively.
R x ( ϕ ) = 1 0 0 0 c o s ( ϕ ) s i n ( ϕ ) 0 s i n ( ϕ ) c o s ( ϕ )
R y ( θ ) = c o s ( θ ) 0 s i n ( θ ) 0 1 0 s i n ( θ ) 0 c o s ( θ )
R z ( ψ ) = c o s ( ψ ) s i n ( ψ ) 0 s i n ( ψ ) c o s ( ψ ) 0 0 0 1
Multiplying the three rotation matrices creates at rotation matrix (Equation (4)) capable of transforming a vector into any orientation.
R ( ϕ , θ , ψ ) = R x ( ϕ ) R y ( θ ) R z ( ψ )
R ( ϕ , θ , ψ ) was then multiplied by the raw acceleration signals to obtain a rotated acceleration vector (Equation (5)).
a r o t , x a r o t , y a r o t , z = R ( ϕ , θ , ψ ) a r a w , x a r a w , y a r a w , z
If the correct rotation angles ( ϕ , θ , ψ ) are chosen the rotated accelerometer coordinate frame will align with the anatomic axes of the body. To determine the correct rotation angles, we first converted the rotated signals to pitch and roll angles corresponding to the orientation of the subject’s trunk with Equations (6) and (7). Optimization was performed jointly on Equations (6) and (7) with a non-linear curve-fitting algorithm in a least-squares sense with the Matlab function lsqcurvefit. Sensor pitch and roll angles were optimized to fit trunk pitch and roll angles obtained from the movement trials marked as training data. These gold-standard trunk pitch and roll angles were determined from motion capture as the angle between the global reference frame and the line defined between the sacrum and C7 marker [37]. The variables optimized were ϕ , θ , and ψ from Equation (4). Lower bounds were set to 0 and upper bounds were set to 2 π . As this is a quasi-static analysis, the accelerometer has only two degrees of freedom because we assume the magnitude of the acceleration vector equals 1 g. As a result, the optimization often found local minima. To find a global minimum a MultiStart algorithm was used to generate multiple initial conditions [38]. This process was applied to each sensor separately.
R o l l = t a n 1 a r o t , y a r o t , z
P i t c h = t a n 1 a r o t , x ( a r o o t , y 2 + a r o t , z 2 )
Once the signals from each accelerometer were aligned with the trunk anatomic axis and converted to pitch and roll angles, the angles from all the six accelerometers were fused with one of two algorithms. The first, shown in Equation (8), was a weighted average function where the angle ( a k ) was multiplied with a weighting parameter ( w k ). The angles from each accelerometer are then summed and divided by the sum of the weights. The second method employed a Townsend algorithm [39], defined by Equation (9), which was originally derived to fuse heart rate signals from multiple sources in a hospital setting. Fused pitch and roll angles were optimized to minimize least-squares error between the trunk pitch and roll angles obtained from the motion capture during the training movements through a second optimization with a non-linear curve-fitting algorithm in a least-squares sense with the Matlab function lsqcurvefit. The variables optimized were the weights (w) in Equation (8) and weights ( σ ) in Equation (9). Lower bounds were set to 0 and upper bounds were set to 1 for the weights (w) in Equation (8). Lower bounds were set to −1 and upper bounds were set to 1 for the weights ( σ ) in Equation (9). The second optimization acts both to reduce overall error and as an objective method for choosing the sensors that best reflect the pitch and roll angles.
a ¯ = k = 1 n ( a k ) · w k k = 1 n w k
a ¯ = k = 1 n i = 1 , i k n σ i 2 i = 1 n ( j = 1 , j i n σ j 2 ) · a k

2.4. Clinical Calibration

For the eventual clinical implementation and widespread dissemination of the seated balance controllers we envisage for NNP recipients, it should be possible to perform the calibration and fusion process outside of a laboratory with expensive motion capture capabilities. We, therefore, explored the possibility of utilizing only equipment typically available in a clinical or home setting. Instead of optimizing the calibration constants to match gold-standard motion capture data, we used a conventional commercially available medical goniometer to assess the various trunk postures. Each subject assumed five postures, lasting 10 s each, while data were collected from each accelerometer. The five postures set via the goniometer were: upright sitting, 30° trunk flexion, 30° right bending, 30° trunk extension, and 30° left bending. Each posture was assumed once. Figure 3 contains a flowchart of the experimental procedure.
The training data were set as the first 2.5 s of each posture and remaining time was discarded. Testing data were the same testing trials collected from the motion caption calibration. The first 2.5 s from each posture were collated into a single matrix. Each timepoint was paired with the target angles set by the goniometer. For example, the data from upright sitting would be paired with 0° pitch and 0° roll angles; the data from 30° trunk flexion would be paired with 30° pitch and 0° roll angles. The same least squares optimization described earlier was applied to the data to determine the angles from Equation (4) by minimizing the error between the targeted posture measured with the goniometer and those indicated by the accelerometers. The optimization process was the same as reported in Section 2.3 above. A second optimization was performed with the fusion Equations (8) and (9) to optimize the weights (w, σ) that minimized the error between the targeted posture measured with the goniometer and those indicated by the now fused accelerometers.

2.5. Experiment Data Analysis and Statistics

After optimization, both the motion capture and clinical calibration algorithms were verified with the movement trials set aside for testing from the motion capture calibration section. Measures of trunk position were compared to the motion capture of those same movements with root mean squared error (RMSE) and correlation coefficients (r).

3. Results

3.1. Motion Capture Calibration

All subjects were able to reach the desired angles with the help of the experimenter or their upper extremities. No fatigue was observed during the movements. All of the subjects had some residual upper extremity function to aid in these movements. The average flexion, extension, right bending, and left bending angles were 37.8 ± 7.1°, −38.9 ± 10.9°, −45.3 ± 6.4°, and 45.5 ± 8.3°, respectively. Figure 5 shows the fused signals over a movement trial for all subjects. Both the weighted average and the Townsend algorithms tracked the target gold standard derived from the motion capture. An offset was present during the dwell stages of the movements. This occurred to the greatest degree during the flexion movements of S2, S3, and S4 with the maximum offset hovering around 10°.
The correlation coefficients (r) and root mean squared errors (RMSE) for the motion capture calibration are shown in Table 2. The r values for the weighted average equation ranged from 0.96 to 0.99 with the average being 0.98 ± 0.014 and 0.99 ± 0.004 for the pitch and roll directions, respectively. Those for the Townsend equation ranged from 0.94 to 0.99 with the average being 0.97 ± 0.019 and 0.99 ± 0.003 for the pitch and roll directions, respectively. The RMSE values for weighted average equation ranged from 2.12 to 5.1° with an average value of 4.01 ± 0.78° and 2.96 ± 0.78° for the pitch and roll directions, respectively. Those for Townsend equation ranged from 2.16 to 5.12° with an average value of 4.26 ± 0.86° and 3.03 ± 0.82° for the pitch and roll directions, respectively.
To determine which sensors were prioritized by the calibration process we plotted the relative weights of each sensor for each subject in Figure 6. The algorithm incorporated information from between two to five sensors. No obvious trends appeared in these data.

3.2. Clinical Calibration

Figure 7 shows the fused signals over a movement trial for all subjects. Both the weighted average and the Townsend algorithms track the target gold standard derived from the motion capture. The clinical calibration method was still able to track trunk movement, however with greater errors especially evident in the dwell stages of movement.
The correlation coefficient (r) and root mean squared error (RMSE) for the clinical lab calibration are shown in Table 3. The r values for the weighted average equation ranged from 0.85 to 0.98, with the average being 0.93 ± 0.045 and 0.97 ± 0.024 for the pitch and roll directions, respectively. Those for the Townsend equation ranged from 0.85 to 0.98 with the average being 0.93 ± 0.045 and 0.97 ± 0.024 for the pitch and roll directions, respectively. The RMSE values for weighted average equation ranged from 3.63 to 9.57° with an average value of 7.14 ± 1.62° and 6.86 ± 2.14° for the pitch and roll directions, respectively. Those for Townsend equation ranged from 3.63 to 9.57° with an average value of 7.15 ± 1.62° and 6.86 ± 2.14° for the pitch and roll directions, respectively.

4. Discussion

An accurate measure of trunk orientation is a necessary component for robust design of feedback control systems for trunk stabilization with FNS after SCI. Current feedback control systems rely on a signal obtained from a single accelerometer sensor placed externally on the trunk. This process requires the user to don and doff the sensor, which could result in inconsistent placement from day to day. The implanted accelerometers from the NNP are capable of providing a feedback signal, however the location and orientation of these sensors are arbitrary as dictated by surgical constraints. In this paper, we have developed a method of fusing signals from multiple sensors with unknown orientations and locations into a single measure of trunk posture. Although the NNP is the inspiration for this study, the methods developed here would be applicable to applications determining trunk orientation from multiple sensors (implanted or surface mounted) without prior knowledge of their orientation relative to the body.
The motion capture calibration method shown here results in high correlation coefficients above 0.97 and RMSE values below 5°. These results are similar to other studies that measure trunk orientation which found errors ranging from 1 to 5° and correlation coefficients from 0.74 to 0.95 (Table 4) [30,31,32,33,34,35]. Two methods for fusing the sensor signals were explored: weighted average and Townsend equation. There were only minor differences, of the order of a tenth of a degree for the RMSE, between the two. As a result, either of these equations would be viable as a sensor fusion algorithm. We recommend the weighted average as implementation was simpler and the weights provide a more intuitive understanding of the relative importance of each sensor. To fuse six sensors, the weighted average equation has 17 computational operations compared to the Townsend equation with 425 operations, which could impact real time implementation. The Townsend equation was originally designed to combine different measures of heart rate by weighting them based on their residual error [39]. In this study, only the equation structure was used and the constants were determined through optimization. Future work could explore methods for predicting a sensor’s error through characterization of the noise or a Kalman filter. The Townsend equation could then be employed with constants based on predicted error at each time point.
The fidelity of the clinical calibration method was less than the motion capture calibration. With errors of 7° exceeding 20% of the targeted 30° leaning postures. We expected greater errors, as optimizing the algorithm directly to the target measurement will always yield better results when compared to optimizing based on a proxy measurement. Nonetheless, the clinical calibration indicates that this procedure can be performed with minimal materials, only requiring a hand-held goniometer to measure trunk orientation, adequately trained staff or caregivers, and a computer to record the signals and perform the optimizations. The process is simple enough that, with proper training, it could be performed at home by the NNP users or their caregivers and all computations carried out with the smartphone application that will be provided to all recipients [26]. Possibly, the motion capture calibration could be performed initially and if there is any signal degradation, the home calibration could be performed to fine-tune the initially derived constants.
During calibration, we determined each sensor’s pitch and roll angle by measuring the inclination of the gravity vector. This method assumes the accelerations from any movement are small. Figure 5c shows that at times where the subject is initiating movement and accelerating to a new position, the resulting sensor signals show greater fluctuations compared to dwell postures. Luinge et al. [34] addressed the body accelerations with a Kalman filter designed to differentiate body accelerations from gravity, which reduced RMSE of trunk orientation from 3 to 2°. We assumed trunk accelerations will be relatively low during seated activities, such as leaning. However, for high acceleration tasks, inclination Equations 6 and 7 could be replaced with a Kalman filter. The remaining calibration process could remain unchanged.
We found RMSE of below 5 and 8° for the motion capture and clinical calibration methods respectively. Crago et al. suggested that resolutions of 5, 3, and 5° would be acceptable for control of the hip, knee, and ankle during walking [40]. Feedback control of trunk movements likely requires less fidelity than walking as a seated posture is inherently more stable than standing. Assuming a trunk length of 50 cm (S1 to Posterior Superior Iliac Spine [41]) and a leaning target of 30° pitch, the C7 vertebrae would be extended 25 cm. If, for example, there was an error of −10° over double the error observed in this study, then the C7 vertebrae would be extended 17 cm. In this case, the workspace of the user would still be significantly extended, and the individual would be able to compensate with their upper extremities. If, instead, the offset was positive, the individual would be dwelling farther away from upright thus extending their workspace at the expense of requiring greater muscle forces. The errors observed here tended to undershoot the orientation of the trunk (Figure 5). Additionally, a controller could be envisioned that only activates once the user assumes their desired posture. This would account for possible inaccuracies and allow the user to set the posture based on the task at hand. Future work should incorporate the calibration method in feedback control of seated balance. Previous trunk-based feedback control systems have relied on a single accelerometer placed at C7 [18,19]. The algorithm shown here has the same outputs as the single accelerometer from previous studies. Therefore, we predict that multiple accelerometers with calibration could directly replace the single accelerometer without detriment to the controller.

Limitations and Future Work

A limitation of this sensor fusion method is the inability to measure axial rotation of the trunk. Our quasi-static analysis determined trunk pitch and roll based on the inclination of the gravity vector. The accelerometers are blind to axial rotations because there is no change in accelerometer signal while the accelerometer is rotated about the gravity vector. The majority of IMUs are also equipped with a gyroscope to address this deficiency by measuring angular velocity. Currently, the NNP only contains accelerometers and adding gyroscopes to future incarnations of the system would allow for measurement of axial rotation. However, the addition would likely have a minimal effect on the accuracy of trunk pitch and roll angles. Luige et al. was able to determine trunk orientation from only a three-axis accelerometer with 2° RMSE [34]. A later addition of a gyroscope to their method did not result in a substantial change of accuracy [33]. Another advantage of using only accelerometers is the potential reduction in power demand. In a full IMU the accelerometer requires 5% of the power consumption, gyroscope 80%, and magnetometer 7% [20]. Even running six accelerometers simultaneously would result in less power consumption compared to a single gyroscope.
The calibration method here was only tested with individuals with SCI, as a paralyzed trunk represents a more difficult test scenario and the most relevant. There is no reason to believe this method would not work in the able-bodied population as well. However, proof in individuals with SCI is all that is required to move forward with implanted sensors for trunk control. Additionally, our sample size was small (N = 6) and skewed older. This study represents an initial proof of concept, and the calibration process will be applied to future individuals who receive a trunk-based neuroprosthesis, thus increasing the sample size over time. Increasing the sample size will help confirm the generalizability of this method. However, we only need to generalize to individuals that would benefit from improved seated balance, which we specifically targeted in this study.
The reliability of these measurements over the course of hours or multiple days was not determined in this study. Instead, the focus was on developing the fusing process. IMU drift occurs from integrating gyroscope data that results in a random errors as the integration amplifies noise [22,42]. Due to the lack of gyroscopes in this analysis our method may be less sensitive to the sources of random drift. Accelerometers are also known to be temperature dependent [43]. We do not expect this to be an issue with an implanted sensor, as there will be little temperature variation inside the body. However, these assumptions and the sensor fusion process need to be tested in a recipient of the NNP system. The quality of trunk orientation measurements will need to be assessed over the course of multiple days and months to see how often the system needs re-calibration.

5. Conclusions

We have shown a method of determining trunk posture from multiple externally placed accelerometers with random orientation and location. The procedure is developed with considerations for future clinical implementation that contains multiple implanted accelerometers placed in unknown orientations due to surgical constraints. The procedure can be calibrated either with a motion capture system to obtain measures of trunk pitch and roll with under 5° RMSE and correlation coefficients above 0.97 or using tools typically available in the clinical or home settings to obtain calibrations with RMSE under 8° and correlation coefficients above 0.93. Once the process is implemented with a subject with implanted sensors, the feedback signal can be employed in trunk control systems to resist internal or external perturbations and facilitate leaning movements, thus eventually providing more options for people with SCI using FNS for trunk stability.

Author Contributions

Conceptualization, A.R.W.F., M.L.A. and R.J.T.; methodology, A.R.W.F.; software, A.R.W.F.; validation, A.R.W.F.; formal analysis, A.R.W.F.; investigation, A.R.W.F. and M.L.A.; resources, M.L.A. and R.J.T.; data curation, A.R.W.F., M.L.A. and R.J.T.; writing—original draft preparation, A.R.W.F.; writing—review and editing, A.R.W.F., M.L.A. and R.J.T.; visualization, A.R.W.F.; supervision, M.L.A. and R.J.T.; project administration, M.L.A. and R.J.T.; funding acquisition, M.L.A. and R.J.T. All authors have read and agreed to the published version of the manuscript.

Funding

Research reported in this publication was supported by the National Institutes of Neurological Disorders and Stroke of the National Institutes of Health under Award Number R01NS101043 and the National Institute of Biomedical Imaging and Bioengineering of the National Institutes of Health under award number T32EB004314. The research was supported by the Department of Defense, SCIR Program (Grant SC210292). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or the Department of Defense. The research was conducted with the support of facilities located at the Advanced Platform Technology Center in the Louis Stokes Cleveland VA Medical Center, Cleveland, OH, USA.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of VA Northeast Ohio Healthcare System (Protocol Number: 1591730, Approval Date: 7 February 2021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study. All participants read and signed photo and video release forms.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to source data participant consent limitations.

Acknowledgments

The authors would like to thank the subjects for participating in this study and Lisa M. Lombardo and Kevin M. Foglyano for assistance in the experiments.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
FNSFunctional Neuromuscular Stimulation
SCISpinal Cord Injury
AISAmerican Spinal Injury Association Impairment Score
NNPNetworked Neuroprosthesis
IMUInertial Measurement Unit
RMSERoot Mean Squared Error
rCorrelation Coefficient

References

  1. Hardin, E.; Kobetic, R.; Murray, L.; Corado-Ahmed, M.; Pinault, G.; Sakai, J.; Bailey, S.N.; Ho, C.; Triolo, R.J. Walking after incomplete spinal cord injury using an implanted FES system: A case report. J. Rehabil. Res. Dev. 2007, 44, 333. [Google Scholar] [CrossRef] [PubMed]
  2. Thrasher, T.A.; Popovic, M.R. Functional electrical stimulation of walking: Function, exercise and rehabilitation. In Annales de Réadaptation et de Médecine Physique; Elsevier Masson: Paris, France, 2008; Volume 51, pp. 452–460. [Google Scholar]
  3. Hasnan, N.; Ektas, N.; Tanhoffer, A.; Tanhoffer, R.; Fornusek, C.; Middleton, J.W.; Husain, R.; Davis, G.M. Exercise responses during functional electrical stimulation cycling in individuals with spinal cord injury. Med. Sci. Sports Exerc. 2013, 45, 1131–1138. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Gelenitis, K.; Foglyano, K.; Lombardo, L.; Triolo, R. Selective neural stimulation methods improve cycling exercise performance after spinal cord injury: A case series. J. Neuroeng. Rehabil. 2021, 18, 1–14. [Google Scholar] [CrossRef]
  5. Andrews, B.; Gibbons, R.; Wheeler, G. Development of functional electrical stimulation rowing: The Rowstim series. Artif. Organs 2017, 41, E203–E212. [Google Scholar] [CrossRef] [PubMed]
  6. Triolo, R.J.; Bailey, S.N.; Miller, M.E.; Lombardo, L.M.; Audu, M.L. Effects of stimulating hip and trunk muscles on seated stability, posture, and reach after spinal cord injury. Arch. Phys. Med. Rehabil. 2013, 94, 1766–1775. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Schearer, E.M.; Liao, Y.W.; Perreault, E.J.; Tresch, M.C.; Memberg, W.D.; Kirsch, R.F.; Lynch, K.M. Multi-muscle FES force control of the human arm for arbitrary goals. IEEE Trans. Neural Syst. Rehabil. Eng. 2013, 22, 654–663. [Google Scholar] [CrossRef] [Green Version]
  8. Kapadia, N.M.; Bagher, S.; Popovic, M.R. Influence of different rehabilitation therapy models on patient outcomes: Hand function therapy in individuals with incomplete SCI. J. Spinal Cord Med. 2014, 37, 734–743. [Google Scholar] [CrossRef] [Green Version]
  9. Karamian, B.A.; Siegel, N.; Nourie, B.; Serruya, M.D.; Heary, R.F.; Harrop, J.S.; Vaccaro, A.R. The role of electrical stimulation for rehabilitation and regeneration after spinal cord injury. J. Orthop. Traumatol. 2022, 23, 1–17. [Google Scholar] [CrossRef]
  10. Marquez-Chin, C.; Popovic, M.R. Functional electrical stimulation therapy for restoration of motor function after spinal cord injury and stroke: A review. Biomed. Eng. Online 2020, 19, 1–25. [Google Scholar] [CrossRef]
  11. McDaniel, J.; Lombardo, L.M.; Foglyano, K.M.; Marasco, P.D.; Triolo, R.J. Setting the pace: Insights and advancements gained while preparing for an FES bike race. J. Neuroeng. Rehabil. 2017, 14, 1–8. [Google Scholar] [CrossRef]
  12. Anderson, K.D. Targeting recovery: Priorities of the spinal cord-injured population. J. Neurotrauma 2004, 21, 1371–1383. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Collinger, J.L.; Boninger, M.L.; Bruns, T.M.; Curley, K.; Wang, W.; Weber, D.J. Functional priorities, assistive technology, and brain-computer interfaces after spinal cord injury. J. Rehabil. Res. Dev. 2013, 50, 145. [Google Scholar] [CrossRef] [PubMed]
  14. Huh, S.; Ko, H.Y. Recovery target priorities of people with spinal cord injuries in Korea compared with other countries: A survey. Spinal Cord 2020, 58, 998–1003. [Google Scholar] [CrossRef] [PubMed]
  15. Kukke, S.N.; Triolo, R.J. The effects of trunk stimulation on bimanual seated workspace. IEEE Trans. Neural Syst. Rehabil. Eng. 2004, 12, 177–185. [Google Scholar] [CrossRef]
  16. Triolo, R.J.; Bailey, S.N.; Lombardo, L.M.; Miller, M.E.; Foglyano, K.; Audu, M.L. Effects of intramuscular trunk stimulation on manual wheelchair propulsion mechanics in 6 subjects with spinal cord injury. Arch. Phys. Med. Rehabil. 2013, 94, 1997–2005. [Google Scholar] [CrossRef] [Green Version]
  17. Vanoncini, M.; Holderbaum, W.; Andrews, B.J. Electrical stimulation for trunk control in paraplegia: A feasibility study. Control. Eng. Pract. 2012, 20, 1247–1258. [Google Scholar] [CrossRef]
  18. Audu, M.L.; Lombardo, L.M.; Schnellenberger, J.R.; Foglyano, K.M.; Miller, M.E.; Triolo, R.J. A neuroprosthesis for control of seated balance after spinal cord injury. J. Neuroeng. Rehabil. 2015, 12, 1–12. [Google Scholar] [CrossRef] [Green Version]
  19. Friederich, A.R.; Bao, X.; Triolo, R.J.; Audu, M.L. Feedback Control of Upright Seating with Functional Neuromuscular Stimulation during a Functional Task after Spinal Cord Injury: A Case Study. In Proceedings of the 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Virtual, 1–5 November 2021; pp. 5719–5722. [Google Scholar]
  20. Lambrecht, J.M.; Kirsch, R.F. Miniature low-power inertial sensors: Promising technology for implantable motion capture systems. IEEE Trans. Neural Syst. Rehabil. Eng. 2014, 22, 1138–1147. [Google Scholar] [CrossRef]
  21. Roetenberg, D.; Luinge, H.J.; Baten, C.T.; Veltink, P.H. Compensation of magnetic disturbances improves inertial and magnetic sensing of human body segment orientation. IEEE Trans. Neural Syst. Rehabil. Eng. 2005, 13, 395–405. [Google Scholar] [CrossRef] [Green Version]
  22. Xing, H.; Hou, B.; Lin, Z.; Guo, M. Modeling and compensation of random drift of MEMS gyroscopes based on least squares support vector machine optimized by chaotic particle swarm optimization. Sensors 2017, 17, 2335. [Google Scholar] [CrossRef]
  23. De Vries, W.; Veeger, H.; Baten, C.; Van Der Helm, F. Magnetic distortion in motion labs, implications for validating inertial magnetic sensors. Gait Posture 2009, 29, 535–541. [Google Scholar] [CrossRef] [PubMed]
  24. Bheemreddy, A.; Lombardo, L.M.; Miller, M.E.; Foglyano, K.M.; Nogan-Bailey, S.; Triolo, R.J.; Audu, M.L. A closed-loop self-righting controller for seated balance in the coronal and diagonal planes following spinal cord injury. Med. Eng. Phys. 2020, 86, 47–56. [Google Scholar] [CrossRef] [PubMed]
  25. Smith, B.; Crish, T.; Buckett, J.; Kilgore, K.; Peckham, P. Development of an implantable networked neuroprosthesis. In Proceedings of the 2nd International IEEE EMBS Conference on Neural Engineering, Arlington, VA, USA, 16–20 March 2005; pp. 454–457. [Google Scholar]
  26. Makowski, N.S.; Campean, A.; Lambrecht, J.M.; Buckett, J.R.; Coburn, J.D.; Hart, R.L.; Miller, M.E.; Montague, F.W.; Crish, T.; Fu, M.J.; et al. Design and testing of stimulation and myoelectric recording modules in an implanted distributed neuroprosthetic system. IEEE Trans. Biomed. Circuits Syst. 2021, 15, 281–293. [Google Scholar] [CrossRef] [PubMed]
  27. Castillo-Escario, Y.; Kumru, H.; Valls-Solé, J.; García-Alen, L.; Jané, R.; Vidal, J. Quantitative evaluation of trunk function and the StartReact effect during reaching in patients with cervical and thoracic spinal cord injury. J. Neural Eng. 2021, 18, 0460d2. [Google Scholar] [CrossRef] [PubMed]
  28. Armandei, M.; Saberi, H.; Derakhshanrad, N.; Yekaninejad, M. Pivotal role of cervical rotation for rehabilitation outcomes in patients with subaxial cervical spinal cord injury. Neurochirurgie 2020, 66, 247–251. [Google Scholar] [CrossRef]
  29. Field-Fote, E.C.; Ray, S.S. Seated reach distance and trunk excursion accurately reflect dynamic postural control in individuals with motor-incomplete spinal cord injury. Spinal Cord 2010, 48, 745–749. [Google Scholar] [CrossRef] [Green Version]
  30. Grimpampi, E.; Bonnet, V.; Taviani, A.; Mazzà, C. Estimate of lower trunk angles in pathological gaits using gyroscope data. Gait Posture 2013, 38, 523–527. [Google Scholar] [CrossRef]
  31. Mazza, C.; Donati, M.; McCamley, J.; Picerno, P.; Cappozzo, A. An optimized Kalman filter for the estimate of trunk orientation from inertial sensors data during treadmill walking. Gait Posture 2012, 35, 138–142. [Google Scholar] [CrossRef]
  32. Punchihewa, N.G.; Miyazaki, S.; Chosa, E.; Yamako, G. Efficacy of Inertial Measurement Units in the Evaluation of Trunk and Hand Kinematics in Baseball Hitting. Sensors 2020, 20, 7331. [Google Scholar] [CrossRef]
  33. Luinge, H.J.; Veltink, P.H. Measuring orientation of human body segments using miniature gyroscopes and accelerometers. Med. Biol. Eng. Comput. 2005, 43, 273–282. [Google Scholar] [CrossRef]
  34. Luinge, H.J.; Veltink, P.H. Inclination measurement of human movement using a 3-D accelerometer with autocalibration. IEEE Trans. Neural Syst. Rehabil. Eng. 2004, 12, 112–121. [Google Scholar] [CrossRef] [PubMed]
  35. Brouwer, N.P.; Yeung, T.; Bobbert, M.F.; Besier, T.F. 3D trunk orientation measured using inertial measurement units during anatomical and dynamic sports motions. Scand. J. Med. Sci. Sport. 2021, 31, 358–370. [Google Scholar] [CrossRef]
  36. Audu, M.L.; Triolo, R.J. Intrinsic and extrinsic contributions to seated balance in the sagittal and coronal planes: Implications for trunk control after spinal cord injury. J. Appl. Biomech. 2015, 31, 221–228. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Leardini, A.; Biagi, F.; Belvedere, C.; Benedetti, M.G. Quantitative comparison of current models for trunk motion in human movement analysis. Clin. Biomech. 2009, 24, 542–550. [Google Scholar] [CrossRef]
  38. Ugray, Z.; Lasdon, L.; Plummer, J.; Glover, F.; Kelly, J.; Martí, R. Scatter search and local NLP solvers: A multistart framework for global optimization. INFORMS J. Comput. 2007, 19, 328–340. [Google Scholar] [CrossRef]
  39. Li, Q.; Mark, R.G.; Clifford, G.D. Robust heart rate estimation from multiple asynchronous noisy sources using signal quality indices and a Kalman filter. Physiol. Meas. 2007, 29, 15. [Google Scholar] [CrossRef] [Green Version]
  40. Crago, P.E.; Chizeck, H.J.; Neuman, M.R.; Hambrecht, F.T. Sensors for use with functional neuromuscular stimulation. IEEE Trans. Biomed. Eng. 1986, BME-33, 256–268. [Google Scholar] [CrossRef]
  41. Ernst, M.J.; Rast, F.M.; Bauer, C.M.; Marcar, V.L.; Kool, J. Determination of thoracic and lumbar spinal processes by their percentage position between C7 and the PSIS level. BMC Res. Notes 2013, 6, 1–6. [Google Scholar] [CrossRef] [Green Version]
  42. Al Borno, M.; O’Day, J.; Ibarra, V.; Dunne, J.; Seth, A.; Habib, A.; Ong, C.; Hicks, J.; Uhlrich, S.; Delp, S. OpenSense: An open-source toolbox for Inertial-Measurement-Unit-based measurement of lower extremity kinematics over long durations. J. Neuroeng. Rehabil. 2022, 19, 1–11. [Google Scholar] [CrossRef]
  43. El-Diasty, M.; El-Rabbany, A.; Pagiatakis, S. Temperature variation effects on stochastic characteristics for low-cost MEMS-based inertial sensor error. Meas. Sci. Technol. 2007, 18, 3321. [Google Scholar] [CrossRef]
Figure 1. Diagram of a distributed sensor system. The coordinate frames of these sensors are unknown relative to the body’s anatomical coordinate frame.
Figure 1. Diagram of a distributed sensor system. The coordinate frames of these sensors are unknown relative to the body’s anatomical coordinate frame.
Sensors 22 07690 g001
Figure 2. Locations of the 3-axis accelerometers and reflective markers on the subject. The body’s anatomical coordinate frame is shown in the right image. Pitch, roll, and yaw refer to trunk flexion and extension, lateral bending, and axial rotation about the x, y, and z anatomical axes, respectively.
Figure 2. Locations of the 3-axis accelerometers and reflective markers on the subject. The body’s anatomical coordinate frame is shown in the right image. Pitch, roll, and yaw refer to trunk flexion and extension, lateral bending, and axial rotation about the x, y, and z anatomical axes, respectively.
Sensors 22 07690 g002
Figure 3. Experimental procedure flowchart for both the motion caption and clinical calibration methods.
Figure 3. Experimental procedure flowchart for both the motion caption and clinical calibration methods.
Sensors 22 07690 g003
Figure 4. Overview of the sensor rotation and fusion process. Signals from each accelerometer are first rotated, then converted to pitch and roll angles. Finally, the pitch and roll angles from every sensor are fused into a single measure of trunk position.
Figure 4. Overview of the sensor rotation and fusion process. Signals from each accelerometer are first rotated, then converted to pitch and roll angles. Finally, the pitch and roll angles from every sensor are fused into a single measure of trunk position.
Sensors 22 07690 g004
Figure 5. Pitch and roll angles from all subjects S1 (a), S2 (b), S3 (c), S4 (d), S5 (e), and S6 (f) determined through sensor fusion optimized with motion capture.
Figure 5. Pitch and roll angles from all subjects S1 (a), S2 (b), S3 (c), S4 (d), S5 (e), and S6 (f) determined through sensor fusion optimized with motion capture.
Sensors 22 07690 g005
Figure 6. Sensor weights for determining the pitch (a) and roll (b) angles from the weighted average equation. Values are separated by subject number and sensor number. Locations of the sensors are as followed: 1. right chest; 2. left chest; 3. right front abdomen; 4. left front abdomen; 5. right back abdomen; and 6. left back abdomen. These weights resulted from the motion capture calibration process.
Figure 6. Sensor weights for determining the pitch (a) and roll (b) angles from the weighted average equation. Values are separated by subject number and sensor number. Locations of the sensors are as followed: 1. right chest; 2. left chest; 3. right front abdomen; 4. left front abdomen; 5. right back abdomen; and 6. left back abdomen. These weights resulted from the motion capture calibration process.
Sensors 22 07690 g006
Figure 7. Pitch and roll angles from all subjects S1 (a), S2 (b), S3 (c), S4 (d), S5 (e), and S6 (f) determined through sensor fusion optimized with motion capture.
Figure 7. Pitch and roll angles from all subjects S1 (a), S2 (b), S3 (c), S4 (d), S5 (e), and S6 (f) determined through sensor fusion optimized with motion capture.
Sensors 22 07690 g007
Table 1. Clinical characteristics of the study participants.
Table 1. Clinical characteristics of the study participants.
SubjectAge (y)GenderHeight (cm)Weight (kg)Injury LevelAIS * GradeTime Post Injury (y)
S150F16858.5C7B24
S269M16877.1T5D5
S359F17384.9C4–C7C4
S446F17384.9T4A10
S562M19193.8T11B12
S631M18866.2C5C10
* American Spinal Injury Association Impairment Score (AIS).
Table 2. Correlation coefficients (r) and root mean squared error (RMSE) from the motion capture calibration process. Individual results from each subject is shown along with the bolded summary statistics.
Table 2. Correlation coefficients (r) and root mean squared error (RMSE) from the motion capture calibration process. Individual results from each subject is shown along with the bolded summary statistics.
SubjectCorrelation Coefficient (r)RMSE (°)
PitchRollPitchRoll
WeightedTownsendWeightedTownsendWeightedTownsendWeightedTownsend
S10.9910.9910.9940.9932.692.732.122.16
S20.9580.9400.9930.9934.134.962.462.50
S30.9830.9810.9960.9964.264.522.252.25
S40.9840.9830.9930.9923.813.993.443.88
S50.9590.9590.9830.9865.105.123.983.91
S60.9840.9830.9900.9914.044.263.523.50
Average0.9760.9730.9910.9924.014.262.963.03
STD0.0140.0190.0040.0030.780.860.780.82
Table 3. Correlation coefficients (r) and root mean squared error (RMSE) from the clinical calibration process. Individual results from each subject is shown along with the bolded summary statistics.
Table 3. Correlation coefficients (r) and root mean squared error (RMSE) from the clinical calibration process. Individual results from each subject is shown along with the bolded summary statistics.
SubjectCorrelation Coefficient (r)RMSE (°)
PitchRollPitchRoll
WeightedTownsendWeightedTownsendWeightedTownsendWeightedTownsend
S10.9720.9720.9840.9844.834.833.633.63
S20.8470.8470.9680.9688.258.257.267.26
S30.9310.9310.9250.9258.898.899.579.57
S40.9310.9380.9950.9958.028.068.118.11
S50.9590.9590.9790.9795.525.535.125.12
S60.9570.9570.9810.9817.357.357.497.49
Average0.9340.9340.9720.9727.147.156.866.86
STD0.0450.0450.0240.0241.621.622.142.14
Table 4. Comparison of previous work with the results from our study (first two rows).
Table 4. Comparison of previous work with the results from our study (first two rows).
SourceActivityPopulationSensorrRMSE (°)
Motion Capture CalibrationLeaningIndividuals with SCISix 3-axis
accelerometers
0.975
Clinical CalibrationLeaningIndividuals with SCISix 3-axis
accelerometers
0.937
Mazza et al. [31]WalkingAble-bodied9-axis IMU0.911
Punchihewa et al. [32]Baseball hittingAble-bodiedTwo 9-axis IMU0.955
Grimpampi et al. [30]WalkingIndividuals with
hemiplegia or Parkinson’s
3-axis gyroscope0.741.3 plus
a 2 offset
Luinge et al. [33]Lifting cratesAble-bodied6-axis IMUN/A3
Luinge et al. [34]Lifting cratesAble-bodied3-axis accelerometerN/A2
Brouwer et al. [35]Dynamic
sport motions
Able-bodiedTwo 9-axis IMU0.855
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Friederich, A.R.W.; Audu, M.L.; Triolo, R.J. Trunk Posture from Randomly Oriented Accelerometers. Sensors 2022, 22, 7690. https://doi.org/10.3390/s22197690

AMA Style

Friederich ARW, Audu ML, Triolo RJ. Trunk Posture from Randomly Oriented Accelerometers. Sensors. 2022; 22(19):7690. https://doi.org/10.3390/s22197690

Chicago/Turabian Style

Friederich, Aidan R. W., Musa L. Audu, and Ronald J. Triolo. 2022. "Trunk Posture from Randomly Oriented Accelerometers" Sensors 22, no. 19: 7690. https://doi.org/10.3390/s22197690

APA Style

Friederich, A. R. W., Audu, M. L., & Triolo, R. J. (2022). Trunk Posture from Randomly Oriented Accelerometers. Sensors, 22(19), 7690. https://doi.org/10.3390/s22197690

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop