Next Article in Journal
An Efficient Metaheuristic-Based Clustering with Routing Protocol for Underwater Wireless Sensor Networks
Next Article in Special Issue
Kinematic Effect on the Navicular Bone with the Use of Rearfoot Varus Wedge
Previous Article in Journal
Interactive Deep Learning for Shelf Life Prediction of Muskmelons Based on an Active Learning Approach
Previous Article in Special Issue
The Effect of a Verbal Cognitive Task on Postural Sway Does Not Persist When the Task Is Over
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predicting Axial Impairment in Parkinson’s Disease through a Single Inertial Sensor

1
Department of Control and Computer Engineering, Politecnico di Torino, 10129 Turin, Italy
2
PolitoBIOMed Lab—Biomedical Engineering Laboratory, Politecnico di Torino, 10129 Turin, Italy
3
Department of Information Engineering, Electronics and Telecommunication, Sapienza University of Rome, 00184 Rome, Italy
4
Department of Human Neurosciences, Sapienza University of Rome, 00185 Rome, Italy
5
IRCCS NEUROMED Institute, 86077 Pozzilli, Italy
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(2), 412; https://doi.org/10.3390/s22020412
Submission received: 17 November 2021 / Revised: 23 December 2021 / Accepted: 5 January 2022 / Published: 6 January 2022
(This article belongs to the Collection Sensors for Gait, Human Movement Analysis, and Health Monitoring)

Abstract

:
Background: Current telemedicine approaches lack standardised procedures for the remote assessment of axial impairment in Parkinson’s disease (PD). Unobtrusive wearable sensors may be a feasible tool to provide clinicians with practical medical indices reflecting axial dysfunction in PD. This study aims to predict the postural instability/gait difficulty (PIGD) score in PD patients by monitoring gait through a single inertial measurement unit (IMU) and machine-learning algorithms. Methods: Thirty-one PD patients underwent a 7-m timed-up-and-go test while monitored through an IMU placed on the thigh, both under (ON) and not under (OFF) dopaminergic therapy. After pre-processing procedures and feature selection, a support vector regression model was implemented to predict PIGD scores and to investigate the impact of L-Dopa and freezing of gait (FOG) on regression models. Results: Specific time- and frequency-domain features correlated with PIGD scores. After optimizing the dimensionality reduction methods and the model parameters, regression algorithms demonstrated different performance in the PIGD prediction in patients OFF and ON therapy (r = 0.79 and 0.75 and RMSE = 0.19 and 0.20, respectively). Similarly, regression models showed different performances in the PIGD prediction, in patients with FOG, ON and OFF therapy (r = 0.71 and RMSE = 0.27; r = 0.83 and RMSE = 0.22, respectively) and in those without FOG, ON and OFF therapy (r = 0.85 and RMSE = 0.19; r = 0.79 and RMSE = 0.21, respectively). Conclusions: Optimized support vector regression models have high feasibility in predicting PIGD scores in PD. L-Dopa and FOG affect regression model performances. Overall, a single inertial sensor may help to remotely assess axial motor impairment in PD patients.

1. Introduction

Parkinson’s disease (PD) is a neurodegenerative disorder clinically characterized by bradykinesia, tremor, and rigidity [1]. Besides these cardinal signs, axial impairment, including gait and postural disorders, is among the most disabling symptoms responsible for progressive motor impairment and frequent falls in PD [2,3]. According to the Hoehn and Yahr scale, the staging of PD is based on the severity of axial signs, including balance impairment and the ability to walk independently [4]. Currently, the clinical assessment of axial impairment in PD implies the measurement of the postural stability/gait difficulty (PIGD) score which represents an accurate indicator of the disease severity and prognosis [5]. To obtain quantitative markers of disease progression, it would be relevant to measure the PIGD score objectively in patients with PD (PDPs).
Over the last two decades, wearable sensing systems based on accelerometers and gyroscopes have been increasingly used for the objective monitoring of gait and balance in PDPs [6,7,8]. These technologies have provided highly accurate data on gait and balance in PD [9,10], through the analysis of inertial data recorded during different activities, including stance [11,12], postural transitions [13,14], walking [15,16,17], and turning [18,19]. In addition, several machine-learning (ML) algorithms have been previously used to objectively assess PDPs and evaluate their disease severity [20,21]. However, so far, only a few studies have used sensor-based recordings in PD to predict specific Unified Parkinson’s Disease rating scale (UPDRS) items concerning balance and gait or even the PIGD score, reaching suboptimal performances. In [22], inertial data from 75 PDPs were recorded during gait, using a single IMU on waist. A support vector machine (SVM) classifier was employed for gait detection, and the power spectra in the 0–10 Hz range was computed and used as output. Results showed that the algorithm output was correlated with the UPDRS gait (r = −0.73, p < 0.001) and postural stability (r = −0.42, p < 0.001) scores. In [23], 31 PDPs were equipped with 3 inertial sensors on the lower back and on each foot. Inertial data were recorded in home environments, and gait, turn, and stance activities were detected and analysed. Several measures regarding quantity and quality of movements were extracted, selected, and input to a multivariable linear regression model. The algorithm outcome correlated with the total UPDRS-part III (r = 0.48, p = 0.007) and with the PIGD score (r = 0.61, p < 0.001). These studies have not considered several clinical biases with relevant impact on sensor-based measures such as the effect of L-Dopa and freezing of gait (FOG) occurrence. In addition, the use of multiple inertial sensors reduced the unobtrusiveness and comfortableness of adopted sensing systems [23].
In this study, axial impairment in PD was assessed by calculating the PIGD scores through sensor-based technologies. First, the impact of L-Dopa on ML models’ performance for the PIGD prediction was examined by comparing patients under (ON) and not under (OFF) dopaminergic therapy. In addition, patients with and without FOG were compared to consider possible differences in the PIGD prediction based on the occurrence of FOG. To limit the sensing system obtrusiveness, a single small and lightweight inertial sensor was used. To improve the ecological value of our data, the wearable sensor was attached to the thigh of the patients thus resembling a common smartphone placed in the front pocket. Still, to optimize the sensing performances and improve the accuracy, many time- and frequency-domain features were computed, along with the classical spatiotemporal gait parameters, and ML algorithms were used, owing to their ability to achieve automatic storage, elaboration, and interpretation of a large amount of data driven by wearable sensors [24,25]. The objective and automatic evaluation of the PIGD score based on a single wearable sensor would open new opportunities also in the remote assessment of the disease progression in PD in line with new telemedicine approaches. Indeed, although the International Parkinson and Movement Disorder Society has recently validated standardised procedures and scales to remotely assess PDPs, these telemedicine procedures do not allow the evaluation of axial impairment which requires specific clinical tests. Hence, predicting the PIGD score through a single inertial sensor and dedicated ML algorithms would allow obtaining more ecological data reflecting disease progression in PDPs.
The rest of this paper is organized as follows: Section 2 describes the population enrolled in this study, the experimental protocol, and the processing performed on inertial data; Section 3 reports the results obtained, further evaluating the effect of L-Dopa and FOG; in Section 4, the results are discussed, while in Section 5, conclusions are drawn and future works are proposed.

2. Materials and Methods

2.1. Subjects

Thirty-one PDPs were enrolled from the Movement Disorder outpatient clinic of the Department of Human Neurosciences, Sapienza University of Rome, Italy, based on the following inclusion criteria: diagnosis of idiopathic PD; lack of dementia (i.e., Mini-Mental State Examination—MMSE > 24); ability to walk autonomously; lack of neurological, orthopaedic or rheumatic comorbidities possibly affecting gait. Two neurologists, with expertise in movement disorders, investigated the presence of FOG in all patients by a clinical interview and direct physical examination. Overall, 17 PDPs showed definite FOG (FOG+), while the remaining 14 never experienced FOG (FOG−). The following standardised scales for clinical assessment were used: Hoehn and Yahr scale (H&Y), modified Movement Disorder Society—unified Parkinson’s disease rating scale (MDS-UPDRS) part III, FOG questionnaire (FOG-Q), MMSE, frontal assessment battery (FAB), Hamilton depression rating scale (HAM-D), and Beck anxiety inventory (BAI). In order to further assess axial impairment, the PIGD score was calculated, measured as the sum of items 2.12, 2.13, 3.10, 3.11, and 3.12 of MDS-UPDRS, both OFF and ON state of therapy. Patients were clinically assessed both OFF (i.e., after L-Dopa withdrawal for at least 12 h) and ON (1 h after L-Dopa intake) state of therapy. In addition, L-Dopa equivalent daily doses (LEDDs) were calculated for each patient, according to standardised procedures [26]. Demographic and clinical features of PDPs enrolled in this study are summarized in Table 1 and Table 2. Experimental procedures were approved by the institutional review board and performed according to the Declaration of Helsinki.

2.2. Experimental Protocol and Data Acquisition

Patients were asked to perform a 7-m timed-up-and-go (TUG) test consisting of the following procedures: (1) getting up from a chair; (2) walking in a straight line for 7 m; (3) turning; (4) walking back; (5) sitting down. To maximize the ecological value of our recordings and trigger the possible occurrence of FOG, the 7-m TUG test was performed in a free living-like environment with a number of factors simulating a domestic setting (e.g., passage from a spacious room to a narrow and furnished corridor with the interposition of an open door) [8]. Patients’ gait was video-recorded through a camera and monitored by a single IMU placed and fixed on the thigh through an elastic band (Figure 1). The IMU positioning on the patient’s thigh was implemented so that when the patient was standing, the y-axis represented the inverse gravity vector and x-axis lies in the frontal plane. Hence, the angular velocity around the x-axis allowed a good representation of the thigh motion during linear gait. The STMicroelectronics system-on-board prototype neMEMSi [27] was equipped with the following components: a 9-axis IMU (LSM9DS0), integrating a 3-axis accelerometer and a 3-axis gyroscope; a Bluetooth V3.0 module (BT33); a lithium-ion battery; an ultralow-power 32-bit microcontroller (STM32L1). Sensors range was settable up to ±16 g and ±2000 dps for accelerometer and gyroscope, respectively. A sample frequency up to 200 Hz can be used. The device size (including battery) is 25 mm × 30 mm × 4 mm (Figure 1). Moreover, neMEMSi includes a temperature sensor, a hygrometer sensor and a pressure sensor that were not used for this study. Table 3 reports technical characteristics of the inertial sensors embedded in the IMU (specifications refer to those set in this study). Before placement, a preliminary conventional calibration of the inertial sensors was performed, including software correction of the displacement of the IMU framework with respect to the earth framework. Specifically, static acquisitions of both accelerometer and gyroscope data were carried out as indicated in [28,29]. The IMU was systematically arranged in specific positions on a table. The operations to correct or align the sensor with the reference framework were performed in real-time, with NeMEMSi transmitting data via Bluetooth to the PC. Orientation was derived from measurements and compared to earth observation framework. Rotation between sensor and earth quaternions was calculated at each IMU tested position and used for orientation correction. Once the calibration procedure was finished, the IMU was positioned on the patient. The resulting data were sent in real-time to a personal computer through the neMEMSi Bluetooth module and progressively saved in CSV format. Each CSV file was related to a single test. Data in CSV files were processed offline as described in the next section.

2.3. Preprocessing

In this section, the signal processing steps performed prior to the statistical analysis and the regression task are described. First, a sensor fusion process was performed to compute the orientation signal from the raw accelerometer and raw gyroscope readings (Section 2.3.1). Then, the orientation signal was used to detect walking bouts from the entire TUG recording (Section 2.3.2). Finally, inertial data were segmented and temporal and spectral features were extracted from each stride (Section 2.3.3).

2.3.1. Orientation Estimation

A Kalman filter [30] was used to estimate the sensor orientation from the fusion of raw acceleration and angular velocity recordings. The sensor fusion algorithm alternates iteratively two processes, including a prediction step and a correction step. The former consists in an approximation of the orientation estimate, performed through an integration of the gyroscope readings; the latter exploits accelerometer readings to correct the drift due to the integration of the slow-varying bias affecting the gyroscope measurements [31]. Figure 2 shows the raw gyroscope (a) and raw accelerometer (b) readings, and the orientation estimate (d) obtained using the Kalman filter (c). After orientation estimation, acceleration, angular velocity, and orientation signals were filtered, in order to keep only the frequency components of interest while removing mean values, low-frequency trends, and high frequency noise. A second-order zero-lag band-pass Butterworth filter was used to keep only components in the 0.5–20 Hz band, while avoiding phase distortion.

2.3.2. Walking Bouts Detection

In order to select only the walking segments of data, a continuous wavelet transform (CWT)-based approach was implemented, which is often used for walking steps detection algorithms [32,33]. CWT uses inner products to measure the similarity between the signal x ( t ) and an analysing function, which is a wavelet ψ . Equation (1) reports the formula for CWT computation. First, the wavelet is shifted by b R values and stretched/compressed by a R + values, then the shifted and stretched/compressed versions of the wavelet ψ * ( t b a ) is compared to the signal x ( t ) in order to compute their similarity. This procedure is performed using a mother wavelet ψ and all possible values of a and b.
X ( a , b , x ( t ) , ψ ) = + x ( t ) 1 a ψ * t b a d t
In this study, a Morse mother wavelet was used, due to its similarity with the orientation signal pattern during walking. Moreover, the scale parameter (a) was set so that the frequency analysis was performed in the range 0.5–2 Hz. This is done considering that stride time is rather heterogeneous in PDPs, due to the variability of motor features among patients [18], the pharmacological condition [8], and the gait velocity [34]. In [35], stride time in PD was found to be 1.13 ± 0.21 s, taking into consideration eleven studies on parkinsonian gait.
The scalogram obtained from the CWT is reported in Figure 3 (restricted in the frequency range 0–1 Hz), where the yellow zones correspond to the walking segments of the signal. In order to identify walking bouts, the intensity profile was computed for each value of the frequency scale; then, the obtained profiles were averaged, and finally, the regions in which the average intensity profile exceeded the standard deviation value were selected. The result of this procedure is reported in Figure 4, where the walking bouts are identified in the orientation signal.

2.3.3. Segmentation and Feature Extraction

In each walking segment of the orientation signal, initial contacts were identified (ICs) as the positive orientation signal peaks [36]. Aiming to avoid possible double-peak detection, the orientation signal was low-pass filtered using a second-order zero-lag Butterworth filter, with a cut-off frequency of 2 Hz. In addition, only peaks higher than the signal standard deviation and at least 0.5 s apart were selected. As suggested in [36], final contacts (FCs) correspond to the negative peaks following the ICs. The acceleration, angular velocity, and orientation recordings were segmented into windows corresponding to strides (i.e., from an IC to the subsequent IC), in order to prepare the data for the subsequent feature extraction step.
From each stride, a total number of 102 features were extracted from the acceleration, angular velocity, and orientation signal. Features include spatiotemporal gait parameters, and both time- and frequency-domain features. For each stride i, stride time, stance time, and swing time were computed as follows:
T s t r i d e = I C i + 1 I C i T s t a n c e = F C i I C i T s w i n g = I C i + 1 F C i
Table 4 and Table 5 report the list of features extracted from the time and frequency domain, respectively. The listed features describe different aspects of the gait movement. For instance, R a n g e , S t d , and R M S are related to the movement amplitude and intensity; E t o t and b i n E n e r g y measure the energy content of the signal; E n t r o p y and s E n t r o p y describe movement complexity; D H w i d t h and D H r a t i o are related to the stride regularity. As far as the spectral features are concerned, they were computed from the Fast Fourier Transform (FFT) of the signal. In order to have homogeneous spectral representations of all strides from all patients, the number of points in which to represent the FFT was set to be n = T ¯ s t r i d e · F s , where T ¯ s t r i d e is the average stride time found in PDPs [35] and F s is the sample frequency. For strides lasting more than T ¯ s t r i d e , a small loss of spectral resolution occurs, while for strides lasting less than T ¯ s t r i d e , some points are added to the FFT, obtained as linear interpolation of the actual data-points. In any case, a spectral resolution of at least 1 Hz is expected, which is adequate for the computation of features listed in Table 5.

2.4. PIGD Prediction

This section describes the statistical processing following the extraction of the entire feature set for each patient’s stride, intended to investigate the clinical significance of the extracted features. First, correlation analysis was performed between engineered features extracted from walking bouts and the clinical scores; this was done computing the Pearson correlation coefficient and the corresponding p-value for each feature–clinical score pair. Then, a regression model was implemented to predict the PIGD score of PDPs (Section 2.4.1). The analysis was performed in patients both OFF and ON state of therapy, to evaluate the effect of the pharmacological treatment on the performance of the prediction model (Section 2.4.2). Finally, to also evaluate the effect of FOG on model performance, patients were divided based on the clinical presence of FOG (Section 2.4.3).

2.4.1. PIGD Score Regression

The Pearson correlation coefficient (r) between the extracted features and the PIGD score was computed in patients both OFF and ON therapy. In order to reduce the dimensionality of the entire feature set (i.e., 102 features), the least significant features (i.e., those with r < 0.4 ) were discarded. To further reduce the set dimensionality, the features were ranked according to their prediction capability. This was done exploiting two different approaches, and evaluating their effect on the final prediction capability.
The first approach consisted in sorting the features in descending order of r, then selecting the first N features. The second approach made use of principal component analysis (PCA) to reduce the dimensionality of the feature set, keeping only the first N principal components. The parameter N was tuned in the range of 5–25 estimating the effect of the different feature set dimensionality on the model performance. Figure 5 reports a schematic of the entire process.
Feature scaling was applied to each feature using the z-score normalization, which consists in removing the mean value and dividing by the standard deviation. This was done to uniform the feature range, while reducing the effect of possible outliers. Then, range normalization was performed both on the feature set and on the target vector (i.e., PIGD score) to rescale data in the range [0, 1]. Concerning the regression model, a support vector regression (SVR) model [37,38] was implemented. In order to provide a robust performance evaluation, the model was tested employing the leave-one-subject-out (LOSO) cross-validation, which resembles the realistic working condition of the model. It consists in training the model with data from all patients except one, which is used as test. In order to optimize the model parameters, a LOSO-based training-validation procedure was carried out, selecting those parameters providing the best performance on the validation set. Kernel function, kernel scale, and misclassification cost (box-constraint) parameters were optimized for each SVR model, while the margin of tolerance (epsilon parameter) was set to the default value, corresponding to a tenth of the PIGD score standard deviation.
The entire process is described in Algorithm 1. The goodness-of-fit was assessed using the metrics reported in Equation (2).
r = 1 i = 1 N ( y i y ^ ) 2 i = 1 N ( y i y ¯ ) R M S E = 1 N i = 1 N ( y ^ i y i ) 2 M A E = 1 N i = 1 N | y i y ¯ |
Algorithm 1 Algorithm for model optimization, validation and test performance evaluation
procedure optimizedModel ( D a t a , a c t u a l S c o r e ) , performance ( D a t a , a c t u a l S c o r e )
  for i 1 to N do▹ Perform N times test procedure
    t r a i n i n g S e t data from all subjects except for ith
    t e s t S e t data from ith subject
   for k e r n e l f u n c t i o n [ l i n e a r , q u a d r a t i c , c u b i c , g a u s s i a n ] do▹ tune kernel function
    for k e r n e l S c a l e [ 0.001 1000 ] do▹ tune kernel scale
     for b o x C o n s t r a i n t [ 0.001 1000 ] do▹ tune cost parameter
      for j 1 to N 1 do▹ Perform N 1 times validation procedure
        t r a i n i n g S e t data from t r a i n i n g S e t except for jth subject
        [ v a l i d a t i o n S e t ] data from jth subject
        M o d e l t r a i n ( m o d e l ( t r a i n i n g S e t ) ) ▹ train model
        v a l P r e d i c t i o n ( j ) p r e d i c t ( m o d e l ( v a l i d a t i o n S e t ) ) ▹ predict
      end for
       R M S E 1 N 1 j = 1 N 1 ( v a l P r e d i c t i o n a c t u a l S c o r e ) 2
     end for
    end for
   end for
    [ k e r n e l F u n c t i o n , k e r n e l S c a l e , b o x C o n s t r a i n t ] m i n ( R M S E )
    o p t i m i z e d M o d e l model( k e r n e l F u n c t i o n , k e r n e l S c a l e , b o x C o n s t r a i n t )
    t e s t P r e d i c t i o n ( i ) predict( o p t i m i z e d M o d e l ( t e s t S e t ))▹ prediction on test set
  end for
   p e r f o r m a n c e [r,RMSE,MAE]( t e s t p r e d i c t i o n , a c t u a l S c o r e )]▹ test performance
  return o p t i m i z e d M o d e l , p e r f o r m a n c e
end procedure
The correlation coefficient (r) measures how well the model fits the dependent variable, i.e., how much variability in the dependent variable can be explained by the model; it ranges between 0 and 1, with larger values indicating better performance. Root mean square error (RMSE) and mean absolute error (MAE) are absolute measures of the goodness of fit, providing the entity of deviation from the target values. While MAE treats all errors the same, RMSE gives larger penalization to big prediction errors.

2.4.2. The Effect of L-DOPA

Inertial data from PDPs were divided based on the pharmacological condition. Two independent datasets were obtained from patients OFF and ON state of therapy. The motor condition of patients while OFF and ON was compared performing the Wilcoxon test on the MDS-UPDRS part III and on the PIGD score in the two pharmacological conditions. Then, the analysis reported in Figure 5 was performed, optimizing the model according to Algorithm 1. The performance obtained on patients OFF and ON was compared using different feature set sizes, different dimensionality reduction methods, and optimizing the regression model parameters. Finally, the performance of the model in patients OFF and ON therapy were compared.

2.4.3. The Effect of Freezing of Gait

The dataset was split according to clinical presence of FOG. Then, the Mann–Whitney U-test was used to compare both the clinical scores and the engineered features of FOG+ and FOG− patients. Then, the analysis reported in Figure 5 was performed, optimizing the model according to Algorithm 1. The performance obtained on patients with and without FOG was compared using different feature set sizes, different dimensionality reduction methods, and optimizing the regression model parameters. The entire procedure was carried out for each pharmacological condition. Finally, the the effect of FOG on the model performance was evaluated.
All the experiments were executed in Matlab R2020a, using a personal computer with Microsoft Windows 10, a 2.4 GHz Intel® Core Processor i5-6200, 8 GB RAM and 4 GB GPU.

3. Results

3.1. Clinical-Behavioural Correlations

Pearson correlation analysis showed that most time- and frequency-domain features significantly correlated with PIGD scores. In more detail, as axial motor control worsened, the minimum value of inertial signals increased, whereas maximum and root mean square values of inertial signals, average height of peaks in the time-domain and height of the dominant harmonic decreased. Table 6 summarizes the Pearson correlation coefficients and the respective p-values for different feature-PIGD pairs. Only the most informative features for either therapeutic conditions, i.e., those with a Pearson correlation coefficient with PIGD score larger than 0.5, were included in the table. Figure 6 reports the scatter plots for the average height of the dominant harmonic (mean DH height) versus PIGD score OFF and ON.

3.2. PIGD Score Regression

This section reports results from the optimized support vector regression models in LOSO validation. Specifically, Section 3.3 summarizes findings concerning the effect of L-Dopa by comparing regression models in patients OFF and ON therapy. The best model configuration was identified for each pharmacological condition and the performance of the regression models were compared. Section 3.4 reports findings concerning the effect of FOG occurrence, by comparing regression models in FOG+ and FOG−. The best model configuration was extracted for each subgroup of patients and the performance of the regression models were compared.

3.3. The Effect of L-DOPA

The Wilcoxon test demonstrated that both UPDRS-part III and the PIGD score were different in patients OFF and ON therapy (p < 0.001). Table 7 summarizes the performance of the regression model in terms of correlation coefficient, RMSE, and MAE, in PDPs OFF and ON state of therapy. Results are reported for different sizes of the feature set and different dimensionality reduction methods.
Based on the results from Table 7, visually reported in Figure 7, the following considerations were derived.
  • Model: SVR with linear kernel is selected in 85% of cases; top performances were obtained with linear kernel and small values of box-constraint parameter (i.e., <0.009).
  • Number of features: increasing the feature set size did not ensure progressively better performances (Figure 7). Best results were obtained with n = 15 features, both for patients OFF and ON therapy.
  • Dimensionality reduction: for larger feature set size (i.e., # features > 15), PCA-based dimensionality reduction always implied better results, compared to those attained with correlation-based feature selection (Figure 7). PCA-based dimensionality reduction method led to the best results both for patients OFF and ON therapy.
  • Performance: regression models provided better performances in patients OFF than those ON therapy.
Consequently, the best regression model parameters were identified for each pharmacological condition. Then, such models were trained on patients ON (OFF) therapy and tested on patients OFF (ON) therapy. This procedure resulted in r = 0.70 (0.67), RMSE = 0.57 (0.42), and MAE = 0.47 (0.15). When the model was tested using LOSO on all available data, regardless of the pharmacological condition, r = 0.64, RMSE = 0.22, and MAE = 0.17 were obtained from an SVR with linear kernel and box-constraint = 0.07. Figure 8 reports the true versus predicted score scatter plot, together with the the best fit line.

3.4. The Effect of Freezing of Gait

Table 8 reports the demographic and clinical features of PDPs with and without FOG, along with the significance level computed using the Mann–Whitney U test. In PDPs with FOG, FOG duration was 4.8 ± 2.7 and the total FOG-Q score was 15.4 ± 4.4. As far as concerns the engineered features, the Mann–Whitney U test showed that PDPs with FOG had higher M i n and lower M e a n , R M S , D H h e i g h t , and E t o t compared to those without FOG (p < 0.001).
Table 9 reports the performance of the optimized regression models for FOG+ and FOG− patients ON state of therapy, visually reported in Figure 9.
From Figure 9, it can be inferred that, when the size of the feature set increased, regression models provided comparable performance in FOG+ and FOG−. This was particularly evident for n = 25 features, for which r and RMSE were very similar in the two populations, regardless of the dimensionality reduction method. From the results above, the following considerations were derived.
  • Model: SVR with linear kernel is selected in 95% of cases; top performances were obtained with linear kernel and small values of box-constraint parameter (i.e., <0.51).
  • Number of features: increasing the feature set size did not ensure progressively better performances (Figure 9). Best results were obtained with n = 15 (n = 5) features in patients with (without) FOG.
  • Dimensionality reduction: correlation-based and PCA-based dimensionality reduction methods provided similar results, regardless of the feature set size (Figure 7).
  • Correlation-based dimensionality reduction method led to the best results both for FOG+ and FOG− patients.
  • Performance: regression models provided better performances in FOG− patients, as evident from larger values of r and lower values of the RMSE (Figure 9).
Based on the considerations above, the dimension of the feature set was set to 15 (5) for FOG+ (FOG−) patients, and the dimensionality reduction method to correlation-based for both populations. Then, the best regression model was trained on FOG+ (FOG−) and tested on FOG− (FOG+). This procedure resulted in r = 0.34 (0.40), RMSE = 0.43 (0.39), and MAE = 0.37 (0.35), respectively.
The performance gap between PDPs with and without FOG may be due to the different discrimination power of some features in the two populations. From Table 9, it turns out that, for each feature set size, the correlation between top-ranked features and PIGD score is larger in patients without FOG. Top-ranked features for those patients were found to be Min (r = 0.79, p = 0.001), vPeaks (r = −0.75, p = 0.004), RMS (r = −0.72, p = 0.006), hPeaks (r = −0.70, p = 0.008) from the x-axis orientation signal, and E t o t (r = −0.79, p = 0.001) from the x-axis angular velocity signal. As far as concerns PDPs with FOG, top-ranked features included Min (r = 0.66, p = 0.004), DH height (r = −0.62, p = 0.008), RMS (r = −0.58, p = 0.015), hPeaks (r = −0.58, p = 0.016) from the y-axis acceleration signal, and DH height (r = −0.65, p = 0.005) from the x-axis orientation signal.
Table 10 reports the performance of the optimized regression models for FOG+ and FOG− OFF state of therapy, visually reported in Figure 10.
Based on the results above, the following considerations were derived.
  • Model: SVR with linear kernel is selected in 95% of cases; top performances were obtained with linear kernel both in patients with and without freezing of gait.
  • Number of features: increasing the feature set size did not ensure progressively better performances (Figure 10). Best results were obtained with n = 25 (n = 15) features in patients with (without) freezing of gait.
  • Dimensionality reduction: PCA-based (correlation-based) dimensionality reduction was selected for patients with (without) FOG.
  • Performance: regression models provided slightly better performances in patients without FOG, in terms of RMSE (Figure 10), independently of the model configuration; performance in terms of r depends on the regression model parameters, with best results superior in patients with FOG (Table 10).
Based on the considerations above, the dimension of the feature set was set to 25 (15) and the dimensionality reduction method to the PCA-based (correlation-based) for FOG+ (FOG−). Then, the best regression model were trained on FOG+ (FOG−) and tested on FOG− (FOG+). This procedure resulted in r = 0.73 (0.69), RMSE = 0.36 (0.33), and MAE = 0.25 (0.25), respectively.
Table 11 reports all the results obtained for each population under investigation and for each pharmacological condition; results were obtained using LOSO test. As evident from the table, model performance improved when considering separately patients in different pharmacological conditions. Concerning the effect of FOG, if the model is specifically trained on FOG+ and FOG− separately, the performance significantly improves in patients without FOG while ON state of therapy and in patients with FOG while OFF therapy. Table 12 reports the results obtained by training and testing the regression model on different populations (i.e., ON versus OFF therapy, FOG+ versus FOG−). Prediction errors provided by the global model (i.e., the regression model trained and validated on all subjects, independently of the pharmacological condition and of freezing of gait) were compared to those obtained using different models for each pharmacological condition separately. The Wilcoxon test proved that the difference in prediction errors was not statistically significant (p = 0.074); thus, a single model may be used to estimate the PIGD score. On the other hand, training the model on specific subgroups (e.g., patients with FOG, patients ON therapy) and testing on different subgroups led to a large performance impairment, as evident from RMSE values reported in Table 12. Summarizing these findings, it is possible to implement a very general algorithm, but attention should be paid to collect a very general dataset, including patients in different pharmacological conditions, as well as patients with and without FOG.
The large prediction errors observed when training and testing the model on different populations may be due to the different discrimination power of some features. As can be observed in Figure 11, the sensibility of some features to changes in PIGD score depends on the pharmacological condition. Some features were found to exhibit strong correlation with PIGD in patients ON therapy but not in patients OFF therapy, and vice versa. The same behaviour can be observed when training and testing the regression model on patients with and without FOG, while ON therapy. As previously reported when discussing Table 9, top-ranked features were different in FOG+ and FOG− patients, thus, the prediction model performance worsens when trained and tested on different populations.
Finally, from Table 12, it can be noticed that performance did not get significantly impaired when training the model with data from FOG+ (FOG−) patients and testing on data from FOG− (FOG+) patients, while OFF therapy. In this case, common top-ranked features included minimum value, root mean square value, and average height of peaks from the orientation signal; average value of the angular velocity signal; height of the dominant harmonic from the acceleration signal along the y-axis.

4. Discussion

Machine-learning algorithms can reliably predict PIGD scores in PDPs during gait through sensor-based recordings. In this study, a homogeneous cohort of PDPs was recruited and the PIGD scores were calculated in patients OFF and ON therapy, according to standardized clinical procedures. To further control for clinical biases, patients were allocated to the FOG or non-FOG group according to the direct observation of FOG episodes rather than only considering patients’ records. Furthermore, to maximize the prediction performance, many time- and frequency-domain features were computed in addition to classical spatio-temporal parameters routinely used in gait analysis studies. Lastly, a comprehensive statistical analysis was provided on both clinical scores and engineered features, to provide deeper insights into the capability of features to measure axial motor impairment in PDPs.
Significant correlations were found between specific sensor-based variables in the time-as well as frequency-domain and PIGD scores, suggesting that higher PIGD scores are associated with greater kinematic abnormalities during gait in PDPs. In more detail, higher axial motor impairment measured with PIGD was associated with greater abnormalities in movement amplitude, intensity, and regularity in PDPs. In line with these findings, the authors of [23] found significant associations of PIGD scores with sensor-based measures, including the number of walking bouts, gait speed and sway area. These findings also agree with previous studies showing higher impairment of spatio-temporal gait parameters in PDPs presenting a PIGD phenotype with more severe axial dysfunction than those with a tremor-dominant phenotype [39,40]. Accordingly, our clinical-behavioural correlations lay the foundations for elaborating PIGD prediction models based on the considered time- and frequency-domain features.
When considering PIGD prediction with respect to L-Dopa intake, regression models had better performances in PDPs OFF than those ON state of therapy (p = 0.002). The finding of better performance in PDPs OFF with respect to those ON therapy is in line with previous results, reporting variable accuracy of ML algorithms in the sensor-based assessment of motor disorders in PDPs in different pharmacological conditions [41]. Indeed, L-Dopa significantly changes spatiotemporal stride parameters and, accordingly, acts on the ML performance when measuring gait in PD [41,42]. Since the PIGD score consists of several items reflecting both postural and walking abilities, a possible explanation for different ML performances in patients OFF and ON therapy relies on the heterogeneous L-Dopa sensitivity of balance and gait in PD. Indeed, unlike gait, L-Dopa usually does not substantially impact balance in PD [7,43,44]. Therefore, we hypothesize that PIGD scores are more accurately predicted in patients OFF than those ON state of therapy owing to a more similar trend of postural and walking abilities in patients not under dopaminergic therapy. The performance of our regression models in PDPs both OFF and ON therapy were higher than those reported in a previous study testing PDPs only ON therapy [23]. Moreover, while in [23] different activities (i.e., gait, turn, stance) were analysed to provide the final output, in the present study only features extracted from walking bouts were used to predict the PIDG score. Our results suggested that it is possible to implement a single regression model capable of predicting PIGD in PDPs, regardless of the therapeutic condition and the presence of freezing of gait. However, data should be collected from a heterogeneous cohort of PDPs, under different pharmacological conditions. When models were trained on a subgroup of patients (i.e., patients with FOG, patients ON therapy), impaired performance was observed when testing on a different subgroup.
Several time- and frequency-domain features, such as M i n , R M S , M e a n and D H h e i g h t , were found to have different sensibility in patients with and without FOG, a finding fully in agreement with previous studies demonstrating worse continuous gait abnormalities in PD patients with FOG than those without FOG, also outside FOG episodes [45,46,47]. Moreover, different time- and frequency-domain features also explain another relevant finding of this study, that is, models trained in patients OFF therapy do not perform well in patients ON therapy and vice versa. It is likely that, in addition to changes of continuous gait parameters and pharmacological condition, the unpredictable and sudden appearance of FOG affects the walking pattern in PDPs, worsening ML performances. In addition, despite the direct impact on gait, FOG is not included in the calculation of the PIGD score and, accordingly, is not considered for the assessment of axial impairment when using this standardized clinical index.
Unlike the only previous study predicting PIGD scores in PD using three sensing devices [23], only a single, small, and lightweight wearable inertial sensor placed on the thigh was here used, providing a little demanding and unobtrusive solution for everyday application in free-living settings. However, future studies are necessary to clarify the technical feasibility of applying the proposed ML algorithms to data recorded through smartphones in non-supervised environments.
In this study, the experimental tools, including wearable sensors and ML algorithms, were already largely used and validated [48,49,50,51]. The novelty of our study primarily relies on the application of these tools to overcome the clinical need for quantitative measures reflecting axial impairment in PD. However, when considering the findings of this study, the lack of validation on an independent test set is a possible limitation to be accounted for. Indeed, data from thirty-one subjects were used for the analysis. Accordingly, additional studies are necessary to reproduce these findings in larger cohorts of patients.

5. Conclusions

A single inertial sensor placed on the thigh may be a feasible wearable solution for the remote assessment of axial impairment in PD by predicting the PIGD score through dedicated ML algorithms. When implementing prediction models of PIGD scores, patients’ pharmacological conditions and FOG occurrence are significant clinical variables to be considered. The use of an unobtrusive sensing system composed of a single inertial sensor supports the future adoption of commonly available smartphones, embedding inertial systems, for the long-term motor assessment in PD. Accordingly, future studies will address the need for collecting additional sensor-based data in PDPs to further implement subject-dependent prediction models. In addition, data collection will be performed directly in unsupervised conditions to monitor free-living daily activities and get more ecological measures.

Author Contributions

Conceptualization, F.I., I.M., A.S. and A.Z.; methodology, L.B.; software, L.B.; formal analysis, G.O. and L.B.; investigation, L.B.; resources, F.I. and I.M.; data curation, I.M., A.S. and A.Z.; writing—original draft preparation, L.B., G.O., I.M., F.I., A.S. and A.Z.; writing—review and editing, F.I., I.M., G.O. and A.Z.; visualization, L.B.; supervision, F.I., G.O. and A.S.; project administration, F.I., G.O. and A.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the institutional review board, Sapienza University of Rome, Italy.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

Authors wish to thank Luigi Della Torre from STMicroelectronics (Agrate Brianza, Italy) for providing neMEMSi devices.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
BAIBeck Anxiety Inventory
CWTContinuous Wavelet Transform
FABFrontal Assessment Battery
FFTFast Fourier Transform
FOGFreezing of Gait
FOG-QFreezing of Gait Questionnaire
FOG+patients with Freezing of Gait
FOG−patients without Freezing of Gait
HAM-DHamilton Depression rating scale
H&YHoehn and Yahr scale
IMUInertial Measurement Unit
LEDDLevodopa Equivalent Daily Dose
LOSOLeave-One-Subject-Out
LSBLeast Significant Bit
MLMachine Learning
MAEMean Square Error
MDS-UPDRSMovement Disorder Society—Unified Parkinson’s Disease Rating Scale
MMSEMini-Mental State Examination
ONunder dopaminergic therapy
OFFnot under dopaminergic therapy
PIGDPostural Instability and Gait Difficulty
PDParkinson’s Disease
PDPsPatients with Parkinson’s Disease
RMSERoot Mean Square Error
TUGTimed Up and GO

References

  1. Armstrong, M.; Okun, M. Diagnosis and Treatment of Parkinson Disease: A Review. JAMA 2020, 60, 323–548. [Google Scholar] [CrossRef]
  2. Boonstra, T.; van der Kooij, H.; Munneke, M.; Bloem, B. Gait disorders and balance disturbances in Parkinson’s disease: Clinical update and pathophysiology. Curr. Opin. Neurol. 2008, 21, 461–471. [Google Scholar] [CrossRef]
  3. Fasano, A.; Canning, C.; Hausdorff, J.; Lord, S.; Rochester, L. Falls in Parkinson’s disease: A complex and evolving picture. Mov. Disord. 2017, 32, 1524–1536. [Google Scholar] [CrossRef] [PubMed]
  4. Goetz, C.G.; Poewe, W.; Rascol, O.; Sampaio, C.; Stebbins, G.T.; Counsell, C.; Giladi, N.; Holloway, R.G.; Moore, C.G.; Wenning, G.K.; et al. Movement Disorder Society Task Force report on the Hoehn and Yahr staging scale: Status and recommendations. Mov. Disord. 2004, 19, 1020–1028. [Google Scholar] [CrossRef] [PubMed]
  5. Van der Heeden, J.; Marinus, J.; Martinez-Martin, P.; Rodriguez-Blazquez, C.; Geraedts, V.; van Hilten, J. Postural instability and gait are associated with severity and prognosis of Parkinson disease. Neurology 2016, 86, 2243–2250. [Google Scholar] [CrossRef]
  6. Horak, F.; Mancini, M. Objective biomarkers of balance and gait for Parkinson’s disease using body-worn sensors. Mov. Disord. 2013, 11, 1544–1551. [Google Scholar] [CrossRef] [Green Version]
  7. Zampogna, A.; Mileti, I.; Martelli, F.; Paoloni, M.; Del Prete, Z.; Palermo, E. Early balance impairment in Parkinson’s Disease: Evidence from Robot-assisted axial rotations. Clin. Neurophysiol. 2021, 132, 2422–2430. [Google Scholar] [CrossRef]
  8. Suppa, A.; Kita, A.; Leodori, G.; Zampogna, A.; Nicolini, E.; Lorenzi, P.; Rao, R.; Irrera, F. L-DOPA and freezing of gait in Parkinson’s disease: Objective assessment through a wearable wireless system. Front. Neurol. 2017, 8, 406. [Google Scholar] [CrossRef]
  9. Zampogna, A.; Mileti, I.; Palermo, E.; Celletti, C.; Paoloni, M.; Manoni, A. Fifteen Years of Wireless Sensors for Balance Assessment in Neurological Disorders. Sensors 2020, 20, 3247. [Google Scholar] [CrossRef] [PubMed]
  10. Di Biase, L.; Di Santo, A.; Caminiti, M.; De Liso, A.; Shah, S.; Ricci, L.; Vincenzo, D.L. Gait Analysis in Parkinson’s Disease: An Overview of the Most Accurate Markers for Diagnosis and Symptoms Monitoring. Sensors 2020, 20, 3529. [Google Scholar] [CrossRef] [PubMed]
  11. Borzì, L.; Fornara, S.; Amato, F.; Olmo, G.; Artusi, C.A.; Lopiano, L. Smartphone-based evaluation of postural stability in Parkinson’s disease patients during quiet stance. Electronics 2020, 9, 919. [Google Scholar] [CrossRef]
  12. Emmanouil, A.; Rousanoglou, E.; Georgaki, A.; Boudolos, K. Concurrent Validity of Inertially Sensed Measures during Voluntary Body Sway in Silence and while Exposed to a Rhythmic Acoustic Stimulus: A Pilot Study. Digit. Biomark. 2021, 5, 65–73. [Google Scholar] [CrossRef]
  13. Weiss, A.; Herman, T.; Mirelman, A.; Shiratzky, S.S.; Giladi, N.; Barnes, L.L.; Bennett, D.A.; Buchman, A.S.; Hausdorff, J.M. The transition between turning and sitting in patients with Parkinson’s disease: A wearable device detects an unexpected sequence of events. Gait Posture 2019, 67, 224–229. [Google Scholar] [CrossRef]
  14. Atrsaei, A.; Paraschiv-Ionescu, A.; Krief, H.; Henchoz, Y.; Santos-Eggimann, B.; Büla, C.; Aminian, K. Instrumented 5-Time Sit-To-Stand Test: Parameters Predicting Serious Falls beyond the Duration of the Test. Gerontology 2021, 1–14. [Google Scholar] [CrossRef]
  15. Castiglia, S.F.; Tatarelli, A.; Trabassi, D.; De Icco, R.; Grillo, V.; Ranavolo, A.; Varrecchia, T.; Magnifica, F.; Di Lenola, D.; Coppola, G.; et al. Ability of a set of trunk inertial indexes of gait to identify gait instability and recurrent fallers in parkinson’s disease. Sensors 2021, 21, 3449. [Google Scholar] [CrossRef]
  16. Bizovska, L.; Svoboda, Z.; Janura, M.; Bisi, M.C.; Vuillerme, N. Local dynamic stability during gait for predicting falls in elderly people: A one-year prospective study. PLoS ONE 2018, 13, e0197091. [Google Scholar] [CrossRef] [Green Version]
  17. Mazzetta, I.; Zampogna, A.; Suppa, A.; Gumiero, A.; Pessione, M.; Irrera, F. Wearable sensors system for an improved analysis of freezing of gait in Parkinson’s disease using electromyography and inertial signals. Sensors 2019, 19, 948. [Google Scholar] [CrossRef] [Green Version]
  18. Mitchell, T.; Conradsson, D.; Paquette, C. Gait and trunk kinematics during prolonged turning in Parkinson’s disease with freezing of gait. Park. Relat. Disord. 2019, 64, 188–193. [Google Scholar] [CrossRef]
  19. Borzì, L.; Varrecchia, M.; Olmo, G.; Artusi, C.A.; Fabbri, M.; Rizzone, M.G.; Romagnolo, A.; Zibetti, M.; Lopiano, L. A new index to assess turning quality and postural stability in patients with Parkinson ’ s disease. Biomed. Signal Process. Control 2020, 62, 1–7. [Google Scholar] [CrossRef]
  20. Zhan, A.; Mohan, S.; Tarolli, C.; Schneider, R.B.; Adams, J.L.; Sharma, S.; Elson, M.J.; Spear, K.L.; Glidden, A.M.; Little, M.A.; et al. Using Smartphones and Machine Learning to Quantify Parkinson Disease Severity: The Mobile Parkinson Disease Score. JAMA Neurol. 2018, 75, 876–880. [Google Scholar] [CrossRef]
  21. Landolfi, A.; Ricciardi, C.; Donisi, L.; Cesarelli, G.; Troisi, J.; Vitale, C.; Barone, P.; Amboni, M. Machine Learning Approaches in Parkinson’s Disease. Curr. Med. Chem. 2021, 28, 6548–6568. [Google Scholar] [CrossRef] [PubMed]
  22. Rodríguez-Molinero, A.; Samà, A.; Pérez-López, C.; Rodríguez-Martín, D.; Alcaine, S.; Mestre, B.; Quispe, P.; Giuliani, B.; Vainstein, G.; Browne, P.; et al. Analysis of correlation between an accelerometer-Based algorithm for Detecting Parkinsonian gait and UPDRS subscales. Front. Neurol. 2017, 8, 1–6. [Google Scholar] [CrossRef] [Green Version]
  23. Safarpour, D.; Dale, M.L.; Shah, V.V.; Talman, L.; Carlson-Kuhta, P.; Horak, F.B.; Mancini, M. Surrogates for rigidity and PIGD MDS-UPDRS subscores using wearable sensors. Gait Posture 2021, 91, 186–191. [Google Scholar] [CrossRef] [PubMed]
  24. Kubota, K.; Chen, J.; Little, M.A. Machine learning for large-scale wearable sensor data in Parkinson’s disease: Concepts, promises, pitfalls, and futures. Mov. Disord. 2016, 9, 1314–1326. [Google Scholar] [CrossRef]
  25. Rajkomar, A.; Dean, J.; Kohane, I. Machine Learning in Medicine. New Engl. J. Med. 2019, 380, 1347–1358. [Google Scholar] [CrossRef]
  26. Tomlinson, C.L.; Stowe, R.; Patel, S.; Rick, C.; Gray, R.; Clarke, C.E. Systematic review of levodopa dose equivalency reporting in Parkinson’s disease. Mov. Disord. 2010, 25, 2649–2653. [Google Scholar] [CrossRef]
  27. Comotti, D.; Galizzi, M.; Vitali, A. neMEMSi: One step forward in wireless attitude and heading reference systems. In Proceedings of the 2014 International Symposium on Inertial Sensors and Systems (ISISS), Laguna Beach, CA, USA, 25–26 February 2014; pp. 1–4. [Google Scholar] [CrossRef]
  28. Vargas-Valencia, L.S.; Elías, A.; Frizera Neto, A.; Rocón, E. Body to sensor calibration procedure for lower limb joint angle estimation applied to imu-based gait analysis. In Proceedings of the XXIV Brazilian Congress on Biomedical Engineering (CBEB 2014), Uberlandia, Brazil, 13–17 October 2014; pp. 777–780. Available online: https://digital.csic.es/bitstream/10261/130403/1/2014-Body_To_Sensor_Calibration_Procedure_for_Lower_Limb_Joint_Angle_Estimation_Applied_To_Imu-Based_Gait_Analysis.pdf (accessed on 16 November 2021).
  29. Sijobert, B.; Benoussaad, M.; Denys, J.; Pissard-Gibollet, R.; Geny, C.; Coste, C.A. Implementation and validation of a stride length estimation algorithm, using a single basic inertial sensor on healthy subjects and patients suffering from Parkinson’s disease. Health 2015, 7, 704–714. [Google Scholar] [CrossRef] [Green Version]
  30. Roetenberg, D.; Luinge, H.J.; Baten, C.T.; Veltink, P.H. Compensation of magnetic disturbances improves inertial and magnetic sensing of human body segment orientation. IEEE Trans. Neural Syst. Rehabil. Eng. 2005, 13, 395–405. [Google Scholar] [CrossRef] [Green Version]
  31. Caruso, M.; Sabatini, A.M.; Laidig, D.; Seel, T.; Knaflitz, M.; Croce, U.D.; Cereatti, A. Analysis of the Accuracy of Ten Algorithms for Orientation Estimation Using Inertial and Magnetic Sensing under Optimal Conditions: One Size Does Not Fit All. Sensors 2021, 21, 2543. [Google Scholar] [CrossRef]
  32. Barralon, P.; Vuillerme, N.; Noury, N. Walk Detection With a Kinematic Sensor: Frequency and Wavelet Comparison. In Proceedings of the 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, New York, NY, USA, 30 August–3 September 2006; pp. 1711–1714. [Google Scholar] [CrossRef]
  33. Pham Minh, H.; Elshehabi, M.; Haertner, L.; Del Din, S.; Srulijes, K.; Heger, T.; Synofzik, M.; Hobert, M.A.; Faber, G.S.; Hansen, C.; et al. Validation of a Step Detection Algorithm during Straight Walking and Turning in Patients with Parkinson’s Disease and Older Adults Using an Inertial Measurement Unit at the Lower Back. Front. Neurol. 2017, 8, 457. [Google Scholar] [CrossRef] [Green Version]
  34. Huijben, B. The effect of walking speed on quality of gait in older adults Gait & Posture The e ff ect of walking speed on quality of gait in older adults. Gait Posture 2018, 65, 112–116. [Google Scholar] [CrossRef] [Green Version]
  35. Bouça-Machado, R.; Jalles, C.; Guerreiro, D.; Pona-Ferreira, F.; Branco, D.; Guerreiro, T.; Matias, R.; Ferreira, J.J. Gait Kinematic Parameters in Parkinson’s Disease: A Systematic Review. J. Park. Dis. 2020, 10, 843–853. [Google Scholar] [CrossRef]
  36. Abhayasinghe, N.; Murray, I. Human gait phase recognition based on thigh movement computed using IMUs. In Proceedings of the IEEE ISSNIP 2014—2014 IEEE 9th International Conference on Intelligent Sensors, Sensor Networks and Information Processing, Singapore, 21–24 April 2014. [Google Scholar] [CrossRef] [Green Version]
  37. Smola, A.; Schölkopf, B. A tutorial on support vector regression. JAMA 2004, 14, 199–222. [Google Scholar] [CrossRef] [Green Version]
  38. Mangasarian, O.; Musicant, D. Robust linear and support vector regression. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22, 950–955. [Google Scholar] [CrossRef]
  39. Terashi, H.; Taguchi, T.; Ueta, Y.; Yoshihiko, O.; Hiroshi, M.; Hitoshi, A. Analysis of non-invasive gait recording under free-living conditions in patients with Parkinson’s disease: Relationship with global cognitive function and motor abnormalities. BMC Neurol. 2020, 161. [Google Scholar] [CrossRef] [PubMed]
  40. Wu, Z.; Zhong, M.; Jiang, X.; Shen, B.; Zhu, J.; Pan, Y.; Dong, J.; Yan, J.; Xu, P.; Zhang, W.; et al. Can Quantitative Gait Analysis Be Used to Guide Treatment of Patients with Different Subtypes of Parkinson’s Disease? Neuropsychiatr. Dis. Treat. 2020, 9, 2335–2341. [Google Scholar] [CrossRef] [PubMed]
  41. Borzì, L.; Mazzetta, I.; Zampogna, A.; Suppa, A.; Olmo, G.; Irrera, F. Prediction of freezing of gait in parkinson’s disease using wearables and machine learning. Sensors 2021, 21, 614. [Google Scholar] [CrossRef] [PubMed]
  42. Curtze, C.; Nutt, J.; Carlson-Kuhta, P.; Mancini, M.; Horak, F. Levodopa Is a Double-Edged Sword for Balance and Gait in People With Parkinson’s Disease. Mov. Disord. 2015, 30, 1361–1370. [Google Scholar] [CrossRef]
  43. De Kam, D.; Nonnekes, J.; Oude Nijhuis, L.; Geurts, A.C.H.; Bloem, B.R.; Weerdesteyn, V. Dopaminergic medication does not improve stepping responses following backward and forward balance perturbations in patients with Parkinson’s disease. J. Neurol. 2014, 261, 2330–2337. [Google Scholar] [CrossRef]
  44. Di Giulio, I.; St George, R.; Kalliolia, E.; Peters, A.; Limousin, P.; Day, B. Maintaining balance against force perturbations: Impaired mechanisms unresponsive to levodopa in Parkinson’s disease. J. Neurophysiol. 2016, 116, 493–502. [Google Scholar] [CrossRef] [Green Version]
  45. Barbe, M.; Amarell, M.; Snijders, A.; Florin, E.; Quatuor, E.; Schönau, E.; Fink, G.; Bloem, B.; Timmermann, L. Gait and upper limb variability in Parkinson’s disease patients with and without freezing of gait. J. Neurol. 2014, 261, 330–342. [Google Scholar] [CrossRef] [PubMed]
  46. Plotnik, M.; Giladi, N.; Balash, Y.; Peretz, C.; Hausdorff, J. Is freezing of gait in Parkinson’s disease related to asymmetric motor function? Ann. Neurol. 2005, 57, 656–663. [Google Scholar] [CrossRef] [PubMed]
  47. Lorenzi, P.; Rao, R.; Romano, G.; Kita, A.; Serpa, M.; Filesi, F.; Parisi, R.; Supp, A.; Bologn, M.; Berardelli, A.; et al. Smart Sensing Systems for the Detection of Human Motion Disorders. Procedia Eng. 2015, 120, 324–327. [Google Scholar] [CrossRef] [Green Version]
  48. Montesinos, L.; Castaldo, R.; Pecchia, L. Wearable inertial sensors for fall risk assessment and prediction in older adults: A systematic review and meta-analysis. IEEE Trans. Neural Syst. Rehabil. Eng. 2018, 26, 573–582. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Brognara, L.; Palumbo, P.; Grimm, B.; Palmerini, L. Assessing Gait in Parkinson’s Disease Using Wearable Motion Sensors: A Systematic Review. Diseases 2019, 7, 18. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Zanardi, A.P.J.; da Silva, E.S.; Costa, R.R.; Passos-Monteiro, E.; dos Santos, I.O.; Kruel, L.F.M.; Peyré-Tartaruga, L.A. Gait parameters of Parkinson’s disease compared with healthy controls: A systematic review and meta-analysis. Sci. Rep. 2021, 11, 752. [Google Scholar] [CrossRef] [PubMed]
  51. Del Din, S.; Kirk, C.; Yarnall, A.J.; Rochester, L.; Hausdorff, J.M. Body-Worn Sensors for Remote Monitoring of Parkinson’s Disease Motor Symptoms: Vision, State of the Art, and Challenges Ahead. J. Park. Dis. 2021, 11, 35–47. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Sketch of sensor position, together with an exploded view of the neMEMSI device.
Figure 1. Sketch of sensor position, together with an exploded view of the neMEMSI device.
Sensors 22 00412 g001
Figure 2. Schematic of the Kalman filter, together with input and output. Raw gyroscope (a) and accelerometer (b) readings are input to the Kalman filter (c) to provide an estimate of orientation (d).
Figure 2. Schematic of the Kalman filter, together with input and output. Raw gyroscope (a) and accelerometer (b) readings are input to the Kalman filter (c) to provide an estimate of orientation (d).
Sensors 22 00412 g002
Figure 3. Absolute value of the CWT plotted as a function of time and frequency. Yellow zones represent the walking segments of the signal.
Figure 3. Absolute value of the CWT plotted as a function of time and frequency. Yellow zones represent the walking segments of the signal.
Sensors 22 00412 g003
Figure 4. Orientation signal (blue) and walking bouts detected by the algorithm (orange).
Figure 4. Orientation signal (blue) and walking bouts detected by the algorithm (orange).
Sensors 22 00412 g004
Figure 5. Schematic of the analysis performed. The processing was performed for both pharmacological conditions, different populations, different sizes of the feature set, and different dimensionality reduction methods. ON: under dopaminergic therapy; OFF: not under dopaminergic therapy; FOG: patients with Parkinson’s disease and freezing of gait; FOG−: patients with Parkinson’s disease without freezing of gait; PCA: principal component analysis.
Figure 5. Schematic of the analysis performed. The processing was performed for both pharmacological conditions, different populations, different sizes of the feature set, and different dimensionality reduction methods. ON: under dopaminergic therapy; OFF: not under dopaminergic therapy; FOG: patients with Parkinson’s disease and freezing of gait; FOG−: patients with Parkinson’s disease without freezing of gait; PCA: principal component analysis.
Sensors 22 00412 g005
Figure 6. Correlation plot between the average principal harmonic height for the x-axis angular velocity (DH height 4) and PIGD score. Data and PIGD score refer to patients OFF (left) and ON (right) therapy. PIGD: postural instability and gait difficulty.
Figure 6. Correlation plot between the average principal harmonic height for the x-axis angular velocity (DH height 4) and PIGD score. Data and PIGD score refer to patients OFF (left) and ON (right) therapy. PIGD: postural instability and gait difficulty.
Sensors 22 00412 g006
Figure 7. The effect of therapy on the regression model performances, in terms of correlation coefficient (left) and root mean square error (right). ON: under dopaminergic therapy; OFF: not under dopaminergic therapy.
Figure 7. The effect of therapy on the regression model performances, in terms of correlation coefficient (left) and root mean square error (right). ON: under dopaminergic therapy; OFF: not under dopaminergic therapy.
Sensors 22 00412 g007
Figure 8. Regression results for patients under different pharmacological condition. Data are plotted using a scatter plot and the regression line is reported as the best fit line. (a) Patients under dopaminergic therapy. (b) Patients not under dopaminergic therapy.
Figure 8. Regression results for patients under different pharmacological condition. Data are plotted using a scatter plot and the regression line is reported as the best fit line. (a) Patients under dopaminergic therapy. (b) Patients not under dopaminergic therapy.
Sensors 22 00412 g008
Figure 9. The effect of freezing of gait on the regression model performance, in terms of correlation coefficient (left) and root mean square error (right). Performance refers to patients under dopaminergic therapy. FOG+: patients with freezing of gait; FOG−: patients without freezing of gait.
Figure 9. The effect of freezing of gait on the regression model performance, in terms of correlation coefficient (left) and root mean square error (right). Performance refers to patients under dopaminergic therapy. FOG+: patients with freezing of gait; FOG−: patients without freezing of gait.
Sensors 22 00412 g009
Figure 10. The effect of freezing of gait on the regression model performance, in terms of correlation coefficient (left) and root mean square error (right). Performance refers to patients not under dopaminergic therapy. FOG+: patients with freezing of gait; FOG−: patients without freezing of gait.
Figure 10. The effect of freezing of gait on the regression model performance, in terms of correlation coefficient (left) and root mean square error (right). Performance refers to patients not under dopaminergic therapy. FOG+: patients with freezing of gait; FOG−: patients without freezing of gait.
Sensors 22 00412 g010
Figure 11. Pearson correlation coefficient between features and PIGD score. DH ratio and DH frequency refer to the component θ x ; Min and vPeaks refer to the component ω x ; RMSE and Range refer to the component α y .
Figure 11. Pearson correlation coefficient between features and PIGD score. DH ratio and DH frequency refer to the component θ x ; Min and vPeaks refer to the component ω x ; RMSE and Range refer to the component α y .
Sensors 22 00412 g011
Table 1. Demographic and clinical features of patients enrolled in the present study (mean ± standard deviation). H&Y: Hoehn and Yahr.
Table 1. Demographic and clinical features of patients enrolled in the present study (mean ± standard deviation). H&Y: Hoehn and Yahr.
# Patients (Male)Age (Years)Disease Duration (Years)H&Y
31 (23)71.9 ± 6.910.9 ± 5.92.4 ± 0.8
Table 2. Standardised scales and scores of patients enrolled in the present study (mean ± standard deviation). MMSE: mini-mental state examination; FAB: frontal assessment battery; HAM-D: Hamilton depression rating scale; BAI: Beck anxiety inventory; LEDD: L-Dopa equivalent daily dose; MDS-UPDRS-III: Movement Disorder Society—unified Parkinson’s disease rating scale part III; OFF: not under dopaminergic therapy; ON: under dopaminergic therapy; PIGD: postural instability/gait difficulty score.
Table 2. Standardised scales and scores of patients enrolled in the present study (mean ± standard deviation). MMSE: mini-mental state examination; FAB: frontal assessment battery; HAM-D: Hamilton depression rating scale; BAI: Beck anxiety inventory; LEDD: L-Dopa equivalent daily dose; MDS-UPDRS-III: Movement Disorder Society—unified Parkinson’s disease rating scale part III; OFF: not under dopaminergic therapy; ON: under dopaminergic therapy; PIGD: postural instability/gait difficulty score.
MMSEFABHAM-DBAILEDD (mg)MDS-UPDRS-III OFF (ON)PIGD OFF (ON)
28.1 ± 1.914.7 ± 2.812.9 ± 6.811.8 ± 7.5819 ± 40635.9 ± 13.9 (27.9 ± 13.7)7.3 ± 5.7 (6.3 ± 4.6)
Table 3. Inertial sensors technical characteristics.
Table 3. Inertial sensors technical characteristics.
SensorRangeSensitivitySample Rate
Accelerometer±2 g61 μ g/LSB60 Hz
Gyroscope±245 dps8.75 mdps/digit60 Hz
Table 4. List of time-domain features extracted in the present study, together with equations and some brief explanations. α : acceleration; ω : angular velocity; θ : orientation.
Table 4. List of time-domain features extracted in the present study, together with equations and some brief explanations. α : acceleration; ω : angular velocity; θ : orientation.
IDFeatureComponentNumberEquationExplanation
1Min α y , α z , ω x , θ x 4-minimum value
2Max α y , α z , ω x , θ x 4-maximum value
3Mean α y , α z , ω x , θ x 4 x ¯ = 1 N i = 1 N x i average value
4Std α y , α z , ω x , θ x 4 σ x = 1 N i = 1 N ( x i x ¯ ) 2 standard deviation
5RMS α y , α z , ω x , θ x 4 x R M S = 1 N i = 1 N x i 2 root mean square value
6Range α y , α z , ω x , θ x 4 r x  =  x m a x x m i n range of values
7Entropy α y , α z , ω x , θ x 4 E x = x log ( x + ϵ ) , ϵ = 10 5 Shannon signal entropy
8nPeaks α y , α z , ω x , θ x 4-number of peaks higher than Std
9hPeaks α y , α z , ω x , θ x 4-average height of nPeaks
10vPeaks α y , α z , ω x , θ x 4-standard deviation of hPeaks
11Zc α y , α z , ω x , θ x 4-zero-crossing rate
12Corr α y , α z , ω x , θ x 7 r ( i , j ) = c o v ( i , j ) σ ( i ) σ ( j ) correlation between axis pair
Table 5. List of spectral-domain features extracted in the present study, together with equations and some brief explanations. α : acceleration; ω : angular velocity; θ : orientation.
Table 5. List of spectral-domain features extracted in the present study, together with equations and some brief explanations. α : acceleration; ω : angular velocity; θ : orientation.
IDFeatureComponentNumberEquationExplanation
13DH frequency α y , α z , ω x , θ x 4-frequency of the principal harmonic
14DH height α y , α z , ω x , θ x 4-amplitude of the principal harmonic
15DH width α y , α z , ω x , θ x 4-width of the principal harmonic
16 E t o t α y , α z , ω x , θ x 4 f = 1 F s / 2 X f total signal energy
17DH ratio α y , α z , ω x , θ x 4-ratio between the energy of the principal harmonic and E t o t
18sEntropy α y , α z , ω x , θ x 4 X f log ( X f + ϵ ) Shannon entropy of the signal FFT
19binEnergy α y , α z , ω x , θ x 24-ratio between energy in specific frequency bands and E t o t
Table 6. Correlation between engineered features and PIGD score. Results are reported in terms of Pearson correlation coefficient and relative p-value. For each feature, significant components are reported. α : acceleration; ω : angular velocity; θ : orientation.
Table 6. Correlation between engineered features and PIGD score. Results are reported in terms of Pearson correlation coefficient and relative p-value. For each feature, significant components are reported. α : acceleration; ω : angular velocity; θ : orientation.
FeatureComponentPearson Correlation Coefficient (p-Value)
PIGD OFFPIGD ON
Min α y 0.54 (0.002)0.58 (<0.001)
Mean ω x 0.64 (<0.001)0.54 (0.002)
RMS α y , ω x −0.67 (<0.001), −0.74 (<0.001)−0.57 (0.002), −0.72 (<0.001)
hPeaks α y , ω x −0.70 (<0.001), −0.74 (<0.001)−0.58 (<0.001), −0.60 (<0.001)
DH height α y ω x , θ x −0.59 (<0.001), −0.71 (<0.001), −0.69 (<0.001)−0.57 (<0.001), −0.70 (<0.001), −0.65 (<0.001)
Table 7. Performance of regression models in different pharmacological conditions using leave-one-subject-out validation. Results were obtained for different sizes of the feature set and different dimensionality reduction methods. Best performances are marked with bold type. ON: under dopaminergic therapy; OFF: not under dopaminergic therapy; var: total variance explained; r: correlation coefficient; SVR: support vector regression; RMSE: root mean square error; MAE: mean absolute error.
Table 7. Performance of regression models in different pharmacological conditions using leave-one-subject-out validation. Results were obtained for different sizes of the feature set and different dimensionality reduction methods. Best performances are marked with bold type. ON: under dopaminergic therapy; OFF: not under dopaminergic therapy; var: total variance explained; r: correlation coefficient; SVR: support vector regression; RMSE: root mean square error; MAE: mean absolute error.
# FeaturesTherapyDimensionality ReductionSVR ParametersPerformance
MethodValueKernelKernel ScaleBox ConstraintrRMSEMAE
5ONr (min–max)0.65–0.72linear-10.90.710.220.18
var (%)82.9linear-0.090.710.250.20
OFFr (min–max)0.76–0.77gaussian1.412.670.760.210.18
var (%)77.3linear-0.0060.770.210.16
10ONr (min–max)0.58–0.72linear-378.60.540.270.22
var (%)93.0linear-0.070.550.260.20
OFFr (min–max)0.74–0.77linear-0.350.690.230.19
var (%)88.7linear-1.910.510.280.23
15ONr (min–max)0.56–0.72linear-0.0030.670.230.19
var (%)97.5linear-0.0090.750.200.16
OFFr (min–max)0.68–0.77gaussian449.69253.510.690.230.19
var (%)94.7linear-0.0010.790.190.15
20ONr (min–max)0.55–0.72linear-0.0020.710.220.16
var (%)99.2linear-641.60.50.280.24
OFFr (min–max)0.66–0.77linear-0.0040.790.200.15
var (%)97.9gaussian40.060.870.760.210.15
25ONr (min–max)0.52–0.72linear-0.0050.660.240.19
var (%)99.8linear-0.0030.710.220.16
OFFr (min–max)0.62–0.72linear-0.0040.780.200.15
var (%)99.5cubic-0.190.750.210.16
Table 8. Demographic and clinical features of patients enrolled in the present study (mean ± standard deviation). H&Y: Hoehn and Yahr; FOG: freezing of gait; FOG-Q: freezing of gait questionnaire.
Table 8. Demographic and clinical features of patients enrolled in the present study (mean ± standard deviation). H&Y: Hoehn and Yahr; FOG: freezing of gait; FOG-Q: freezing of gait questionnaire.
Group# Patients (Male)Age (Years)MDS-UPDRS-III OFF (ON)PIGD OFF (ON)
FOG+17 (13)72.0 ± 7.640.9 ± 13.2 (32.9 ± 14.1)11.2 ± 4.5 (9.6 ± 3.4)
FOG−14 (10)71.8 ± 6.429.7 ± 12.3 (21.9 ± 10.8)2.6 ± 2.5 (2.4 ± 2.3)
p0.353 (0.531)0.8110.054 (0.030)<0.001 (<0.001)
Table 9. Performance of regression models in patients with (FOG+) and without (FOG−) freezing of gait, both under dopaminergic therapy. Results were obtained for different feature set size and different dimensionality reduction methods. Best performances are marked with bold type. RMSE: root mean square error; r: correlation coefficient; MAE: mean absolute error.
Table 9. Performance of regression models in patients with (FOG+) and without (FOG−) freezing of gait, both under dopaminergic therapy. Results were obtained for different feature set size and different dimensionality reduction methods. Best performances are marked with bold type. RMSE: root mean square error; r: correlation coefficient; MAE: mean absolute error.
# FeaturesGroupDimensionality ReductionSVM ParametersPerformance
MethodValueKernelKernel ScaleBox ConstraintrRMSEMAE
5FOG+r (min–max)0.58–0.69linear-0.0070.70.280.22
var (%)85.2linear-0.020.630.300.25
FOG−r (min–max)0.77–0.84linear-0.070.850.190.13
var (%)82.1linear-0.0070.770.220.15
10FOG+r (min–max)0.55–0.69linear-1.690.50.340.26
var (%)96.6linear-0.030.470.340.29
FOG−r (min–max)0.69–0.84linear-0.020.830.190.15
var (%)96.5linear-0.0040.830.190.15
15FOG+r (min–max)0.53–0.69linear-0.510.710.270.21
var (%)99.8linear-0.060.640.300.24
FOG−r (min–max)0.66–0.84quadratic-0.0190.70.250.20
var (%)99.8linear-0.150.760.220.18
20FOG+r (min–max)0.50–0.69linear-0.0070.580.320.28
var (%)99.9linear-0.460.670.290.23
FOG−r (min–max)0.64–0.84linear-0.0040.810.200.25
var (%)99.9linear-0.010.760.220.17
25FOG+r (min–max)0.46–0.69linear-0.0140.70.280.24
var (%)99.9linear-4.020.710.270.22
FOG−r (min–max)0.62–0.84linear-0.020.770.220.19
var (%)99.95linear-85.90.760.220.18
Table 10. Performance of regression models in patients with (FOG+) and without (FOG−) freezing of gait, both not under dopaminergic therapy. Results were obtained for different feature set sizes and different dimensionality reduction methods. Best performances are marked with bold type. RMSE: root mean square error; r: correlation coefficient; MAE: mean absolute error.
Table 10. Performance of regression models in patients with (FOG+) and without (FOG−) freezing of gait, both not under dopaminergic therapy. Results were obtained for different feature set sizes and different dimensionality reduction methods. Best performances are marked with bold type. RMSE: root mean square error; r: correlation coefficient; MAE: mean absolute error.
# FeaturesGroupDimensionality ReductionSVM ParametersPerformance
MethodValueKernelKernel ScaleBox ConstraintrRMSEMAE
5FOG+r (min–max)0.58–0.65linear-2.70.540.330.29
var (%)83.1gaussian69.32.30.650.300.25
FOG−r (min–max)0.70–0.76linear-0.010.740.230.16
var (%)83.5linear-0.060.650.260.20
10FOG+r (min–max)0.55–0.65linear-0.930.760.250.18
var (%)95.7linear-0.0040.780.250.22
FOG−r (min–max)0.69–0.76linear-83.90.750.230.18
var (%)97.2linear-0.0030.750.230.15
15FOG+r (min–max)0.52–0.65linear-0.030.670.290.24
var (%)99.7linear-118.50.630.300.26
FOG−r (min–max)0.63–0.76linear-0.0060.79 0.210.15
var (%)99.6linear-0.0020.690.250.16
20FOG+r (min–max)0.50–0.65linear-0.370.820.220.19
var (%)99.8linear-0.050.790.240.21
FOG−r (min–max)0.61–0.76linear-0.0090.780.220.14
var (%)99.8linear-0.0020.710.240.16
25FOG+r (min–max)0.48–0.65linear-621.20.810.230.19
var (%)99.9linear-24.20.830.220.19
FOG−r (min–max)0.59–0.76linear-0.690.750.230.16
var (%)99.9linear-0.120.690.250.17
Table 11. Performance of regression models on different populations under different pharmacological conditions. ON: under dopaminergic therapy; OFF: not under dopaminergic therapy; FOG+: patients with freezing of gait; FOG−: patients without freezing of gait.
Table 11. Performance of regression models on different populations under different pharmacological conditions. ON: under dopaminergic therapy; OFF: not under dopaminergic therapy; FOG+: patients with freezing of gait; FOG−: patients without freezing of gait.
TherapyFOGPerformance
rRMSEMAE
AllAll0.640.220.17
ONAll0.750.200.16
FOG+0.710.270.21
FOG−0.850.190.13
OFFAll0.790.190.15
FOG+0.830.220.19
FOG−0.790.210.15
Table 12. Performance of the regression model for different combination of training and test samples. ON: under dopaminergic therapy; OFF: not under dopaminergic therapy; FOG+: patients with freezing of gait; FOG−: patients without freezing of gait.
Table 12. Performance of the regression model for different combination of training and test samples. ON: under dopaminergic therapy; OFF: not under dopaminergic therapy; FOG+: patients with freezing of gait; FOG−: patients without freezing of gait.
Training SampleTesting SamplePerformance
rRMSEMAE
ONOFF0.700.570.47
OFFON0.670.420.15
FOG+ (ON)FOG− (ON)0.340.430.37
FOG− (ON)FOG+ (ON)0.400.390.35
FOG+ (OFF)FOG− (OFF)0.730.360.25
FOG− (OFF)FOG+ (OFF)0.690.330.25
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Borzì, L.; Mazzetta, I.; Zampogna, A.; Suppa, A.; Irrera, F.; Olmo, G. Predicting Axial Impairment in Parkinson’s Disease through a Single Inertial Sensor. Sensors 2022, 22, 412. https://doi.org/10.3390/s22020412

AMA Style

Borzì L, Mazzetta I, Zampogna A, Suppa A, Irrera F, Olmo G. Predicting Axial Impairment in Parkinson’s Disease through a Single Inertial Sensor. Sensors. 2022; 22(2):412. https://doi.org/10.3390/s22020412

Chicago/Turabian Style

Borzì, Luigi, Ivan Mazzetta, Alessandro Zampogna, Antonio Suppa, Fernanda Irrera, and Gabriella Olmo. 2022. "Predicting Axial Impairment in Parkinson’s Disease through a Single Inertial Sensor" Sensors 22, no. 2: 412. https://doi.org/10.3390/s22020412

APA Style

Borzì, L., Mazzetta, I., Zampogna, A., Suppa, A., Irrera, F., & Olmo, G. (2022). Predicting Axial Impairment in Parkinson’s Disease through a Single Inertial Sensor. Sensors, 22(2), 412. https://doi.org/10.3390/s22020412

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop