Next Article in Journal
Multitask Attention-Based Neural Network for Intraoperative Hypotension Prediction
Previous Article in Journal
Predicting Respiratory Rate from Electrocardiogram and Photoplethysmogram Using a Transformer-Based Model
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development of a New Wearable Device for the Characterization of Hand Tremor

1
Biotecnomed S.C.aR.L., Viale Europa, 88100 Catanzaro, Italy
2
Neuroscience Research Center, Department of Medical and Surgical Sciences, University “Magna Graecia”, Viale Europa, 88100 Catanzaro, Italy
3
Institute of Neurology, Department of Medical and Surgical Sciences, University “Magna Graecia”, Viale Europa, 88100 Catanzaro, Italy
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Bioengineering 2023, 10(9), 1025; https://doi.org/10.3390/bioengineering10091025
Submission received: 19 July 2023 / Revised: 17 August 2023 / Accepted: 28 August 2023 / Published: 30 August 2023
(This article belongs to the Topic Machine Learning and Biomedical Sensors)

Abstract

:
Rest tremor (RT) is observed in subjects with Parkinson’s disease (PD) and Essential Tremor (ET). Electromyography (EMG) studies have shown that PD subjects exhibit alternating contractions of antagonistic muscles involved in tremors, while the contraction pattern of antagonistic muscles is synchronous in ET subjects. Therefore, the RT pattern can be used as a potential biomarker for differentiating PD from ET subjects. In this study, we developed a new wearable device and method for differentiating alternating from a synchronous RT pattern using inertial data. The novelty of our approach relies on the fact that the evaluation of synchronous or alternating tremor patterns using inertial sensors has never been described so far, and current approaches to evaluate the tremor patterns are based on surface EMG, which may be difficult to carry out for non-specialized operators. This new device, named “RT-Ring”, is based on a six-axis inertial measurement unit and a Bluetooth Low-Energy microprocessor, and can be worn on a finger of the tremulous hand. A mobile app guides the operator through the whole acquisition process of inertial data from the hand with RT, and the prediction of tremor patterns is performed on a remote server through machine learning (ML) models. We used two decision tree-based algorithms, XGBoost and Random Forest, which were trained on features extracted from inertial data and achieved a classification accuracy of 92% and 89%, respectively, in differentiating alternating from synchronous tremor segments in the validation set. Finally, the classification response (alternating or synchronous RT pattern) is shown to the operator on the mobile app within a few seconds. This study is the first to demonstrate that different electromyographic tremor patterns have their counterparts in terms of rhythmic movement features, thus making inertial data suitable for predicting the muscular contraction pattern of tremors.

1. Introduction

Tremor is the most common movement disorder and is defined as an involuntary, rhythmic, oscillatory movement of a body part, often involving the hands [1]. Differential diagnosis of tremor mainly comprises Parkinson’s disease (PD) and essential tremor (ET), which are the two most common causes of upper limb tremor [1,2,3,4].
Electrophysiological tremor analysis allows an objective and reproducible characterization of tremor features, which can help clinicians in the differential diagnosis [5,6]. Among the various tremor features, the contraction pattern of the antagonistic forearm muscles has shown the highest diagnostic value in previous studies, outperforming tremor amplitude or frequency, especially when tremor analysis was employed in patients with rest tremor (RT) [7].
The evaluation of rest tremor pattern is usually performed through visual inspection of tremor recordings by neurologists or neurophysiologists expert in tremor analysis [7,8]. In addition, a quantitative method also exists [9] to confirm the visual assessment of the pattern, based on the calculation of the tremor phase, which reflects the shift between contraction bursts of antagonist muscles; the pattern is synchronous (S) when bursts are “in phase” (low phase values) and alternating (A) when bursts are phase-shifted (high phase values). These methods are equally valid. However, both are based on the surface EMG tremor analysis, which requires an electromyograph and profound technical expertise (correct positioning of the electrodes, trace acquisition, visual interpretation of the tremor recordings, or quantitative phase analysis). For this reason, to date, the analysis of tremor patterns and phases has been performed mainly in centers that have access to technological and human resources. In Figure 1, example tremor EMG signals are shown, acquired by an electromyograph, from two different patients: the signal in Figure 1A refers to an alternating tremor pattern, while the signal in Figure 1B is an example of a synchronous tremor activation pattern.
In the last years, there has been an increasing demand for more accessible tools and techniques that could assist not only specialists but also general practitioners in screening for neurological disorders characterized by tremor symptoms. In a first attempt to export the technology used in electrophysiology laboratories into outpatient settings, we have recently developed a wearable mobile device, termed “μEMG” [10], in the form of a wrist-watch-like support, with two pairs of surface electrodes that record the contraction of the antagonist muscles in the forearm. The recorded data are accessed through a mobile application. This technique closely resembles the process of recording tremors using sEMG. Despite its portability advantage, which allows its use also and in the absence of an electromyograph, the μEMG device still requires the use of surface electrodes for muscle recording, and needs dedicated expertise for the correct application of electrodes on the forearm antagonist muscles and for setting various acquisition parameters (signal-to-noise threshold, duration of the recording, etc.).
The need for simpler and cost-effective approaches in tremor analysis has led to the development of many wearable devices based on inertial sensors, which do not require any specific expertise (differently from EMG-based approaches) and can also be used to evaluate tremors at home or in primary-care centers. Most of the proposed solutions so far have focused on detecting tremor frequency and power, which are of great value for assessing tremor severity. On the other hand, there is a lack of simple devices assessing the phase or pattern of tremors using inertial sensors and signals [11].
The objectives of this study were as follows:
To develop a new low-cost miniaturized wearable device, termed “RT-ring”, which can be placed on a finger of the hand with RT to acquire inertial (accelerometric and gyroscopic) data of tremors.
By analyzing the inertial data collected with the RT-Ring experimental prototype, and employing ML algorithms to identify combinations of inertial features that can accurately differentiate between alternating and synchronous tremor patterns.
This is a proof-of-concept study testing the feasibility of predicting the muscular contraction pattern of rest tremor using inertial data only, in the absence of surface electromyography. The use of Machine Learning (ML) and Artificial Intelligence (AI) has been of great help in the last decades to automate complex tasks and improve performances in various fields, including in industrial [12] and biomedical [13] applications. Rhythmic muscle activation in the forearm can be regarded as the motor source of periodic, tremulous movements of the hand. Therefore, it is reasonable to look for information about different activation patterns of the motor source by analyzing through ML algorithms the movement of the hand as detected by inertial sensors. This approach has never been described so far and would allow an easier evaluation of tremor patterns, even by operators without EMG expertise.

2. Materials and Methods

The overall architecture of the proposed hardware and software solution is graphically reported in Figure 2a, while the block diagram of the RT-Ring device is shown in Figure 2b. Acceleration and gyroscopic rate samples were acquired using an inertial measurement unit (IMU) included into the RT-Ring and sent over Bluetooth Low Energy (BLE) communication to a smartphone running a dedicated mobile app. The mobile app preprocesses and stores the data into binary files. Then, these files are sent over the Internet, through a TCP connection to a backend server, where data are processed and classified using pre-trained machine learning (ML) models. The classification response (alternating or synchronous RT pattern) is sent back to the mobile app and the result is shown to the user.
Following are the details of each hardware and software component of the overall system.

2.1. Development of the Wearable Device

The Printed Circuit Board (PCB) design of RT-Ring was based on the Nordic Semiconductors’ nRF52840 microcontroller, a multiprotocol Bluetooth 5.3 System-On-Chip (SOC), packed in the ISP-1807 module by Insight SiP. This module integrates an nRF52840 microcontroller together with 32 MHz and 32 KHz external crystal clocks and an RF antenna in an 8.0 × 8.0 × 1.0 mm package. The microcontroller receives inertial data from an ST Microelectronics LSM6DSL 6-axis inertial measurement unit (IMU) through an I2C bus. The LSM6DSL sensor exhibits 3 accelerometric axes and 3 gyroscopic axes. The PCB board is also equipped with a low drop-out (LDO) voltage regulator, a battery charge controller, a fuel gauge, and soft button controller coupled with a normally open (NO) single pole—single throw (SPST) button. The top and bottom PCB layouts of the device are shown in Figure 3a and Figure 3b, respectively.
The assembled PCB is sized 1.5 × 1.5 mm (Figure 3c) and is powered by a 65 mAh Lithium-Polymer battery. Both the PCB and the rechargeable battery are housed in a 3D-printed plastic case and a Velcro strap is used to fix the device on the middle finger of the hand affected with tremor, as shown in Figure 3d.

2.2. Firmware and Mobile App

The nRF52840 microcontroller is flashed with Nordic’s SoftDevice, version 6.1.1, implementing the Bluetooth Low Energy (BLE) stack, and with a modified bootloader allowing for Over-the-Air (OTA) Device Firmware Update (DFU). The application firmware was developed using the Arduino Integrated Development Environment (IDE). The .hex file produced by the compiler was merged into an OTA-DFU zip package using the nrfutil programming tool.
The application firmware implements a finite state machine and a set of commands used to interact with the device in order to:
Read the device inclination in terms of pitch and roll angles, with an output data rate of 2 samples/s;
Read scaled acceleration and angular velocity data from all sensing axes, with a default output data rate of 100 sample/s, a default acceleration range of ±2 G, and a default angular velocity range of ±500 deg/s;
Configure sensor ranges and output data rate;
Check battery charge status;
Force reboot of the microcontroller in bootloader mode.
Commands and data are exchanged through the UART characteristic of the BLE wireless communication protocol, using a mobile app named e-RT-Ring. The mobile app was developed using the .NET MAUI programming framework and allows the user to control the device and acquire data. The files recorded from the mobile app are then sent over the Internet to a remote server, where a backend application processes the data and sends back responses to the mobile client. The backend microservice was developed in the Python programming language, using the Flask framework.

2.3. Data Acquisition and Processing

The RT-Ring device was positioned on the middle finger of the hand with rest tremor of each subject, on the third phalanx in a proximal position, as shown in Figure 3d. The mobile app guided the operator during the inertial data acquisition, ensuring that the hand with tremor was at rest and with a proper inclination before each recording. Surface EMG signals from the extensor carpi radialis and flexor carpi ulnaris muscles were acquired simultaneously to the inertial data to assess the RT pattern in each recording segment. All surface EMG procedures were performed as previously described [14,15]. A total of 200 recording segments (of 10 s each) were recorded from 40 rest tremor patients. Five 10 s recording segments were acquired from each patient.
As rest tremor is mainly expressed in the 4–8 Hz frequency range [1], the signals were bandpass filtered in the 2–10 Hz band using a 4th order, two-pass zero-phase Butterworth filter, in order to encompass all possible tremor oscillations.
Next, a periodicity check was performed on each recording segment to assess the actual presence of tremor information in the collected samples. This check was performed both in time and frequency domain, on the dominant acceleration axis, i.e., on the axis with the highest amplitude. Then, each segment was accepted for processing if there was a magnitude peak in the range 3–8 Hz and the number of zero-crossings was at least half the expected number of zero-crossings of a sine wave at fpeak, with fpeak being the frequency of such magnitude peak. The traces that did not respect these criteria were discarded.
After this quality check, 168 segments were selected for processing. EMG traces corresponding to these inertial recording segments were visually inspected by two independent raters (a neurologist and a technician expert in tremor analysis), and the RT contraction patterns were classified as “A” (alternating) or “S” (synchronous); a third rater evaluated the traces in case of discrepancy. Ninety-one segments were labeled as “A” and 77 segments were labeled as “S” according to visual inspection of RT pattern on corresponding EMG recordings.
In Figure 4, inertial signals acquired from 2 tremulous subjects with different patterns are shown. Figure 4a–d show inertial signals from a subject with alternating tremor pattern (a–b unfiltered and c–d filtered), while signals from a subject with synchronous tremor pattern are shown in Figure 4e–h (e–f unfiltered and g–h filtered).
For each recording segment, extracted inertial data included time and frequency domain features. The IMU included into the RT-ring recorded 6 different signals: ax, ay, az accelerations, expressed in (g), and wx, wy, wz angular rates, expressed in (deg/s). By considering a typical flexo-extension movement as mainly involving the y and z accelerometric axes and the x gyroscopic axis, the following frequency and time domain features were computed from the ay, az, and wx signals:
Tremor frequency from single axes power spectral densities (PSD) and from ay-az cross power spectral density (cPSD);
Pearson’s correlation coefficient between ay and az axes;
Power spectral amplitudes at tremor frequency, evaluated on ay-az cPSD and on wx PSD;
Powers and bandwidths of 3 dB;
ay-az magnitude squared coherence;
One-second coherence, defined as the mean of second-by-second ratios between 3 dB power and total power;
Peak-to-peak amplitudes from all axes;
The sum of the first two harmonics on az axis;
Detail d3, d2, d1, and approximation a3 coefficients were computed from ‘db2’, 3 levels, wavelet decomposition on each sensing axis.
Power spectral densities and cross-power spectral densities were computed using MATLAB/Octave pwelch and cpsd functions, with 3 s Hanning windowing, 75% overlap, and 216 FFT points. The same parameters were used for the computation of magnitude squared coherence by means of the mscohere function. Wavelet decomposition was performed using the Large Time/Frequency Analysis Toolbox (LTFAT) for MATLAB/Octave.
A total of 63 features were computed for “A” and “S” segments. All the features were compared using either Student’s t-test or Wilcoxon rank sum test, after checking for normality using the Shapiro–Wilk test. All p values were corrected according to Benjamini–Hochberg method for false discovery rate (FDR). The significance level was set at p = 0.05.

2.4. Machine Learning Algorithms

We used machine learning (ML) algorithms based on inertial data to estimate the tremor pattern. The visually inspected pattern of RT on EMG traces was used as reference standard, and the performance of two ML algorithms, Random Forest (RF) [16] and Extreme Gradient Boosting (XGB]) [17], in distinguishing recording segments with alternating pattern from those with synchronous pattern, was assessed using combinations of inertial features.
The dataset of 168 recording segments was split into two random, 50% subsets of 84 segments each with a balanced percentage of alternating and synchronous segments. The first subset was used to train the ML models, and the second independent dataset was used as a testing set to calculate the classification performance of the models.
As a first step, inertial features from the training set were sorted in descending order, according to their importance as measured by RF and XGB algorithms. Then, RF and XGB models were trained to perform a 80–20%, 5-fold cross-validation, with hyperparameters tuning. Classification performances of trained models in predicting alternating (A) or synchronous (S) patterns were then assessed on the independent testing set. The tuning of hyperparameters is reported in Table 1.
Processing and feature extraction were performed in GNU Octave and R programming languages. ML models were trained using the R Classification And REgression Training (caret) library [18].

2.5. Backend Application

Finally, the best-performing RF and XGB models were selected and embedded in a software tool, designed as a web microservice. This tool was installed on a remote server, to work as an application backend. The backend application was developed in the Python programming language using the Flask framework and implemented a threaded execution to serve multiple incoming requests at the same time.
A block diagram of the whole preprocessing, training, and validation process is shown in Figure 5.
The whole preprocessing and ML training and testing process (Figure 5a) allowed us to train the best-performing RF and XGB models and to evaluate their classification performances. The backend server application (Figure 5b) takes a single segment as input and utilizes one of the best models evaluated in the training phase to obtain a classification response. This response is sent to the mobile application, or a “fail” message is sent if the frequency check is not passed.

3. Results

Means and standard deviations and comparisons of computed features are shown in Table 2.
After FDR correction, 58 out of 63 features were significantly different between the “A” and “S” segments. Before training ML models, two inertial feature sets were defined: FRF = {fRF(1), fRF(2), …, fRF(N)} and FXGB = { fXGB(1), fXGB(2), …, fXGB(N)}, including all the initial features sorted by decreasing importance metrics computed by RF and XGB algorithms, respectively. The RF models were trained on all sorted subsets of FRF, starting with the first feature and then adding one feature at a time. Similarly, XGB models were trained on all sorted subsets of FXGB.
The model with the highest testing classification accuracy was selected as the best-performing model for RF and XGB, respectively. The best-performing RF model was trained on the first 6 features of FRF, while the best XGB model was trained on the first 13 features of FXGB. Optimal feature subsets, together with their computed importance, for RF and XGB models are shown in Figure 6a and Figure 6b, respectively.
Overall accuracy, Cohen’s kappa, sensitivity, specificity, positive predictive value (ppv), and negative predictive value (npv), measured in the training dataset (5-fold cross-validation) and in the independent testing dataset, are reported in Table 3. Performance metrics (accuracy, kappa, sensitivity, and specificity) of all training folds are reported in Table 4.
Cohen’s kappa showed a substantial reliability (kappa > 0.60) of the classifiers when compared to random guessing.
Overall performances of the two models are comparable, even though RF performs slightly better than XGB. Moreover, the RF model used a smaller number of features.
The training Receiver Operating Characteristic (ROC) curves evaluated from the 5-fold 80–20% cross-validation are shown in Figure 7a,b. Figure 7c shows the calibration plots, assessing the agreement between predictions and observations, while the testing ROC curves are shown in Figure 7d.
The mean training Area Under the Curve (AUC) was 0.91 for Random Forest and 0.95 for XGBoost, respectively. On the testing dataset, Random Forest reached an AUC of 0.96, while XGBoost had an AUC of 0.97.
The mean processing time for each segment is less than 5 s, including transfer time to and from the backend server.

4. Discussion

In this study, we developed a new compact wearable device for the assessment of rest tremor. This device is termed “RT-Ring” since it can be worn as a ring around a finger of the hand with RT. The main aim of this miniaturized device is to estimate the tremor pattern through machine learning technology using only inertial (accelerometric and gyroscopic) data, in the absence of EMG.
There is great interest in assessing the RT pattern in tremulous disorders. Previous studies demonstrated a strong association between this RT feature and the presence/absence of striatal dopaminergic damage, making the RT pattern of high relevance in the differential diagnosis between Parkinsonian and non-Parkinsonian rest tremor syndromes. The surface EMG is the only approach suitable to evaluate the tremor pattern since it is possible to visualize the temporal shift of contraction burst of antagonistic muscles generating the tremor. Unfortunately, surface EMG requires technology and expertise in tremor analysis, making this approach suitable only for specialists with an interest in tremors. In the last decade, there has been a growing effort to use inertial signals for medical purposes since they can be acquired through MEMS accelerometers and gyroscopes, which can be easily included into wearables or even mobile phones.
The main applications of inertial sensors in tremulous patients described so far include wearable solutions for detecting tremors [19,20,21,22,23,24,25,26,27] or quantitatively assessing tremor severity [28,29,30,31,32,33,34,35,36,37,38,39]. Some devices have been tested in laboratory settings, with the aim of supporting the clinical evaluation of tremors [19,20,21,22,23,24]; and others have been tested in home-based settings with the aim of detecting tremors in the context of daily life [25,26,27], with the potential usefulness of an early detection of tremulous disorders if employed for large-scale population screening. Finally, there has been a growing interest in developing wearable devices to assess tremor severity at home [34,35,36,37,38,39], with obvious significant advantages in monitoring the efficacy of therapies during the whole day, beyond the clinical consultation [28,29,31,34].
A few devices based on inertial data have also been proposed to distinguish among different causes of tremor [40,41,42,43,44,45,46,47,48], mainly between Parkinson’s disease (PD) and essential tremor (ET), but there is still much room for improvement in this field. Most of the proposed devices explored the characteristics of rest tremor in PD and postural tremor in ET [40,41,42,43,44,45,46], which are different by definition, and a few studies focused on postural tremor in both diseases [46,47] or a combination of different tremors [48], while studies focusing on tremor at rest are lacking. In addition, these previous studies mainly explored the potential usefulness of data based on tremor power or frequency [40,41,42,43,46,47] for the differential diagnosis, and none of the described approaches aimed to estimate the tremor pattern using inertial data.
Machine Learning and Artificial Intelligence have gained increasing importance in dealing with classification and estimation problems [13], trying to find relationships between data that are not immediately seen by humans. By fitting mathematical models to data, scientists and clinicians have been able to automatically perform diagnostic tasks with significant accuracy. In the current study, we employed ML algorithms to estimate the RT pattern using combinations of inertial tremor features, achieving excellent classification performances (AUC above 0.90). The RF algorithm found 3 dB power and tremor spectral amplitude on the reference gyroscopic axis (wx), together with wavelet decomposition coefficients from accelerometric axis z, as the most informative features for discriminating between alternating and synchronous tremor patterns. XGBoost confirmed the importance of most of the features identified by RF, adding 3 dB bandwidth and 1 s coherence evaluated on wx, together with wavelet decomposition coefficients from wx, ay, and az, thus confirming that such sensing axes are the most important in capturing tremor characteristics using time–frequency information.
The main limitation of this study is the relatively low number of examined recording segments, which makes this project a pilot study. Future validation studies on a larger amount of data are needed to confirm the performance of the RT-Ring system in predicting the RT pattern and further validate the feasibility of this approach.

5. Conclusions

The present work is the first attempt, to our knowledge, to characterize muscle behaviors, commonly assessed by electromyographic approaches, using inertial data and combining such data into machine learning models. The excellent classification performances reached by the classifiers, namely, AUC = 0.96, accuracy = 0.92 for RF; and AUC = 0.97, accuracy = 0.89 for XGB, demonstrated that different electromyographic tremor patterns have their counterparts in terms of rhythmic movement features. This may allow the replacement of expensive, complex, and time-consuming electromyographic examinations with a simpler, cheaper, and faster (within a few seconds) evaluation through a tiny wearable device.
We have carried on a full stack development process, from electronic design to the Internet of Things, to devise and test a new wearable device (RT-Ring) and a software system for the automatic characterization of rest tremor. The adoption of a MEMS inertial measurement unit allowed us to design a miniaturized device, which can be easily worn and used by non-specialized operators or even by patients. Future studies will include the comparison of different ML algorithms, using automated tools for model tuning and optimization [12], and the assessment of the RT-ring performance in distinguishing patients with different rest tremor syndromes at the individual level.

6. Patents

Italian patent application no. 102021000019793 was filed on 2021/07/26.

Author Contributions

Conceptualization, B.V., M.D.M., and A.Q. (Aldo Quattrone); methodology, B.V. and M.D.M.; software, B.V. and M.D.M.; validation, C.C., F.A., R.N., and M.C.; formal analysis, C.C., F.A., B.V., and M.D.M.; investigation, A.Q. (Andrea Quattrone), A.Q. (Aldo Quattrone), B.V., and M.D.M.; resources, A.Q. (Aldo Quattrone) and R.N.; data curation, M.C., F.A., B.V., and M.D.M.; writing—original draft preparation, B.V. and M.D.M.; writing—review and editing, A.Q. (Aldo Quattrone) and A.Q. (Andrea Quattrone); visualization, C.C., B.V., and M.D.M.; supervision, A.Q. (Aldo Quattrone) and A.Q. (Andrea Quattrone); project administration, A.Q. (Aldo Quattrone); funding acquisition, A.Q. (Andrea Quattrone) All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Italian Society for Parkinson and Movement Disorders LIMPE-DISMOV Foundation, 2021 SEGALA grant for young researchers (23 December 2021).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Ethics Committee of the Calabria Region, Sezione Area Centro (no. 330, 22 October 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to privacy reasons.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bhatia, K.P.; Bain, P.; Bajaj, N.; Elble, R.J.; Hallett, M.; Louis, E.D.; Raethjen, J.; Stamelou, M.; Testa, C.M.; Deuschl, G. Consensus Statement on the Classification of Tremors. From the Task Force on Tremor of the International Parkinson and Movement Disorder Society. Mov. Disord. 2018, 33, 75–87. [Google Scholar] [CrossRef] [PubMed]
  2. Postuma, R.B.; Berg, D.; Stern, M.; Poewe, W.; Olanow, C.W.; Oertel, W.; Obeso, J.; Marek, K.; Litvan, I.; Lang, A.E.; et al. MDS Clinical Diagnostic Criteria for Parkinson’s Disease. Mov. Disord. 2015, 30, 1591–1601. [Google Scholar] [CrossRef] [PubMed]
  3. Van De Wardt, J.; Van Der Stouwe, A.M.M.; DIrkx, M.; Elting, J.W.J.; Post, B.; Tijssen, M.A.J.; Helmich, R.C. Systematic Clinical Approach for Diagnosing Upper Limb Tremor. J. Neurol. Neurosurg. Psychiatry 2020, 91, 822–830. [Google Scholar] [CrossRef] [PubMed]
  4. Chen, W.; Hopfner, F.; Becktepe, J.S.; Deuschl, G. Rest Tremor Revisited: Parkinson’s Disease and Other Disorders. Transl. Neurodegener. 2017, 6, 16. [Google Scholar] [CrossRef]
  5. Vial, F.; Kassavetis, P.; Merchant, S.; Haubenberger, D.; Hallett, M. How to Do an Electrophysiological Study of Tremor. Clin. Neurophysiol. Pract. 2019, 4, 134–142. [Google Scholar] [CrossRef]
  6. Chen, K.-H.S.; Chen, R. Principles of Electrophysiological Assessments for Movement Disorders. J. Mov. Disord. 2020, 13, 27–38. [Google Scholar] [CrossRef]
  7. Quattrone, A.; Nisticò, R.; Morelli, M.; Arabia, G.; Crasà, M.; Vescio, B.; Mechelli, A.; Cascini, G.L.; Quattrone, A. Rest Tremor Pattern Predicts DaTscan (123I-Ioflupane) Result in Tremulous Disorders. Mov. Disord. 2021, 36, 2964–2966. [Google Scholar] [CrossRef]
  8. Milanov, I. Electromyographic Differentiation of Tremors. Clin. Neurophysiol. 2001, 112, 1626–1632. [Google Scholar] [CrossRef]
  9. Boose, A.; Jentgens, C.; Spieker, S.; Dichgans, J. Variations on Tremor Parameters. Chaos Interdiscip. J. Nonlinear Sci. 1995, 5, 52–56. [Google Scholar] [CrossRef]
  10. Vescio, B.; Nisticò, R.; Augimeri, A.; Quattrone, A.; Crasà, M.; Quattrone, A. Development and Validation of a New Wearable Mobile Device for the Automated Detection of Resting Tremor in Parkinson’s Disease and Essential Tremor. Diagnostics 2021, 11, 200. [Google Scholar] [CrossRef]
  11. Vescio, B.; Quattrone, A.; Nisticò, R.; Crasà, M.; Quattrone, A. Wearable Devices for Assessment of Tremor. Front. Neurol. 2021, 12, 680011. [Google Scholar] [CrossRef] [PubMed]
  12. Hadi, R.H.; Hady, H.N.; Hasan, A.M.; Al-Jodah, A.; Humaidi, A.J. Improved Fault Classification for Predictive Maintenance in Industrial IoT Based on AutoML: A Case Study of Ball-Bearing Faults. Processes 2023, 11, 1507. [Google Scholar] [CrossRef]
  13. De, A.; Bhatia, K.P.; Volkmann, J.; Peach, R.; Schreglmann, S.R. Machine Learning in Tremor Analysis: Critique and Directions. Mov. Disord. 2023, 38, 717–731. [Google Scholar] [CrossRef] [PubMed]
  14. Nisticò, R.; Quattrone, A.; Crasà, M.; De Maria, M.; Vescio, B.; Quattrone, A. Evaluation of Rest Tremor in Different Positions in Parkinson’s Disease and Essential Tremor plus. Neurol. Sci. 2022, 43, 3621–3627. [Google Scholar] [CrossRef]
  15. Nisticò, R.; Pirritano, D.; Salsone, M.; Novellino, F.; Del Giudice, F.; Morelli, M.; Trotta, M.; Bilotti, G.; Condino, F.; Cherubini, A.; et al. Synchronous Pattern Distinguishes Resting Tremor Associated with Essential Tremor from Rest Tremor of Parkinson’s Disease. Park. Relat. Disord. 2011, 17, 30–33. [Google Scholar] [CrossRef]
  16. Breiman, L. Random Forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef]
  17. Chen, T.; Guestrin, C. XGBoost. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; ACM: New York, NY, USA, 2016; pp. 785–794. [Google Scholar]
  18. Kuhn, M. Building Predictive Models in R Using the Caret Package. J. Stat. Softw. 2008, 28, 1–26. [Google Scholar] [CrossRef]
  19. De Araújo, A.C.A.; Santos, E.G.d.R.; de Sá, K.S.G.; Furtado, V.K.T.; Santos, F.A.; de Lima, R.C.; Krejcová, L.V.; Santos-Lobato, B.L.; Pinto, G.H.L.; Cabral, A.d.S.; et al. Hand Resting Tremor Assessment of Healthy and Patients with Parkinson’s Disease: An Exploratory Machine Learning Study. Front. Bioeng. Biotechnol. 2020, 8, 778. [Google Scholar] [CrossRef]
  20. Channa, A.; Ifrim, R.C.; Popescu, D.; Popescu, N. A-Wear Bracelet for Detection of Hand Tremor and Bradykinesia in Parkinson’s Patients. Sensors 2021, 21, 981. [Google Scholar] [CrossRef]
  21. Luft, F.; Sharifi, S.; Mugge, W.; Schouten, A.C.; Bour, L.J.; van Rootselaar, A.F.; Veltink, P.H.; Heida, T. A Power Spectral Density-Based Method to Detect Tremor and Tremor Intermittency in Movement Disorders. Sensors 2019, 19, 4301. [Google Scholar] [CrossRef]
  22. Yang, H.; Shen, Y.; Zhuang, W.; Gao, C.; Dai, D.; Zhang, W. A Smart Wearable Ring Device for Sensing Hand Tremor of Parkinson’s Patients. Comput. Model. Eng. Sci. 2021, 126, 1217–1238. [Google Scholar] [CrossRef]
  23. Kostikis, N.; Hristu-Varsakelis, D.; Arnaoutoglou, M.; Kotsavasiloglou, C. A Smartphone-Based Tool for Assessing Parkinsonian Hand Tremor. IEEE J. Biomed. Health Inform. 2015, 19, 1835–1842. [Google Scholar] [CrossRef] [PubMed]
  24. Peres, L.B.; Calil, B.C.; da Silva, A.P.S.P.B.; Dionísio, V.C.; Vieira, M.F.; de Oliveira Andrade, A.; Pereira, A.A. Discrimination between Healthy and Patients with Parkinson’s Disease from Hand Resting Activity Using Inertial Measurement Unit. Biomed. Eng. Online 2021, 20, 50. [Google Scholar] [CrossRef] [PubMed]
  25. LeMoyne, R.; Tomycz, N.; Mastroianni, T.; McCandless, C.; Cozza, M.; Peduto, D. Implementation of a Smartphone Wireless Accelerometer Platform for Establishing Deep Brain Stimulation Treatment Efficacy of Essential Tremor with Machine Learning. In Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy, 25–29 August 2015; ISBN 9781424492701. [Google Scholar]
  26. McNames, J.; Shah, V.V.; Mancini, M.; Curtze, C.; El-Gohary, M.; Aboy, M.; Carlson-Kuhta, P.; Nutt, J.G.; Horak, F. A Two-Stage Tremor Detection Algorithm for Wearable Inertial Sensors During Normal Daily Activities. In Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany, 23–27 July 2019; pp. 2535–2538. [Google Scholar]
  27. San-Segundo, R.; Zhang, A.; Cebulla, A.; Panev, S.; Tabor, G.; Stebbins, K.; Massa, R.E.; Whitford, A.; de la Torre, F.; Hodgins, J. Parkinson’s Disease Tremor Detection in the Wild Using Wearable Accelerometers. Sensors 2020, 20, 5817. [Google Scholar] [CrossRef] [PubMed]
  28. Rovini, E.; Maremmani, C.; Cavallo, F. How Wearable Sensors Can Support Parkinson’s Disease Diagnosis and Treatment: A Systematic Review. Front. Neurosci. 2017, 11, 555. [Google Scholar] [CrossRef]
  29. Jeon, H.; Lee, W.; Park, H.; Lee, H.J.; Kim, S.K.; Kim, H.B.; Jeon, B.; Park, K.S. High-Accuracy Automatic Classification of Parkinsonian Tremor Severity Using Machine Learning Method. Physiol. Meas. 2017, 38, 1980–1999. [Google Scholar] [CrossRef]
  30. Ali, S.M.; Arjunan, S.P.; Peters, J.; Perju-Dumbrava, L.; Ding, C.; Eller, M.; Raghav, S.; Kempster, P.; Motin, M.A.; Radcliffe, P.J.; et al. Wearable Sensors during Drawing Tasks to Measure the Severity of Essential Tremor. Sci. Rep. 2022, 12, 5242. [Google Scholar] [CrossRef]
  31. Dai, H.; Zhang, P.; Lueth, T. Quantitative Assessment of Parkinsonian Tremor Based on an Inertial Measurement Unit. Sensors 2015, 15, 25055–25071. [Google Scholar] [CrossRef]
  32. Kim, H.B.; Lee, W.W.; Kim, A.; Lee, H.J.; Park, H.Y.; Jeon, H.S.; Kim, S.K.; Jeon, B.; Park, K.S. Wrist Sensor-Based Tremor Severity Quantification in Parkinson’s Disease Using Convolutional Neural Network. Comput. Biol. Med. 2018, 95, 140–146. [Google Scholar] [CrossRef]
  33. Sanchez-Perez, L.A.; Sanchez-Fernandez, L.P.; Shaout, A.; Martinez-Hernandez, J.M.; Alvarez-Noriega, M.J. Rest Tremor Quantification Based on Fuzzy Inference Systems and Wearable Sensors. Int. J. Med. Inform. 2018, 114, 6–17. [Google Scholar] [CrossRef]
  34. Heldman, D.A.; Jankovic, J.; Vaillancourt, D.E.; Prodoehl, J.; Elble, R.J.; Giuffrida, J.P. Essential Tremor Quantification during Activities of Daily Living. Parkinsonism Relat. Disord. 2011, 17, 537–542. [Google Scholar] [CrossRef] [PubMed]
  35. Hssayeni, M.D.; Jimenez-Shahed, J.; Burack, M.A.; Ghoraani, B. Wearable Sensors for Estimation of Parkinsonian Tremor Severity during Free Body Movements. Sensors 2019, 19, 4215. [Google Scholar] [CrossRef] [PubMed]
  36. Mahadevan, N.; Demanuele, C.; Zhang, H.; Volfson, D.; Ho, B.; Erb, M.K.; Patel, S. Development of Digital Biomarkers for Resting Tremor and Bradykinesia Using a Wrist-Worn Wearable Device. NPJ Digit. Med. 2020, 3, 5. [Google Scholar] [CrossRef] [PubMed]
  37. Rigas, G.; Tzallas, A.T.; Tsipouras, M.G.; Bougia, P.; Tripoliti, E.E.; Baga, D.; Fotiadis, D.I.; Tsouli, S.G.; Konitsiotis, S. Assessment of Tremor Activity in the Parkinsons Disease Using a Set of Wearable Sensors. IEEE Trans. Inf. Technol. Biomed. 2012, 16, 478–487. [Google Scholar] [CrossRef]
  38. Sigcha, L.; Pavón, I.; Costa, N.; Costa, S.; Gago, M.; Arezes, P.; López, J.M.; Arcas, G. De Automatic Resting Tremor Assessment in Parkinson’s Disease Using Smartwatches and Multitask Convolutional Neural Networks. Sensors 2021, 21, 291. [Google Scholar] [CrossRef]
  39. Zheng, X.; Campos, A.V.; Ordieres-Meré, J.; Balseiro, J.; Marcos, S.L.; Aladro, Y. Continuous Monitoring of Essential Tremor Using a Portable System Based on Smartwatch. Front. Neurol. 2017, 8, 96. [Google Scholar] [CrossRef]
  40. Di Biase, L.; Brittain, J.-S.; Shah, S.A.; Pedrosa, D.J.; Cagnan, H.; Mathy, A.; Chen, C.C.; Martín-Rodríguez, J.F.; Mir, P.; Timmerman, L.; et al. Tremor Stability Index: A New Tool for Differential Diagnosis in Tremor Syndromes. Brain 2017, 140, 1977–1986. [Google Scholar] [CrossRef]
  41. Wile, D.J.; Ranawaya, R.; Kiss, Z.H.T. Smart Watch Accelerometry for Analysis and Diagnosis of Tremor. J. Neurosci. Methods 2014, 230, 1–4. [Google Scholar] [CrossRef]
  42. Surangsrirat, D.; Thanawattano, C.; Pongthornseri, R.; Dumnin, S.; Anan, C.; Bhidayasiri, R. Support Vector Machine Classification of Parkinson’s Disease and Essential Tremor Subjects Based on Temporal Fluctuation. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 August 2016; pp. 6389–6392. [Google Scholar]
  43. Duque, J.D.L.; Egea, A.J.S.; Reeb, T.; Rojas, H.A.G.; González-Vargas, A.M. Angular Velocity Analysis Boosted by Machine Learning for Helping in the Differential Diagnosis of Parkinson’s Disease and Essential Tremor. IEEE Access 2020, 8, 88866–88875. [Google Scholar] [CrossRef]
  44. Hossen, A.; Muthuraman, M.; Al-Hakim, Z.; Raethjen, J.; Deuschl, G.; Heute, U. Discrimination of Parkinsonian Tremor from Essential Tremor Using Statistical Signal Characterization of the Spectrum of Accelerometer Signal. Biomed. Mater. Eng. 2013, 23, 513–531. [Google Scholar] [CrossRef]
  45. Locatelli, P.; Alimonti, D. Differentiating Essential Tremor and Parkinson’s Disease Using a Wearable Sensor—A Pilot Study. In Proceedings of the 2017 7th IEEE International Workshop on Advances in Sensors and Interfaces (IWASI), Vieste, Italy, 15–16 June 2017; pp. 213–218. [Google Scholar]
  46. Barrantes, S.; Sánchez Egea, A.J.; González Rojas, H.A.; Martí, M.J.; Compta, Y.; Valldeoriola, F.; Mezquita, E.S.; Tolosa, E.; Valls-Solè, J. Differential Diagnosis between Parkinson’s Disease and Essential Tremor Using the Smartphone’s Accelerometer. PLoS ONE 2017, 12, e0183843. [Google Scholar] [CrossRef] [PubMed]
  47. Muthuraman, M.; Hossen, A.; Heute, U.; Deuschl, G.; Raethjen, J. A New Diagnostic Test to Distinguish Tremulous Parkinson’s Disease from Advanced Essential Tremor. Mov. Disord. 2011, 26, 1548–1552. [Google Scholar] [CrossRef] [PubMed]
  48. Balachandar, A.; Algarni, M.; Oliveira, L.; Marsili, L.; Merola, A.; Sturchio, A.; Espay, A.J.; Hutchison, W.D.; Balasubramaniam, A.; Rudzicz, F.; et al. Are Smartphones and Machine Learning Enough to Diagnose Tremor? J. Neurol. 2022, 269, 6104–6115. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Examples of tremor activation patterns in electromyography (EMG) signals from antagonist muscles of the forearm: (A) alternating pattern, when flexor and extensor tremor bursts are phase-shifted; and (B) synchronous pattern, when flexor and extensor tremor bursts are in phase. Muscle bursts occur periodically; their repetition frequency is the characteristic frequency of tremor.
Figure 1. Examples of tremor activation patterns in electromyography (EMG) signals from antagonist muscles of the forearm: (A) alternating pattern, when flexor and extensor tremor bursts are phase-shifted; and (B) synchronous pattern, when flexor and extensor tremor bursts are in phase. Muscle bursts occur periodically; their repetition frequency is the characteristic frequency of tremor.
Bioengineering 10 01025 g001
Figure 2. (a) Overall signal generation and processing system architecture: signals generated by RT-Ring are acquired by a mobile app and then sent to the backend server through a TCP connection over the mobile network. Processing output is then sent back to the mobile app. (b) Block diagram of the RT-Ring wearable device: the core of the device is represented by the ST Microelectronics LM6DSL 6-axis Inertial Measurement Unit (IMU) and by the ISP1807 module, incorporating a nRF52840 microcontroller, with 32 KHz and 32 MHz crystal clocks and BLE antenna. An MCP73831 charge controller provides charging current from USB interface to a 65 mAh Lithium-Polymer batter; an RT9193 Low Dropout regulator converts 3.7 V battery output to 1.8 V and delivers power to all other components. Power delivery is activated by a LTC2955 soft button controller. A MAX17048 digital fuel gauge accurately measures battery charge and communicates with the microcontroller.
Figure 2. (a) Overall signal generation and processing system architecture: signals generated by RT-Ring are acquired by a mobile app and then sent to the backend server through a TCP connection over the mobile network. Processing output is then sent back to the mobile app. (b) Block diagram of the RT-Ring wearable device: the core of the device is represented by the ST Microelectronics LM6DSL 6-axis Inertial Measurement Unit (IMU) and by the ISP1807 module, incorporating a nRF52840 microcontroller, with 32 KHz and 32 MHz crystal clocks and BLE antenna. An MCP73831 charge controller provides charging current from USB interface to a 65 mAh Lithium-Polymer batter; an RT9193 Low Dropout regulator converts 3.7 V battery output to 1.8 V and delivers power to all other components. Power delivery is activated by a LTC2955 soft button controller. A MAX17048 digital fuel gauge accurately measures battery charge and communicates with the microcontroller.
Bioengineering 10 01025 g002
Figure 3. Layout of the PCB: (a) Top layer, with (1) ISP-1807 module, (2) ST LSM6DSL IMU, (3) (optional) protection diodes for D0 and D1 USB lines, (4) LDO voltage regulator, and (5) battery charge controller; (b) bottom layer, with (1) USB socket, (2) pushbutton, (3) soft-button controller, and (4) fuel gauge; (c) assembled PCB with battery; (d) device worn on a patient’s middle finger. PCB: Printed Circuit Board; IMU: Inertial Measurement Unit; USB: Universal Serial Bus; LDO: Low Drop-Out.
Figure 3. Layout of the PCB: (a) Top layer, with (1) ISP-1807 module, (2) ST LSM6DSL IMU, (3) (optional) protection diodes for D0 and D1 USB lines, (4) LDO voltage regulator, and (5) battery charge controller; (b) bottom layer, with (1) USB socket, (2) pushbutton, (3) soft-button controller, and (4) fuel gauge; (c) assembled PCB with battery; (d) device worn on a patient’s middle finger. PCB: Printed Circuit Board; IMU: Inertial Measurement Unit; USB: Universal Serial Bus; LDO: Low Drop-Out.
Bioengineering 10 01025 g003
Figure 4. Signals acquired by RT-Ring from two subjects with different tremor activation patterns: (a) raw accelerations, (b) raw angular velocities, (c) filtered accelerations, and (d) filtered angular velocities from a subject with alternating tremor pattern; (e) raw accelerations, (f) raw angular velocities, (g) filtered accelerations, and (h) filtered angular velocities from a subject with synchronous tremor pattern. Filtered signals have been processed using a 4th order, two-pass, zero-phase Butterworth filter.
Figure 4. Signals acquired by RT-Ring from two subjects with different tremor activation patterns: (a) raw accelerations, (b) raw angular velocities, (c) filtered accelerations, and (d) filtered angular velocities from a subject with alternating tremor pattern; (e) raw accelerations, (f) raw angular velocities, (g) filtered accelerations, and (h) filtered angular velocities from a subject with synchronous tremor pattern. Filtered signals have been processed using a 4th order, two-pass, zero-phase Butterworth filter.
Bioengineering 10 01025 g004
Figure 5. Block diagrams of (a) preprocessing and Machine Learning process for the evaluation of optimal models; (b) processing of a single segment on the backend server.
Figure 5. Block diagrams of (a) preprocessing and Machine Learning process for the evaluation of optimal models; (b) processing of a single segment on the backend server.
Bioengineering 10 01025 g005
Figure 6. Importance of optimal features subsets used for training Random Forest (a) and XGBoost (b) best models.
Figure 6. Importance of optimal features subsets used for training Random Forest (a) and XGBoost (b) best models.
Bioengineering 10 01025 g006
Figure 7. (a) ROC curve from Random Forest training with 5-fold 80–20% cross-validation, mean curve is plotted in green color, mean AUC is 0.91; (b) ROC curve from XGBoost training with 5-fold 80–20% cross-validation, mean curve is plotted in green color, mean AUC is 0.95; (c) calibration plots, assessing the agreement between observations and predictions by the two classifier models; (d) ROC curves evaluated on the testing set, showing AUC = 0.96 and AUC = 0.97 for RF and XGB, respectively.
Figure 7. (a) ROC curve from Random Forest training with 5-fold 80–20% cross-validation, mean curve is plotted in green color, mean AUC is 0.91; (b) ROC curve from XGBoost training with 5-fold 80–20% cross-validation, mean curve is plotted in green color, mean AUC is 0.95; (c) calibration plots, assessing the agreement between observations and predictions by the two classifier models; (d) ROC curves evaluated on the testing set, showing AUC = 0.96 and AUC = 0.97 for RF and XGB, respectively.
Bioengineering 10 01025 g007
Table 1. Hyperparameters tuning of Random Forest and eXtreme Gradient Boosting models.
Table 1. Hyperparameters tuning of Random Forest and eXtreme Gradient Boosting models.
ModelHyperparametersDefinition
RFMtry = 1Number of variables randomly sampled as candidates at each split
XGBoostNrounds = 300
Max.depth = 4
Eta = 0.05
Gamma = 0.0
Col.sample_by_tree = 0.4
Child_weight = 1
Subsample = 0.75
Maximum number of iterations/trees to grow
Depth of the tree
Learning rate
Regularisation (preventing overfitting)
Controls the number of features supplied to a tree
Leaf threshold for stopping tree splitting
Controls the number of samples supplied to a tree
RF: Random Forest; XGBoost: eXtreme Gradient Boosting.
Table 2. Frequency domain, time domain, and time–frequency domain inertial features used in machine learning models for the classification between Synchronous and Alternating tremor patterns.
Table 2. Frequency domain, time domain, and time–frequency domain inertial features used in machine learning models for the classification between Synchronous and Alternating tremor patterns.
Features
Description Synchronous PatternAlternating
Pattern
p-Value
ay-az cross-spectral frequency (Hz) 5.63 ± 0.694.96 ± 0.65<0.001#
ay-az cross-spectral amplitude (m2/s4/Hz) 0.38 ± 1.0310.70 ± 18.32<0.001#
wx spectral amplitude ((°/s)2/Hz) 338 ± 161913656 ± 23240<0.001#
ay-az magnitude squared coherence 0.81 ± 0.270.96 ± 0.09<0.001#
ay-az axes correlation 0.55 ± 0.640.93 ± 0.15<0.001#
ay-az phase difference (°) 45.35 ± 54.5011.84 ± 17.36<0.001#
3 dB power, ay-az cross-spectrum (m2/s4) 0.18 ± 0.494.80 ± 8.34<0.001#
3 dB powers (m2/s4)wx156 ± 6936144 ± 10628<0.001#
ay0.26 ± 0.914.95 ± 9.04<0.001#
az0.14 ± 0.306.18 ± 11.81<0.001#
3 dB bandwidth, ay-az cross-spectrum (Hz) 0.65 ± 0.240.57 ± 0.090.016#
3 dB bandwidths (Hz)wx0.74 ± 0.330.58 ± 0.140.001#
ay0.72 ± 0.290.59 ± 0.140.001#
az0.68 ± 0.260.57 ± 0.080.003#
y,z spectral amplitudes (m2/s4/Hz)ay0.39 ± 0.732.46 ± 2.45<0.001#
az0.36 ± 0.522.88 ± 2.83<0.001#
Mean 1 s coherence, ay-az cross spectrum 0.71 ± 0.070.75 ± 0.04<0.001#
Mean 1 s coherence, wx spectrum 0.72 ± 0.050.76 ± 0.02<0.001#
Var. 1 s coherence, y-z cross spectrum 0.04 ± 0.050.01 ± 0.02<0.001#
Var. 1 s coherence, wx spectrum 0.04 ± 0.030.01 ± 0.02<0.001#
Skew. 1 s coherence, ay-az cross spectrum −0.47 ± 0.74−0.37 ± 0.720.582#
Skew. 1 s coherence, wx spectrum −0.38 ± 0.72−0.32 ± 0.710.631*
Kurt. 1 s coherence, ay-az cross spectrum 2.46 ± 1.002.46 ± 1.010.962#
Kurt. 1 s coherence, wx spectrum 2.48 ± 1.062.40 ± 0.800.881#
Single-axis frequencies (Hz)ax5.52 ± 0.844.97 ± 0.73<0.001#
ay5.63 ± 0.714.96 ± 0.65<0.001#
az5.61 ± 0.654.95 ± 0.65<0.001#
wx5.57 ± 0.784.91 ± 0.63<0.001#
wy5.51 ± 0.864.97 ± 0.81<0.001#
wz5.63 ± 0.664.98 ± 0.73<0.001#
Single-axis accelerometer peak-to-peak amplitudes (mG)ax93.38 ± 149.64355.73 ± 349.61<0.001#
ay85.64 ± 132.39521.64 ± 517.66<0.001#
az77.69 ± 90.18594.47 ± 562.86<0.001#
Vectorial magnitude of peak-to-peak accelerometer amplitudes (mG) 157.76 ± 212.64919.24 ± 782.95<0.001#
Single-axis gyroscope peak-to-peak amplitudes (°/s)wx17.54 ± 32.72180.59 ± 174.16<0.001#
wy26.43 ± 56.1376.24 ± 81.57<0.001#
wz31.97 ± 66.0584.77 ± 82.09<0.001#
Vectorial magnitude of peak-to-peak gyroscope amplitudes (°/s) 49.07 ± 90.55224.69 ± 196.97<0.001#
Sum of first 2 harmonics on axis az (m2/s4/Hz) 0.12 ± 0.265.66 ± 10.58<0.001#
ax, wavelet approx. coefficient (m/s2)a37.17 ± 3.369.61 ± 5.080.004#
ax, wavelet detail coefficients (m/s2)d30.62 ± 0.822.39 ± 2.04<0.001#
d20.24 ± 0.241.04 ± 1.02<0.001#
d10.10 ± 0.090.46 ± 0.57<0.001#
ay, wavelet approx. coefficient (m/s2)a324.54 ± 2.6222.90 ± 5.540.158#
ay, wavelet detail coefficients (m/s2)d30.83 ± 0.793.11 ± 2.44<0.001#
d20.48 ± 0.271.10 ± 0.96<0.001#
d10.26 ± 0.130.45 ± 0.420.001#
az, wavelet approx. coefficient (m/s2)a37.92 ± 5.1312.83 ± 6.32<0.001#
az, wavelet detail coefficients (m/s2)d30.58 ± 0.553.55 ± 2.91<0.001#
d20.22 ± 0.161.27 ± 1.27<0.001#
d10.10 ± 0.070.52 ± 0.75<0.001#
wx, wavelet approx. coefficient (°/s)a319.61 ± 30.67162.47 ± 149.40<0.001#
wx, wavelet detail coefficients (°/s)d312.11 ± 19.61100.66 ± 92.52<0.001#
d23.65 ± 6.0429.83 ± 33.77<0.001#
d11.16 ± 2.348.61 ± 12.26<0.001#
wy, wavelet approx. coefficient (°/s)a331.61 ± 40.7376.36 ± 77.29<0.001#
wy, wavelet detail coefficients (°/s)d317.28 ± 33.3352.65 ± 51.71<0.001#
d25.14 ± 8.7220.67 ± 23.12<0.001#
d11.32 ± 2.137.20 ± 9.89<0.001#
wz, wavelet approx. coefficient (°/s)a328.76 ± 48.3780.76 ± 75.45<0.001#
wz, wavelet detail coefficients (°/s)d320.86 ± 41.1451.00 ± 44.17<0.001#
d25.55 ± 10.0815.75 ± 13.79<0.001#
d11.30 ± 2.304.73 ± 5.17<0.001#
# Wilcoxon rank sum test, * Student’s t-test, p values adjusted according to Benjamini–Hochberg FDR correction method.
Table 3. Classification performances in training and testing datasets for RF and XGB models.
Table 3. Classification performances in training and testing datasets for RF and XGB models.
ModelMetricTrainingTesting
Random Forestaccuracy0.88 (0.87–0.90)0.92 (0.83–0.97)
kappa0.760.83
sensitivity0.890.96
specificity0.880.87
ppv0.890.90
npv0.870.94
XGBoostaccuracy0.89 (0.86–0.92)0.89 (0.80–0.95)
kappa0.790.78
sensitivity0.890.96
specificity0.900.82
ppv0.910.86
npv0.880.94
Table 4. Performance metrics of ML models in all training folds.
Table 4. Performance metrics of ML models in all training folds.
ModelFoldAccuracyKappaSensitivitySpecificity
Random forest10.940.880.901.00
20.820.650.780.88
30.870.731.000.72
40.910.821.000.81
50.870.740.780.97
60.910.820.890.94
70.850.690.900.79
80.710.410.670.75
90.970.941.000.94
100.910.821.000.81
110.820.640.890.75
120.970.941.000.94
130.910.820.851.00
140.760.530.670.88
150.940.881.000.88
160.910.820.851.00
170.760.520.890.63
180.900.790.920.88
191.001.001.001.00
200.840.680.780.91
210.840.670.830.86
220.850.710.830.88
230.940.881.000.88
240.940.880.891.00
250.880.760.890.88
mean0.880.760.890.88
std. dev.0.070.140.100.10
XGBoost10.910.820.970.84
20.900.790.860.94
30.900.790.870.93
40.880.760.870.90
50.900.800.840.97
60.960.910.950.97
70.880.760.860.91
80.900.790.890.90
90.900.790.890.90
100.900.790.890.90
110.910.820.890.94
120.900.790.860.94
130.870.730.860.88
140.840.670.840.84
150.870.730.860.87
160.880.760.860.90
170.900.790.860.94
180.900.790.890.91
190.900.790.920.87
200.900.790.920.87
210.930.850.950.90
220.900.790.890.90
230.900.800.890.92
240.880.760.890.88
250.760.530.780.75
mean0.890.780.880.90
std. dev.0.030.070.040.05
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Vescio, B.; De Maria, M.; Crasà, M.; Nisticò, R.; Calomino, C.; Aracri, F.; Quattrone, A.; Quattrone, A. Development of a New Wearable Device for the Characterization of Hand Tremor. Bioengineering 2023, 10, 1025. https://doi.org/10.3390/bioengineering10091025

AMA Style

Vescio B, De Maria M, Crasà M, Nisticò R, Calomino C, Aracri F, Quattrone A, Quattrone A. Development of a New Wearable Device for the Characterization of Hand Tremor. Bioengineering. 2023; 10(9):1025. https://doi.org/10.3390/bioengineering10091025

Chicago/Turabian Style

Vescio, Basilio, Marida De Maria, Marianna Crasà, Rita Nisticò, Camilla Calomino, Federica Aracri, Aldo Quattrone, and Andrea Quattrone. 2023. "Development of a New Wearable Device for the Characterization of Hand Tremor" Bioengineering 10, no. 9: 1025. https://doi.org/10.3390/bioengineering10091025

APA Style

Vescio, B., De Maria, M., Crasà, M., Nisticò, R., Calomino, C., Aracri, F., Quattrone, A., & Quattrone, A. (2023). Development of a New Wearable Device for the Characterization of Hand Tremor. Bioengineering, 10(9), 1025. https://doi.org/10.3390/bioengineering10091025

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop