Author Contributions
M.U.K.: Design of study, Methodology, Software, Analysis, Interpretation of data, Writing—original draft. S.A.: Design of study, Writing—original draft, Methodology, Software, Validation, Investigation. N.H.: Acquisition of data, Data Curation, Resources, Writing—Proofread. C.J.: Data Curation, Resources, Acquisition of data, Project administration. J.L.: Resources, Data Curation, Writing—Proofread. R.F.-R.: Conceptualization, Acquisition of data, Supervision, Project administration, Writing—review and editing. All authors have read and agreed to the published version of the manuscript.
Figure 1.
Schematic representation of stimulation and perception of pain.
Figure 1.
Schematic representation of stimulation and perception of pain.
Figure 2.
Raw BVP signals of No Pain (NP), High Hand Pain (HHP), High Forearm Pain (HFP), Low Hand Pain (LHP), and Low Forearm Pain (LFP).
Figure 2.
Raw BVP signals of No Pain (NP), High Hand Pain (HHP), High Forearm Pain (HFP), Low Hand Pain (LHP), and Low Forearm Pain (LFP).
Figure 3.
Processed signals of No Pain (NP), High Hand Pain (HHP), High Forearm Pain (HFP), Low Hand Pain (LHP), and Low Forearm Pain (LFP).
Figure 3.
Processed signals of No Pain (NP), High Hand Pain (HHP), High Forearm Pain (HFP), Low Hand Pain (LHP), and Low Forearm Pain (LFP).
Figure 4.
Performance evaluation scheme using leave one subject out cross validation (LOSOCV).
Figure 4.
Performance evaluation scheme using leave one subject out cross validation (LOSOCV).
Figure 5.
Design of study for assessment of pain using BVP signatures. Performance results are reported using the five most consistent classifiers.
Figure 5.
Design of study for assessment of pain using BVP signatures. Performance results are reported using the five most consistent classifiers.
Figure 6.
Performance evaluation with time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 1 (no pain vs. high pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: bi-layered neural network, TLNN: tri-layered neural network).
Figure 6.
Performance evaluation with time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 1 (no pain vs. high pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: bi-layered neural network, TLNN: tri-layered neural network).
Figure 7.
The proposed methodology for experiment 1 (no pain vs. high pain).
Figure 7.
The proposed methodology for experiment 1 (no pain vs. high pain).
Figure 8.
Performance evaluation with time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 2 (No Pain vs. Low Pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: bi-layered neural network, TLNN: tri-layered neural network).
Figure 8.
Performance evaluation with time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 2 (No Pain vs. Low Pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: bi-layered neural network, TLNN: tri-layered neural network).
Figure 9.
The proposed methodology for Experiment 2 (no pain vs. low pain).
Figure 9.
The proposed methodology for Experiment 2 (no pain vs. low pain).
Figure 10.
Performance evaluation with time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 3 (no pain vs. low pain vs. high pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: bi-layered neural network, TLNN: tri-layered neural network).
Figure 10.
Performance evaluation with time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 3 (no pain vs. low pain vs. high pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: bi-layered neural network, TLNN: tri-layered neural network).
Figure 11.
The proposed methodology for Experiment 3 (no pain vs. low pain vs. high pain).
Figure 11.
The proposed methodology for Experiment 3 (no pain vs. low pain vs. high pain).
Table 1.
Summary of the dataset used for the detection and classification of pain.
Table 1.
Summary of the dataset used for the detection and classification of pain.
Category | Details |
---|
Sampling rate | 100 Hz |
Number of subjects | 22 |
Stimulation type | Electrical |
Stimulation location | Hand and Forearm |
Pain categories/classes | 1. HP—High Pain (Pain tolerance or maximum level of Pain the subject can handle) |
| 2. LP—Low Pain (Pain threshold or minimum level of pain) |
| 3. NP—No Pain (baseline data without stimulation) |
Signal type | Blood Volume pulse (BVP) |
Length of each signal | 9 s |
Number of signals per class | NP: 396 |
| HP: 216 |
| LP: 216 |
Signals per subject | 6 subjects have three signals per pain (HP/LP) class. |
| 14 subjects have six signals per pain (HP/LP) class. |
| 18 signals per subject for NP class. |
Table 2.
Mathematical description of time and spectral features used in this work.
Table 2.
Mathematical description of time and spectral features used in this work.
Time Features | Spectral Features |
---|
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
| |
Table 3.
Details of morphological features extracted from BVP signals.
Table 3.
Details of morphological features extracted from BVP signals.
Abbreviation | Details |
---|
SDNN | The standard deviation of intervals |
RMSSD | The square root of the mean of the squares of the successive differences between adjacent intervals |
SDSD | The standard deviation of the successive differences between adjacent intervals |
NN50 | The number of pairs of successive intervals that differ by more than 50 ms |
pNN50 | The proportion of NN50 divided by the total number of intervals |
NN20 | The number of pairs of successive intervals that differ by more than 20 ms |
pNN20 | The proportion of NN20 divided by the total number of intervals |
VLF | Total spectral power of all intervals between 0 and 0.04 Hz |
LF | Total spectral power of all intervals between 0.04 and 0.15 Hz |
HF | Total spectral power of all intervals between 0.15 and 0.4 Hz |
SD1 | The standard deviation of the Poincaré plot perpendicular to the line of identity |
SD2 | The standard deviation of the Poincaré plot along to the line of identity |
Table 4.
Hyperparameters used for each classifier.
Table 4.
Hyperparameters used for each classifier.
Classifier | Parameters |
---|
QSVM | Kernel function: Polynomial, Polynomial order: 2, Box constraint: 1, Standardization: True, Coding: one vs. one |
WKNN | Distance: Euclidean, Number of neighbors: 10, Distance weight: Sqauared inverse, Standardization: True |
AB | Method: AdaBoost M1, Maximum number of splits: 20, Number of learning cycles: 30, Learning rate: 0.1 |
BLNN | Layer sizes: [100 100], Activation function: ReLU, Iteration limit: 1000, Standardization: True |
TLNN | Layer sizes: [100 100 100], Activation function: ReLU, Iteration limit: 1000, Standardization: True |
Table 5.
Performance evaluation with combinations of time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 1 (no pain vs. high pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: Bi-layered Neural Network, TLNN: Tri-layered Neural Network). Bold text indicates the best results.
Table 5.
Performance evaluation with combinations of time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 1 (no pain vs. high pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: Bi-layered Neural Network, TLNN: Tri-layered Neural Network). Bold text indicates the best results.
Classifier | Feature Combination | Acc | Sen | Sp | PPV | NPV | F1-Score |
---|
QSVM | Time + Frq | 80.00 | 100.00 | 50.00 | 75.00 | 100.00 | 85.71 |
Time + Mrp | 73.33 | 83.33 | 58.33 | 75.00 | 70.00 | 78.95 |
Frq + Mrp | 53.33 | 66.67 | 33.33 | 60.00 | 40.00 | 63.16 |
Time + Frq + Mrp | 70.00 | 88.89 | 41.67 | 69.57 | 71.43 | 78.05 |
WKNN | Time + Frq | 80.00 | 88.89 | 66.67 | 80.00 | 80.00 | 84.21 |
Time + Mrp | 80.00 | 94.44 | 58.33 | 77.27 | 87.50 | 85.00 |
Frq + Mrp | 76.67 | 100.00 | 41.67 | 72.00 | 100.00 | 83.72 |
Time + Frq + Mrp | 83.33 | 100.00 | 58.33 | 78.26 | 100.00 | 87.80 |
AB | Time + Frq | 66.67 | 66.67 | 66.67 | 75.00 | 57.14 | 70.59 |
Time + Mrp | 60.00 | 55.56 | 66.67 | 71.43 | 50.00 | 62.50 |
Frq + Mrp | 70.00 | 88.89 | 41.67 | 69.57 | 71.43 | 78.05 |
Time + Frq + Mrp | 63.33 | 55.56 | 75.00 | 76.92 | 52.94 | 64.52 |
BLNN | Time + Frq | 76.67 | 83.33 | 66.67 | 78.95 | 72.73 | 81.08 |
Time + Mrp | 66.67 | 61.11 | 75.00 | 78.57 | 56.25 | 68.75 |
Frq + Mrp | 63.33 | 55.56 | 75.00 | 76.92 | 52.94 | 64.52 |
Time + Frq + Mrp | 80.00 | 83.33 | 75.00 | 83.33 | 75.00 | 83.33 |
TLNN | Time + Frq | 73.33 | 66.67 | 83.33 | 85.71 | 62.50 | 75.00 |
Time + Mrp | 63.33 | 61.11 | 66.67 | 73.33 | 53.33 | 66.67 |
Frq + Mrp | 70.00 | 88.89 | 41.67 | 69.57 | 71.43 | 78.05 |
Time + Frq + Mrp | 96.67 | 100.00 | 91.67 | 94.74 | 100.00 | 97.30 |
Table 6.
Performance evaluation with combinations of time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 2 (no pain vs. low pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: bi-layered neural network, TLNN: tri-layered neural network). Bold text indicates the best results.
Table 6.
Performance evaluation with combinations of time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 2 (no pain vs. low pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: bi-layered neural network, TLNN: tri-layered neural network). Bold text indicates the best results.
Classifier | Feature Combination | Acc | Sen | Sp | PPV | NPV | F1-Score |
---|
QSVM | Time + Frq | 70.00 | 100.00 | 25.00 | 66.67 | 100.00 | 80.00 |
Time + Mrp | 83.33 | 100.00 | 58.33 | 78.26 | 100.00 | 87.80 |
Frq + Mrp | 80.00 | 100.00 | 50.00 | 75.00 | 100.00 | 85.71 |
Time + Frq + Mrp | 76.67 | 100.00 | 41.67 | 72.00 | 100.00 | 83.72 |
WKNN | Time + Frq | 63.33 | 83.33 | 33.33 | 65.22 | 57.14 | 73.17 |
Time + Mrp | 73.33 | 94.44 | 41.67 | 70.83 | 83.33 | 80.95 |
Frq + Mrp | 70.00 | 100.00 | 25.00 | 66.67 | 100.00 | 80.00 |
Time + Frq + Mrp | 66.67 | 100.00 | 16.67 | 64.29 | 100.00 | 78.26 |
AB | Time + Frq | 66.67 | 72.22 | 58.33 | 72.22 | 58.33 | 72.22 |
Time + Mrp | 80.00 | 83.33 | 75.00 | 83.33 | 75.00 | 83.33 |
Frq + Mrp | 73.33 | 100.00 | 33.33 | 69.23 | 100.00 | 81.82 |
Time + Frq + Mrp | 86.67 | 100.00 | 66.67 | 81.82 | 100.00 | 90.00 |
BLNN | Time + Frq | 46.67 | 50.00 | 41.67 | 56.25 | 35.71 | 52.94 |
Time + Mrp | 63.33 | 83.33 | 33.33 | 65.22 | 57.14 | 73.17 |
Frq + Mrp | 63.33 | 61.11 | 66.67 | 73.33 | 53.33 | 66.67 |
Time + Frq + Mrp | 70.00 | 94.44 | 33.33 | 68.00 | 80.00 | 79.07 |
TLNN | Time + Frq | 46.67 | 50.00 | 41.67 | 56.25 | 35.71 | 52.94 |
Time + Mrp | 73.33 | 88.89 | 50.00 | 72.73 | 75.00 | 80.00 |
Frq + Mrp | 63.33 | 72.22 | 50.00 | 68.42 | 54.55 | 70.27 |
Time + Frq + Mrp | 60.00 | 83.33 | 25.00 | 62.50 | 50.00 | 71.43 |
Table 7.
Performance evaluation with combinations of time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 3 (No Pain vs. Low Pain vs. High Pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: bi-layered neural network, TLNN: tri-layered neural network. Bold text indicates the best results.
Table 7.
Performance evaluation with combinations of time, frequency (Frq), and morphological (Mrp) features using different classifiers for Experiment 3 (No Pain vs. Low Pain vs. High Pain). (QSVM: Quadratic-SVM, WKNN: Weighted-KNN, AB: AdaBoost, BLNN: bi-layered neural network, TLNN: tri-layered neural network. Bold text indicates the best results.
Classifier | Feature Combination | Acc | Sen | Sp | PPV | NPV | F1-Score |
---|
QSVM | Time + Frq | 54.76 | 88.89 | 50.00 | 57.14 | 85.71 | 69.57 |
Time + Mrp | 50.00 | 61.11 | 62.50 | 55.00 | 68.18 | 57.89 |
Frq + Mrp | 50.00 | 83.33 | 37.50 | 50.00 | 75.00 | 62.50 |
Time + Frq + Mrp | 52.38 | 83.33 | 45.83 | 53.57 | 78.57 | 65.22 |
WKNN | Time + Frq | 52.38 | 61.11 | 66.67 | 57.89 | 69.57 | 59.46 |
Time + Mrp | 61.90 | 94.44 | 54.17 | 60.71 | 92.86 | 73.91 |
Frq + Mrp | 61.90 | 100.00 | 45.83 | 58.06 | 100.00 | 73.47 |
Time + Frq + Mrp | 64.29 | 94.44 | 58.33 | 62.96 | 93.33 | 75.56 |
AB | Time + Frq | 35.71 | 55.56 | 54.17 | 47.62 | 61.90 | 51.28 |
Time + Mrp | 38.10 | 72.22 | 54.17 | 54.17 | 72.22 | 61.90 |
Frq + Mrp | 47.62 | 88.89 | 25.00 | 47.06 | 75.00 | 61.54 |
Time + Frq + Mrp | 40.48 | 66.67 | 58.33 | 54.55 | 70.00 | 60.00 |
BLNN | Time + Frq | 40.48 | 50.00 | 75.00 | 60.00 | 66.67 | 54.55 |
Time + Mrp | 69.05 | 83.33 | 75.00 | 71.43 | 85.71 | 76.92 |
Frq + Mrp | 42.86 | 38.89 | 83.33 | 63.64 | 64.52 | 48.28 |
Time + Frq + Mrp | 57.14 | 88.89 | 66.67 | 66.67 | 88.89 | 76.19 |
TLNN | Time + Frq | 54.76 | 61.11 | 87.50 | 78.57 | 75.00 | 68.75 |
Time + Mrp | 52.38 | 61.11 | 83.33 | 73.33 | 74.07 | 66.67 |
Frq + Mrp | 59.52 | 72.22 | 66.67 | 61.90 | 76.19 | 66.67 |
Time + Frq + Mrp | 61.90 | 77.78 | 70.83 | 66.67 | 80.95 | 71.79 |
Table 8.
Summary of best-performing features and classification methods for all experiments. Experiment 1: no pain vs. high pain, Experiment 2: no pain vs. low pain, Experiment 3: no pain vs. low pain vs. high pain. Bold text indicates significant results.
Table 8.
Summary of best-performing features and classification methods for all experiments. Experiment 1: no pain vs. high pain, Experiment 2: no pain vs. low pain, Experiment 3: no pain vs. low pain vs. high pain. Bold text indicates significant results.
Features | FVL | Experiment 1 | Experiment 2 | Experiment 3 |
---|
Time | 12 | WKNN: 83.3% | WNN: 70% | WKNN: 54.7% |
Frq | 12 | WNN: 76.6% | WKNN: 63.3% | NNN: 57.1% |
Mrp | 12 | AB: 53.3% | LSVM: 63.3% | LSVM: 45.2% |
Time + Frq | 24 | BLNN: 76.6% | QSVM: 70.0% | TLNN: 54.7% |
Time + Mrp | 24 | QSVM:73.3% | QSVM: 83.3% | BLNN: 69.04% |
Frq+ Mrp | 24 | FKNN: 83.33% | WNN: 73.33% | FKNN: 61.9% |
Time + Frq + Mrp | 36 | TLNN: 96.66% | AB: 86.66% | WKNN: 64.28% |