Comparative Analysis of Statistical, Time–Frequency, and SVM Techniques for Change Detection in Nonlinear Biomedical Signals
Abstract
:1. Introduction
- Enhanced sensitivity: These methods can detect subtle changes that may be missed by classical techniques.
- Robustness to noise: They are less sensitive to noise and artifacts, which is common in biomedical signals.
- Ability to handle complex signals: They can effectively handle non-linear and non-stationary signals.
- Scalability: They can handle large datasets and high-dimensional data.
- Computational complexity: Time–Frequency analysis and machine learning algorithms can be computationally expensive, especially for large datasets.
- Parameter tuning: These methods often require careful tuning of parameters to achieve optimal performance.
- Interpretability: The results of these methods can be difficult to interpret, especially for complex models.
2. Method
2.1. Classical Statistical Techniques
2.2. Time–Frequency Analysis
2.3. Machine Learning Algorithms
- (a)
- Input data: Receive a set of labeled training examples.
- (b)
- Feature mapping: Map input feature vectors to a higher-dimensional space using kernel functions.
- (c)
- Optimization objective: Find the optimal hyperplane that maximizes the margin between classes in the transformed space.
- (d)
- Soft margin: Introduce a slack variable to allow for misclassification of some data points, balancing margin maximization and classification error minimization.
- (e)
- Kernel trick: Efficiently compute dot products in the higher-dimensional space without explicitly transforming feature vectors.
- (f)
- Training: Solve a convex optimization problem to learn the optimal hyperplane parameters (weights and bias).
- (g)
- Prediction: Predict class labels of new data points based on the sign of the decision function, which is a linear combination of input features weighted by learned parameters.
- i.
- Change detected (statistical method): The red shaded area indicates the region where the statistical method detected changes due to shifts in mean and standard deviation.
- ii.
- Change detected (CWT method): The green shaded area shows where the Continuous Wavelet Transform (CWT) method detected changes, capturing variations in the time–frequency domain.
- iii.
- Change detected (SVM): The black arrows highlight points where the Support Vector Machine (SVM) detected changes, effectively identifying subtle and complex patterns in the signal.
3. Data and Application
3.1. Data
- (a)
- Base frequencies: We start by generating three sine waves with distinct frequencies: 5 Hz, 10 Hz, and 20 Hz. These frequencies were chosen to provide a mix of low, medium, and high frequency components, simulating the variety of oscillatory behaviors seen in biomedical signals.
- (b)
- Mathematical representation: The synthetic signal x(t) is initially defined as:
- (a)
- Nonlinear transformation: To incorporate nonlinear characteristics, we apply a nonlinear function to one of the sine wave components. In this case, we square the amplitude of the 20 Hz component.
- (b)
- Transformed signal: The modified signal becomes:
- (c)
- Effect: This squaring operation introduces harmonic distortions and amplitude modulation, which are characteristic of nonlinear systems.
- (a)
- Primary pattern: The anomalous signal retains the fundamental sinusoidal pattern but at a consistent frequency of 10 Hz, replicating a basic form of brain electrical activity.
- (b)
- Mathematical representation: Initially, the anomalous signal is represented as:
3.2. Method 1: Classical Statistical Techniques (e.g., Mean and Standard Deviation)
3.3. Method 2: Time–Frequency Analysis (e.g., Wavelet Transform)
3.4. Method 3: Machine Learning Algorithms (e.g., Support Vector Machines)
4. Discussion of the Comparison Results
5. Application, Challenges, and Future Directions
Future directions: | |
Real-world applications: | Apply these methods to real-world biomedical signals from various domains (e.g., electrocardiograms, electroencephalograms) to validate their effectiveness. |
Advanced machine learning: | Explore more advanced machine learning algorithms, such as deep learning, for improved change detection performance. |
Multimodal analysis: | Integrate multiple types of biomedical signals to gain a more comprehensive understanding of physiological processes. |
6. Discussion
7. Conclusions
Key contributions: | |
Comprehensive methodological exploration: | We employed a multifaceted approach, combining classical statistical techniques, machine learning algorithms, and time–frequency analysis to address the challenges of biomedical signal processing. |
Advanced understanding of physiological processes: | Our study provides valuable insights into the underlying dynamics of biomedical signals, aiding in a deeper understanding of physiological processes. |
Improved clinical decision-making: | By accurately identifying significant changes in biomedical signals, our research can contribute to more informed clinical decision-making. |
Innovation in healthcare technology: | Our findings pave the way for the development of new tools and techniques for biomedical signal analysis, potentially leading to advancements in healthcare technology. |
Addressing key challenges: | We successfully addressed the challenges of high-dimensional data handling and the identification of subtle, non-linear patterns in biomedical signals. |
Robust and accurate change detection: | Our study demonstrates the effectiveness of the combined methods in achieving robust and accurate change detection. |
Funding
Data Availability Statement
Conflicts of Interest
References
- Rangayyan, R.M.; Krishnan, S. Biomedical Signal Analysis; John Wiley & Sons: Hoboken, NJ, USA, 2024. [Google Scholar]
- Rajeswari, J.; Jagannath, M. Advances in biomedical signal and image processing—A systematic review. Inform. Med. Unlocked 2017, 8, 13–19. [Google Scholar] [CrossRef]
- AlHinai, N. Introduction to biomedical signal processing and artificial intelligence. In Biomedical Signal Processing and Artificial Intelligence in Healthcare; Academic Press: Cambridge, MA, USA, 2020; pp. 1–28. [Google Scholar]
- Goldberger, A.L.; Amaral, L.A.; Glass, L.; Hausdorff, J.M.; Ivanov, P.C.; Mark, R.G.; Mietus, J.E.; Moody, G.B.; Peng, C.-K.; Stanley, H.E. PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals. Circulation 2000, 101, e215–e220. [Google Scholar] [CrossRef] [PubMed]
- Bizzego, A.; Battisti, A.; Gabrieli, G.; Esposito, G.; Furlanello, C. Pyphysio: A physiological signal processing library for data science approaches in physiology. SoftwareX 2019, 10, 100287. [Google Scholar] [CrossRef]
- Azizi, T. Impact of mental arithmetic task on the electrical activity of the human brain. Neurosci. Inform. 2024, 4, 100162. [Google Scholar] [CrossRef]
- Azizi, T. Disrupted organization of dynamic functional networks with application in epileptic seizure recognition. Neurosci. Inform. 2024, 4, 100153. [Google Scholar] [CrossRef]
- Azizi, T. On the Fractal Geometry of Gait Dynamics in Different Neuro-degenerative Diseases. Phys. Med. 2022, 14, 100050. [Google Scholar] [CrossRef]
- Heyat, M.B.B.; Akhtar, F.; Munir, F.; Sultana, A.; Muaad, A.Y.; Gul, I.; Sawan, M.; Asghar, W.; Iqbal, S.M.A.; Baig, A.A.; et al. Unravelling the complexities of depression with medical intelligence: Exploring the interplay of genetics, hormones, and brain function. Complex Intell. Syst. 2024, 10, 5883–5915. [Google Scholar] [CrossRef]
- Inan, O.T.; Giovangrandi, L.; Kovacs, G.T. Robust neural-network-based classification of premature ventricular contractions using wavelet transform and timing interval features. IEEE Trans. Biomed. Eng. 2006, 53, 2507–2515. [Google Scholar] [CrossRef]
- Blinowska, K.J.; Żygierewicz, J. Practical Biomedical Signal Analysis Using MATLAB®; CRC Press: Boca Raton, FL, USA, 2021. [Google Scholar]
- Krishnan, S.; Athavale, Y. Trends in biomedical signal feature extraction. Biomed. Signal Process. Control 2018, 43, 41–63. [Google Scholar] [CrossRef]
- Gradl, S.; Kugler, P.; Lohmüller, C.; Eskofier, B. Real-time ECG monitoring and arrhythmia detection using Android-based mobile devices. In Proceedings of the 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, USA, 28 August–1 September 2012; IEEE: Piscataway, NJ, USA, 2012; pp. 2452–2455. [Google Scholar]
- Azizi, T. On the fractal geometry of different heart rhythms. Chaos Solitons Fractals X 2022, 9, 100085. [Google Scholar] [CrossRef]
- Azizi, T. Measuring fractal dynamics of FECG signals to determine the complexity of fetal heart rate. Chaos Solitons Fractals X 2022, 9, 100083. [Google Scholar] [CrossRef]
- Motamedi-Fakhr, S.; Moshrefi-Torbati, M.; Hill, M.; Hill, C.M.; White, P.R. Signal processing techniques applied to human sleep EEG signals—A review. Biomed. Signal Process. Control 2014, 10, 21–33. [Google Scholar] [CrossRef]
- Sörnmo, L.; Laguna, P. Bioelectrical Signal Processing in Cardiac and Neurological Applications; Academic Press: Cambridge, MA, USA, 2005. [Google Scholar]
- Xie, L.; Li, Z.; Zhou, Y.; He, Y.; Zhu, J. Computational diagnostic techniques for electrocardiogram signal analysis. Sensors 2020, 20, 6318. [Google Scholar] [CrossRef] [PubMed]
- Wu, Y.C.; Liao, Y.S.; Yeh, W.H.; Liang, S.F.; Shaw, F.Z. Directions of deep brain stimulation for epilepsy and Parkinson’s disease. Front. Neurosci. 2021, 15, 680938. [Google Scholar] [CrossRef] [PubMed]
- Orozco-Arroyave, J.R.; Vásquez-Correa, J.C.; Nöth, E. Current methods and new trends in signal processing and pattern recognition for the automatic assessment of motor impairments: The case of Parkinson’s disease. In Neurological Disorders and Imaging Physics; Volume 5: Applications in Dyslexia, Epilepsy and Parkinson’s; IOP Publishing: Bristol, UK, 2020; pp. 8-1–8-57. [Google Scholar]
- Xie, L.; Zou, S.; Xie, Y.; Veeravalli, V.V. Sequential (quickest) change detection: Classical results and new directions. IEEE J. Sel. Areas Inf. Theory 2021, 2, 494–514. [Google Scholar] [CrossRef]
- Inglada, J.; Mercier, G. A new statistical similarity measure for change detection in multitemporal SAR images and its extension to multiscale change analysis. IEEE Trans. Geosci. Remote Sens. 2007, 45, 1432–1445. [Google Scholar] [CrossRef]
- Parveen, S.; Heyat, M.B.B.; Akhtar, F.; Parveen, S.; Asrafali, B.; Singh, B.; Ali, K.; Huang, L.; Li, X.P.; Jabbar, A.; et al. Interweaving artificial intelligence and bio-signals in mental fatigue: Unveiling dynamics and future pathways. In Proceedings of the 2023 20th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China, 15–17 December 2023; IEEE: Piscataway, NJ, USA, 2023. [Google Scholar]
- Sanei, S.; Chambers, J.A. EEG Signal Processing and Machine Learning; John Wiley & Sons: Hoboken, NJ, USA, 2021. [Google Scholar]
- Hu, L.; Zhang, Z. (Eds.) EEG Signal Processing and Feature Extraction; Springer Nature: Berlin, Germany, 2019. [Google Scholar]
- Ghaderpour, E.; Pagiatakis, S.D.; Hassan, Q.K. A survey on change detection and time series analysis with applications. Appl. Sci. 2021, 11, 6141. [Google Scholar] [CrossRef]
- Xiong, W.; Cai, C.S. Time-frequency-based bridge scour identification by trend-change detection. J. Bridge Eng. 2022, 27, 04022093. [Google Scholar] [CrossRef]
- Aiordăchioaie, D.; Nistor, N.; Andrei, M. Change Detection in Time-Frequency Images by Feature Processing in Compressed Spaces. In Proceedings of the 2018 IEEE 24th International Symposium for Design and Technology in Electronic Packaging (SIITME), Pitesti, Romania, 21–24 October 2020; IEEE: Piscataway, NJ, USA, 2018; pp. 181–186. [Google Scholar]
- Zheng, W.-L.; Lu, B.-L. Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Trans. Auton. Ment. Dev. 2022, 7, 162–175. [Google Scholar] [CrossRef]
- Chatterjee, R.; Maitra, T.; Islam, S.H.; Hassan, M.M.; Alamri, A.; Fortino, G. A novel machine learning-based feature selection for motor imagery EEG signal classification in the Internet of medical things environment. Future Gener. Comput. Syst. 2019, 98, 419–434. [Google Scholar] [CrossRef]
- Andrzejak, R.G.; Schindler, K.; Rummel, C. Nonrandomness, nonlinear dependence, and nonstationarity of electroencephalographic recordings from epilepsy patients. Phys. Rev. E 2012, 86, 046206. [Google Scholar] [CrossRef] [PubMed]
- Shoeb, A.H. Application of Machine Learning to Epileptic Seizure Onset Detection and Treatment. Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA, USA, 2023. [Google Scholar]
- Deng, Y.; Meng, Y.; Chen, J.; Yue, A.; Liu, D.; Chen, J. TChange: A Hybrid Transformer-CNN Change Detection Network. Remote Sens. 2023, 15, 1219. [Google Scholar] [CrossRef]
- Zhang, X.L.; Begleiter, H.; Porjesz, B.; Wang, W.; Litke, A. Event-related potentials during object recognition tasks. Brain Res. Bull. 1995, 38, 531–538. [Google Scholar] [CrossRef] [PubMed]
- Pegoraro, J.A.; Lavault, S.; Wattiez, N.; Similowski, T.; Gonzalez-Bermejo, J.; Birmelé, E. Machine-learning based feature selection for a non-invasive breathing change detection. BioData Min. 2021, 14, 33. [Google Scholar] [CrossRef]
- Yang, Y.; Cong, X.; Long, K.; Luo, Y.; Xie, W.; Wan, Q. MRF model-based joint interrupted SAR imaging and coherent change detection via variational Bayesian inference. Signal Process. 2018, 151, 144–154. [Google Scholar] [CrossRef]
- Emara, H.M.; El-Shafai, W.; Algarni, A.D.; Soliman, N.F.; Abd El-Samie, F.E. A Hybrid Compressive Sensing and Classification Approach for Dynamic Storage Management of Vital Biomedical Signals. IEEE Access 2023, 11, 108126–108151. [Google Scholar] [CrossRef]
- Duan, J.; Xiong, J.; Li, Y.; Ding, W. Deep learning based multimodal biomedical data fusion: An overview and comparative review. Inf. Fusion 2024, 112, 102536. [Google Scholar] [CrossRef]
- Tovar-Lopez, F.J. Recent progress in micro-and nanotechnology-enabled sensors for biomedical and environmental challenges. Sensors 2023, 23, 5406. [Google Scholar] [CrossRef]
- Adali, T.; Levin-Schwartz, Y.; Calhoun, V.D. Multimodal data fusion using source separation: Application to medical imaging. Proc. IEEE 2015, 103, 1494–1506. [Google Scholar] [CrossRef]
- Shuqair, M.; Jimenez-Shahed, J.; Ghoraani, B. Reinforcement Learning-Based Adaptive Classification for Medication State Monitoring in Parkinson’s Disease. IEEE J. Biomed. Health Inform. 2024, 28, 6168–6179. [Google Scholar] [CrossRef]
- Mahmud, M.; Kaiser, M.S.; Hussain, A.; Vassanelli, S. Applications of deep learning and reinforcement learning to biological data. IEEE Trans. Neural Netw. Learn. Syst. 2018, 29, 2063–2079. [Google Scholar] [CrossRef] [PubMed]
- Yu, J.; Behrouzi, T.; Garg, K.; Goldenberg, A.; Tonekaboni, S. Dynamic Interpretable Change Point Detection for Physiological Data Analysis. In Proceedings of the Machine Learning for Health (ML4H), PMLR, Seattle, WA, USA, 30 November–1 December 2023; pp. 636–649. [Google Scholar]
- Liu, S.; Zhou, Y.; Yang, X.; Wang, X.; Yin, J. A Robust Automatic Epilepsy Seizure Detection Algorithm Based on Interpretable Features and Machine Learning. Electronics 2024, 13, 2727. [Google Scholar] [CrossRef]
- Lee, J.; Nemati, S.; Silva, I.; Edwards, B.A.; Butler, J.P.; Malhotra, A. Transfer entropy estimation and directional coupling change detection in biomedical time series. Biomed. Eng. Online 2012, 11, 19. [Google Scholar] [CrossRef] [PubMed]
- Paul, Y. Various epileptic seizure detection techniques using biomedical signals: A review. Brain Inform. 2018, 5, 6. [Google Scholar] [CrossRef] [PubMed]
- AlShorman, O.; Masadeh, M.; Heyat, M.B.B.; Akhtar, F.; Almahasneh, H.; Ashraf, G.M.; Alexiou, A. Frontal lobe real-time EEG analysis using machine learning techniques for mental stress detection. J. Integr. Neurosci. 2022, 21, 20. [Google Scholar] [CrossRef]
- Heyat, B.; Akhtar, F.; Sultana, A.; Tumrani, S.; Teelhawod, B.N.; Abbasi, R.; Kamal, M.A.; Muaad, A.Y.; Lai, D.; Wu, K. Role of oxidative stress and inflammation in insomnia sleep disorder and cardiovascular diseases: Herbal antioxidants and anti-inflammatory coupled with insomnia detection using machine learning. Curr. Pharm. Des. 2022, 28, 3618–3636. [Google Scholar] [CrossRef]
- Heyat, M.B.B.; Lai, D.; Khan, F.I.; Zhang, Y. Sleep bruxism detection using decision tree method by the combination of C4-P4 and C4-A1 channels of scalp EEG. IEEE Access 2019, 7, 102542–102553. [Google Scholar] [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Azizi, T. Comparative Analysis of Statistical, Time–Frequency, and SVM Techniques for Change Detection in Nonlinear Biomedical Signals. Signals 2024, 5, 736-755. https://doi.org/10.3390/signals5040041
Azizi T. Comparative Analysis of Statistical, Time–Frequency, and SVM Techniques for Change Detection in Nonlinear Biomedical Signals. Signals. 2024; 5(4):736-755. https://doi.org/10.3390/signals5040041
Chicago/Turabian StyleAzizi, Tahmineh. 2024. "Comparative Analysis of Statistical, Time–Frequency, and SVM Techniques for Change Detection in Nonlinear Biomedical Signals" Signals 5, no. 4: 736-755. https://doi.org/10.3390/signals5040041
APA StyleAzizi, T. (2024). Comparative Analysis of Statistical, Time–Frequency, and SVM Techniques for Change Detection in Nonlinear Biomedical Signals. Signals, 5(4), 736-755. https://doi.org/10.3390/signals5040041