An Innovative Random-Forest-Based Model to Assess the Health Impacts of Regular Commuting Using Non-Invasive Wearable Sensors
Abstract
:1. Introduction
2. Related Literature Review
3. Data Collection and Research Hypothesis
- While travelling to work, participants had to wear an EEG headset, and a sensor arm and ear clip.
- For five working days, bio signals were recorded when they commuted to work.
- They were instructed to initialize the devices and fill out an online health questionnaire as a part of the pre-experiment process.
- The wearable devices captured the bio signals when the participant was travelling to and from work.
- When the participant arrived at their place of work, they took three to four minutes to complete an online survey that documented their experience during their commute.
- Please keep in mind that all the information or data that was recorded was made anonymous and kept secret.
4. Implementation
4.1. Performance Metrics for Classification
4.1.1. Confusion Matrix
4.1.2. Classification Accuracy
4.1.3. Precision
4.1.4. Recall
4.1.5. F1 Score
4.1.6. The Area under ROC Curve
5. Results and Discussion
5.1. Approach 1: Using Only EEG, and BP Data
5.1.1. Support Vector Machine
5.1.2. K-Nearest Neighbor
5.1.3. Random Forest
- Select samples at random from a data or training set.
- This algorithm will produce a decision tree for each training set.
- Voting will use an average of the choice tree.
- Choose as the final prediction outcome the one that has received the most votes.
5.1.4. Naive Bayes
5.1.5. Multi-Layer Perceptron Neural Network
5.2. Approach 2: Using EEG, BP, and Personalized Parameters
5.2.1. Random Forest
5.2.2. Naive Bayes
6. Analysis and Critical Review
6.1. Approach 1: Using Only the Main Objective Parameters (EEG, and BP)
6.2. Approach 2: Using EEG, BP, and Personalized Parameters
6.3. PANAS Results
7. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Chatterjee, K.; Chng, S.; Clark, B.; Davis, A.; De Vos, J.; Ettema, D.; Handy, S.; Martin, A.; Reardon, L. Commuting and wellbeing: A critical overview of the literature with implications for policy and future research. Transp. Rev. 2020, 40, 5–34. [Google Scholar] [CrossRef]
- Gatersleben, B.; Uzzell, D. Affective appraisals of the daily commute: Comparing perceptions of drivers, cyclists, walkers, and users of public transport. Environ. Behav. 2007, 39, 416–431. [Google Scholar] [CrossRef] [Green Version]
- Attar, E.T.; Balasubramanian, V.; Subasi, E.; Kaya, M. Stress analysis based on simultaneous heart rate variability and eeg monitoring. IEEE J. Transl. Eng. Health Med. 2021, 9, 1–7. [Google Scholar] [CrossRef] [PubMed]
- Taggart, P.; Boyett, M.R.; Logantha, S.J.R.; Lambiase, P.D. Anger, emotion, and arrhythmias: From brain to heart. Front. Physiol. 2011, 2, 67. [Google Scholar] [CrossRef] [Green Version]
- Costa, G.; Pickup, L.; Di Martino, V. Commuting—A further stress factor for working people: Evidence from the european community. ii. an empirical study. Int. Arch. Occup. Environ. Ment. Health 1988, 60, 377–385. [Google Scholar] [CrossRef]
- Milner, A.; Badland, H.; Kavanagh, A.; LaMontagne, A.D. Time spent commuting to work and mental health: Evidence from 13 waves of an australian cohort study. Am. J. Epidemiol. 2017, 186, 659–667. [Google Scholar] [CrossRef] [PubMed]
- Buckley, F.; O’Regan, B. The Psychological Effects of Commuting in Dublin; Dublin City University: Dublin, Ireland, 2004. [Google Scholar]
- Wener, R.E.; Evans, G.W. Comparing stress of car and train commuters. Transp. Res. Part F Traffic Psychol. Behav. 2011, 14, 111–116. [Google Scholar] [CrossRef]
- Choi, J.; Coughlin, J.F.; D’Ambrosio, L. Travel time and subjective well-being. Transp. Res. Rec. 2013, 2357, 100–108. [Google Scholar] [CrossRef]
- Golino, H.F.; Amaral, L.S.d.B.; Duarte, S.F.P.; Gomes, C.M.A.; Soares, T.d.J.; Reis LAd Santos, J. Predicting increased blood pressure using machine learning. J. Obes. 2014, 2014, 637635. [Google Scholar] [CrossRef]
- Sriramprakash, S.; Prasanna, V.D.; Murthy, O.R. Stress detection in working people. Procedia Comput. Sci. 2017, 115, 359–366. [Google Scholar] [CrossRef]
- Evin, M.; Hidalgo-Munoz, A.; Béquet, A.J.; Moreau, F.; Tattegrain, H.; Berthelon, C.; Fort, A.; Jallais, C. Personality trait prediction by machine learning using physiological data and driving behavior. Mach. Learn. Appl. 2022, 9, 100353. [Google Scholar] [CrossRef]
- Ahmed, T.; Qassem, M.; Kyriacou, P.A. Physiological monitoring of stress and major depression: A review of the current monitoring tech- niques and considerations for the future. Biomed. Signal Process. Control 2022, 75, 103591. [Google Scholar] [CrossRef]
- Al-Jebrni, A.H.; Chwyl, B.; Wang, X.Y.; Wong, A.; Saab, B.J. Ai-enabled remote and objective quantification of stress at scale. Biomed. Signal Process. Control 2020, 59, 101929. [Google Scholar] [CrossRef]
- Bobade, P.; Vani, M. Stress detection with machine learning and deep learning using multimodal physiological data. In Proceedings of the 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), Coimbatore, India, 15–17 July 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 51–57. [Google Scholar]
- Brodsky, M.A.; Sato, D.A.; Iseri, L.T.; Wolff, L.J.; Allen, B.J. Ventricular tachyarrhythmia associated with psychological stress: The role of the sympathetic nervous system. JAMA 1987, 257, 2064–2067. [Google Scholar] [CrossRef] [PubMed]
- Hämmig, O.; Gutzwiller, F.; Bauer, G. Work-life conflict and associations with work-and nonwork-related factors and with physical and mental health outcomes: A nationally representative cross-sectional study in Switzerland. BMC Public Health 2009, 9, 435. [Google Scholar] [CrossRef] [Green Version]
- Rizwan, M.F.; Farhad, R.; Mashuk, F.; Islam, F.; Imam, M.H. Design of a biosignal based stress detection system using machine learning techniques. In Proceedings of the 2019 International Conference on Robotics, Electrical and Signal Processing Techniques (ICREST), Dhaka, Bangladesh, 10–12 January 2019; IEEE: Piscataway, NJ, USA; pp. 364–368. [Google Scholar]
- Xia, L.; Malik, A.S.; Subhani, A.R. A physiological signal-based method for early mental-stress detection. Biomed. Signal Process. Control 2018, 46, 18–32. [Google Scholar] [CrossRef]
- Hou, X.; Liu, Y.; Sourina, O.; Tan, Y.R.E.; Wang, L.; Mueller-Wittig, W. EEG based stress monitoring. In Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics, Hong Kong, China, 9–12 October 2015; IEEE: Piscataway, NJ, USA, 2015; pp. 3110–3115. [Google Scholar]
- Ghaderi, A.; Frounchi, J.; Farnam, A. Machine learning-based signal processing using physiological signals for stress detection. In Proceedings of the 2015 22nd Iranian Conference on Biomedical Engineering (ICBME), Tehran, Iran, 25–27 November 2015; IEEE: Piscataway, NJ, USA, 2015; pp. 93–98. [Google Scholar]
- Cho, H.M.; Park, H.; Dong, S.Y.; Youn, I. Ambulatory and laboratory stress detection based on raw electrocardiogram signals using a convolutional neural network. Sensors 2019, 19, 4408. [Google Scholar] [CrossRef] [Green Version]
- Ahuja, R.; Banga, A. Mental stress detection in university students using machine learning algorithms. Procedia Comput. Sci. 2019, 152, 349–353. [Google Scholar] [CrossRef]
- Pascual, R.K.C.; Serrano, J.P.D.; Soltez, J.M.A.; Castillo, J.C.D.; Torres, J.L.; Cruz, F.R.G. Artificial neural network based stress level detection system using physiological signals. In Proceedings of the 2018 IEEE 10th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM), Baguio City, Philippines, 29 November–2 December 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 1–6. [Google Scholar]
- Samant, R.; Rao, S. Evaluation of artificial neural networks in prediction of essential hypertension. Int. J. Comput. Appl. 2013, 81, 34–38. [Google Scholar] [CrossRef]
- Sulaiman, N.; Ying, B.S.; Mustafa, M.; Jadin, M.S. Offline labview-based EEG signals analysis for human stress monitoring. In Proceedings of the 2018 9th IEEE Control and System Graduate Research Colloquium (ICSGRC), Shah Alam, Malaysia, 3–4 August 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 126–131. [Google Scholar]
- Miranda-Correa, J.A.; Patras, I. A multi-task cascaded network for prediction of affect, personality, mood and social context using EEG signals. In Proceedings of the 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi’an, China, 15–19 May 2018; IEEE: Piscataway, NJ, USA, 2018; pp. 373–380. [Google Scholar]
- Lee, D.H.; Jeong, J.H.; Kim, K.; Yu, B.W.; Lee, S.W. Continuous EEG decoding of pilots’ mental states using multiple feature block-based convolutional neural network. IEEE Access 2020, 8, 121929–121941. [Google Scholar] [CrossRef]
- Daniel, W.W.; Cross, C.L. Biostatistics: A Foundation for Analysis in the Health Sciences; Wiley: Hoboken, NJ, USA, 2018. [Google Scholar]
- Bhaduri, A.; Bhaduri, A.; Bhaduri, A.; Mohapatra, P. Blood pressure modeling using statistical and computational intelligence approaches. In Proceedings of the 2009 IEEE International Advance Computing Conference, Patiala, India, 6–7 March 2009; IEEE: Piscataway, NJ, USA, 2009; pp. 1026–1030. [Google Scholar]
- Díaz-García, A.; González-Robles, A.; Mor, S.; Mira, A.; Quero, S.; García-Palacios, A.; Baños, R.M.; Botella, C. Positive and negative affect schedule (PANAS): Psychometric properties of the online Spanish version in a clinical sample with emotional disorders. BMC Psychiatry 2020, 20, 56. [Google Scholar] [CrossRef] [Green Version]
- Watson, D.; Clark, L.A.; Tellegen, A. Development and validation of brief measures of positive and negative affect: The PANAS scales. J. Personal. Soc. Psychol. 1988, 54, 1063. [Google Scholar] [CrossRef] [PubMed]
- Kannel, W.B.; Gordon, T.; Schwartz, M.J. Systolic versus diastolic blood pressure and risk of coronary heart disease: The framingham study. Am. J. Cardiol. 1971, 27, 335–346. [Google Scholar] [CrossRef] [PubMed]
- Flint, A.C.; Conell, C.; Ren, X.; Banki, N.M.; Chan, S.L.; Rao, V.A.; Melles, R.B.; Bhatt, D.L. Effect of systolic and diastolic blood pressure on cardiovascular outcomes. N. Engl. J. Med. 2019, 381, 243–251. [Google Scholar] [CrossRef] [PubMed]
- Kumar, R.; Indrayan, A. Receiver operating characteristic (ROC) curve for medical researchers. Indian Pediatr. 2011, 48, 277–287. [Google Scholar] [CrossRef]
- Patro, V.M.; Patra, M.R. Augmenting weighted average with confusion matrix to enhance classification accuracy. Trans. Mach. Learn. Artif. Intell. 2014, 2, 77–91. [Google Scholar]
- Malhotra, R.; Meena, S. Empirical validation of cross-version and 10-fold cross-validation for defect prediction. In Proceedings of the 2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC), Coimbatore, India, 4–6 August 2021; IEEE: Piscataway, NJ, USA; pp. 431–438. [Google Scholar]
- Seliya, N.; Khoshgoftaar, T.M.; Van Hulse, J. A study on the relationships of classifier performance metrics. In Proceedings of the 2009 21st IEEE International Conference on Tools with Artificial Intelligence, Newark, NJ, USA, 2–4 November 2009; IEEE: Piscataway, NJ, USA, 2009; pp. 59–66. [Google Scholar]
- Yang, H.; Han, J.; Min, K. A multi-column CNN model for emotion recognition from EEG signals. Sensors 2019, 19, 4736. [Google Scholar] [CrossRef] [Green Version]
- Zhao, C.; Li, C.; Chao, J.; Wang, T.; Lei, C.; Liu, J.; Peng, H. F-score based EEG channel selection methods for emotion recognition. In Proceedings of the 2020 IEEE International Conference on E-health Networking, Application & Services (HEALTHCOM), Virtual, 1–2 March 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 1–6. [Google Scholar]
- Sovierzoski, M.A.; de Azevedo, F.M.; Argoud, F.I.M. Performance evaluation of an ann ff classifier of raw eeg data using roc analysis. In Proceedings of the 2008 International Conference on BioMedical Engineering and Informatics, Chengdu, China, 17–19 October 2020; IEEE: Piscataway, NJ, USA, 2008; pp. 332–336. [Google Scholar]
Category | Sub-Category | Number (N) |
---|---|---|
Sex | Male | 27 |
Female | 18 | |
Age | Less than 25 | 7 |
Between 25–45 | 30 | |
45+ | 8 | |
Location | North London | 11 |
Southeast London | 21 | |
East London | 11 | |
Southwest London | 2 | |
Mode of Commute | Bus | 8 |
Driving | 6 | |
Cycling | 7 | |
Train | 9 | |
Tube | 13 | |
Bus and Train | 2 |
1 | 2 | 3 | 4 | 5 |
---|---|---|---|---|
Very Slightly or Not at All | A Little | Moderately | Quite a Bit | Extremely |
|
|
Approach | Accuracy | Acc with 10-Fold Cross Validation Score | Acc with 5-Fold Cross-Validation |
---|---|---|---|
SVM | 80 | 80 | 80 |
KNN | 80 | 80 | 79 |
Random Forest | 91 | 91 | 90 |
Naïve Bayes | 77 | 77 | 76 |
MLP | 73 | 71 | 64 |
Technique | Accuracy | Cross-Validation Score | Precision Class 0 | Precision Class 1 | Recall Class 0 | Recall Class 1 | F1 Class 0 | F1 Class 1 |
---|---|---|---|---|---|---|---|---|
SVM | 80 | 0.71 | 1.0 | 0.78 | 0.31 | 1.0 | 0.47 | 0.88 |
KNN | 78 | 0.73 | 0.67 | 0.81 | 0.46 | 0.91 | 0.55 | 0.85 |
Random Forest | 91 | 0.75 | 0.91 | 0.91 | 0.77 | 0.97 | 0.83 | 0.94 |
Naïve Bayes | 78 | 0.73 | 1.0 | 0.76 | 0.23 | 1.0 | 0.38 | 0.86 |
MLP | 76 | 0.64 | 0.60 | 0.80 | 0.46 | 0.88 | 0.52 | 0.84 |
Avg Pre-Positive Affect | Avg Post-Positive Affect | Avg Pre-Negative Affect | Avg Post-Negative Affect |
---|---|---|---|
34.73 | 28.60 | 11.16 | 19.05 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Sharif, M.S.; Raj Theeng Tamang, M.; Fu, C.H.Y.; Baker, A.; Alzahrani, A.I.; Alalwan, N. An Innovative Random-Forest-Based Model to Assess the Health Impacts of Regular Commuting Using Non-Invasive Wearable Sensors. Sensors 2023, 23, 3274. https://doi.org/10.3390/s23063274
Sharif MS, Raj Theeng Tamang M, Fu CHY, Baker A, Alzahrani AI, Alalwan N. An Innovative Random-Forest-Based Model to Assess the Health Impacts of Regular Commuting Using Non-Invasive Wearable Sensors. Sensors. 2023; 23(6):3274. https://doi.org/10.3390/s23063274
Chicago/Turabian StyleSharif, Mhd Saeed, Madhav Raj Theeng Tamang, Cynthia H. Y. Fu, Aaron Baker, Ahmed Ibrahim Alzahrani, and Nasser Alalwan. 2023. "An Innovative Random-Forest-Based Model to Assess the Health Impacts of Regular Commuting Using Non-Invasive Wearable Sensors" Sensors 23, no. 6: 3274. https://doi.org/10.3390/s23063274
APA StyleSharif, M. S., Raj Theeng Tamang, M., Fu, C. H. Y., Baker, A., Alzahrani, A. I., & Alalwan, N. (2023). An Innovative Random-Forest-Based Model to Assess the Health Impacts of Regular Commuting Using Non-Invasive Wearable Sensors. Sensors, 23(6), 3274. https://doi.org/10.3390/s23063274