End-to-End Dataset Collection System for Sport Activities
Abstract
:1. Introduction
- RQ1: Is it possible to develop an end-to-end versatile system architecture for efficiently and easily collecting data on activities from different sports and supporting efficient ML dataset creation?
- RQ2: Can devices with limited resources and low cost, such as an Arduino board, provide reliable results in ultra-low-power and low-energy contexts?
- RQ3: Is it possible to develop a compact system that can be easily integrated in various sport contexts, either on the human body or on sport instruments, without compromising the quality of the collected data nor disturbing regular sport activity?
2. Related Works
3. System Architecture
- Operative range: >150 m, based on the standard soccer field’s diagonal length;
- Battery duration: >4 h, longer than most match/session durations;
- Size: <50 mm × 50 mm × 30 mm, to allow the device to be placed without hindering the sport activity;
- Wearable device: the device should be easily attachable to body/equipment parts such as the wrist, waist, leg, handle, etc.;
- Ease of use: users who are deeply engaged in a sport activity cannot be distracted nor are they supposed to have particular knowledge about devices and systems.
3.1. Edge
3.1.1. Communication
- GSM: This option is more expensive and demands a higher power supply. It is best suited for environmental data collection applications with a powerful edge carrying out the activities of the fog layer as well, thus also transmitting data to the cloud. It offers wide coverage, making it ideal for utilization in remote areas. For these reasons, GSM in wearables is typically used for safety and health systems [36,37], which require prompt action in cases of serious need, thus bypassing the fog layer;
- Wi-Fi: This communication system is preferred for applications where the size of the board is relevant and a power source is available. It utilizes a fog layer as a bridge between the device and the database, without the possibility of controlling data recording. Wi-Fi is suitable for indoor environments or areas where connectivity is stable and reliable [38].
- BLE: This solution fits applications that require both a compact device size and low power consumption. It needs a fog layer to relay data to the cloud server. This layer can also serve as a human–computer interface with the ED, enabling dynamic functionality changes remotely. BLE is ideal for wearable devices or scenarios where energy efficiency and user inputs are priorities [39].
3.1.2. Sensor and Microcontroller
3.1.3. Power Supply
- Battery-less: it requires additional hardware to harvest energy from the environment [44] (i.e., antennas, solar panels, etc.). This solution would add significant complexity to the design and is not the focus of our research but could be considered at a later stage.
- External battery: this option exploits the USB connection of the Arduino board, allowing the user to connect an external battery. It adds weight to the device and could increase its size.
- Embedded battery: this option requires the development of a dedicated board to connect a small battery to the device. While this solution does result in a slight increase in the device’s size and weight, it retains its overall compact design.
3.2. Fog
3.3. Cloud
3.4. Resulting Architecture
4. Results
4.1. Applications
4.2. Supervised ML Dataset Assessment
4.3. Power Consumption Analysis
4.4. Comparison with State-of-the Art Solutions
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- McDevitt, S.; Hernandez, H.; Hicks, J.; Lowell, R.; Bentahaikt, H.; Burch, R.; Ball, J.; Chander, H.; Freeman, C.; Taylor, C.; et al. Wearables for Biomechanical Performance Optimization and Risk Assessment in Industrial and Sports Applications. Bioengineering 2022, 9, 33. [Google Scholar] [CrossRef]
- Meng, Z.; Zhang, M.; Guo, C.; Fan, Q.; Zhang, H.; Gao, N.; Zhang, Z. Recent Progress in Sensing and Computing Techniques for Human Activity Recognition and Motion Analysis. Electronics 2020, 9, 1357. [Google Scholar] [CrossRef]
- Ghasemzadeh, H.; Jafari, R. Coordination Analysis of Human Movements With Body Sensor Networks: A Signal Processing Model to Evaluate Baseball Swings. IEEE Sens. J. 2011, 11, 603–610. [Google Scholar] [CrossRef]
- Ueda, M.; Negoro, H.; Kurihara, Y.; Watanabe, K. Measurement of Angular Motion in Golf Swing by a Local Sensor at the Grip End of a Golf Club. IEEE Trans. Hum.-Mach. Syst. 2013, 43, 398–404. [Google Scholar] [CrossRef]
- Aubol, K.G.; Milner, C.E. Foot Contact Identification Using a Single Triaxial Accelerometer during Running. J. Biomech. 2020, 105, 109768. [Google Scholar] [CrossRef]
- Banko, M.; Brill, E. Scaling to Very Very Large Corpora for Natural Language Disambiguation. In Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics, Toulouse, France, 6–11 July 2001; Association for Computational Linguistics: Toulouse, France; pp. 26–33. [Google Scholar]
- Machine Learning Costs: Price Factors and Real-World Estimates | HackerNoon. Available online: https://hackernoon.com/machine-learning-costs-price-factors-and-real-world-estimates (accessed on 8 March 2024).
- Santos-Gago, J.M.; Ramos-Merino, M.; Vallarades-Rodriguez, S.; Álvarez-Sabucedo, L.M.; Fernández-Iglesias, M.J.; García-Soidán, J.L. Innovative Use of Wrist-Worn Wearable Devices in the Sports Domain: A Systematic Review. Electronics 2019, 8, 1257. [Google Scholar] [CrossRef]
- Hsu, Y.-L.; Yang, S.-C.; Chang, H.-C.; Lai, H.-C. Human Daily and Sport Activity Recognition Using a Wearable Inertial Sensor Network. IEEE Access 2018, 6, 31715–31728. [Google Scholar] [CrossRef]
- Cust, E.E.; Sweeting, A.J.; Ball, K.; Robertson, S. Machine and Deep Learning for Sport-Specific Movement Recognition: A Systematic Review of Model Development and Performance. J. Sports Sci. 2019, 37, 568–600. [Google Scholar] [CrossRef]
- Nadeem, A.; Jalal, A.; Kim, K. Automatic Human Posture Estimation for Sport Activity Recognition with Robust Body Parts Detection and Entropy Markov Model. Multimed. Tools Appl. 2021, 80, 21465–21498. [Google Scholar] [CrossRef]
- Tabish, M.; Tanooli, Z.-R.; Shaheen, M. Activity Recognition Framework in Sports Videos. Multimed. Tools Appl. 2024, 83, 15101–15123. [Google Scholar] [CrossRef]
- Simonyan, K.; Zisserman, A. Very Deep Convolutional Networks for Large-Scale Image Recognition. arxiv 2014, arXiv:1409.1556. [Google Scholar] [CrossRef]
- Jain, A.K.; Dubes, R.C. Algorithms for Clustering Data; Prentice-Hall, Inc.: Upper Saddle River, NJ, USA, 1988; ISBN 978-0-13-022278-7. [Google Scholar]
- Rangasamy, K.; As’ari, M.A.; Rahmad, N.A.; Ghazali, N.F. Hockey Activity Recognition Using Pre-Trained Deep Learning Model. ICT Express 2020, 6, 170–174. [Google Scholar] [CrossRef]
- Fresta, M.; Dabbous, A.; Bellotti, F.; Capello, A.; Lazzaroni, L.; Pighetti, A.; Berta, R. Low-Cost, Edge-Cloud, End-to-End System Architecture for Human Activity Data Collection. In Proceedings of the Applications in Electronics Pervading Industry, Environment and Society; Bellotti, F., Grammatikakis, M.D., Mansour, A., Ruo Roch, M., Seepold, R., Solanas, A., Berta, R., Eds.; Springer Nature Switzerland: Cham, Switzerland, 2024; pp. 444–449. [Google Scholar]
- Cuperman, R.; Jansen, K.M.B.; Ciszewski, M.G. An End-to-End Deep Learning Pipeline for Football Activity Recognition Based on Wearable Acceleration Sensors. Sensors 2022, 22, 1347. [Google Scholar] [CrossRef]
- Dabbous, A.; Fresta, M.; Bellotti, F.; Berta, R. Neural Architecture for Tennis Shot Classification on Embedded System. In Proceedings of the Applications in Electronics Pervading Industry, Environment and Society; Bellotti, F., Grammatikakis, M.D., Mansour, A., Ruo Roch, M., Seepold, R., Solanas, A., Berta, R., Eds.; Springer Nature Switzerland: Cham, Switzerland, 2024; pp. 97–102. [Google Scholar]
- Berta, R.; Bellotti, F.; De Gloria, A.; Lazzaroni, L. Assessing Versatility of a Generic End-to-End Platform for IoT Ecosystem Applications. Sensors 2022, 22, 713. [Google Scholar] [CrossRef]
- Liu, R.; Wang, Z.; Shi, X.; Zhao, H.; Qiu, S.; Li, J.; Yang, N. Table Tennis Stroke Recognition Based on Body Sensor Network. In Proceedings of the Internet and Distributed Computing Systems; Montella, R., Ciaramella, A., Fortino, G., Guerrieri, A., Liotta, A., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 1–10. [Google Scholar]
- Nguyen, L.N.N.; Rodríguez-Martín, D.; Català, A.; Pérez-López, C.; Samà, A.; Cavallaro, A. Basketball Activity Recognition Using Wearable Inertial Measurement Units. In Proceedings of the XVI International Conference on Human Computer Interaction; Association for Computing Machinery: New York, NY, USA, 2015; pp. 1–6. [Google Scholar]
- Haider, F.; Salim, F.A.; Postma, D.B.W.; van Delden, R.; Reidsma, D.; van Beijnum, B.-J.; Luz, S. A Super-Bagging Method for Volleyball Action Recognition Using Wearable Sensors. Multimodal Technol. Interact. 2020, 4, 33. [Google Scholar] [CrossRef]
- Cornacchia, M.; Ozcan, K.; Zheng, Y.; Velipasalar, S. A Survey on Activity Detection and Classification Using Wearable Sensors. IEEE Sens. J. 2017, 17, 386–403. [Google Scholar] [CrossRef]
- Kunze, K.; Lukowicz, P. Sensor Placement Variations in Wearable Activity Recognition. IEEE Pervasive Comput. 2014, 13, 32–41. [Google Scholar] [CrossRef]
- Perumal, T.; Ramanujam, E.; Suman, S.; Sharma, A.; Singhal, H. Internet of Things Centric-Based Multiactivity Recognition in Smart Home Environment. IEEE Internet Things J. 2023, 10, 1724–1732. [Google Scholar] [CrossRef]
- Testoni, A.; Di Felice, M. A Software Architecture for Generic Human Activity Recognition from Smartphone Sensor Data. In Proceedings of the 2017 IEEE International Workshop on Measurement and Networking (M&N), Naples, Italy, 27–29 September 2017; IEEE: Naples, Italy; pp. 1–6. [Google Scholar]
- MongoDB: The Developer Data Platform. Available online: https://www.mongodb.com (accessed on 17 July 2023).
- Balkhi, P.; Moallem, M. A Multipurpose Wearable Sensor-Based System for Weight Training. Automation 2022, 3, 132–152. [Google Scholar] [CrossRef]
- Ghibellini, A.; Bononi, L.; Di Felice, M. Intelligence at the IoT Edge: Activity Recognition with Low-Power Microcontrollers and Convolutional Neural Networks. In Proceedings of the 2022 IEEE 19th Annual Consumer Communications & Networking Conference (CCNC), Las Vegas, NV, USA, 8–11 January 2022; IEEE: Las Vegas, NV, USA; pp. 707–710. [Google Scholar]
- Liu, Y. Research and Development of GNSS Wearable Device for Sports Performance Monitoring by Example of Soccer Player Analysis∗. In Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering, Xiamen, China, 21–23 October 2022; ACM: Xiamen, China; pp. 901–906. [Google Scholar]
- Zhang, H.; Zhang, Z.; Gao, N.; Xiao, Y.; Meng, Z.; Li, Z. Cost-Effective Wearable Indoor Localization and Motion Analysis via the Integration of UWB and IMU. Sensors 2020, 20, 344. [Google Scholar] [CrossRef]
- Berta, R.; Mazzara, A.; Bellotti, F.; De Gloria, A.; Lazzaroni, L. Edgine, A Runtime System for IoT Edge Applications. In Applications in Electronics Pervading Industry, Environment and Society; Saponara, S., De Gloria, A., Eds.; Lecture Notes in Electrical Engineering; Springer International Publishing: Cham, Switzerland, 2021; Volume 738, pp. 261–266. ISBN 978-3-030-66728-3. [Google Scholar]
- Farjana, M.; Fahad, A.B.; Alam, S.E.; Islam, M.M. An IoT- and Cloud-Based E-Waste Management System for Resource Reclamation with a Data-Driven Decision-Making Process. IoT 2023, 4, 202–220. [Google Scholar] [CrossRef]
- Arcobelli, V.A.; Zauli, M.; Galteri, G.; Cristofolini, L.; Chiari, L.; Cappello, A.; De Marchi, L.; Mellone, S. mCrutch: A Novel m-Health Approach Supporting Continuity of Care. Sensors 2023, 23, 4151. [Google Scholar] [CrossRef] [PubMed]
- Sudha Kumari, L.; Kouzani, A.Z. A Miniaturized Closed-Loop Optogenetic Brain Stimulation Device. Electronics 2022, 11, 1591. [Google Scholar] [CrossRef]
- Sunehra, D.; Sreshta, V.S.; Shashank, V.; Kumar Goud, B.U. Raspberry Pi Based Smart Wearable Device for Women Safety Using GPS and GSM Technology. In Proceedings of the 2020 IEEE International Conference for Innovation in Technology (INOCON), Bangaluru, India, 6–8 November 2020; pp. 1–5. [Google Scholar]
- Rihana, S.; Mondalak, J. Wearable Fall Detection System. In Proceedings of the 2016 3rd Middle East Conference on Biomedical Engineering (MECBME), Beirut, Lebanon, 6–7 October 2016; pp. 84–87. [Google Scholar]
- Rodrigues, M.J.; Postolache, O.; Cercas, F. Wearable Smart Sensing and UWB System for Fall Detection in AAL Environments. In Proceedings of the 2023 IEEE Sensors Applications Symposium (SAS), Ottawa, ON, Canada, 18–20 July 2023; pp. 1–6. [Google Scholar]
- Dabbous, A.; Fresta, M.; Bellotti, F.; Berta, R. Arduino Nano-Based System for Tennis Shot Classification. Lect. Notes Electr. Eng. 2024, 1113, 357–362. [Google Scholar] [CrossRef]
- Soro, A.; Brunner, G.; Tanner, S.; Wattenhofer, R. Recognition and Repetition Counting for Complex Physical Exercises with Deep Learning. Sensors 2019, 19, 714. [Google Scholar] [CrossRef] [PubMed]
- Xia, K.; Wang, H.; Xu, M.; Li, Z.; He, S.; Tang, Y. Racquet Sports Recognition Using a Hybrid Clustering Model Learned from Integrated Wearable Sensor. Sensors 2020, 20, 1638. [Google Scholar] [CrossRef] [PubMed]
- Ghazali, N.F.; Shahar, N.; Rahmad, N.A.; Sufri, N.A.J.; As’ari, M.A.; Latif, H.F.M. Common Sport Activity Recognition Using Inertial Sensor. In Proceedings of the 2018 IEEE 14th International Colloquium on Signal Processing & Its Applications (CSPA), Penang, Malaysia, 9–10 March 2018; IEEE: Batu Feringghi, Malaysia; pp. 67–71. [Google Scholar]
- Nano Family. Available online: https://store.arduino.cc/pages/nano-family (accessed on 13 February 2024).
- Yang, C.-C.; Pandey, R.; Tu, T.-Y.; Cheng, Y.-P.; Chao, P.C.-P. An Efficient Energy Harvesting Circuit for Batteryless IoT Devices. Microsyst. Technol. 2020, 26, 195–207. [Google Scholar] [CrossRef]
- Flutter-Build Apps for Any Screen. Available online: https://flutter.dev/ (accessed on 14 February 2024).
- Thambawita, V.; Hicks, S.A.; Borgli, H.; Stensland, H.K.; Jha, D.; Svensen, M.K.; Pettersen, S.-A.; Johansen, D.; Johansen, H.D.; Pettersen, S.D.; et al. PMData: A Sports Logging Dataset. In Proceedings of the 11th ACM Multimedia Systems Conference, New York, NY, USA, 27 May 2020; ACM: Istanbul, Turkey; pp. 231–236. [Google Scholar]
- Fresta, M.; Bellotti, F.; Capello, A.; Cossu, M.; Lazzaroni, L.; De Gloria, A.; Berta, R. Efficient Uploading of.Csv Datasets into a Non-Relational Database Management System. In Applications in Electronics Pervading Industry, Environment and Society; Berta, R., De Gloria, A., Eds.; Lecture Notes in Electrical Engineering; Springer Nature Switzerland: Cham, Switzerland, 2023; Volume 1036, pp. 9–15. ISBN 978-3-031-30332-6. [Google Scholar]
- Berta, R.; Kobeissi, A.; Bellotti, F.; De Gloria, A. Atmosphere, an Open Source Measurement-Oriented Data Framework for IoT. IEEE Trans. Ind. Inform. 2021, 17, 1927–1936. [Google Scholar] [CrossRef]
- Capello, A.; Fresta, M.; Bellotti, F.; Haghighi, H.; Hiller, J.; Mozaffari, S.; Berta, R. Exploiting Big Data for Experiment Reporting: The Hi-Drive Collaborative Research Project Case. Sensors 2023, 23, 7866. [Google Scholar] [CrossRef]
- Lazzaroni, L.; Mazzara, A.; Bellotti, F.; De Gloria, A.; Berta, R. Employing an IoT Framework as a Generic Serious Games Analytics Engine. In Proceedings of the Games and Learning Alliance; Marfisi-Schottman; Bellotti, F.I., Hamon, L., Klemke, R., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 79–88. [Google Scholar]
- Fresta, M.; Capello, A.; Bellotti, F.; Lazzaroni, L.; Cossu, M.; Berta, R. Supporting a .Csv-Based Workflow in MongoDB for Data Analysts. In Proceedings of the 2023 IEEE 32nd International Symposium on Industrial Electronics (ISIE), Helsinki-Espoo, Finland, 19–21 June 2023; IEEE: Helsinki, Finland; pp. 1–4. [Google Scholar]
- Khalife, R.; Mrad, R.; Dabbous, A.; Ibrahim, A. Real-Time Implementation of Tiny Machine Learning Models for Hand Motion Classification. In Proceedings of the Applications in Electronics Pervading Industry, Environment and Society; Bellotti, F., Grammatikakis, M.D., Mansour, A., Ruo Roch, M., Seepold, R., Solanas, A., Berta, R., Eds.; Springer Nature Switzerland: Cham, Switzerland, 2024; pp. 487–492. [Google Scholar]
- Vinayakumar, R.; Soman, K.P.; Poornachandran, P. Evaluating Effectiveness of Shallow and Deep Networks to Intrusion Detection System. In Proceedings of the 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Manipal, India, 13–16 September 2017; pp. 1282–1289. [Google Scholar]
- Products | Joy-IT. Available online: https://joy-it.net/en/products/JT-UM120 (accessed on 13 March 2024).
- Xu, C.; Liu, Z.; Li, P.; Yan, J.; Yao, L. Bifurcation Mechanism for Fractional-Order Three-Triangle Multi-Delayed Neural Networks. Neural Process. Lett. 2023, 55, 6125–6151. [Google Scholar] [CrossRef]
Module | GSM | Wi-Fi | BLE |
---|---|---|---|
Peak current | ~600 mA | ~190 mA | ~14 mA |
Distance | NA 1 | <50 m | <400 m |
Byte per message | NA 2 | NA 2 | 20 |
Additional fog requirements | NA 1 | Wi-Fi Internet connection | Device with Bluetooth and Internet connection |
Additional shield | Yes | Often onboard | Often onboard |
Additional costs | SIM contract | No | No |
Sport | Actions | ED Position | Number of Athletes | Recording Duration | Sampling Frequency |
---|---|---|---|---|---|
Fitwalking | Walking, Running, Climbing Stairs | Chest | 10 | 150 min | 10 Hz |
Tennis | Forehand, Backhand, Serve | Racket | 10 | 190 min | 10 Hz |
Soccer | Shot, Pass, Stop | Shin guard | 10 | 180 min | 10 Hz |
Boxing | Cross, Left Hook, Right Hook | Belt | 10 | 130 min | 10 Hz |
Sport | Input Size 1 | Kernel Size | NN Layers | Test Accuracy |
---|---|---|---|---|
Fitwalking | [25, 6] | 3 | [Conv1D, Conv1D, Conv1D, Dense, Dense] | 93.81% |
Tennis | [15, 6] | 3 | [Conv1D, Conv1D, Dense, Dense] | 97.54% |
Soccer | [15, 6] | 3 | [Conv1D, Conv1D, Dense, Dense] | 96.35% |
Boxing | [15, 6] | 3 | [Conv1D, Conv1D, Dense, Dense] | 95.97% |
ED Condition | Battery Duration [min] | Battery-Powered | USB-Powered | ||
---|---|---|---|---|---|
Average Current [mA] | Average Power Consumption [mW] | Average Current [mA] | Average Power Consumption [mW] | ||
Idle | 355 | 44.41 | 159.88 | 21.33 | 106.67 |
Standalone | 301 | 52.22 | 187.99 | 25.02 | 125.10 |
10 Hz Continuous | 293 | 52.65 | 189.54 | 25.14 | 125.69 |
30 Hz Continuous | 286 | 53.02 | 190.87 | 25.19 | 125.97 |
Solution | Wearable | End-to-End Architecture | Open Source | Fog Device | Multiple EDs | GUI Dashboard | Cloud Connection Required | Multi-Sport Ready Deployability |
---|---|---|---|---|---|---|---|---|
[26] | ✔ | ✔ | ||||||
[29] | ✔ | ✔ | ||||||
[28] | ✔ | |||||||
[30] | ✔ | ✔ | ✔ | ✔ | ||||
[31] | ✔ | ✔ | ||||||
[9] | ✔ | ✔ | ✔ | ✔ | ✔ | |||
[25] | ✔ | ✔ | ✔ | ✔ | ✔ | ✔ | ||
[32] | ✔ | ✔ | ✔ | ✔ | ✔ | |||
Ours | ✔ | ✔ | ✔ | ✔ | ✔ | 1 | ✔ |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Fresta, M.; Bellotti, F.; Capello, A.; Dabbous, A.; Lazzaroni, L.; Ansovini, F.; Berta, R. End-to-End Dataset Collection System for Sport Activities. Electronics 2024, 13, 1286. https://doi.org/10.3390/electronics13071286
Fresta M, Bellotti F, Capello A, Dabbous A, Lazzaroni L, Ansovini F, Berta R. End-to-End Dataset Collection System for Sport Activities. Electronics. 2024; 13(7):1286. https://doi.org/10.3390/electronics13071286
Chicago/Turabian StyleFresta, Matteo, Francesco Bellotti, Alessio Capello, Ali Dabbous, Luca Lazzaroni, Flavio Ansovini, and Riccardo Berta. 2024. "End-to-End Dataset Collection System for Sport Activities" Electronics 13, no. 7: 1286. https://doi.org/10.3390/electronics13071286
APA StyleFresta, M., Bellotti, F., Capello, A., Dabbous, A., Lazzaroni, L., Ansovini, F., & Berta, R. (2024). End-to-End Dataset Collection System for Sport Activities. Electronics, 13(7), 1286. https://doi.org/10.3390/electronics13071286