1. Introduction
Countries around the globe have been experiencing a pandemic situation since December 2019. The outbreak of COVID-19 set up a concerning international public health crisis. As the outbreak continues to develop, the whole world is searching for possibilities to preclude the outbreak of the virus in new places, or to stop human-to-human interaction at places where the virus that originates COVID-19 was previously mingling. The public health departments in each county have taken the necessary steps to achieve these goals, such as implementing quarantine, which entails restricting human movement, maintaining a social distance from the rest of the public, or isolating healthy individuals who may not show any symptoms, with the goal of detecting virus-infected people early. Many states have legally permitted enforcement of quarantine from time to time when a new variant of COVID-19 starts spreading [
1]. With the increasing number of health problems worldwide because of a lack of physical activity during the quarantine period, it is necessary to do indoor physical activities to prevent non-communicable diseases. They cannot spread from one person to another, but can last a long time. Cardiovascular diseases, cancer, diabetes, and other chronic respiratory diseases are categorized as non-communicable diseases. Sometimes, sudden falls due to physical activities may damage the human body, especially when a person is alone.
With the recent rapid technological advances, numerous monitoring systems such as camera-based, wearable, and ambient sensors-based technology are helpful for detecting falls to reduce fall-related injuries [
2]. In this context, monitoring with portable sensors to detect immediate falls during physical activities not only helps in detecting falls but can also help with interventions before and after the fall [
3]. The systems used to detect sports falls are based on the sports automatic recognition (SAR) system. They are designed to provide accurate measures and analysis in sports that have the potential to increase the efficiency and accuracy of exercises and increase health and safety. In common SAR systems, recognition can be attained through the machine and deep learning approaches by capturing data with inertial sensing and computer vision technologies [
4]. Physical activities data measured by computer vision can be used for motion recognition and tracking. SAR systems include human detection and tracking, synchronization, and detection of targeted movements, depending on the type of sport and the camera settings [
5]. SAR systems based on computer vision technology can provide coaches and athletes with prompt post-match analysis and real-time response before the next game. However, this system suffers from constrained environments, because the cameras are expensive devices and may not capture all subjects in the installed environment due to blind spots, affecting accurate measurement and performance analysis.
Another solution for detecting sports activities is inertial sensing technology, where the sensors are portable and consist of gyroscopes, accelerometers, and magnetometers. Wearable devices with onboard inertial sensors are commonly used in many applications such as rehabilitation, authentication and gait analysis, healthcare, human activities, diseases, navigation, etc. [
6,
7,
8,
9,
10,
11]. Recently, many researchers have developed and analyzed technologically advanced wearable inertial sensing-based sports activities monitoring systems for physical activities such as: running, jumping, cycling, golf, tennis, badminton, table tennis, football, baseball, basketball, and volleyball [
12,
13,
14,
15,
16,
17,
18]. Although wearable sensing technologies are promising solutions for monitoring physical activities and detecting falls, they are not recommended in the pandemic situation because they may become a carrier for spreading the virus, and are uncomfortable for children and elders. Under these circumstances, non-contact sensing technology is a promising solution to control the spread of the virus, such as Wi-Fi, radar, and SDR-based human activities sensing technologies. These technologies are becoming popular in the modern era because they monitor human activities in a non-contact manner [
19]. However, each technology has a trade-off between advantages and limitations, so when we talk about Wi-Fi-based sensing, it is low cost and easily accessible, but has portability and flexibility issues. On the other hand, radar-based sensing is generally used in military contexts, but a trade-off is the cost of equipment. SDR-based sensing provides an improved solution in terms of cost and performance. SDR-based sensing of human activities is cost-effective, portable, and flexible because software modification is possible without changing the hardware [
20,
21,
22]. The main advantage of using SDR technology is that it can be exploited as Wi-Fi and radar technology as well. This initial research exploits the SDR technology-based non-contact smart sensing TTW by using artificial intelligence. The proposed system is a novel solution for monitoring falls during the quarantine period.
Following are the contributions of this research to monitoring physical activities during the quarantine period to prevent lifelong non-communicable diseases.
- ▪
Design of non-contact smart sensing system for monitoring falls by extracting fine-grained WCSI in the presence of walls.
- ▪
Enhancing the monitoring system by using portable, flexible, and multi-functional SDR technology.
- ▪
Intelligent monitoring accomplished by the use of machine learning algorithms. The optimal performance is evaluated by measuring classification accuracy, prediction speed, and training time for each algorithm.
The paper is structured as follows. In
Section 2, related existing work on non-contact smart sensing for monitoring human activities by using Wi-Fi, radar, and SDR-based sensing technologies is provided for deeper insight.
Section 3 provides an overview of the non-contact sensing platform used for development by exploiting the SDR technology.
Section 4 is dedicated to the methodology used for extracting the WCSI data and building the classification model for physical activities. In
Section 5, the accomplished results and their performance are presented. Lastly,
Section 6 summarizes the performance of non-contact smart sensing using SDR technology, and future recommendations are suggested for improving the system.
2. Related Work
There are a lot of existing Wi-Fi technology-based platforms developed for human activities monitoring and detecting vital signs. The wireless sensor network (WSN) uses Wi-Fi technology to detect movements of the human body without a portable device in the operating area. Passive dynamic velocity moving people detection system (PADS) uses device-less detection to extract amplitude and phase information from the WCSI and exploit spatial diversity using MIMO systems; such a system uses commercial Wi-Fi devices to capture human body motions [
23]. Human activity can be identified by the reflected Wi-Fi signals from the human body to create a unique pattern. A system that exploits CSI for detecting and monitoring human activities uses commercial Wi-Fi devices [
24]. TTW human presence sensing systems use the Wi-Fi signals for moving and stationary people with a single Wi-Fi access point (AP). In this research, researchers have carried out the experiments in an empty room, in which a person moves or is stationary, and the channel frequency response (CFR) is analyzed for human activity [
25]. Device-free-based solutions use Wi-Fi devices, which are generally available in homes and offices, to extract fine-grained CSI for analysis of human activities [
26]. An untrained human vitality detection platform has been proposed that relies on basic Wi-Fi infrastructure to detect human movement in real-time. This system does not require any human effort to train offline or to calibrate manually. The platform can continuously monitor human activities for various purposes [
27].
A wireless occupant activity recognition system (Wi-OAR) was developed for building management systems (BMS) to create user-friendly real-time environments for residents. The CSI extraction method based on Wi-Fi signals provides contactless user-centered services in offices to work intelligently. The fast and robust target component separation (FRTCS) algorithm is designed to evaluate both accuracy and time efficiency. This prototype was developed for different office environments with two commercial Wi-Fi devices [
28]. A human activity recognition system used Wi-Fi signals to collect data from ten people doing sixteen different indoor activities. This system reduces costs and improves performance in various areas [
29]. Wi-Motion used CSI data for extracting the phase and magnitude response to build the classification model for six diverse human activities [
30]. A non-wearable and privacy-protective human activity detection platform used Wi-Fi signals for imminent smart buildings by extracting the images of wireless channel response [
31]. The Wi-Fi-based system used deep learning algorithms with enhanced CSI features for human activity recognition [
32].
Nowadays, Wi-Fi access points are very readily available everywhere, and the human presence between the access points provides a unique CSI. Machine learning is used to extract CSI data to classify human movements [
33]. Wi-Fi technology is becoming increasingly popular in mobile sensing devices for monitoring daily human activities [
34]. A non-contact sensing-based Wi-Run system uses commercial Wi-Fi devices to estimate human steps [
35]. The wireless detection uses 5G C-band technology to record falls and body movements of people with high precision [
36]. Passive Wi-Fi sensing monitors health conditions including breathing rate and falls [
37]. A passive Wi-Fi system detects two-dimensional phase information for monitoring human falls [
38]. Breathing and heart rate patterns are important indicators of a person’s physical health. A commercial Wi-Fi-based system was designed to analyze the changes in breathing and heart rate patterns. This system is inexpensive and convenient for continuous monitoring of health conditions [
39]. Wi-Fall is a real-time system used to monitor the sudden falls of persons living alone, especially in old age. This system detects the fall of the human in a non-contact manner using a commodity 802.11n network interface card (NIC). This system achieves high accuracy for the fall detection of a single person [
40]. RT-Fall, a non-contact sensing system, used commodity Wi-Fi devices for fall detection. This system is inexpensive for monitoring daily activities without attaching any device to the human body [
41]. The Res-Beat, a non-contact sensing system, used commodity Wi-Fi devices for monitoring real-time respiration rate. The system analyzed bimodal WCSI data for breathing abnormality information by detecting peaks to evaluate respiration rates [
42]. Wi-Fi technology-based sensing has the advantage of being easily accessible and low cost, but having limitations of portability and flexibility due to the limited number of OFDM subcarriers and fixed standards.
Radar technology is also used to monitor human activities and detect vital signs in the existing literature. A system based on ambient radar has been proposed to detect human activity in an indoor environment. The 7.8 GHz operating frequency detected human activity by sending 16 pulses per second. This system can differentiate between human movements to recognize different activities [
43]. The Bumble-Bee radar-based system can efficiently capture micro-Doppler signatures for human movements for recognition in indoor environments [
44]. A wireless sensing approach used a passive-Doppler radar to detect human body movement’s variations, recognizing abnormal respiration rate and various human physical activities to observe health condition. The wireless signals are used to detect human activity [
45]. The radar technology detects large-scale body motions to improve the home life of older adults. This system classifies falls using radar spectrogram image data [
46]. Radar technology is a promising solution, but has the potential risk of explosion due to released heat and is not used widely due to expensive hardware setup. Furthermore, the technology needs a line-of-sight (LOS) environment, i.e., no obstruction is recommended between radar and human, which limits the system’s physical deployment.
Recently, SDR-based sensing technology has been used to detect human activities and vital signs using wireless signals. A device-free system using smart sensing recognizes different human activities by extracting WCSI in an indoor environment. Human body motions were detected in a real-time setting using SDR equipment [
47]. Blueprints of WCSI present distinctive variations caused by body motions, characterizing small and large-scale motions. SDR-based sensing technology exploits radio wave signals to extract human body motion patterns [
48]. The SDR sensing-based platform used a deep learning algorithm-based convolutional neural networks (CNN) model to detect ankle movements [
49]. The SDR sensing-based, non-contact identification platform classifies weightlifting activities performed by humans [
50]. SDR technology is portable, flexible, scalable, and has multifunction capabilities [
19,
22]. The existing literature can be helpful in developing a COVID-19 platform to monitor human body motion, resulting in the diagnosis of various health issues, and monitoring of human activities in a non-contact manner. A summary of classification performance of monitoring health and vital signs by using non-contact sensing technology Wi-Fi, Radar, and SDR is given in
Table 1. Although Wi-Fi, Radar, and SDR technologies are viable solutions for monitoring physical activities during the quarantine period, there are still limitations. In this research, we exploit SDR technology to overcome the limitations of Wi-Fi and Radar technology. The cost of SDR technology is low because it can be redefined through modification of software without changing or adding a new hardware setup. It is flexible because it can adopt any wireless standard by redefining software. It is portable because of the self-generating abilities of radio signals, and has multiple functional capabilities that can be exploited such as Wi-Fi, Radar, GSM, FM radio, etc.
3. Platform
The platform contains computers, SDR devices, and omni-directional antennas. The computers used for experiments are Lenovo, Intel(R) Core (TM) i5-7500 3.40 GHz processor, 12 GB RAM and Windows 10 64-bit operating system. The SDR devices used for experiments are universal software radio peripheral (USRP) B210, and the software is MATLAB Simulink version R2019a. The main functional blocks for the platform’s development are transmitter PC, transmitter USRP device, wireless channel, receiver USRP device, and receiver PC, as shown in
Figure 1.
3.1. Transmitter PC
In transmitter PC operation, software-defined functionality is utilized to transmit a flexible OFDM frame. Initially, a signal of random bits is generated continuously at uninterrupted sample times and gets one channel per column. Data columns are buffered into frames by stipulating samples per frame. This input data signal used quaternary phase-shift keying (QPSK) digital modulation. Further, vector data was split into smaller subcarriers, and data of identical types concatenated to create contiguous output data. The inverse fast Fourier transform (IFFT) of all subcarriers is computed to transform frequency domain data into the time domain data with orthogonality between the subcarriers. A cyclic prefix (CP) is added to each data frame for avoiding inter-symbol interference (ISI). The adoptive gain is added to improve the strength of the transmitted signal. The software-defined hardware configuration block of USRP is used for flexible parameters modification, which is also the operation of the transmitter PC. The software-defined parameters are given in
Table 2. These adjustable parameters can be redefined at any stage to improve the platform’s performance.
3.2. Transmitter USRP Device
The transmitter USRP device functions are digital up-conversion (DUC), digital to analog conversion (DAC), low-pass filtering (LPF), mixer, and transmit amplification (TA). These functions of the hardware device are fixed and cannot be altered.
3.3. Wireless Channel
The wireless channel is a room environment to collect the human movements of standing, walking, running, bending, and falling activities, as shown in
Figure 2. The WCSI signal is collected through multipath due to the reflection of the human body in-between the two omni-directional antennas.
3.4. Receiver USRP Device
The receiver USRP device functions are low noise amplification (LNA), mixer, LPF, analog to digital converter (ADC), and digital down converter (DDC).
3.5. Receiver PC
In the receiver PC, the USRP hardware flexible receiver configuration block is used to modify and control hardware. The frame synchronization process is used to detect when the frame begins and helps remove the CP correctly. The FFT is applied to transform the time domain data into the frequency domain data. The frame status conversion sets the sampling mode of the output data frame. The amplitude response of the data is extracted to analyze the WCSI data in the frequency domain. WCSI data is in the raw form, which is further preprocessed by cleaning, smoothing, and grouping. Additionally, features are extracted to transform the WCSI data for meaningful analysis. Finally, three machine learning algorithms are applied to classify falls separately from standing, walking, running, and bending.
5. Results and Discussion
The results are taken from the human physical activities experiments. The 64-subcarriers amplitude response of WCSI data is analyzed to detect physical activities. In
Figure 3, the standing activity amplitude response of all the subcarriers in different colors is presented along the
y-axis. The results show that WCSI amplitude response remains stable due to no human body movement in the standing activity over 8000 OFDM frames. In
Figure 4, the walking activity amplitude response of all the subcarriers is presented in different colors along the
y-axis. The results show that WCSI amplitude response varies slowly up and down due to slow human leg movement during the walking activity over 8000 OFDM frames. In
Figure 5, the running activity amplitude response of all the subcarriers is presented in different colors along the
y-axis. The results show that WCSI amplitude response varies rapidly up and down due to human leg movement during the running activity over 8000 OFDM frames. In
Figure 6, the bending activity amplitude response of all the subcarriers is presented in different colors along the
y-axis. The results show that WCSI amplitude response varies from top to bottom due to human upper body movement during the bending activity over 8000 OFDM frames. In
Figure 7, the fall activity amplitude response of all the subcarriers is presented in different colors along the
y-axis. The results show that WCSI amplitude response varies when the human body falls on the floor and then is stable during the fall activity over 8000 OFDM frames.
The confusion matrix presents the performance of the algorithm for each class. The confusion matrix determines the areas where the algorithm has performed well or poorly. The rows show the actual class, and the columns show the predicted class. The diagonal values give optimal results where the actual class and predicted class match. The observations from the actual class and predicted for physical activities are shown in
Table 6. The results were achieved by applying machine learning algorithms on WCSI data collected from the SDR technology-based platform for monitoring falls. The performance of the different algorithms is shown in
Table 7, which includes algorithm accuracy in percentage, observations per second (obs/s) for speed prediction, and time taken for training in seconds. The fine tree algorithm is best for WCSI data to classify physical activities, with an accuracy of 99.7%. Although fine KNN is less accurate, its prediction speed is higher than other algorithms, with more observations in unit time and less time in training the model on WCSI data.
6. Conclusions
In this research, smart sensing using SDR technology is exploited to detect falls during the quarantine period from other physical activities to reduce the chances of non-communicable as well as communicable diseases. USRP hardware is used to collect real-time data TTW of human physical activities that take place between the two antennas. The fine-grained WCSI data is extracted using OFDM technology to develop machine learning models. The machine learning model efficiently classifies fall activity separately from other physical activities. The performance of machine learning algorithms shows promising results, with the fine tree producing a high accuracy result of 99.7%, prediction speed of nearly 72,000 obs/s, and training in almost 9 s. This proof of concept can be further investigated to detect COVID-19 symptoms like shortness of breath, coughing, and cardiac arrest issues by exploring the smart sensing SDR technology platform.
Currently, the whole world is fighting against the novel coronavirus (COVID-19) and limiting their physical activities over time. In the future, smart sensing using SDR technology can cover a larger area by increasing the system gain, sampling rate, and Multiple Input Multiple Output (MIMO) antennas. Multiple subjects’ physical and sports activities can be recognized by extracting the signal reflection of each subject by examining the path of the reflected signals at multiple links. We can further reconstruct the signal profile of each subject as if only a single subject has performed an activity in the environment to facilitate multi-subjects’ activity recognition. The phase response is another solution to recognize multi-user activities in the same environments by measuring phase delays. The wireless channel is robust in nature, and it is hard to predict responses under changing surrounding environments. The time and frequency domain feature extraction of WCSI data can be exploited for better recognition accuracy by deploying state-of-the-art deep and machine learning algorithms.