1. Introduction
In the recent past, several studies have highlighted the importance of multi access physical monitoring systems for observing physical activities of human, which help to infer and analyse the healthcare treatment process of the human body [
1]. Through the formation and application of the highly accurate interconnected health monitoring system, we can predict the health conditions of humans using rapid healthcare services in psychiatric emergency service (PES) [
2]. In the near future, the medical industry will integrate multimedia technology, artificial intelligence, intelligent Internet of Things, and other high-end technologies to promote the enhancement of wearable Internet of Things (IoT) medical devices. Among all the technologies, multimedia technology is considered as one of the most prominent and cost-effective technologies, which provides quality heterogeneous healthcare data to the support healthcare of the patients. In the revolution of multimedia technology [
3,
4], smart patches or chips have just begun, which may be the next skin-like wearables that are capable of monitoring human health conditions using IoT sensors. These patches have an ultra-thin flexible patch array, as shown in the
Figure 1, which can monitor skin temperature and function of heart; moreover, these flexible patches contain thermal liquids and imaging sensors, which help to monitor the temperature variation for human body condition [
5].
This device monitors the psychological signals of the human body and provides early warning to the medical practitioner in case the health is potentially in a dangerous condition. This device consists of Bluetooth silicon on chip (SoC) for dataset transfer, battery power backup holder, and test points for data processing.
The existing patches [
6] in the smart healthcare sector of the multi access physical monitoring system with multimedia technology are operated in a cloud environment to monitor the physical activities. The cloud computing technology (CCT) [
7] helps to transfer the health data, which are collected and processed by IoT devices through internet using various deep learning, machine learning, and convolutional neural networks, which are deployed in the cloud environment. However, there is a massive explosion that has taken place in the present era of the multi access physical monitoring systems, where the major concerns in competent condition during data processing faced by the researchers in the era are listed below:
Streaming of large datasets: Continuous generation of large datasets that are deployed and distributed in cloud platforms results in congestion due to a larger amount of data processing [
8]. Dataset on heterogeneity suffers more residual error [
9].
Improper space time relation on IoT devices in data processing leads to high noise data, which suffers errors, inaccurate data transmission in multi access physical monitoring systems, and network congestion with more cost and more energy [
10].
These features increase the complexity of the wearable IoT devices, and it fluctuates the optimization parameters such as latency, throughput, accuracy, efficiency, mean residual error, delay, and more energy consumption. This unpredictable response of the device between cloud and IoT leads to network congestion with various I/O challenges in delivering reliable healthcare data for multi access physical monitoring system. The response times of the present system with IoT sensors are much less due to interrupted and discontinuous data transmission with long-range data processing intervals [
11]. In addition, the privacy of the healthcare data is completely accessed by the third party, which leads to authentication problems. This leads researchers to pay their attention to designing and developing a novel system with enhanced algorithmic computation. Hence, current multi access physical monitoring systems need highly intelligent delay sensitivity with reliable health monitoring system to provide accurate data during the diagnosis of human health. In this research, a wearable smart-log patch with Internet of Things (IoT) sensors has been designed and developed with multimedia technology to overcome the incompetency, and edge computing on Bayesian deep learning network (EC-BDLN) algorithm has been used to infer and identify various physical data collected from humans in an accurate manner. This system would be a more robust and promising way to solve the problems that are presently faced in the healthcare sector of multi access physical monitoring systems in human physical activities as well as health monitoring.
Contribution
A novel optimized neutral network with densely connected layer for determining the temperature imbalance in health;
Bayesian deep learning network for accurate prediction of improper working of organs, which are integrated in Wearable IoT smart patch for data processing;
Complete physical monitoring system using multimedia technology with edge computing using agile learning for real-time data analysis using IoT sensors;
Streamlined efficient model to identify the various signal patterns of the human physical activities using edge computing on Bayesian neural network.
The remaining sections of the article are organized as follows.
Section 2 surveys various literatures about the significance of multi access physical monitoring system and the importance of multimedia in healthcare data analysis.
Section 3 describes the architecture of smart-log patch with Internet of Things (IoT) sensors along with edge computing on Bayesian deep learning network (EC-BDLN) algorithm for data computation. In
Section 4, experimental validation and its discussion in comparison with existing techniques are analysed.
Section 5 concludes the research with future extension.
3. Edge Computing on Bayesian Deep Learning Network for Physical Education System Using Multimedia Technology
As shown in
Figure 2, edge computing uses a hybridized platform of edge and cloud to solve the storage problem of large amounts of physical datasets. The health-related datasets are processed at edge computing platform, which consists of an IoT sensor physical monitoring device layer, edge layer, and smart log system with smart patch for processing of IoT data with multimedia technology from the human physical system. At the IoT physical monitor in, several bio sensors such as blood, temperature, electro-myo-gram (EMG), electro-cardio-gram (ECG), electro-encephalo-gram (EEG), pressure, visual, respiration, accelerator gyroscope, and sink node have been integrated with the edge platform for accurate diagnosis and prediction of body patterns. Here, edge computing technology brings data more closely to the location where the data are needed using distributed device. This wearable smart log patch with IoT sensor in edge computing environment helps to produce accurate data about the physical activities of the human physical system, which would be more useful in multi access physical monitoring systems for health monitoring of children and adults. In the past, there have been two different ways to analyse the monitored data:
In both the categories, early warning about the improper function of organs is more complex and it takes more time for report generation. This has been overcome through the edge platform because it runs distributed networks using a smart router, storage unit, and high-power capacities, which are more suitable for multi access physical monitoring systems for physical monitoring of the human body. In this proposed architecture, a wearable smart patch with IoT sensors transmits the datasets to the edge platform using the local area network such as Wi-Fi and Bluetooth. In this approach, a Bayesian deep learning network algorithm, which has been used in distributed device of the edge computing environment that helps to infer and identify various physical data collected from the humans in an accurate manner to monitor their physical activities as shown in
Figure 3. The initial process of this network is to analyse and extract the features or patterns of the health datasets. The normalized dataset has been processed to minimize the data reliability and redundancy. Here, the system consists of an input layer, multilayer or hidden layer, and output layer. These layers are integrated with the Bayesian network where the matrix consists of various IoT datasets as shown in
Table 1, which are represented as signals and these signals are converted as numerical in the matrix; each layer is connected between the same and cross layers, which are represented as a regression model. This resembles the flow of the human brain with a limited subset. Here, the normalization operation has been mathematically derived using “Mean (µ) and Standard Deviation (
σ)”.
Case: 1-Mean µ = ”0”and Standard Deviation (σ) = ”1”
Solution:
Inside the smart log patch of the wearable device, the input of the network is represented as
where
. The IoT sensor datasets with the maximum range “N” are processed in the input layer and transmitted to filter layer to reduce the noise by analysing number of input vectors. In the datasets, there are a number of depolarized and repolarized patterns, which are processed using mean and standard deviation values as shown in the Equation (1),
From Equation (1),
is the normalized set of input vectors used in the deep learning network and
is considered as various range starts from zero to “N”. This condition helps to extract the physiological signals, for instance typical electro cardiogram (ECG) tracing, as shown in
Figure 4, consists of atrial depolarization wave as denoted as “P” and ventricular depolarization as denoted as “QRS” with ventricular repolarization “T”. In this wave, “U” is generally ignored because it is not typically seen, which represents the papillary muscles patterns. These four entities are analysed from input to output layer and it has been processed using Bayesian network for accuracy.
From the analysis, the means and standard deviations are represented in terms of zero and high logic in Equations (2) and (3),
Equations (2) and (3) help to analyse the data description and normalized range of all the health datasets from input layer to output layer. Then, the IoT datasets are processed on the edge platform inside the smart log interface, as discussed in the Case-2.
Case: 2-IoT data acquisition sensor for smart log system routing mode on edge platform
Solution:
IoT data acquisition sensor architecture consists of a multiplexer, a buffer, and a static random access memory (SRAM) configuration cell, as shown in
Figure 5.
As shown in
Figure 1, IoT programmable routing sensor architecture consists of n-metal oxide semiconductor (n-MOS) (MN1 and MN2) and p-metal oxide semiconductor (p-MOS) (MP1, MP2, MP3, MP4, and MP5) sleep transistors in parallel. Here, the data selector, so-called multiplexer, has been used to regulate the output data, and data acquisition sensors are used as data-loggers, which maintain the database of the system. In this hardware structure, Both P-MOS and N-MOS operates on three mode of operation such as Dynamic, Sleep and Snooze mode as listed in the
Table 1. Here, the IoT data have been analysed using statistical and information gain ratio
using the health datasets. The information gain is shown in the Equation (4)
where
is the number of instance “NI” with the range of i vary from 1 to
Further, the data integrity of the IoT sensor in the hidden layer are measured using entropy values based on various iteration processes, with filter layer helping to reduce the noise and mean residual error. The prediction reliability of the sensor data has been evaluated using information gain ratio, and further improvement in the information ratio can be mathematically evaluated using gain ratio (GR), which is the ratio of
and its log factor
as shown in Equation (5),
where
is the fraction of datasets that are processed in the hidden layer or filtered layer, and I ranges from
.
Here, degree of system routing mode-I operational logics are formulated with the help of AND (&) operator and the degrees are shown in Equations (6) and (7),
where ∀ is the min operation in the logic. Various modes of operation are listed in the
Table 2.
The data retention nature of the switch in the IoT architecture is applied over and done with the tri-modal switch, which has the capacity to preserve information in the snooze mode. The tri-modal switch is intended based on distinct low power IoT design methodologies such as data-retentive power gating, multi-snooze mode structure, and on-chip dynamic voltage scaling as shown in Algorithm 1.
Algorithm 1.Deep learning-assisted IoT System Routing Mode-I Operation for data processing |
Initialize inputs MPX, MNX; |
\ * the MPX, MNX indicated the number of PMOS and NMOS used in the design*\ |
Output S, D, SL; |
\* The S (Snooze), D (Dynamic), SL (Sleep) mode of operation used*\ |
Begin |
Set1: If (S=Logic ‘0’) |
MP1|MP3|MP5 =Logic ‘1’; |
Else |
MN1|MP4 =Logic ‘1’; |
Set2: If (S|SL=Logic ‘0’) |
MN1|MP1|MP3 =Logic ‘1’; |
Else |
MP1|MP3|MP5 =Logic ‘1’; |
Else |
MN2|MP4 =Logic ‘1’; |
Set3: If (S|SL=Logic ‘0’) |
MP2|MP3|MN3 =Logic ‘1’; |
Else if(S= Logic ‘1’ &&SL=Logic ‘0’) |
MP2|MP3|MP5 =Logic ‘1’; |
Else |
Switch (Set-1); |
\* Snooze mode due low swing which occurs at Vdd*\ |
End |
As depicted in Algorithm 1 above, the three distinct modes of operation for IoT datasets are shown in
Table 2. When sleep mode=Logic ‘1′, irrespective of snooze state, the circuit would be in active state. When snooze mode=Logic ‘0′, it makes the transistor MP1, MP3, MP5 = ON, over which the circuit will attain power through MP4.
Condition: 1-
Data Logic Function: 1-When Snooze mode=Logic ‘1’, it creates the transistor MN1, MP4 =ON, through which the circuit will attain power through Mp4.
Condition: 2-
Data Logic Function: 2-When Snooze = Logic ‘0’ and Sleep = Logic ‘0’, it creates the transistor MN2, MP1, MP3 = ON; through this mode, the transistors are activated, which put the circuit in sleep state due to the activation of transistor MN2 = ON, which in turn, stop the passage supply voltage.
Condition: 3-
Data Logic Function: 3-When drowsy = Logic ‘1′ and sleep = Logic ‘0′MP3, MP2, MN2 = ON because of this method, it creates the circuit worked at drowsy mode due to low swing, which ensues at Vdd1.These modes of operation aid in the decrease in the energy consumption of the storage unit with less delay in the wearable architecture of the smart log patch. The energy consumption has been significantly reduced by reducing the unwanted switching activity of the transistor using drowsy, sleep, and snooze state transitions.
Further, the network training has been done using a Bayesian deep learning algorithm on an edge computing platform processing health datasets to improve accuracy and efficiency as discussed in case 3.
Case: 3- Training the network using Bayesian deep learning algorithm with prediction metrics
Solution:
Here, the agile learning has been introduced because it provides the trade-off between the data, which have been processed from the input to output layer in terms of complexity or congestion and accuracy. This is because, in general, deep learning models are more complex on edge devices in real-time diagnosis of health data of the multi access physical monitoring system with multimedia technology. Here, the data have been normalized to avoid data distribution and congestion as represented in Equations (8) and (9),
where
is the difference between dimensions of
kth input with respect to the average number of input datasets.
is the ration of
kth dimension datasets with standard deviation. This is mainly described to reduce the layer of unwanted noise due to external frequency on the smart log system. The computation complexity of the smart log patch has been reduced using agile learning liner activation function, which is considered as one of the significant components in the Bayesian network, as shown in Equations (10) and (11).
Substitute (11) and (12) in (10) and we will get a noise-free expression model (
), which minimizes the problem in data complexity using a certain degree of fast convergence, which provides the optimum trade-off between accuracy and complexity as well as reducing the delay, as shown in Equation (13)
where
is the noise factor, which is the product of
, and where
are the input vectors of the linear activation function of agile learning. In this activation function, Gaussian factor has been introduced from input layer to output layer to improve the accuracy of the prediction and helps to reduce the energy consumption by maintaining unwanted switching activities in the network during data processing of the smart log patch. The Gaussian restricted activation function is represented as Equations (14) and (15),
where
is the Gaussian restricted activation function;
—visible neurons;
—hidden neurons;
—standard deviation of the Gaussian restricted activation function;
—weight of the neuron.
In agile learning of Bayesian networks, the complexity of the data with time factor as mentioned in n/m seconds is computed using a Bayesian deep learning prediction algorithm. Here, “y” is the input dataset with the total data length “N” and the time is measured as “T” to predict the input data “y”; the complexity can be reduced if we set the time limit “” and the computation flow has been shown in the Algorithm 2.
Algorithm 2. Agile learning of Bayesian networks for congestion check in wearable system |
Initial: Time T= () |
Ensure: No congestion on Prediction data for |
While (Logic “1”) for prediction check |
If (j<n) then |
M (O) =S (D); |
//*M (O) = is the memory output layer//* |
//*S (D) = Input datasets which are stored//* |
S (D) = |
Return (No_Congestion) |
If () |
M (O) = D(C) |
//*D(C) = Data Congestion//* |
Return (Congestion) |
Break |
M (O) = Return (prediction check) |
End if |
End if |
End While |
End begin |
From Algorithm 2, after the completion of the prediction phase, the final training stage has been formulated for fine tuning the datasets at the output layer. Here, activation function of the neurons are represented in Equation (16),
where,
;
;
;
.
This output factor has been designed to represent the accurate class activities of the neurons with the help of visible nodes in the network on edge platform of the smart log patch.
From the all the cases, it is clear that a smart log patch with a Bayesian deep learning network on an edge computing platform shows promising outcome in terms of accuracy, efficiency, mean residual error, delay, and energy consumption.
Then, the efficiency of this wearable IoT smart log system with multimedia technology is evaluated using experimental results and discussions as follows.
4. Experimental Analysis
In this research, various health datasets have been compared by placing a wearable smart log patch, which analyses various activities of the complete body nerves and helps to monitor blood, temperature, electro-myo-gram (EMG), electro-cardio-gram (ECG), electro-encephalo-gram (EEG), pressure, visual, respiration, and accelerator gyroscope of the human physical system through palm and heel because a completed nerve system has been integrated in the palm and leg as listed in
Table 3 and the hardware specification of the smart log patch has been given in
Table 3.
The hardware details of the wearable IoT smart log patch has been tabulated in
Table 4. The datasets are collected from the IoT sensor on the edge platform and it has been analysed to check the performance parameters, which are listed below.
The accurate classification has been done with the help of the activation function. α^k y^k &
are the input vectors of the linear activation function of agile learning. In this activation function, Gaussian factor has been introduced from input layer to output layer to improve the accuracy of the prediction and it helps to reduce the energy consumption by maintaining unwanted switching activities in the network during data processing of the smart log patch. The comparison of EC-BDLN with CCT, RNA, CNA, DIA, and CPM shows prominent results in the smart log patch in the output layer, as shown in
Figure 6. The accuracy has been calculated based on the true positive and negative values in correlation with false positive and negative values of the sensor datasets, which is represented as Equation (18).
In the IoT sensor, the error has been estimated as the difference between observed and unobserved quantity of health datasets. Here, mean residual error is the estimation of observed health dataset (
) or processed datasets with the total number of estimated inputs (
). In this research, these layers are integrated with a Bayesian network where the matrix consists of various IoT datasets, which are represented as numerical in the matrix and each layer is connected between the same and cross layer, which are represented as a regression model. Here, the normalization operation has been mathematically derived using “ Mean (µ) and Standard Deviation (
)”; to reduce the error rate through filtered output, the hidden layer has been processed using gain ratio(GR) as shown in Equation (5), the graphical representation is shown in
Figure 7, and the mathematical formulation of RMSE is shown in Equation (19),
As shown in Equation (20), the mean residual square error (RMSE) is the collective squared error among the input and output image, whereas peak signal-to-noise ratio (PSNR) indicates a degree of the peak error. The lower the value of RMSE, the lower the error. These, in turn, increase the efficiency of the system. Because the data retention of the switch in the IoT architecture is applied over the tri-modal switch, which has lowers RMSE, the graphical comparison of efficiency of the proposed system is shown in
Figure 8.
The number of health dataset inputs and its corresponding rate of transmission as estimated as delay in the IoT data transmission delay have been reduced due to the following conditions, which are listed as:
Delay factor
C1- Snooze mode = Logic ‘1′ it makes the transistor MN1, MP4 = ON;
C2-Snooze = Logic ‘0′ and Sleep = Logic ‘0′ it makes the transistor MN2, MP1, MP3 = ON;
C3- drowsy = Logic ‘1′ and sleep = Logic ‘0′MP3, MP2, MN2 = ON.
The comparison of EC-BDLN with CCT, RNA, CNA, DIA, and CPM shows prominent results in the smart log patch in the output layer as shown in
Figure 9.
In this graph, as shown in
Figure 10, the proposed EC-BDLN algorithm reduces data faults and also has high throughput while sending the information from input to output layer. Even though the network effectively detects data faults, it successfully transmits the data from source to destination by consuming minimum energy, where the Gaussian factor has been introduced to improve the accuracy of prediction by maintaining unwanted switching activities in the network during data processing of the smart log patch. The Gaussian restricted activation function is represented as Equations (14) and (15) and the energy table is shown in
Table 5.
From the results and discussions, it shows that the EC-BDLN algorithm is one of the state-of-the-art evolutionary algorithms in health monitoring of multi access physical monitoring system with multimedia technology. In this research, a wearable smart-log patch with Internet of Things (IoT) sensors has been designed and developed with multimedia technology to analyse the various activities of complete body such as blood, temperature, electro-myo-gram (EMG), electro-cardio-gram (ECG), electro-encephalo-gram (EEG), pressure, visual, respiration, and accelerator gyroscope of the human physical system, and the optimization parameters such as accuracy, efficiency, mean residual error, delay, and energy consumption have been experimentally validated using the EC-BDLN algorithm in the distributed devices on an edge computing environment, which shows to be more promising than traditional approaches.