Next Article in Journal
A Wide-Range Four-Phase All-Digital DLL with De-Skew Circuit
Next Article in Special Issue
Pruning- and Quantization-Based Compression Algorithm for Number of Mixed Signals Identification Network
Previous Article in Journal
Bidirectional CLLLC Resonant Converter Based on Frequency-Conversion and Phase-Shift Hybrid Control
Previous Article in Special Issue
An Image Object Detection Model Based on Mixed Attention Mechanism Optimized YOLOv5
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

ECG Signal Denoising Method Based on Disentangled Autoencoder

1
School of Mathematics and Statistics, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250353, China
2
Shandong Artificial Intelligence Institute, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250014, China
*
Author to whom correspondence should be addressed.
Electronics 2023, 12(7), 1606; https://doi.org/10.3390/electronics12071606
Submission received: 22 February 2023 / Revised: 23 March 2023 / Accepted: 27 March 2023 / Published: 29 March 2023
(This article belongs to the Special Issue Advanced Technologies of Artificial Intelligence in Signal Processing)

Abstract

:
The electrocardiogram (ECG) is widely used in medicine because it can provide basic information about different types of heart disease. However, ECG data are usually disturbed by various types of noise, which can lead to errors in diagnosis by doctors. To address this problem, this study proposes a method for denoising ECG based on disentangled autoencoders. A disentangled autoencoder is an improved autoencoder suitable for denoising ECG data. In our proposed method, we use a disentangled autoencoder model based on a fully convolutional neural network to effectively separate the clean ECG data from the noise. Unlike conventional autoencoders, we disentangle the features of the coding hidden layer to separate the signal-coding features from the noise-coding features. We performed simulation experiments on the MIT-BIH Arrhythmia Database and found that the algorithm had better noise reduction results when dealing with four different types of noise. In particular, using our method, the average improved signal-to-noise ratios for the three noises in the MIT-BIH Noise Stress Test Database were 27.45 db for baseline wander, 25.72 db for muscle artefacts, and 29.91 db for electrode motion artefacts. Compared to a denoising autoencoder based on a fully convolutional neural network (FCN), the signal-to-noise ratio was improved by an average of 12.57%. We can conclude that the model has scientific validity. At the same time, our noise reduction method can effectively remove noise while preserving the important information conveyed by the original signal.

1. Introduction

At present, cardiovascular disease is one of the major threats to human life and health, and the number of deaths due to cardiovascular disease is increasing every year [1]. The electrocardiogram (ECG) is an important tool for cardiology research, and it is also a powerful basis for doctors to directly analyze the cardiac status of patients. Compared with other methods, ECG is often highly efficient and non-invasive and has low costs [2]. As a bioelectric signal source, the signal intensity of the heart must be directly related to the number of active cells, and the number of heart cells constituting the atrium and ventricle is the largest. Therefore, a surface ECG waveform mainly reflects changes in the action potentials of the atrial and ventricular cells [3]. Figure 1 shows a complete ECG cycle in which the P wave, QRS bundle, and T wave are the most important characteristic waves. These waves and the PR interval, QT interval, and ST segment formed on their basis are the most important characteristic information of the ECG [4] and can reflect the conduction system of the heart and whether the heart itself has lesions from many aspects. Therefore, in the process of collecting ECG data, it is particularly important to ensure that the ECG is not disturbed by noise.
The ECG has the characteristics of low frequency and energy concentration, and the signal is weak, easily disturbed by noise, and also has quasi-periodicity [5]. ECG sampling is often accompanied by a lot of noise, mainly muscle artefacts (MA) [6], electrode motion artefacts (EM) [7], and baseline wander (BW) [8]. Muscle artefacts are a common type of high-frequency noise, usually between 30 and 300 Hz. The source of this noise comes from the tremor of the body’s muscles and therefore appears on the image as a discrepancy between the muscle image and the actual situation. In order to reduce the impact of this noise on the image quality, medical imaging professionals must use appropriate techniques to reduce its effects. Electrode motion artefacts are instantaneous noise caused by poor contact between the skin and the electrodes. Baseline wander is low-frequency noise, mainly caused by breathing, and electrode slippage is caused by low-frequency interference. These noises have a major impact on a clinician’s ability to diagnose the nature of a disease, which is likely to lead to a false diagnosis. Therefore, it is particularly important to denoise sampled ECG data. The purpose of this paper is to effectively reduce the noise in ECG data in order to improve the signal-to-noise ratio of the signal, accurately detect ECG data, improve the visualization and analysis of ECG data, and effectively improve the accuracy of diagnosis. We have been involved in researching a noise reduction method that separates the depth characteristics of ECG data from noisy signals, with the aim of reducing unnecessary noise, improving the accuracy of ECG data, better detecting heart disease, and improving healthcare.

2. Related Work

2.1. The Traditional ECG Denoising Method

The ECG acquisition process is often accompanied by a large amount of noise, which seriously affects a doctor’s accurate diagnosis of a patient. Therefore, technical research on removing noise from ECG data has always been a hot topic. Many researchers have proposed different research algorithms. In 2015, the authors of [9] proposed the use of multivariate empirical mode decomposition (MEMD) to remove baseline wander in ECG data. MEMD technology was a multivariate extension of EMD, which had recently attracted the attention of researchers for many applications [10]. The basic idea of this method was to transform a signal into a multi-channel signal and use the MEMD algorithm to process the multi-channel signal at the same time. The last intrinsic mode function (IMF) or the last two IMFs obtained by decomposition were removed from the ECG as the baseline wander to obtain a baseline-corrected ECG. Simulation results showed that this method can remove the baseline wander in ECG data and retain the morphological characteristics of ECG data. Empirical mode decomposition technology was a data-driven adaptive threshold method that was very suitable for non-stationary signals such as ECG data [11]. However, it could not select IMF efficiently and adaptively, which led to the loss of information. The authors of [12] proposed a noise removal method based on empirical mode decomposition combined with a wavelet threshold for adaptive ECG baseline wander. ECG data containing BW noise were denoised. First, they were decomposed into high-frequency signals and low-frequency signals using empirical mode decomposition. Then, the low-frequency signals were wavelet-transformed, and the high-frequency signals were combined to reconstruct the ECG data, thereby achieving the effect of removing baseline wander noise. The technology based on the wavelet transform was also more popular and widely used because of its ability to characterize the time–frequency domain information of time-domain signals [13]. The noise reduction method based on wavelets was widely used because it had good localization properties and could fully highlight the detailed features of ECG data in the time domain and frequency domain. However, due to the selection of the wavelet basis function and threshold, the amplitudes of the R wave and S wave may have been reduced after denoising [14]. Therefore, how to select the appropriate wavelet basis function and wavelet decomposition level to remove the noise in the input signal was still a problem [15]. In the wavelet denoising method, two thresholds [16] were used to enhance the ECG data. Tan Xue et al. [17] proposed an improved wavelet-threshold-function denoising method that avoided the defect of poor continuity at the threshold after processing the signal in the traditional soft and hard threshold function. Das et al. [18] compared the wavelet transform and proposed an ECG denoising method based on the S-transform. Because of the sparse characteristics of the ECG itself [19], a method based on sparse representation had been studied a lot in recent years. However, some ladder components were introduced after sparse noise reduction [20], which made the signal uneven after noise reduction, and most sparse representations use the L1 norm as a penalty term, which leads to the underestimation of the original signal [21].
In the field of deep learning, an ECG denoising method based on the autoencoder model [22] was more popular. An autoencoder composed of eight convolution blocks and eight deconvolution blocks was proposed by Eleni et al. [23], which can effectively learn the characteristics of ECGs and remove noise. As one of the many breakthroughs in deep learning technology, a generative adversarial network (GAN) had been widely used. Since Goodfellow [24] first introduced this method, many variants of generative adversarial networks have been developed. Radford et al. [25] proposed a deep convolutional generative adversarial network (DCGAN) in 2015. The DCGAN used a convolutional layer to replace the fully connected layer and replaced the original pooling layer with a convolution of the same step size. Pratik Singh and Gayahar Pradhan [26] proposed a generative adversarial network architecture for ECG denoising. The GAN model based on convolutional neural networks was effectively trained for ECG noise filtering, and end-to-end GAN model training was performed using clean and noisy ECG data. Zhu et al. [27] proposed a generative adversarial network, which was a Bi-LSTM-CNN network composed of bidirectional long short-term memory (LSTM) and a convolutional neural network (CNN). The model included a generator and a discriminator. The generator used a two-layer Bi-LSTM network, and the discriminator was based on a convolutional neural network.

2.2. Disentangled Representation Learning

Disentangled representation learning [28] was first proposed by Bengio in 2013. The feature sets being trained may be used for multiple tasks, which may have different relevant feature subsets. Therefore, the most robust method of feature learning was to separate as many factors as possible and discard as little information as possible. The application of disentangled representation learning makes the black box project of deep learning more interpretable and can show the specific meaning and function of each layer of the neural network. The traditional denoising autoencoder maps the signal information and noise information to the hidden space together in the encoding phase and then decodes them into signals through the hidden space variable. We believe that there is a phenomenon of decoding confusion; that is, some noise information is decoded into signal information together, thus reducing the noise reduction effect of the signal. Therefore, we are trying to decouple the noise information and signal information in the hidden space, eliminate the entanglement of signal information and noise information, and then decode the clean signal.

2.3. The Major Contributions of the Paper

Although the ECG denoising method based on a denoising autoencoder is robust to different types of noise, it is still a problem that the signal features and noise features are not completely separated, resulting in the underestimation of some ECG details. Based on this, our contributions are as follows:
(1)
Based on the denoising autoencoder, we introduce the disentangled mechanism and propose a new disentangled autoencoder network (DANet) for ECG denoising processing, which solves the problem of the incomplete separation of signal features and noise features.
(2)
In the realization of the disentangled mechanism, we use attention to shunt latent variables, deconstruct the potential spatial separation between noise and the original ECG data, and finally use two decoders to approximate the original signal and noise.
(3)
Experiments demonstrated that our proposed method achieved optimal performance and can effectively preserve useful detail characteristics.
The overall structure of this paper is as follows: Section 2 provides the related work. Section 3 focuses on the details of the database we used and how the data were processed. Section 4 details the implementation of the algorithm, the coding of ECG features, the separation of signal and noise characteristics, and the signal recovery process. Section 5 presents experiments comparing the denoising effects on ECG data and four different types of noise. Section 6 and Section 7 provide a general discussion and a summary of our proposed method.

3. The Materials

3.1. Dataset Description

We used the MIT-BIH Noise Stress Test Database and the Arrhythmia Database as the main dataset [29]. The MIT-BIH Arrhythmia Database contains 48 half-hour dual-channel dynamic electrocardiogram recording excerpts from 47 subjects studied by the BIH arrhythmia laboratory between 1975 and 1979. Each record was sampled at a sampling rate of 360 Hz, with a total of 650,000 signal samples. We sliced each recorded ECG by 1024 signal samples, and 630 slices are selected for each record, so a total of 30,240 slices were used as clean ECG datasets. In the MIT-BIH Noise Stress Test Database, baseline wander noise, electrode motion artifact noise, and muscle artifact noise were obtained, which also totaled 650,000 signal samples. We also sliced each noise signal by 1024 signal samples and selected 630 slices as the noise dataset. We normalized the clean ECG dataset and noise dataset according to the following formula to ensure that the signal value of each ECG segment was between 0 and 1:
N o r m a l i z e d x i = x i x m i n x m a x x m i n   ,
where x i is the value of the signal in a sliced signal, x m a x is the largest value of the signal in this slice signal, and x m i n is the smallest value of the signal in this slice signal. We then used Equation (2) to add different types of noise with signal-to-noise ratios of −5 dB, −2.5 dB, 0 dB, 2.5 dB, and 5 dB to the clean ECG. These noises included Gaussian white noise, baseline wander noise, electrode motion artifact noise, and muscle artifact noise. We used the following expressions to add the noise:
Y = X + N , N i = η i x i 2 ( η i 2 ) 10 s n r 10   ,
where x i is a clean ECG, η i is a noise signal, s n r is the signal-to-noise ratio, and Y is the ECG with noise. N i represents the noise calculated after adding a certain signal-to-noise intensity. We divided the ECG dataset into the training set, validation set, and test set in the proportion of 8:1:1. Therefore, 630 data slices of each ECG record were randomly partitioned into 504, 63, and 63 data slices according to the ratio, and a total of 24,192 data slices were used as the training set for ECG noise reduction, 3024 data slices were used as the validation set for ECG noise reduction, and 3024 data slices were used as the test set for ECG noise reduction.

3.2. Verifying Indicators

In our study, we used the signal-to-noise ratio (SNR), root-mean-square error (RMSE), and percentage root-mean-square error (PRD) as important indicators to measure the noise reduction effect of the ECG data. The higher the signal-to-noise ratio, the better the noise reduction effect, and the smaller the values of PRD and RMSE, the better the noise reduction effect. These three metrics can be calculated using the following three expressions:
R M S E = x i x ^ i 2 ,
P R D = 100 x i x ^ i 2 x i 2 ,
S N R = 10 log 10 x i 2 x ^ i x i 2 ,
where x i is the original ECG data and x ^ i is the ECG data after noise reduction.

4. The Method

ECG denoising is a basic and lasting task in ECG processing. The main challenge is to recover the clean signal ( X ) and additive noise ( N ) from the mixed signal ( Y ), namely:
Y = X + N ,
where Y represents the noisy ECG data, X represents the clean ECG data, and N represents the noise. This problem is ill-posed because the ECG term X and the noise term N are unknown and difficult to separate. Therefore, we propose a noise reduction method for separating ECG data and noise. First, we review denoising autoencoders [30] and disentangled representation learning.

4.1. Review of Denoising Autoencoders

Autoencoders are very popular deep learning models in the field of signal processing and image restoration. The goal of an autoencoder is to make the output data as close as possible to the input data so as to achieve the ability of data recovery. Vincent et al. proposed a denoising autoencoder based on an autoencoder, adding noise to the original input data to improve the robustness of the model. The denoising autoencoder can be divided into two stages:
(1)
Coding stage:
E n Y : H = φ W y + b ,
(2)
Decoding stage:
D e H : X ^ = ψ W ^ h + b ^ ,
where E n     ·   and D e     ·   represent the encoder and decoder, respectively, which are composed of a series of convolution layers and activation function layers. Y represents the sum of input data ( X ) and noise ( N ), H represents the feature of the hidden layer, X is the output data, W and b are the weights and biases of the encoder, and W ^ and b ^   are the weights and biases of the decoder. Figure 2 shows the structure of the denoising autoencoder. The objective function of the denoising autoencoder is:

4.2. Disentangled Operator

Disentangled representation learning is a new concept in machine learning [31]. In signal vector space, H represents the coupling feature of the signal and noise, H R C × L . H can be characterized as k basis vectors h 1 , h 2 , , h k . Each basis vector represents a more subtle feature of the signal and noise, and each subtle feature is coupled into H :
H = h 1 h 2 h k .
Through a transformation, the coupling information of H is disentangled. We define the disentangled operator:
f : H Z .
Because the characteristic basis vectors   h 1 , h 2 , h k   are entangled with each other, H is decomposed into each decomposition factor using a disentangled transformation. They are independent of each other, which can be expressed as:
Z = z 1 z 2 z j .
This is similar to the subspace direct sum of the solution space, but the difference is to solve each direct sum subspace of the transformed feature space. In the ECG denoising processing, we disentangle the noise-containing signal features using neural networks and separate them into signal features and noise features. This is to separate the feature space ( H ) of the hidden layer into two incompatible spaces ( U and S ). U represents the coded feature space of noise, while S represents the clean ECG space.

4.3. Proposed Method

Using the idea of disentangled representation learning, we improve the denoising autoencoder model and propose a new autoencoder: a disentangled autoencoder. As shown in Figure 3, unlike the denoising autoencoder, the features of the encoded hidden layer are decoupled to separate the signal-coding features and the noise-coding features. The loss function of the disentangled autoencoder can be expressed as:
L = L 1 + L 2 = X X ^ 1 + N N ^ 1 .
We propose a new network structure called DANet for ECG denoising. As shown in Figure 4, the disentangled autoencoder network structure consists of three parts: an encoder, a disentangled module, and two decoders. In the encoder part, five different coding modules are used to encode the noisy input signal. In order to obtain the detailed features of the input signal, each coding module contains two convolution layers with the same convolution kernel size, a maximum pooling layer, and an empty attention module. The convolution sizes of the convolution layers of the five coding modules are 1 × 15, 1 × 9, 1 × 7, 1 × 5, and 1 × 3, respectively. Each pooling layer uses a convolution kernel of 1 × 2 and a stride size of 2 to compress the signal features. The dilated attention module (DSE block) first uses a 1 × 1 convolution on the input features, uses a convolution with dilated rates of 2 and 4, performs feature stacking, and finally uses a residual connection to prevent overfitting of the network model.
In the disentangled module part, this is to separate the feature map of the decoder output, the signal features, and the noise features. The noisy ECG Y ,   with a sampling size of 1024 × 1, is used as the input and the output after the encoder obtains a feature map   H with a channel of 512 and a size of 32 × 1. The feature maps ( S and U ) are obtained using convolution layers with convolution kernels of 1 × 3 and 1 × 5. Then, the two feature maps are superimposed to obtain the fused feature map ( H ) ˜ , which can be expressed as:
H ˜ = S + U .
Then, the feature map ( H ) ˜ is input into the average pooling layer to obtain a feature map with a channel number of 1024 and a size of 1 × 1. Then, the attention coefficients ( α and   β ) are obtained from the two fully connected layers and multiplied by the original feature maps ( S   and U )   to obtain a signal feature map S ˜ and a noise feature map U ˜ with sizes of 32 × 1 × 1024. The formulas can be expressed as:
S ˜ = S × α ,
U ˜ = U × β .
In the decoder part, two decoder network structures with the same structure are used to decode the signal feature map S ˜ and the noise feature map U ˜ , respectively, to obtain the denoised ECG X   and the approximated noise N . The network structure of the decoder is similar to that of the encoder. The difference is that the maximum pooling layer in the encoder is replaced by a deconvolution layer with a convolution kernel of 1 × 2 and a stride size of 2. In addition, a convolution layer and a sigmoid activation function layer are used in the final output layer.

4.4. Model Optimization

In our experiment, we used a GPU (NVIDIA RTX3090) with 40 G of memory. We used the python programming language and selected PyTorch as the deep learning framework for model training and testing. After repeated experiments, the batch sizes were set to 256, 128, 64, 32, and 16 at the beginning, and the learning rates of the network model training optimizer were set to 0.1, 0.05, 0.01, 0.005, 0.001, 0.0005, and 0.0001. As shown in Figure 5, the original ECG was added with Gaussian white noise with a signal-to-noise ratio of 0 dB, and the network model was trained with different batch sizes and learning rates. The experimental results show that the learning rate of our proposed network model training was 0.001 The experimental effect was the best when the batch size was set to 32. The signal-to-noise ratio of the ECG was the highest.
In our experiment, we used four different optimization algorithms to compare which optimization algorithm had a better network training effect. These four optimization algorithms were stochastic gradient descent (SGD) [32], adaptive moment estimation (Adam) [33], root-mean-square prop (RMSProp) [34], and adaptive subgradient (AdaGrad) [35]. We added 0 dB baseline wander noise to the clean ECG and then trained the proposed model with a batch size of 32 and a learning rate of 0.001 using these four different optimization algorithms. This experiment aimed to compare the performance differences of the four different optimizers under the same training settings. We used training parameters with a batch size of 32 and a learning rate of 0.001. We tested the test set to obtain the noise reduction effect of each optimizer, including the means and standard deviations of the SNR, PRD, and RMSE. The relevant data are shown in Table 1. The experimental results show that the network model training effect was better when based on Adam’s optimization algorithm. The SNR reached 27.33 dB, the PRD was 4.81, and the RMSE was 0.0181. Adam’s signal-to-noise ratio was about 44% higher than the SGD. As shown in Figure 6 below, our proposed network model underwent 100 iterations of training, experimental training loss, and verification loss. From the experimental results, it can be seen that the training loss and verification loss were very close, so the network model was not fitted, thus verifying the reliability of the DANet network model.

5. The Experiment

5.1. Denoising Performance of the Proposed Model

To verify the robustness of our proposed network model to different types of ECG noises, we randomly selected different numbers of signals from the MIT-BIH Arrhythmia Database and then added four different forms of ECG noises to these signals, specifically Gaussian white noise, baseline wander noise, electrode motion artifact noise, and muscle artifact noise. Gaussian white noise was simulated by generating random noise, while baseline wander noise, electrode motion artifact noise, and muscle artifact noise were simulated by the three corresponding types of noise in the MIT-BIH Noise Stress Test Database. Figure 7 shows the noise reduction effect of the 220th recorded ECG in the MIT-BIH Arrhythmia Database after adding baseline wander noises at an input SNR of 5 dB. We can see that the original ECG had baseline wander after adding the baseline wander noise, which was not conducive to a doctor’s diagnosis. In the denoising process, our proposed method effectively restored the baseline characteristics of the original signal. Figure 8 shows the noise reduction effect of the 123rd ECG recorded in the MIT-BIH Arrhythmia Database after adding electrode motion noise at an input SNR of 0 db. It can be seen in Figure 8 that the original ECG was severely damaged after adding the noise. The P wave and T wave disappeared completely. The QRS wave still existed, but some deformation also occurred. In the denoising process, the signal details of the P wave and T wave were reproduced, and the QRS band was completely restored.
Figure 9 shows the noise reduction effect diagram of the 117th recorded ECG in the MIT-BIH Arrhythmia Database after adding muscle artifact noise at an input SNR of 2.5 db. After adding muscle artifact noise to the original ECG, the original ECG retained the signal characteristics of the R wave. In addition, other bands were damaged by different degrees of waves. Most of the signal waves were changed into wave shapes, and the original P wave, T wave, Q wave, and other characteristic band information were lost. In the process of denoising, not only was all the characteristic wave information restored, but the ECG was also smoother. Figure 10 shows the noise reduction effect diagram of the ECG recorded in the MIT-BIH Arrhythmia Database after adding Gaussian white noise at an input SNR of 5 db to the ECG recorded in the MIT-BIH Arrhythmia Database. It can be seen in Figure 10 that after adding Gaussian white noise at an input SNR of 5 db, the characteristic information of each band of the original ECG was completely lost. Compared with the three other types of noise, the wave damage of Gaussian white noise was the most thorough, and it was impossible to extract useful information. This damage was catastrophic to a doctor’s diagnosis. In the process of ECG denoising, our proposed method could make the denoised ECG retain the morphological characteristics of each band and also made the ECG smoother. Even after adding Gaussian white noise, the band features of the original ECG were completely lost, and the proposed method could still recover the feature information of each band of the ECG. This verifies that our method can effectively eliminate Gaussian white noise.

5.2. The Contrast Experiment

To compare the denoising performance of our proposed method, we chose an autoencoder based on a deep fully connected neural network (hereafter referred to as DNN) [36] and a denoising autoencoder based on a fully convolutional neural network (hereafter referred to as FCN) [30] as the comparison objects. To make the comparison experiments more scientific, we set the DNN, FCN, and DANet all to train on the same training set and test on the same test set. For fairness, we used Adam’s optimization algorithm to train all the models. The batch size of the training dataset was set to 32, the learning rate was 0.001, the loss function was the root-mean-square error between the original ECG and the denoised ECG, and the number of training iterations was set to 100. In addition, all models were batch-normalized, and the activation function was the RELU function. At the 0 dB input signal-to-noise ratio noise level, Table 2, Table 3 and Table 4 represent a quantitative comparison of the denoising effects of the various autoencoder models after adding baseline wander noise, muscle artifact noise, and electrode motion artifact noise, respectively. In these three tables, it can be seen that using different ECG noise reduction performance indicators, the proposed denoising framework based on a disentangled autoencoder was superior to a fully convolutional denoising autoencoder and a fully connected autoencoder. These quantitative performance evaluations demonstrate the strength of the proposed disentangled-autoencoder-based denoising framework. The proposed framework has good generalization for EM, MA, and BW noises. It should be noted that it can be further enhanced by larger training datasets and better DANet model design. In addition, multiple noise cases can be trained simultaneously using a single DANet model. In the future, we hope to use different databases and other noise conditions to train the model.

6. Discussion

As a model for ECG denoising, DANet is a new idea based on a disentangled autoencoder, which has certain advantages and disadvantages. The disentangled autoencoder used in DANet can effectively reduce the noise interference of ECG and improve the signal quality. The model was designed based on deep learning technology, which can use large-scale data for training to improve prediction ability and accuracy. However, DANet also has some limitations and shortcomings. Firstly, due to the complex structure of the decoupled autoencoder, a large amount of computing resources and time are required during training. At the same time, the model needs a certain amount of time to process during testing, and there may be a certain delay. In terms of training strategies, it is necessary to consider the issue of protecting patient privacy and how to train and test efficiently on limited datasets. In our experimental design, the lack of separation of patient data may have affected our accurate assessment of model performance. Therefore, in order to more accurately evaluate the performance of the model, we have taken some measures. Specifically, we separated the data according to the patient record number. We selected six ECG data with record numbers of 107, 115, 123, 207, 220, and 233 as the test set and selected the remaining patient record data as the training set. The ratio of the training set and test set was 7:1. In this way, we could better protect the privacy and security of the patient data, more accurately evaluate the performance of the model, and improve the credibility of the experimental design. According to the experimental results in Table 5, compared with the experiment (such as in Table 2, Table 3 and Table 4) without patient data separation, the noise reduction effect of the baseline wander noise of the DANet model was reduced by 11.47%, and the noise reduction effect of the electrode motion artifacts was reduced by 5.36%, while the signal-to-noise ratio of the DANet model increased by 7.46% when dealing with muscle artifact noise. The experimental results show that although the signal-to-noise ratio of the DANet model decreased slightly in the patient data separation experiment, it could still maintain a good noise reduction effect. Therefore, it can be concluded that the noise reduction ability of the DANet model still performed well in different types of noise processing after the separation of patient data.

7. Conclusions

We introduced a disentangled mechanism module into a traditional autoencoder and proposed a new autoencoder model. We used disentangled representation learning to decouple the hidden layer features after coding, achieved the separation of signal and noise features, and then obtained the denoised signal by decoding. In this paper, different types of noise were added, which proved that our proposed denoising method has good robustness. Meanwhile, the effectiveness of the proposed method was evaluated using the signal-to-noise ratio, percentage root-mean-square error, and mean square error. In experiments, compared with models such as an FCN-based denoising autoencoder and a DNN-based autoencoder, our proposed method had more advantages in the signal-to-noise ratio and PRD. In future work, we will explore how to better extract the features of ECG, separate ECG features and noise features, improve the noise reduction effect of ECG, and better apply these findings to an automatic diagnosis system of ECG.

Author Contributions

Conceptualization, H.L., R.L. and Z.L.; methodology, H.L., R.L. and Z.L.; software, H.L.; validation, H.L., R.L. and Z.L.; formal analysis, H.L., R.L. and Z.L.; investigation, H.L., R.L. and Z.L.; resources, H.L.; data curation, H.L.; writing—original draft preparation, H.L.; writing—review and editing, H.L., R.L. and Z.L.; visualization, H.L.; supervision, R.L. and Z.L.; project administration, R.L. and Z.L.; funding acquisition, R.L. and Z.L.; All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by the National Natural Science Foundation of China under Grant No. 62172243, the Natural Science Foundation of Shandong Province under Grant No. ZR2021MF084 and ZR2020QF020.

Data Availability Statement

The data presented in this study are available upon request from the corresponding author.

Conflicts of Interest

The authors declare that they have no conflict of interest.

References

  1. Roth, G.A.; Mensah, G.A.; Johnson, C.O.; Addolorato, G.; Ammirati, E.; Baddour, L.M.; Barengo, N.C.; Beaton, A.Z.; Benjamin, E.J.; Benziger, C.P.; et al. Global Burden of Cardiovascular Diseases and Risk Factors, 1990–2019: Update From the GBD 2019 Study. J. Am. Coll. Cardiol. 2020, 76, 2982–3021. [Google Scholar] [CrossRef] [PubMed]
  2. Moridani, M.K.; Marjani, S. A Review of the Methods for Sudden Cardiac Death Detection: A Guide for Emergency Physicians. Int. J. Online Biomed. Eng. 2020, 16, 137–158. [Google Scholar] [CrossRef]
  3. Syed, Z.; Vigmond, E.; Nattel, S.; Leon, L.J. Atrial cell action potential parameter fitting using genetic algorithms. Med. Biol. Eng. Comput. 2005, 43, 561–571. [Google Scholar] [CrossRef] [PubMed]
  4. Jagatap, P.S.; Jagtap, R. Electrocardiogram (ECG) Signal Analysis and Feature Extraction: A Survey. 2014. Available online: https://www.semanticscholar.org/paper/Electrocardiogram-(ECG)-Signal-Analysis-and-Feature-Jagatap-Jagtap/ceadcc88d06518ca4ab2fd987465a22463736fc3 (accessed on 17 January 2023).
  5. Hammad, M.; Maher, A.; Wang, K.; Jiang, F.; Amrani, M. Detection of abnormal heart conditions based on characteristics of ECG signals. Measurement 2018, 125, 634–644. [Google Scholar] [CrossRef]
  6. Sarangi, A.; Mishra, B.G.; Dash, S. Singular Spectrum Analysis Based EMG Artifact Removal from ECG Signal. YMER Digit. 2022, 21, 400–407. [Google Scholar] [CrossRef]
  7. Wang, Z.; Wong, C.M.; da Cruz, J.N.; Wan, F.; Mak, P.-I.; Mak, P.U.; Vai, M.I. Muscle and electrode motion artifacts reduction in ECG using adaptive Fourier decomposition. In Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), San Diego, CA, USA, 5–8 October 2014; pp. 1456–1461. [Google Scholar] [CrossRef]
  8. Lin, C.-C.; Chang, P.-C.; Tsai, P.-H. A Dual-Adaptive Approach Based on Discrete Cosine Transform for Removal of ECG Baseline Wander. Appl. Sci. 2022, 12, 8839. [Google Scholar] [CrossRef]
  9. Gupta, P.; Sharma, K.K.; Joshi, S.D. Baseline wander removal of electrocardiogram signals using multivariate empirical mode decomposition. Health Technol. Lett. 2015, 2, 164–166. [Google Scholar] [CrossRef] [Green Version]
  10. Sharma, R.R.; Pachori, R.B. Baseline wander and power line interference removal from ECG signals using eigenvalue decomposition. Biomed. Signal Process. Control. 2018, 45, 33–49. [Google Scholar] [CrossRef]
  11. Labate, D.; La Foresta, F.; Occhiuto, G.; Morabito, F.C.; Lay-Ekuakille, A.; Vergallo, P. Empirical Mode Decomposition vs. Wavelet Decomposition for the Extraction of Respiratory Signal from Single-Channel ECG: A Comparison. IEEE Sens. J. 2013, 13, 2666–2674. [Google Scholar] [CrossRef]
  12. Chao, L.; Liang, Y.; Xia, H. Adaptive baseline wander reduction based on empirical mode decomposition and wavelet thresholding for ECG. In Proceedings of the Chinese Medical Equipment Conference and 2021 Medical Equipment Exhibition Paper Compilation, Suzhou, China, 15–18 July 2021; pp. 108–114. [Google Scholar]
  13. Addison, P.S. Wavelet transforms and the ECG: A review. Physiol. Meas. 2005, 26, R155–R199. [Google Scholar] [CrossRef] [Green Version]
  14. Goel, S.; Tomar, P.; Kaur, G. An Optimal Wavelet Approach for ECG Noise Cancellation. Int. J. Bio-Sci. Bio-Technol. 2016, 8, 39–52. [Google Scholar] [CrossRef]
  15. Bing, P.; Liu, W.; Zhang, Z. DeepCEDNet: An Efficient Deep Convolutional Encoder-Decoder Networks for ECG Signal Enhancement. IEEE Access 2021, 9, 56699–56708. [Google Scholar] [CrossRef]
  16. Garg, G.; Singh, V.; Gupta, J.R.P.; Mittal, A.P. Optimal algorithm for ECG denoising using Discrete Wavelet Transforms. In Proceedings of the 2010 IEEE International Conference on Computational Intelligence and Computing Research, Coimbatore, India, 28–29 December 2010; pp. 1–4. [Google Scholar] [CrossRef]
  17. Tan, X.; Ye, J.; Zhang, X.; Li, C.; Zhou, J.; Dou, K. Application of improved wavelet threshold in ECG signal de-noising. Chin. J. Med. Devices 2021, 45, 1–5. [Google Scholar]
  18. Das, M.; Ari, S. Analysis of ECG signal denoising method based on S-transform. IRBM 2013, 34, 362–370. [Google Scholar] [CrossRef]
  19. Zhou, Y.; Hu, X.; Tang, Z.; Ahn, A.C. Sparse representation-based ECG signal enhancement and QRS detection. Physiol. Meas. 2016, 37, 2093–2110. [Google Scholar] [CrossRef] [PubMed]
  20. Ning, X.; Selesnick, I.W. ECG Enhancement and QRS Detection Based on Sparse Derivatives. Biomed. Signal Process. Control. 2013, 8, 713–723. [Google Scholar] [CrossRef]
  21. Selesnick, I. Sparsity-assisted signal smoothing (revisited). In Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA, 5–9 March 2017; pp. 4546–4550. [Google Scholar] [CrossRef]
  22. Xiong, P.; Wang, H.; Liu, M.; Zhou, S.; Hou, Z.; Liu, X. ECG signal enhancement based on improved denoising auto-encoder. Eng. Appl. Artif. Intell. 2016, 52, 194–202. [Google Scholar] [CrossRef]
  23. Fotiadou, E.; Konopczyński, T.; Hesser, J.; Vullings, R. Deep Convolutional Encoder-Decoder Framework for Fetal ECG Signal Denoising. In Proceedings of the 2019 Computing in Cardiology (CinC), Singapore, 8–11 September 2019; pp. 1–4. [Google Scholar] [CrossRef]
  24. Goodfellow, I.J.; Pouget-Abadie, J.; Mirza, M.; Xu, B.; Warde-Farley, D.; Ozair, S.; Courville, A.; Bengio, Y. Generative Adversarial Nets. In Proceedings of the Advances in Neural Information Processing Systems; 2014; Volume 27. Available online: https://proceedings.neurips.cc/paper/2014/hash/5ca3e9b122f61f8f06494c97b1afccf3-Abstract.html (accessed on 4 December 2022).
  25. Patil, A. DCGAN: Deep Convolutional GAN with Attention Module for Remote View Classification. In Proceedings of the 2021 International Conference on Forensics, Analytics, Big Data, Security (FABS), Bengaluru, India, 21–22 December 2021; Volume 1, pp. 1–10. [Google Scholar] [CrossRef]
  26. Singh, P.; Pradhan, G. A New ECG Denoising Framework Using Generative Adversarial Network. IEEE/ACM Trans. Comput. Biol. Bioinform. 2021, 18, 759–764. [Google Scholar] [CrossRef]
  27. Zhu, F.; Ye, F.; Fu, Y.; Liu, Q.; Shen, B. Electrocardiogram generation with a bidirectional LSTM-CNN generative adversarial network. Sci. Rep. 2019, 9, 6734. [Google Scholar] [CrossRef] [Green Version]
  28. Bengio, Y.; Courville, A.; Vincent, P. Representation Learning: A Review and New Perspectives. arXiv 2014, 35, 1798–1828. Available online: https://arxiv.org/abs/1206.5538 (accessed on 23 April 2014). [CrossRef] [Green Version]
  29. Costa, M.; Moody, G.B.; Henry, I.; Goldberger, A.L. PhysioNet: An NIH research resource for complex signals. J. Electrocardiol. 2003, 36, 139–144. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Chiang, H.-T.; Hsieh, Y.-Y.; Fu, S.-W.; Hung, K.-H.; Tsao, Y.; Chien, S.-Y. Noise Reduction in ECG Signals Using Fully Convolutional Denoising Autoencoders. IEEE Access 2019, 7, 60806–60813. [Google Scholar] [CrossRef]
  31. Higgins, I.; Amos, D.; Pfau, D.; Racaniere, S.; Matthey, L.; Rezende, D.; Lerchner, A. Towards a Definition of Disentangled Representations. arXiv 2018. Available online: https://arxiv.org/abs/1812.02230 (accessed on 5 December 2018).
  32. Mandt, S.; Hoffman, M.D.; Blei, D.M. Stochastic Gradient Descent as Approximate Bayesian Inference. arXiv 2018. [Google Scholar] [CrossRef]
  33. Fan, W.; Wei, J.; Ang, A.H.-S.; Li, Z. Adaptive estimation of statistical moments of the responses of random systems. Probabilistic Eng. Mech. 2016, 43, 50–67. [Google Scholar] [CrossRef]
  34. Sun, Y. Root Mean Square Minimum Distance as a Quality Metric for Stochastic Optical Localization Nanoscopy Images. Sci. Rep. 2018, 8, 17211. [Google Scholar] [CrossRef] [Green Version]
  35. Duchi, J.; Hazan, E.; Singer, Y. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. J. Mach. Learn. Res. 2011, 12, 39. [Google Scholar]
  36. Rodrigues, R.; Couto, P. A Neural Network Approach to ECG Denoising. arXiv 2012. [Google Scholar] [CrossRef]
Figure 1. A complete ECG cycle.
Figure 1. A complete ECG cycle.
Electronics 12 01606 g001
Figure 2. The structure of the denoising autoencoder.
Figure 2. The structure of the denoising autoencoder.
Electronics 12 01606 g002
Figure 3. The structure of the disentangled autoencoder model.
Figure 3. The structure of the disentangled autoencoder model.
Electronics 12 01606 g003
Figure 4. The DANet network structure.
Figure 4. The DANet network structure.
Electronics 12 01606 g004
Figure 5. SNR and PRD of the DANet network model with different learning rates and different batch sizes.
Figure 5. SNR and PRD of the DANet network model with different learning rates and different batch sizes.
Electronics 12 01606 g005
Figure 6. Loss of training set and loss of validation set.
Figure 6. Loss of training set and loss of validation set.
Electronics 12 01606 g006
Figure 7. Noise reduction effect of ECG with baseline wander noise at input SNR of 5 db.
Figure 7. Noise reduction effect of ECG with baseline wander noise at input SNR of 5 db.
Electronics 12 01606 g007
Figure 8. Noise reduction effect of ECG with electrode motion artifact noise at input SNR of 0 db.
Figure 8. Noise reduction effect of ECG with electrode motion artifact noise at input SNR of 0 db.
Electronics 12 01606 g008
Figure 9. Noise reduction effect of ECG with muscle artifact noise at input SNR of 2.5 db.
Figure 9. Noise reduction effect of ECG with muscle artifact noise at input SNR of 2.5 db.
Electronics 12 01606 g009
Figure 10. Noise reduction effect of ECG with Gaussian white noise at input SNR of 5 db.
Figure 10. Noise reduction effect of ECG with Gaussian white noise at input SNR of 5 db.
Electronics 12 01606 g010
Table 1. The means and standard deviations of the SNR, PRD, and RMSE for the four optimizers.
Table 1. The means and standard deviations of the SNR, PRD, and RMSE for the four optimizers.
OptimizersAdamSGDRMSPropAdaGrad
MeanSNR27.3315.3226.6222.78
PRD4.8119.105.167.80
RMSE0.01810.06920.01930.0289
StdSNR1.402.071.5231.17
PRD0.875.640.881.053
RMSE0.00520.01770.00540.0066
Table 2. Quantitative comparison of denoising effects of various autoencoder models after adding baseline wander noise at 0 dB input SNR noise level.
Table 2. Quantitative comparison of denoising effects of various autoencoder models after adding baseline wander noise at 0 dB input SNR noise level.
RecordDANetFCNDNN
SNRRMSEPRDSNRRMSEPRDSNRRMSEPRD
10926.820.01965.2425.10.02366.3117.020.052614.5
11727.70.02154.3125.920.02655.2917.920.064412.88
11826.230.02495.2924.740.02936.2317.160.06614.04
11926.50.01565.1924.440.01946.3815.230.053818.34
12329.190.01273.7827.240.01584.7116.450.051415.37
21526.760.02074.8724.730.02556.1415.10.07517.68
22030.630.01143.0828.940.01373.7416.150.05815.71
23026.550.02125.2424.840.02526.1916.460.062715.21
23127.170.01414.925.780.01635.714.310.059120.48
23326.960.02525.1324.80.0326.5818.570.059712.18
Average27.4510.018694.70325.6530.022735.72716.4370.0602715.639
Table 3. Quantitative comparison of denoising effects of various autoencoder models after adding muscle artifact noise at 0 dB input SNR noise level.
Table 3. Quantitative comparison of denoising effects of various autoencoder models after adding muscle artifact noise at 0 dB input SNR noise level.
RecordDANetFCNDNN
SNRRMSEPRDSNRRMSEPRDSNRRMSEPRD
10926.150.01825.0925.280.025.5916.890.05114.43
11725.480.0285.5923.60.03456.8817.130.070614.07
11824.990.0285.9623.580.03246.8916.710.069314.72
11924.520.01876.3123.140.02177.3514.750.055219.46
12327.50.01444.3525.950.01735.2116.290.051215.49
21524.740.02496.0423.020.03037.414.770.077618.33
22028.410.01463.9726.320.01845.0215.80.060216.35
23025.050.02596.0123.510.03037.0116.40.066315.26
23125.080.01655.923.20.02027.3913.620.05922.16
23325.290.0285.8923.160.03547.4217.640.064913.56
Average25.7210.021725.51124.0760.026056.616160.0625316.383
Table 4. Quantitative comparison of denoising effects of various autoencoder models after adding electrode motion artifact noise at 0 dB input SNR noise level.
Table 4. Quantitative comparison of denoising effects of various autoencoder models after adding electrode motion artifact noise at 0 dB input SNR noise level.
RecordDANetFCNDNN
SNRRMSEPRDSNRRMSEPRDSNRRMSEPRD
10928.540.01393.9523.50.02456.9514.140.069319.82
11731.030.01452.8724.120.03256.3914.830.092718.33
11829.020.01773.7123.660.03266.8813.420.101721.44
119290.01113.7622.330.02388.1311.560.079627.88
12331.980.00982.8526.40.01815.2814.310.066219.56
21528.60.01683.8723.720.02956.8611.750.114325.92
22032.920.00872.3128.070.01534.0814.170.073819.7
23030.130.01373.323.690.02856.8314.10.083719.91
23128.750.01083.9622.990.02117.4611.450.078427.83
23329.180.01853.6623.050.03757.514.10.101320.02
Average29.9150.013553.42424.1530.026346.63613.3830.086122.041
Table 5. The noise reduction effect of the DANet model using a training set and a test set divided according to different patient data.
Table 5. The noise reduction effect of the DANet model using a training set and a test set divided according to different patient data.
RecordBWEMMA
SNRRMSEPRDSNRRMSEPRDSNRRMSEPRD
10726.050.02795.5127.750.02194.3028.180.02023.96
11526.620.01945.1028.980.01393.6826.930.01754.66
12319.770.039810.6525.590.02155.7824.810.02205.90
20722.030.04668.5828.730.02173.9929.790.01793.28
22025.200.02195.9028.510.01433.8626.180.01865.03
23326.110.02865.4130.310.01653.1329.960.01693.20
Average24.300.03076.8628.310.01834.1227.640.01894.34
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lin, H.; Liu, R.; Liu, Z. ECG Signal Denoising Method Based on Disentangled Autoencoder. Electronics 2023, 12, 1606. https://doi.org/10.3390/electronics12071606

AMA Style

Lin H, Liu R, Liu Z. ECG Signal Denoising Method Based on Disentangled Autoencoder. Electronics. 2023; 12(7):1606. https://doi.org/10.3390/electronics12071606

Chicago/Turabian Style

Lin, Haicai, Ruixia Liu, and Zhaoyang Liu. 2023. "ECG Signal Denoising Method Based on Disentangled Autoencoder" Electronics 12, no. 7: 1606. https://doi.org/10.3390/electronics12071606

APA Style

Lin, H., Liu, R., & Liu, Z. (2023). ECG Signal Denoising Method Based on Disentangled Autoencoder. Electronics, 12(7), 1606. https://doi.org/10.3390/electronics12071606

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop