Next Article in Journal
Blockchain-Empowered AI for 6G-Enabled Internet of Vehicles
Next Article in Special Issue
Redesign of Channel Codes for Joint Source-Channel Coding Systems over One-Dimensional Inter-Symbol-Interference Magnetic Recording Channels
Previous Article in Journal
Drug Adverse Event Detection Using Text-Based Convolutional Neural Networks (TextCNN) Technique
Previous Article in Special Issue
Design of Mutual-Information-Maximizing Quantized Shuffled Min-Sum Decoder for Rate-Compatible Quasi-Cyclic LDPC Codes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Efficient Design of Lossy P-LDPC Codes over AWGN Channels

1
Department of Information and Communication Engineering, Xiamen University, Xiamen 361005, China
2
Xiamen Key Laboratory of Mobile Multimedia Communications, College of Information Science and Engineering, Huaqiao University, Xiamen 361021, China
3
Department of Electrical and Computer Engineering, McGill University, Montreal, QC H3A 0G4, Canada
*
Author to whom correspondence should be addressed.
Electronics 2022, 11(20), 3337; https://doi.org/10.3390/electronics11203337
Submission received: 13 September 2022 / Revised: 6 October 2022 / Accepted: 11 October 2022 / Published: 17 October 2022
(This article belongs to the Special Issue Multirate and Multicarrier Communication)

Abstract

:
Considering the high compression requirements of transmission, lossy block codes are particularly concerned due to their good compression performance and simple implementation. This paper investigates and analyzes the distortion rate performance of protograph LDPC (P-LDPC) codes for Bernoulli sources over AWGN channels. We first analytically establish the connection between the parity check matrix of a P-LDPC code and the extra distortion caused by the noisy channels. It was found that the additional distortion related to channel noise increases with the rising total degree of a parity check matrix. Further, two design algorithms are proposed for optimizing lossy multirate P-LDPC codes, considering the effect of noisy channels. Finally, simulation results demonstrate the robustness of the optimized P-LDPC codes over noisy channels.

1. Introduction

Efficient compression can save hardware storage resources and reduce bandwidth consumption during transmission. Compared with lossless compression, lossy compression can compress data to a greater extent, resulting in a rate smaller than the entropy of the source. In the practical transmission environment, the compressed bits may be interfered by the channel noise, leading to extra transmission distortion, and thus, the study of lossy compression over noisy channels is of great significance.
Lossy compression is based on the distortion rate theory [1,2], and the source is quantized by source coding. Source coding and channel coding have a duality [3], so source compression can be realized by channel coding. Quantization using channel codes is to replace the equivalent codes of the quantization subspace [4] by the channel codes. Therefore, it is of great significance to find error-correcting codes with low complexity and suitable for different source characteristics. Low-density parity check (LDPC) codes are found to be feasible for lossy compression [5], and they have been proven to asymptotically achieve the distortion rate limit for the equal-probability binary symmetric sources, but no specific codes have been proposed [6]. As the dual codes of LDPC codes, low-density generator matrix (LDGM) codes are proposed to compress the Bernoulli sources, which has made the distortion close to the distortion rate limit [7,8]. As a subclass of LDPC codes, protograph LDPC (P-LDPC) codes can obtain their parity check matrix ( H ) by extending a small protomatrix [9,10]. Compared with the randomly generated LDPC codes, P-LDPC codes have linear encoding and decoding complexity. Therefore, the lossy compression using P-LDPC codes has lower complexity, which makes it feasible in practical scenarios. For the compression of Bernoulli sources, Liu [11] proposed two algorithms to re-design P-LDPC codes over noise-free channels. The resultant codes achieved a compression performance close to the distortion rate limit. However, in practical applications, a complete communication system has to consider the sensitivity to noisy channels.
For the compression procedure, the P-LDPC codes and the reinforced belief propagation (RBP) algorithm [12] jointly operate on the sources, serving as a quantization [13,14] scheme for binary sources. The size of the quantization subspace of P-LDPC codes is related to its error correction ability. Since the degree of each variable node of a P-LDPC code varies, the error correction ability of each variable node is different, and this causes the non-uniform error correction interval (i.e., quantized subspace). Therefore, when P-LDPC codes are used for source compression, we need to re-design the P-LDPC codebooks to minimize the quantization distortion ( D S ). Further, the index assigned to each codeword after quantization is transmitted over the channels, and the corrupted index will lead to extra channel distortion ( D C ) [15,16,17]. In this paper, we view information bits of each codeword as an index of the linear block codes. Moreover, it is noted that the design of lossy P-LDPC codes only concerns the parity check matrices, taking into account the index assignment and the noisy channels. We point out that the RBP algorithm for lossy P-LDPC codes and the standard BP algorithm for channel LDPC codes could share the same decoding module on a ship, improving the on-ship area efficiency.
For underwater acoustic communications or power line communications, the robustness of a compression scheme to harsh channel conditions has to be considered, since the channel distortion D C could become the dominant distortion. Therefore, we first analyze the key factors affecting the channel distortion and then consider the influence of channel noise while optimizing the P-LDPC codes. By doing so, the average distortion at both low and high signal-noise ratio (SNR) regions could be balanced. The main contributions of this paper are described as follows:
1.
The connection between D C and the total degree of the variable nodes of a protomatrix is derived and experimentally verified.
2.
Two optimization algorithms are proposed based on the principle of balanced degree allocation, and the optimized codes have excellent compression performance and error resilience.
The remainder of this paper is organized as follows. Section 2 introduces the system model. The optimization of the P-LDPC codes is presented in Section 3, including the analysis for the low SNR region and optimization for the high SNR region. The experimental results and analysis are given in Section 4. The conclusion is given in Section 5.

2. System Model

The Bernoulli source compression system model using P-LDPC codes as the quantization codebook over noisy channels is shown in Figure 1.
S N represents the Bernoulli source, and s N = s 0 , s 1 , , s N 1 T is a Bernoulli source sequence of length N. c N is the quantized codeword. We used the Hamming distance to measure the distortion, i.e.,
d H ( s i , s ^ i ) = 0 i f s i = s ^ i 1 i f s i s ^ i ,
d ( s N , s ^ N ) = 1 N i = 0 N 1 d H ( s i , s ^ i ) .
For the compression system using linear block codes, k is the length of information bits, which is also the length of the binary index c k of the P-LDPC codes. The distortion D S and D C are expressed, respectively, by:
D S = 1 N i = 0 2 k 1 j = 0 2 N k 1 p s i j N d s i j N , c i N ,
D C = 1 N i = 0 2 k 1 j = 0 2 k 1 P c i k P c j k c i k d c i N , c j N ,
where s i j N is the j th source sequence of the i th quantization subspace. As pointed out in [15], when the quantized codeword and subspace division satisfy the centroid codeword and minimum distortion division, the total distortion is equal to the sum of D S and D C .
This system consists of three parts. The first part is the encoding module. This module is the quantization module, which introduces the quantization distortion D S . In this module, the parity check matrix H of the P-LDPC codes is designed by considering the statistical characteristics of the source, so as to reduce D S as much as possible. Then, by considering the influence of channel noise on the index, combined with the corresponding relationship between the index and the codeword, constraints are added to the H matrix to reduce D C . Next, by using the RBP algorithm, each quantization subspace of the source is shrunk to a codeword of P-LDPC codes, so as to achieve the purpose of lossy compression. The schematic diagram is shown in Figure 2, which is to quantize the N-bit Bernoulli source S N to 2 k P-LDPC codewords c N , and the quantization subspace (coding subspace) is the error correction range of the LDPC codes, then through the interception of information bits, that is to extract the index for transmission, to further compress the source.
The second part is the transmission module. In this module, the k-bit binary index is modulated by QPSK, and after transmitting over AWGN channels, QPSK demodulation is used to obtain the index with possible errors. The third part is the decoding module, where the generator matrix ( G ) corresponding to the H matrix is multiplied by the demodulated index to perform linear decoding.

3. Analysis and Optimization Methods

3.1. Analysis for Low SNR Region

For the low SNR region, channel noise will cause serious errors on the index during transmission, leading to a large D C . We can minimize D C by reducing the distance between the two quantization subspaces corresponding to adjacent indices of the P-LDPC codes.
Now, let us assume n 1 is an original source sequence of length N, n 2 is a reconstructed sequence at the receiver, and w is the Hamming distance between the two sequences. Moreover, let u 1 represent the k-bit binary index, which is a short sequence transmitted over the channels. Let u 2 be the short sequence demodulated after demodulation. To this end, D C can be expressed by
D C = w = n 1 n 2 1 = G ( u 1 u 2 ) 1 .
First, suppose that a one-bit error occurs in the binary index during transmission, and let H m × n = H m × k I m × m be a systematic matrix. Without loss of generality, we assume the single-bit error occurs at the last position of the index, and then, we have
Δ u = u 1 u 2 = 0 , 0 , , 0 , 1 T ,
G · Δ u = I k × k H m × k · Δ u = 0 , 0 , , 0 , 1 k , h 1 k , h 2 k , h m k m T ,
where h i j is the ( i , j ) th entry of the H m × n matrix and i [ 1 , m ] * and j [ 1 , k ] * , where ∗ represents integers in this range. Therefore, the source distortion generated by the one-bit error of the binary index is:
w 1 = 1 + i = 1 m h i k = 1 + V k ,
where V k is the degree of the k th variable node. Therefore, the average distortion (in bits) generated by the one-bit error of the binary index is:
w ¯ 1 = 1 k k + j = 1 k i = 1 m h i j = 1 + 1 k j = 1 k V j .
Following the same way, we assume a two-bit error occurs in the index, and the corresponding distortion becomes
w 2 = 2 + V j + V j ^ ,
where j j ^ and the average distortion in bits is:
w ¯ 2 = 2 + 1 C k 2 j ^ = 1 k V j ^ + j j ^ k V j = 2 + k 1 C k 2 j = 1 k V j = 2 1 + 1 k j = 1 k V j .
Finally, the average distortion generated by an e-bit error of the binary index is:
w ¯ e = e · 1 + 1 k j = 1 k V j = e k V G ,
where V G is the total degree of the G matrix. The check matrix of P-LDPC codes whose copy times are Z fills the cyclic matrix in the M N square matrices after the protomatrix is copied. Therefore, for P-LDPC codes, the distortion formula of the e-bit error of the binary index can be changed to:
w ¯ e = e · 1 + 1 N M · Z j = 1 N M i = 1 M Z · B i j = e · 1 + 1 N M j = 1 N M V j ,
where B i j is the ( i , j ) th element in the protomatrix B M × N .
Figure 3 shows the relationship between D C (in bits) and the total degree of variable nodes in a 3 × 5 protomatrix with code rate 0.4, and the length of the information bits is 1000. As can be seen from Figure 3a, a small number of index errors have little effect on the compression system, showing a slow linear growth; a large number of index errors cause a sharp rise in D C , while the proportion of the total degree of the H matrix to the D C influence becomes larger. After the number of assumed index error bits is fixed, we can obtain the simplified Figure 3b from Figure 3a. As can be seen from Figure 3b, if the index error increases (the channel condition is worse), the total degrees have more influence on  D C .
For continuous burst errors that may occur in other channels, we now assume that the probability of two consecutive errors during transmission is independent and identical, and then, we assume the two-bit error occurs at the last two positions of the index, i.e.,
Δ u = u 1 u 2 = 0 , 0 , , 1 , 1 T .
The source distortion in this case is:
w 2 ˜ = 2 + i = 1 m h i k 1 + i = 1 m h i k = 2 + V k 1 + V k .
The different short sequence indices transmitted are connected in the channels, and each index bit transmitted affects each bit variable node on the information bit. Let V k 0 represent the k th position error of the 0 th index short sequence, and the D C caused by it is affected by the degree of the variable node at the k th position in the H matrix:
V k 2 0 V k 1 0 V k 0 u 0 V 1 1 V 2 1 V k 1 u 1 V 1 2 V 2 2 V 3 2 u 2 .
When the index has two consecutive errors in transmission, the corresponding variable nodes that affect the source distortion are (assuming that there can be consecutive errors at the beginning and end)
V k 0 V 1 1 ̲ V 1 1 V 2 1 V k 1 1 V k 1 V k 1 ̲ V 1 2 .
Taking all possible errors to calculate the average channel distortion of a source sequence, the average distortion (in bits) caused by two and three consecutive index errors is, respectively:
w ¯ 2 ˜ = 2 k + 1 k + j = 1 k V j ,
w ¯ 3 ˜ = 3 k + 2 k + j = 1 k V j .
Therefore, the average distortion caused by e consecutive index errors is:
w ¯ e ˜ = e k + e 1 k + j = 1 k V j .
A special case when e = 1 and k is:
w ¯ 1 ˜ = w ¯ 1 = V G V H k k , lim k w ¯ e ˜ = lim k w ¯ e = e .
It can be summarized from the aforementioned analysis that D C is positively related to the total degree of the parity check matrix H . Therefore, a low-weight parity check matrix is highly preferred for reducing D C in the low SNR regime.

3.2. Optimization for High SNR Region

It is known that D C would be small for the high SNR regime, and thus, more attention should be paid to reducing source distortion D S . In order to reduce D S caused by quantization, the division of the quantization subspace needs to be more suitable for source statistical characteristics, and the equivalent codeword of the quantization subspace needs to be closer to the central codeword. In the compression system using linear block codes as the quantization codebook, we can adjust the partition of the quantization subspace and quantization codebook by assigning the degree of variable nodes.
In order to do so, we propose a new algorithm designing the P-LDPC codes based on the codes of [11]. The proposed Algorithm 1 including the check degree allocation (CA) algorithm and the check-variable degree allocation (CVA) algorithm is based on the concept of degree balance, and the resultant codes achieve better distortion rate performance in the high SNR regime, as shown in the next section. In addition, the proposed Algorithm 2 is based on the global degree allocation (GDA) algorithm, which can find codes of better compression performance. Moreover, the GDA algorithm can also achieve a variable code rate and balance compression performance and channel noise robustness by selecting appropriate degrees. The notations in Algorithms 1 and 2 are explained as follows:
Algorithm 1 CA algorithm and CVA algorithm
Require: AR3A-impr codes and AR4JA-impr codes [11]
Ensure: CA-AR3A-impr codes and CVA-AR3A-impr codes;
        CA-AR4JA-impr codes and CVA-AR4JA-impr codes.
1:
for j = M + 1 N do
2:
    C x j V j / M
3:
   if x M V j % M then
4:
       C x j C x j + 1
5:
   else
6:
       C x j C x j
7:
   end if
8:
end for
9:
if x = 1 M C x j = x = 1 M C x j i n p u t then
10:
    C x j C x j i n p u t
11:
else
12:
    C x j C x j
13:
end if
// End of the degree allocation of check nodes.
// Output CA-AR3A-impr and CA-AR4JA-impr codes.
14:
for i = 1 M do
15:
    V i y ( C i 1 ) / ( N M )
   // y M
16:
   if y N ( C i 1 ) % ( N M ) then
17:
       V i y V i y + 1
18:
   else
19:
       V i y V i y
20:
   end if
21:
end for
// End of the degree allocation of variable nodes.
22:
repeat
23:
   swap ( V i y , V i y )
24:
until
V j = ( j = M + 1 N V j ) / ( N M ) + 1 , i f j N ( j = M + 1 N V j ) % ( N M ) V j = ( j = M + 1 N V j ) / ( N M ) , i f M < j < N ( j = M + 1 N V j ) % ( N M )
25:
return CA-AR3A-impr codes; CA-AR4JA-impr codes; CVA-AR3A-impr codes; CVA-AR4JA-impr codes
V j : the degree of the j th variable node ( j [ M + 1 , N ] * );
C i : the degree of the i th check node ( i [ 1 , M ] * );
d: the total degree of the variable nodes associated with the information bit in the protomatrix;
V i y : the number of edges connecting the i th check node and the y th variable node ( y [ M + 1 , N ] * );
C x j : the number of edges connecting the j th variable node and the x th check node ( x [ 1 , M ] * ).
Algorithm 1 optimizes the protomatrices with good compression performance based on the existing codes from [11] by reassigning the degrees of rows and columns. The following Algorithm 1 takes the AR3A-impr codes and the AR4JA-impr codes [11] as an example. Note that Algorithm 1 could be used for any codes of [11].
When the code rate is 0.57, the original and optimized codes are shown as in Equation (22).
1 0 0 0 0 1 2 0 1 0 1 2 1 3 0 0 1 2 1 2 2 A R 3 A i m p r 1 0 0 1 1 1 2 0 1 0 1 1 1 3 0 0 1 1 1 2 2 C A A R 3 A i m p r 1 0 0 1 1 1 2 0 1 0 1 2 2 1 0 0 1 2 1 1 2 C V A A R 3 A i m p r 1 0 0 1 1 1 2 0 1 0 1 1 2 2 0 0 1 1 1 2 2 C V A A R 3 A i m p r t e m p .
Algorithm 2 (GDA) optimizes the P-LDPC codes from scratch and uses the principle of degree balance to generate new codes suitable for equal-probability Bernoulli sources by global degree allocation. The initial structure of the proposed P-LDPC codes is shown in Equation (23), which could make the partition of the quantization subspace by the P-LDPC codes concentrated in B M × k . Algorithm 2 can make the error correction range of each variable node as equal as possible by filling the total degree into B M × k , so that 2 k quantized subspaces are further uniformly divided. By doing so, the quantization distortion D S is reduced. In addition, P-LDPC codes with various rates could be obtained from Algorithm 2, by arbitrarily setting the dimension of the identity matrix and the number of variable nodes in Equation (23). Note that in Equation (23), I M × M denotes the identity matrix, and B M × k is the matrix to be filled.
I M × M B M × k = [ 1 0 0 0 1 0 0 0 1 | B 1 × 1 B 1 × 2 B 1 × k B 2 × 1 B 2 × 2 B 2 × k B M × 1 B M × 2 B M × k ] .
The procedure for generating the GDA codes is shown in Equation (24), when the code rate is M / N .
I M × M B M × k i n p u t d I B c 1 d k B c 2 d k B c ( k 1 ) d k + 1 B c k d k + 1 G l o b a l d e g r e e a l l o c a t i o n o f v a r i a b l e n o d e s I M × M G D A ( B M × k ) G D A c o d e s I B r 1 d M B r 2 d M B r ( M 1 ) d M + 1 B r M d M + 1 G l o b a l d e g r e e a l l o c a t i o n o f c h e c k n o d e s ,
where · is the floor function, d k implies V j = B c j 1 = d k , and d M indicates that C i = B r i 1 + 1 = d M + 1 .
Algorithm 2 GDA algorithm
Require: M & N & d;
Ensure: GDA codes
1:
for j = M + 1 N do
2:
    V j d / ( N M )
3:
   if j N d % ( N M ) then
4:
       V j V j + 1
5:
   else
6:
       V j V j
7:
   end if
8:
end for
// Assign the total degree to the variable nodes
9:
for i = 1 M do
10:
    C i ( d + M ) / M
11:
   if i M ( d + M ) % M then
12:
       C i C i + 1
13:
   else
14:
       C i C i
15:
   end if
16:
end for
// Assign the total degree to the check nodes
17:
for j = M + 1 N do
18:
    C x j V j / M
19:
   if + + x M V j % M then
20:
       C x j C x j + 1
      // Until the degree of the j th variable node is filled
21:
   else
22:
       C x j C x j
23:
   end if
   // Traverse filling; the next filling position begins at an adjacent position
24:
end for
25:
return GDA codes
For example, if we take M = 3 , N = 5 , d = 13 , then the obtained GDA code is
I 3 × 3 B 3 × 2 13 i n p u t 13 I 3 × 3 B c 1 13 2 B c 2 13 2 + 1 G l o b a l d e g r e e a l l o c a t i o n o f v a r i a b l e n o d e s 1 0 0 2 2 0 1 0 2 2 0 0 1 2 3 G D A c o d e I M × M B r 1 13 3 B r 2 13 3 B r 3 13 3 + 1 G l o b a l d e g r e e a l l o c a t i o n o f c h e c k n o d e s .
Since the lossy compression system using the P-LDPC codes is the same as [11], both the encoding and decoding complexities are linear. The complexity of Algorithms 1 and 2 is mainly related to the length and width of the protomatrices. The CA algorithm has a complexity of O ( N M ) ; the complexity of the CVA algorithm amounts to O ( N + M 1 ) ; the complexity of GDA algorithm is O ( 2 N M ) .

4. Simulation Results and Analysis

All parity check matrices H were obtained by extending the aforementioned protomatrices to length N = 2520 in this paper. The RBP algorithm was used as the quantization algorithm, and the parameters of the RBP algorithm used for each code rate were taken from [11]. For clarity, these parameters ( R B P : 1 γ , L ) are given for each figure. The simulation results over AWGN channels with [11] codes are shown in Figure 4.
Figure 5 shows the impacts of the total degree of the protomatrix on D C , which are consistent with the theoretical derivation. It can be seen that the increase of the total degree seriously affects the compression performance in the low SNR region.
The compression performance of the codes obtained by Algorithm 1 is shown in Figure 6 and Figure 7. Compared with the existing codes of [11], the distortion is smaller in the high SNR region.
Note that a similar allocation algorithm can also be obtained by changing the order of allocation in the CVA algorithm. If the degrees of variable nodes are reassigned first, the VCA codes can be obtained. The compression performances of the codes are also shown in Figure 6 and Figure 7. The CVA codes may obtain better compression performance than the CA codes in the high SNR region, but larger distortion may occur in the low SNR region. The VCA codes will reduce the high distortion problem of the CVA codes in the low SNR region, but the compression performance is not as good as the CVA codes in the high SNR region.
Figure 8 compares the distortion rate performance of GDA codes with different total degrees. It can be seen that the protomatrices generated by the GDA algorithm with different total degrees will have good compression performance in the range of the degrees of the protomatrices. The codes having better compression performance than the CVA-AR3A-impr codes can be found using the GDA algorithm. We point out that the GDA algorithm can be used to select the optimal degrees to generate protomatrices of the source codes for noise-free channels. For example, we can select a GDA code of rate 0.4 with a good compression performance, as shown in Equation (26).
G D A 3 × 5 ( 17 ) = 1 0 0 2 3 0 1 0 3 3 0 0 1 3 3 .
The validity of lossy compression is measured by whether the achieved distortion is close to the theoretical distortion rate limit. Based on the analysis and the simulation results, the influence of the total degree on D C and D S can be summarized, for which the increase of total degree of H matrix will cause the increase of D C . In order to adapt to the fluctuation of the channel environment, we can select the GDA codes having enough good compression performance, but with less degree as the source codes to realize the robustness of the channel noise and, finally, achieve the minimum average distortion in a narrow band of the SNR range. Figure 9 shows the simulation results.
For example, although G D A 3 × 9 ( 33 ) has the smallest D S at a 0.66 code rate, considering the influence of D C , we can select the appropriate degree to obtain protomatrix ( d = 27 ) with a 0.66 (3 × 9) code rate using the GDA algorithm from Figure 8 to reduce the total distortion. The generation procedure follows the process shown in Equation (24), and the filling process is achieved by using cyclic filling, which can satisfy the conditions of global degree allocation with fewer allocation times.
G D A 3 × 9 ( 27 ) = 1 0 0 1 1 2 1 2 2 0 1 0 1 2 1 2 1 2 0 0 1 2 1 1 2 2 1 .

5. Conclusions

This paper studied the lossy compression system of equal-probability Bernoulli sources using binary P-LDPC codes over AWGN channels. The index is associated with the corresponding quantization subspace in linear block codes in this paper. Through theoretical derivation, the key factor affecting the D C of the compression system was found, i.e., a low-weight parity check matrix is highly preferred for reducing D C . Through experiments, it was verified that the total degree has a notable influence on D C in the low SNR region. Moreover, the quantization subspace composed of the H matrix is more suitable for the source statistics by assigning the degree of variable nodes; two algorithms that optimize the existing source codes were proposed; the resultant codes further reduce D S . In addition, the proposed GDA algorithm globally assigns each given degree to obtain a series of codes with good compression performance, and it was found explicitly that using the GDA algorithm within a range of total degrees can reduce D S significantly. By selecting a smaller total degree and using the GDA algorithm to generate codes, a trade-off between compression performance and D C can be achieved. In more practical transmission environments such as multipath fading channels and shadowing channels or with multiple noises, the robustness of the compression system will be further investigated in a future work.

Author Contributions

Writing—original draft, R.W.; data curation, R.W.; formal analysis, R.W. and H.W.; software, R.W. and S.L.; investigation, S.L.; supervision, S.L.; writing—review and editing, H.W.; validation, H.W.; funding acquisition, L.W.; methodology, L.W.; project administrator, L.W.; resources, L.W. All authors have read and agreed to the published version of the manuscript.

Funding

National Natural Science Foundation of China: 61671395.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef] [Green Version]
  2. Shannon, C.E. Communication in the presence of noise. Proc. IEEE 1998, 86, 447–457. [Google Scholar] [CrossRef]
  3. Gupta, A.; Verdu, S. Operational duality between lossy compression and channel coding. IEEE Trans. Inf. Theory 2011, 57, 3171–3179. [Google Scholar] [CrossRef]
  4. Chen, D. On two or more dimensional optimum quantizers. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Hartford, CT, USA, 9–11 May 1977; pp. 640–643. [Google Scholar]
  5. Matsunaga, Y.; Yamamoto, H. A coding theorem for lossy data compression by LDPC codes. IEEE Trans. Inf. Theory 2003, 49, 2225–2229. [Google Scholar] [CrossRef] [Green Version]
  6. Martinian, E.; Wainwright, M. Low density codes achieve the distortion rate bound. In Proceedings of the Data Compression Conference (DCC’06), Snowbird, UT, USA, 28–30 March 2006; pp. 153–162. [Google Scholar]
  7. Wainwright, M.J.; Maneva, E.; Martinian, E. Lossy source compression using low-density generator matrix codes: Analysis and algorithms. IEEE Trans. Inf. Theory 2010, 56, 1351–1368. [Google Scholar] [CrossRef] [Green Version]
  8. Wainwright, M.J.; Maneva, E. Lossy source encoding via message-passing and decimation over generalized codewords of LDGM codes. In Proceedings of the International Symposium on Information Theory, Adelaide, SA, Australia, 4–9 September 2005; pp. 1493–1497. [Google Scholar]
  9. Nguyen, T.V.; Nosratinia, A.; Divsalar, D. The design of rate-compatible protograph LDPC codes. IEEE Trans. Commun. 2012, 60, 2841–2850. [Google Scholar] [CrossRef]
  10. Hu, X.Y.; Eleftheriou, E.; Arnold, D.M. Regular and irregular progressive edge-growth tanner graphs. IEEE Trans. Inf. Theory 2005, 51, 386–398. [Google Scholar] [CrossRef]
  11. Liu, S. Research on the Design Principles of Joint Coding and Lossy Source Coding System Based on P-LDPC Codes. Ph.D. Thesis, Xiamen University, Xiamen, China, 2021. [Google Scholar]
  12. Braunstein, A.; Kayhan, F.; Montorsi, G.; Zecchina, R. Encoding for the blackwell channel with reinforced belief propagation. In Proceedings of the 2007 IEEE International Symposium on Information Theory, Nice, France, 24–29 June 2007; pp. 1891–1895. [Google Scholar]
  13. Gray, R. Vector quantization. IEEE ASSP Mag. 1984, 1, 4–29. [Google Scholar] [CrossRef]
  14. Linde, Y.; Buzo, A.; Gray, R. An algorithm for vector quantizer design. IEEE Trans. Commun. 1980, 28, 84–95. [Google Scholar] [CrossRef] [Green Version]
  15. Farvardin, N. A study of vector quantization for noisy channels. IEEE Trans. Inf. Theory 1990, 36, 799–809. [Google Scholar] [CrossRef]
  16. Skoglund, M. Optimal and sub-optimal decoding for vector quantization over noisy channels with memory. In Proceedings of the 9th European Signal Processing Conference (EUSIPCO 1998), Rhodes, Greece, 8–11 September 1998; pp. 1–4. [Google Scholar]
  17. Chang, W.W.; Hsu, H.I. Robust vector quantization for channels with memory. In Proceedings of the 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252), Washington, DC, USA, 24–29 June 2001; p. 239. [Google Scholar]
Figure 1. Lossy compression transmission system using P-LDPC codes over AWGN channels for Bernoulli sources.
Figure 1. Lossy compression transmission system using P-LDPC codes over AWGN channels for Bernoulli sources.
Electronics 11 03337 g001
Figure 2. Simplified diagram of system principle.
Figure 2. Simplified diagram of system principle.
Electronics 11 03337 g002
Figure 3. Relationship between total degrees corresponding to information bits in the protomatrix and D C . (a) Effects of different transmission errors and total degrees on D C (b) Distortion effects of increased total degrees for different index errors.
Figure 3. Relationship between total degrees corresponding to information bits in the protomatrix and D C . (a) Effects of different transmission errors and total degrees on D C (b) Distortion effects of increased total degrees for different index errors.
Electronics 11 03337 g003
Figure 4. Index transmission environment and compression performance of AR3A-impr codes [11] over noisy channels. (a) QPSK modulation over AWGN channels (b) Code rate: 0.4 (RBP: 0.94 1.8).
Figure 4. Index transmission environment and compression performance of AR3A-impr codes [11] over noisy channels. (a) QPSK modulation over AWGN channels (b) Code rate: 0.4 (RBP: 0.94 1.8).
Electronics 11 03337 g004
Figure 5. The influence of the total degree of the variable nodes corresponding to the information bit. (a) Code rate: 0.4 (RBP: 0.94 1.8) (b) Code rate: 0.57 (RBP: 0.85 2.0).
Figure 5. The influence of the total degree of the variable nodes corresponding to the information bit. (a) Code rate: 0.4 (RBP: 0.94 1.8) (b) Code rate: 0.57 (RBP: 0.85 2.0).
Electronics 11 03337 g005
Figure 6. The performance of the optimized codes for lossy compression over AWGN channels (code rate: 0.4). (a) Based on AR3A codes [11] (b) Based on AR4JA codes [11].
Figure 6. The performance of the optimized codes for lossy compression over AWGN channels (code rate: 0.4). (a) Based on AR3A codes [11] (b) Based on AR4JA codes [11].
Electronics 11 03337 g006
Figure 7. The performance of the optimized codes based on AR3A codes [11] for lossy compression over AWGN channels. (a) Code rate: 0.57 (b) Code rate: 0.66.
Figure 7. The performance of the optimized codes based on AR3A codes [11] for lossy compression over AWGN channels. (a) Code rate: 0.57 (b) Code rate: 0.66.
Electronics 11 03337 g007
Figure 8. Compression performance of codes generated by different total degrees of the variable nodes corresponding to the information bit in the protomatrix using the GDA algorithm for noise-free channels [11]. (a) Code rate: 0.4 (b) Code rate: 0.66.
Figure 8. Compression performance of codes generated by different total degrees of the variable nodes corresponding to the information bit in the protomatrix using the GDA algorithm for noise-free channels [11]. (a) Code rate: 0.4 (b) Code rate: 0.66.
Electronics 11 03337 g008
Figure 9. (a) Distortion rate performance [11]. (b) The GDA codes generated by different degrees have different D (code rate: 0.66) [11].
Figure 9. (a) Distortion rate performance [11]. (b) The GDA codes generated by different degrees have different D (code rate: 0.66) [11].
Electronics 11 03337 g009
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wang, R.; Liu, S.; Wu, H.; Wang, L. The Efficient Design of Lossy P-LDPC Codes over AWGN Channels. Electronics 2022, 11, 3337. https://doi.org/10.3390/electronics11203337

AMA Style

Wang R, Liu S, Wu H, Wang L. The Efficient Design of Lossy P-LDPC Codes over AWGN Channels. Electronics. 2022; 11(20):3337. https://doi.org/10.3390/electronics11203337

Chicago/Turabian Style

Wang, Runfeng, Sanya Liu, Huihui Wu, and Lin Wang. 2022. "The Efficient Design of Lossy P-LDPC Codes over AWGN Channels" Electronics 11, no. 20: 3337. https://doi.org/10.3390/electronics11203337

APA Style

Wang, R., Liu, S., Wu, H., & Wang, L. (2022). The Efficient Design of Lossy P-LDPC Codes over AWGN Channels. Electronics, 11(20), 3337. https://doi.org/10.3390/electronics11203337

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop