Next Article in Journal
Citizen Science and Topology of Mind: Complexity, Computation and Criticality in Data-Driven Exploration of Open Complex Systems
Next Article in Special Issue
Modeling and Performance Evaluation of a Context Information-Based Optimized Handover Scheme in 5G Networks
Previous Article in Journal
Entropy in Natural Time and the Associated Complexity Measures
Previous Article in Special Issue
An Approach to Data Analysis in 5G Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

On the Definition of Diversity Order Based on Renyi Entropy for Frequency Selective Fading Channels

Department of Information and Communication Engineering, Dongguk University-Seoul, 30 Pildong-ro 1 Gil, Jung-gu, Seoul 100-715, Korea
*
Author to whom correspondence should be addressed.
Entropy 2017, 19(4), 179; https://doi.org/10.3390/e19040179
Submission received: 23 November 2016 / Revised: 11 April 2017 / Accepted: 18 April 2017 / Published: 20 April 2017
(This article belongs to the Special Issue Information Theory and 5G Technologies)

Abstract

:
Outage probabilities are important measures of the performance of wireless communication systems, but to obtain outage probabilities it is necessary to first determine detailed system parameters, followed by complicated calculations. When there are multiple candidates of diversity techniques applicable for a system, the diversity order can be used to roughly but quickly compare the techniques for a wide range of operating environments. For a system transmitting over frequency selective fading channels, the diversity order can be defined as the number of multi-paths if multi-paths have all equal energy. However, diversity order may not be adequately defined when the energy values are different. In order to obtain a rough value of diversity order, one may use the number of multi-paths or the reciprocal value of the multi-path energy variance. Such definitions are not very useful for evaluating the performance of diversity techniques since the former is meaningful only when the target outage probability is extremely small, while the latter is reasonable when the target outage probability is very large. In this paper, we propose a new definition of diversity order for frequency selective fading channels. The proposed scheme is based on Renyi entropy, which is widely used in biology and many other fields. We provide various simulation results to show that the diversity order using the proposed definition is tightly correlated with the corresponding outage probability, and thus the proposed scheme can be used for quickly selecting the best diversity technique among multiple candidates.

1. Introduction

The outage probability is a critical measurement for evaluating the performance of wireless communication systems over fading channels. In order to obtain an outage probability, however, it is necessary to determine detailed system parameters, followed by complicated high-precision calculations. On the other hand, a diversity order can be used to roughly but quickly compare multiple diversity techniques for a wide range of system parameters and operating environments [1,2,3,4].
5G cellular communication systems consider various usage scenarios such as enhanced mobile broadband, massive machine type communications, and ultra-reliable and low latency communications [5]. Especially in order to achieve reliable communications over fading channels, various diversity techniques need to be considered including antenna, time, frequency, polarity, angle, and site diversity techniques [6,7,8], and the best scheme or the best combination of techniques should be selected within a short time to satisfy the latency requirement.
If the average energy values of multiple paths are all equal in a frequency selective fading channel, the diversity order can be defined as the number of multi-paths and the outage performance can be reduced as the diversity order becomes larger. However, if the average energy values of multiple paths are different, there is no adequate definition to represent the diversity order. In order to roughly represent the diversity achievable in a frequency selective fading channel, one may use the number of multi-paths regardless of the average energy values of the multi-paths, or some others use the reciprocal value of the multi-path energy variance [9,10,11,12]. Diversity order values produced by these schemes, however, are not tightly correlated with the corresponding outage probabilities, and thus they are not very suitable for evaluating the performance of diversity techniques. In this paper, we propose a new definition of a diversity order for a frequency selective fading channel. The proposed scheme is based on Renyi entropy, which is widely used in biology and many other fields. We provide various simulation results showing that diversity orders using the proposed definition are very useful for comparing diversity techniques. The diversity order obtained from the proposed definition is tightly correlated with the corresponding outage probability, and the proposed scheme can be used for quickly selecting the best diversity technique among multiple candidates.
This paper is organized as follow: Section 2 describes the relationships between the outage probabilities and the diversity orders in frequency selective fading channel environments. Section 3 proposes a new definition of a diversity order based on Renyi entropy for frequency selective fading channels and Section 4 shows the effectiveness of the proposed definition of diversity order through various simulation results. Section 5 provides an application example of the proposed scheme and finally, conclusions are drawn in Section 6.

2. Conventional Definitions of Diversity Order

The average power information of multi-paths in a frequency selective fading channel is called the power delay profile (PDP) and a PDP with L multi-paths can be presented as:
p = P t o t a l [ p 0 , p 1 , , p L 1 ]
where P t o t a l is the total energy of the multi-paths, and the vector [ p 0 , p 1 , , p L 1 ] is assumed to satisfy the following equation:
l = 0 L 1 p l = 1

2.1. Outage Probability

The outage probability for a communication system is the probability that the channel capacity will fail to satisfy its target data transmission rate. When instantaneous channel information is not available but the PDP is given, the outage probability can be calculated as:
p o u t = Pr { W log 2 ( 1 + P t o t a l σ 2 l = 0 L 1 | h l | 2 p l ) < R } = Pr { W log 2 ( 1 + S N R l = 0 L 1 | h l | 2 p l ) < R } = Pr { l = 0 L 1 | h l | 2 p l < ξ }
where h l is an independent complex Gaussian random variable with zero mean and unit variance, R is the target data transmission rate, W is the bandwidth; σ 2 is the noise variance, SNR is the signal-to-noise ratio defined as P t o t a l / σ 2 , and ξ ( 2 R / W 1 ) / S N R . The outage probability in Equation (3) can be calculated with the equations described in [12,13].

2.2. Equal Energy Values of Multi-Paths

If the average energy values of multi-paths in a frequency selective fading channel are all equal, the diversity order can be precisely defined. There are L paths with the same energy, the outage probability can be written as Equation (4) [12] and thus the diversity order can be written as L :
p o u t = 1 ( l = 0 L 1 L ξ Γ ( l + 1 ) ) e L ξ

2.3. Different Energy Values of Multi-Paths

If the average energy values of multi-paths are different, there is no adequate definition of the diversity order. One scheme uses the number of multi-paths as the diversity order as shown in Equation (5) assuming that the operating SNR is very large, in other words, the outage probability is very small [12,14]:
D 0 = L
In Equation (5), the effect of different average energy values of multi-paths are not taken into account and thus it may not be tightly correlated with the outage probability except when the operating SNR is very high and thus all energy values of multi-paths are meaningfully large. Another scheme, called effective frequency diversity, uses the reciprocal value of the multi-path energy variance [10,14,15,16], written as follows:
D 2 = ( l = 0 L 1 p l 2 ) 1
In Equation (6), if the average energy values of multi-paths are all equal, in other words, p l = 1 / L with L multi-paths, the diversity order becomes L , which coincides with the result in Section 2.2. The scheme described in Equation (6) mainly takes into account paths with large average energy values and undervalues the effect of small-energy paths. Therefore, this diversity order is not tightly correlated with the outage probability when the operating SNR is large, where a path with a relatively small energy value can contribute to the reduction of outage probabilities.

3. New Definition of Diversity Order

In this paper, we propose a new definition of a diversity order, which is a superset of the two conventional definitions described in Section 2 and applicable to a wide range of target outage probabilities. In order to define a diversity order, we borrow the definition of Renyi entropy, which is widely used to define a diversity order in biology and many other fields [17,18,19,20,21,22]. Renyi entropy is written as:
H α = 1 1 α log ( i = 1 n ρ i α )   ( 0 α , α 1 )
where ρ i is a probability of an event. The diversity order can be represented as two to the power of Renyi Entropy:
D α = 2 H α = ( l = 0 L 1 ρ l α ) 1 1 α   ( 0 α 2 , α 1 )
Although PDP values are not probabilities but energy values, we can use a similar definition as Renyi entropy for a frequency selective fading channel, written as:
H α = 1 1 α log ( i = 1 n p i α )   ( 0 α , α 1 )
and the diversity order can be expressed as follows:
D α = 2 H α = ( l = 0 L 1 p l α ) 1 1 α   ( 0 α 2 , α 1 )
If the average energy values of multi-paths are all equal, in other words, p l = 1 / L with L paths, the diversity order in Equation (10) becomes L , which also coincides with the result in Section 2.2. Note that in the case of α = 0 , Equation (10) is the same to Equation (5), and in the case of α = 2 , it becomes Equation (6). In Equation (10), α is a value which needs to be determined according to the target outage probability. If a target outage probability is very small, a small α can be used. On the other hand, if it is very large, a large α will be preferred. Equation (10) includes the definitions of Equation (5) (with α = 0 ) and Equation (6) (with α = 2 ), and can be used in a wide range of target outage probabilities assuming that a proper value of α can be chosen.
In order to make diversity orders in Equation (10) highly correlated with the corresponding outage probabilities, it is important to choose a proper value of α . We define mean square error (MSE) as the expected value of the square of the difference between a linear interpolation function of an outage probability and a diversity order obtained from Equation (10), written as:
M S E = E { ( f ( P o u t ( p k ) ) D α ( p k ) ) 2 }
where f is a linear interpolation function created from the cases in which the diversity order is precisely defined, in other words, all paths have equal energy values. To express the equation more clearly, the inverse function of f , denoted as g , is defined as:
g ( D ˜ ) = f 1 ( D ˜ ) = log 10 { P o u t ( p ˜ [ D ˜ ] + 1 ) P o u t ( p ˜ [ D ˜ ] ) } ( D ˜ [ D ˜ ] ) + P o u t ( p ˜ [ D ˜ ] )
where p ˜ L is the PDP with L equal-energy multi-paths. A proper α ( 0 α 2 , α 1 ) can be chosen as the value that minimizes the MSE in Equation (11).

4. Simulation Results

In order to observe the correlation of diversity orders and outage probabilities, PDPs are randomly generated and the corresponding diversity orders and outage probabilities are computed. The ratio of the target data transmission rate and bandwidth (R/W) is assumed to be 2. Figure 1 shows outage probabilities versus diversity orders calculated by Equation (6) when PDPs with 5 multi-paths are generated with random energy values. In the figure, “+” represents the points where the diversity order is clearly defined, in other words, all paths have equal energy values. It can be seen that outage probabilities are widely spread, meaning that diversity orders obtained by Equation (6) is not tightly correlated with the outage probabilities. Increasing the diversity order using Equation (6) may not mean that the outage probability can be reduced. If we use the diversity order definition in Equation (5), all cases in Figure 1 correspond to the diversity order of 5 and the diversity order is not correlated with the outage probabilities.
Figure 2 shows the results generated by Equation (10) with α = 0.57. For each value of a diversity order, the outage probability distribution is far narrower than that in Figure 1 and thus we can say that Equation (10) can provide diversity orders tightly correlated with the corresponding outage probabilities compared to the conventional schemes. The diversity order using Equation (10) with a proper α allows quick performance evaluation of diversity techniques.
A proper value of α according to each target operating SNR can be found by evaluating Equation (11) and selecting the value resulting in the minimum MSE. Figure 3, Figure 4 and Figure 5 show the MSEs in Equation (11) according to α with different SNR values, and each figure includes three curves representing 3, 5, and 7 multi-paths, respectively. Note that the optimal α is highly related to the SNR, but independent of the number of multi-paths. If the operating SNR or target outage probability is given, a proper value of α can be determined regardless of the number of multi-paths.
Figure 6 shows the optimal α values according to SNR. A large value of α is required for low operating SNRs, where the outage probability is relatively large and paths with low average energy values make little contribution to the outage probability. On the other hand, a small value of α is preferred for high operating SNRs, where the average channel energy is sufficiently strong and even a path with a relatively low average energy value can help the reduction of the outage probability.

5. Application of Diversity Order

The proposed definition of a diversity order can be applied for quick evaluation of system performance with multiple candidates of diversity techniques without the determination of detailed system parameters or complicated calculation of exact outage probabilities. For example, the proposed definition can be used to determine the optimal delay value for a delay diversity technique in a multiple input single output (MISO) system. Consider a MISO system with two transmission antennas and one reception antenna, shown in Figure 7. Suppose that the PDP of each antenna is given as:
p single = p t o t a l [ p 0 , p 1 , , p L 1 ] ,
and the PDPs of the two antennas are independent. When the delay diversity technique with the delay of K symbols is applied, the resulting PDP at the receiver can be represented as follows:
p M I S O = 1 2 p t o t a l p sin gle + 1 2 p t o t a l [ 0 , , 0 K , p single ]
Without calculating the exact outage probabilities, the optimal delay value K o p t ( 0 K o p t K max ) can be quickly found by evaluating the diversity order for each K and selecting the maximum:
K o p t = argmax 0 K K max D α ( p M I S O ( K ) )
In the simulation, it was assumed that a single-antenna channel has a cluster exponential distribution, as shown in Figure 8 and the maximum delay value K max is 5. Figure 9 and Figure 10 illustrate the diversity orders and the outage probabilities, respectively, according to the delay value K . Comparing Figure 9 and Figure 10, we can see that maximizing the diversity order can achieve minimizing the outage probability. Therefore, using the new definition of a diversity order, quick evaluation of a large number of diversity techniques can be performed without complicated outage calculation.

6. Conclusions

Diversity orders can be used to roughly but quickly compare multiple candidates of diversity techniques in a wide range of operating environments. For a system transmitting over a frequency selective fading channel, however, if the average energy values of multi-paths are different, the diversity order has not been adequately defined. In this paper, we proposed a new definition of diversity order for a frequency selective fading channel. The proposed scheme is based on Renyi entropy and it produces the diversity order tightly correlated with the outage probability. Hence, the proposed definition of a diversity order can be used to quickly evaluate various frequency diversity techniques without calculating the exact outage probabilities. For example, as described in Section 5, the optimal delay value of a delay diversity technique can be quickly found by computing the diversity orders according to delay values. In the future, more theoretical analysis will be performed for the relationships between diversity orders and outage probabilities.

Acknowledgments

This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIP) (No. 2016R1A2B1008953). This work was also supported by the research program of Dongguk University, 2016.

Author Contributions

Seungyeob Chae and Minjoong Rim conceived and designed the study. Seungyeob Chae and Minjoong Rim conceived and designed the simulations. Seungyeob Chae performed the simulations; Minjoong Rim analyzed the data. Seungyeob Chae wrote the paper. All authors have read and approved the final manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Choi, B. A Dual-User Multiplexing Scheme Using Time Diversity over Frequency Nonselective SIMO Fading Channels. J. Korean Inst. Commun. Inf. Sci. 2013, 38, 127–142. [Google Scholar] [CrossRef]
  2. Chae, S.; Kim, H.; Lim, D.; Rim, M.; Kim, Y. On the Definition of Diversity Order for Frequency Selective Fading Channels. In Proceedings of the KICS ICC, Seoul, Korea, 8–10 February 2012; pp. 250–251. [Google Scholar]
  3. Chae, S.; Yeo, G.; Rim, M.; Chung, S.; Kim, C. Determination of Optimal Number of Physical Layer IDs in Heterogeneous Cooperative Communication Systems. In Proceedings of the KICS ICC, Seoul, Korea, 19–21 June 2013; pp. 141–142. [Google Scholar]
  4. Kim, J.; Lim, J.; Cioffi, J. Capacity Scaling and Diversity Order for Secure Cooperative Relaying with Untrustworthy Relays. IEEE Trans. Commun. 2015, 14, 3866–3876. [Google Scholar] [CrossRef]
  5. Andrews, J.G.; Buzzi, S.; Choi, W.; Hanly, S.V.; Lozano, A.; Soong, A.C.K.; Zhang, J.C. What Will 5 G Be? IEEE J. Sel. Areas Commun. 2014, 32, 1065–1082. [Google Scholar] [CrossRef]
  6. Jiang, S.; Yang, G.; Wei, Y.; Bi, M.; Lu, Y.; Zhou, X.; Hu, M.; Li, Q. Performance Analysis of Space-Diversity Free-Space Optical Links over Exponentiated Weibull channels. IEEE Photonics Technol. Lett. 2015, 27, 2250–2252. [Google Scholar] [CrossRef]
  7. Zhu, B.; Cheng, J.; Al-Dhahir, N.; Wu, L. Asymptotically Tight Error Rate Bounds for Diversity Receptions over Arbitrarily Correlated Rician Channels. In Proceedings of the 2015 IEEE Wireless Communications and Networking Conference (WCNC), New Orleans, LA, USA, 9–12 March 2015; pp. 699–704. [Google Scholar]
  8. Sayed, M.; Sebaali, G.; Evans, B.L.; Al-Dhahir, N. Efficient Diversity Technique for Hybrid Narrowband Powerline Wireless Smart Grid Communications. In Proceedings of the 2015 IEEE International Conference on Smart Grid Communications (SmartGridComm), Miami, FL, USA, 2–5 November 2015; pp. 1–6. [Google Scholar]
  9. Tse, D.; Viswanath, P. Fundamentals of Wireless Communication; Cambridge University Press: Cambridge, UK, 2005; pp. 49–60. [Google Scholar]
  10. Barriac, G.; Madhow, U. Characterizing Outage Rates for Space-Time Communication over Wideband Channels. IEEE Trans. Commun. 2004, 52, 2198–2208. [Google Scholar] [CrossRef]
  11. Boche, H.; Jorswieck, E.A. On the Ergodic Capacity as a Function of the Correlation Properties in Systems with Multiple Transmit Antennas without CSI at the Transmitter. IEEE Trans. Commun. 2004, 52, 1654–1657. [Google Scholar] [CrossRef]
  12. Laneman, J.N. Limiting Analysis of Outage Probabilities for Diversity Schemes in Fading Channels. In Proceedings of the Global Telecommunications Conference, San Francisco, CA, USA, 1–5 December 2003; pp. 1242–1246. [Google Scholar]
  13. Khuong, H.V.; Kong, H.Y. General Expression for pdf of a Sum of Independent Exponential Random Variables. IEEE Commun. Lett. 2006, 10, 159–161. [Google Scholar] [CrossRef]
  14. Liang, Y.C.; Leon, W.S.; Zeng, Y.; Xu, C. Design of Cyclic Delay Diversity for Single Carrier Cyclic Prefix (SCCP) Transmissions with Block-Iterative GDFE (BI-GDFE) Receiver. IEEE Trans. Wirel. Commun. 2008, 7, 677–684. [Google Scholar] [CrossRef]
  15. Kim, Y.; Kim, H.; Rim, M.; Lim, D. On the Optimal Cyclic Delay Value in Cyclic Delay Diversity. IEEE Trans. Broadcast. 2009, 55, 790–795. [Google Scholar]
  16. Yoo, D.S.; Stark, W.E. Characterization of WSSUS Channels: Normalized Mean Square Covariance and Diversity Combining. IEEE Trans. Wirel. Commun. 2005, 4, 1307–1310. [Google Scholar]
  17. Jost, L. Entropy and Diversity. Oikos 2006, 113, 363–375. [Google Scholar] [CrossRef]
  18. Keylock, C.J. Simpson Diversity and the Shannon-Wiener Index as Special Cases of a Generalized Entropy. Oikos 2005, 109, 203–207. [Google Scholar] [CrossRef]
  19. Patil, G.P.; Taillie, C. Diversity and its Measurement. JASA 1982, 77, 548–561. [Google Scholar] [CrossRef]
  20. Kim, Y.; Rim, M.; Jin, X.; Lim, D. On the Relation between Outage Probability and Effective Frequency Diversity Order. Appl. Math. Inf. Syst. 2014, 8, 2667–2673. [Google Scholar] [CrossRef]
  21. Leinster, T.; Meckes, M.W. Maximizing Diversity in Biology and Beyond. Entropy 2016, 18, 88. [Google Scholar] [CrossRef]
  22. Guariglia, E. Entropy and Fractal Antennas. Entropy 2016, 18, 84. [Google Scholar] [CrossRef]
Figure 1. Outage probabilities versus diversity orders calculated using Equation (6) (or Equation (10) with α = 2 ), SNR = 17.8 dB.
Figure 1. Outage probabilities versus diversity orders calculated using Equation (6) (or Equation (10) with α = 2 ), SNR = 17.8 dB.
Entropy 19 00179 g001
Figure 2. Outage probabilities versus diversity orders calculated using Equation 10 with α = 0.57 , SNR = 17.8 dB.
Figure 2. Outage probabilities versus diversity orders calculated using Equation 10 with α = 0.57 , SNR = 17.8 dB.
Entropy 19 00179 g002
Figure 3. Mean square errors according to α (SNR = 7.8 dB).
Figure 3. Mean square errors according to α (SNR = 7.8 dB).
Entropy 19 00179 g003
Figure 4. Mean square errors according to α (SNR = 10.8 dB).
Figure 4. Mean square errors according to α (SNR = 10.8 dB).
Entropy 19 00179 g004
Figure 5. Mean square errors according to α (SNR = 17.8 dB).
Figure 5. Mean square errors according to α (SNR = 17.8 dB).
Entropy 19 00179 g005
Figure 6. Optimal α according to operating SNR.
Figure 6. Optimal α according to operating SNR.
Entropy 19 00179 g006
Figure 7. Power delay profile for each antenna with delay diversity.
Figure 7. Power delay profile for each antenna with delay diversity.
Entropy 19 00179 g007
Figure 8. PDP for a single transmission antenna.
Figure 8. PDP for a single transmission antenna.
Entropy 19 00179 g008
Figure 9. Diversity orders according to delay.
Figure 9. Diversity orders according to delay.
Entropy 19 00179 g009
Figure 10. Outage probabilities according to delay.
Figure 10. Outage probabilities according to delay.
Entropy 19 00179 g010

Share and Cite

MDPI and ACS Style

Chae, S.; Rim, M. On the Definition of Diversity Order Based on Renyi Entropy for Frequency Selective Fading Channels. Entropy 2017, 19, 179. https://doi.org/10.3390/e19040179

AMA Style

Chae S, Rim M. On the Definition of Diversity Order Based on Renyi Entropy for Frequency Selective Fading Channels. Entropy. 2017; 19(4):179. https://doi.org/10.3390/e19040179

Chicago/Turabian Style

Chae, Seungyeob, and Minjoong Rim. 2017. "On the Definition of Diversity Order Based on Renyi Entropy for Frequency Selective Fading Channels" Entropy 19, no. 4: 179. https://doi.org/10.3390/e19040179

APA Style

Chae, S., & Rim, M. (2017). On the Definition of Diversity Order Based on Renyi Entropy for Frequency Selective Fading Channels. Entropy, 19(4), 179. https://doi.org/10.3390/e19040179

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop