KQI Performance Evaluation of 3GPP LBT Priorities for Indoor Unlicensed Coexistence Scenarios
Abstract
:1. Introduction
2. Unlicensed Medium Access Mechanisms
2.1. 3GPP Standards
- Category 1: No LBT procedure is performed
- Category 2: LBT without random backoff with deterministic waiting time when the channel is found free
- Category 3: LBT with random backoff and fixed contention window size
- Category 4: LBT with random backoff and variable contention window size
2.2. WiFi
3. Evaluation Framework
4. Performance Indicators
4.1. Key Quality Indicators
- Peak Signal Noise Ratio (PSNR) is a measure that compares the video signal pixel by pixel and frame by frame. It is totally blind to the spatial and temporal relationships between pixels and, as a result, very diverse distortions that clearly produce very different quality perceptions get similar values of PSNR.
- Frame Loss Ratio (FLR) represents the ratio between the number of frames that have errors and the total number of frames sent.
- Delay is the time (ms) required to transmit a frame along its entire end-to-end network path.
- Jitter refers to the variation in delay time in milliseconds between video frames when transmitted over a network.
4.2. Background Traffic User Performance Indicators
4.3. Fairness
Algorithm 1: Fairness evaluation |
Input: Performance UPI values (throughput and latency) measured at IP level |
Output: Null hypothesis, P-value, Dmax |
1 Compute UPI ECDF of the different flows of background traffic through the WiFi network of the operator B, when it coexists with the WiFi network of the operator A, and use it as a baseline (W+L scenario) |
2 Perform step 1 for the case when the WiFi network of the Operator B coexists with the LBT network of the Operator A (L+W) |
3 Run a two-sided sample Kolgomorov–Smirnov test |
4 Calculate P and Dmax values |
5 Accept or reject the null hypothesis (both distributions are similar or fair) based on P-value |
6 In case of null hypothesis rejection compare Dmax wih value |
5. Performance Assessment
5.1. Scenario
5.2. Background Traffic (Load)
5.3. User Traffic
5.4. Fairness
6. Conclusions
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
Abbreviations
3GPP | Third Generation Partnership Project |
AM | Acknowledged Mode (RLC) |
AP | Access Point |
ARQ | Automatic Repeat Request |
BER | Bit Error Rate |
BLER | Block Error Rate |
BS | Base Station |
CCA | Clear Channel Assessment |
CDF | Cumulative probability Distribution Function |
CQI | Channel Quality Indicator |
CS | Carrier Sense |
CSI | Channel State Information |
CSI-RS | Channel State Information Reference Signal |
CSMA | Carrier Sense Multiple Access |
CW | Contention Window |
DCI | Downlink Control Information |
DRS | Discovery Reference Signal |
DSCH | Downlink Shared Data Channel |
ED | Energy Detection |
eLAA | Enhanced Licensed Assisted Access |
FeLAA | Further Enhanced Licensed Assisted Access |
FTP | File Transfer Protocol |
KQI | Key Quality Indicator |
K-S | Kolmogorov-Smirnov |
LAA | Licensed Assisted Access |
LBT | Listen Before Talk |
LSM | Link-to-System-Mapping |
LTE | Long-Term Evolution |
MCOT | Maximum Channel Occupancy Time |
MCS | Modulation and Coding Scheme |
MIESM | Mutual Information Effective SINR Metric |
MIMO | Multiple Input Multiple Output |
NR-U | New Radio Unlicensed |
PF | Proportional Fair |
PDSCH | Physical Downlink Shared Channel |
QoE | Quality of Experience |
QoS | Quality of Service |
RLC | Radio Link Control |
RRM | Radio Resource Management |
RTVS | Real Time Video Streaming |
SINR | Signal to Interference Noise Ratio |
SISO | Single Input Single Output |
SRS | Sounding Reference Signal |
STA | WiFi Station |
TxOP | Transmission Opportunity |
UE | User Equipment |
UPI | User Performance Indicator |
W+L | WiFi and LBT coexistence scenario |
W+W | WiFi and WiFi coexistence scenario |
References
- Whitepaper, C. Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2016–2021. 2016. Available online: http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white_paper_c11-520862.pdf (accessed on 15 January 2020).
- 3GPP. Evolution of LTE in release 13. 3GPP News RP-170848, 3rd Generation Partnership Project (3GPP). 2015. Available online: https://www.3gpp.org/ftp/tsg_ran/TSG_RAN/TSGR_75/Docs/RP-170848.zip (accessed on 15 January 2020).
- IEEE. Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications; IEEE: Piscataway, NJ, USA, 1999. [Google Scholar]
- MulteFire Release 1.1 Technical Overview. White paper, MulteFire Alliance. 2020. Available online: https://www.multefire.org/wp-content/uploads/MulteFire_Release-1.1_WhitePaper_03DEC2018.pdf (accessed on 15 January 2020).
- 3GPP. Physical Layer Procedures for Shared Spectrum Channel Access. Technical specification (TS) 37.213, 3rd Generation Partnership Project (3GPP). 2020. Available online: https://www.3gpp.org/ftp//Specs/archive/37_series/37.213/37213-g30.zip (accessed on 15 January 2020).
- 3GPP. LTE Evolved Universal Terrestrial Radio Access (E-UTRA); Radio Link Control (RLC) protocol specification. Technical specification (TS) 36.322, 3rd Generation Partnership Project (3GPP). 2018. Available online: https://www.3gpp.org/ftp//Specs/archive/36_series/36.322/36322-f30.zip (accessed on 15 January 2020).
- Bianchi, G.; Tinnirello, I.; Scalia, L. Understanding 802.11e contention-based prioritization mechanisms and their coexistence with legacy 802.11 stations. IEEE Netw. 2005, 19, 28–34. [Google Scholar] [CrossRef]
- Zinno, S.; Stasi, G.D.; Avallone, S.; Ventre, G. On a fair coexistence of LTE and Wi-Fi in the unlicensed spectrum: A Survey. Comput. Commun. 2018, 115. [Google Scholar] [CrossRef]
- Naik, G.; Liu, J.; Park, J.J. Coexistence of Wireless Technologies in the 5 GHz Bands: A Survey of Existing Solutions and a Roadmap for Future Research. IEEE Commun. Surv. Tutor. 2018, 20, 1777–1798. [Google Scholar] [CrossRef]
- Bitar, N.; Al Kalaa, M.O.; Seidman, S.J.; Refai, H.H. On the Coexistence of LTE-LAA in the Unlicensed Band: Modeling and Performance Analysis. IEEE Access 2018, 6, 52668–52681. [Google Scholar] [CrossRef]
- Cano, C.; Leith, D.J.; Garcia-Saavedra, A.; Serrano, P. Fair Coexistence of Scheduled and Random Access Wireless Networks: Unlicensed LTE/WiFi. IEEE ACM Trans. Netw. 2017, 25, 3267–3281. [Google Scholar] [CrossRef] [Green Version]
- De Santana, P.M.; De Lima Melo, V.D.; De Sousa, V.A. Performance of License Assisted Access Solutions Using ns-3. In Proceedings of the 2016 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA, 15–17 December 2016; pp. 941–946. [Google Scholar]
- Bojovic, B.; Giupponi, L.; Ali, Z.; Miozzo, M. Evaluating Unlicensed LTE Technologies: LAA vs LTE-U. IEEE Access 2019, 7, 89714–89751. [Google Scholar] [CrossRef]
- 67, G.R. RP-150271. Status Report to TSG: Study on Licensed-Assisted Access to Unlicensed Spectrum. Technical report, 3GPP, 2015. Available online: https://www.3gpp.org/ftp/tsg_ran/TSG_RAN/TSGR_67/Docs/RP-150271.zip (accessed on 15 January 2020).
- 3GPP. Study on NR-based access to unlicensed spectrum. Technical Report (TR) 38.889, 3rd Generation Partnership Project (3GPP). 2018. Available online: https://www.3gpp.org/ftp//Specs/archive/38_series/38.889/38889-g00.zip (accessed on 15 June 2020).
- Ajami, A.; Artail, H. Performance bounds of different channel access priority classes in future Licensed Assisted Access (LAA) LTE networks. Phys. Commun. 2017, 25, 110–127. [Google Scholar] [CrossRef]
- Bianchi, G. Performance analysis of the IEEE 802.11 distributed coordination function. IEEE J. Sel. Areas Commun. 2000, 18, 535–547. [Google Scholar] [CrossRef]
- Riley, G.F.; Henderson, T.R. The ns-3 network simulator. In Modeling and Tools for Network Simulation; Springer: Berlin, Germany, 2010; pp. 15–34. [Google Scholar]
- Kumbhar, F.H.; Saxena, N.; Roy, A. Reliable Relay: Autonomous Social D2D Paradigm for 5G LoS Communications. IEEE Commun. Lett. 2017, 21, 1593–1596. [Google Scholar] [CrossRef]
- Klaue, J.; Rathke, B.; Wolisz, A. Evalvid–A Framework for Video Transmission and Quality Evaluation; Springer: Berlin, Germany, 2003; pp. 255–272. [Google Scholar]
- Giupponi, L.; Henderson, T.; Bojovic, B.; Miozzo, M. Simulating LTE and Wi-Fi Coexistence in Unlicensed Spectrum with ns-3. arXiv 2016, arXiv:1604.06826. [Google Scholar]
- 3GPP. Feasibility Study on Licensed-Assisted Access to Unlicensed Spectrum. Technical Report (TR) 36.889, 3rd Generation Partnership Project (3GPP). 2015. Available online: https://www.3gpp.org/ftp/Specs/archive/36_series/36.889/36889-d00.zip (accessed on 15 January 2020).
- Rupp, M.; Schwarz, S.; Taranetz, M. The Vienna LTE-Advanced Simulators: Up and Downlink, Link and System Level Simulation, 1st ed.; Springer: Berlin, Germany, 2016. [Google Scholar] [CrossRef]
- Mezzavilla, M.; Miozzo, M.; Rossi, M.; Baldo, N.; Zorzi, M. A Lightweight and Accurate Link Abstraction Model for the Simulation of LTE Networks in Ns-3; Association for Computing Machinery: New York, NY, USA, 2012; MSWiM 12; pp. 55–60. [Google Scholar] [CrossRef]
- Catreux, S.; Greenstein, L.J.; Erceg, V. Some results and insights on the performance gains of MIMO systems. IEEE J. Sel. Areas Commun. 2003, 21, 839–847. [Google Scholar] [CrossRef]
- 3GPP. Study on Key Quality Indicators (KQIs) for Service Experience. Technical Report (TR) 32.862, 3rd Generation Partnership Project (3GPP). 2016. Available online: https://www.3gpp.org/ftp/Specs/archive/32_series/32.862/32862-e00.zip (accessed on 15 January 2020).
- Alliance, N.G.M.N. Recommendations for NGMN KPIs and requirements for 5G. Whitepaper 2016. Available online: https://www.ngmn.org/wp-content/uploads/Publications/2016/160603_Annex_NGMN_Liaison_to_3GPP_RAN_72_v1_0.pdf (accessed on 15 January 2020).
- ETSI. Speech and Multimedia Transmission Quality (STQ); QoS Aspects for Popular Services in Mobile Networks. Technical Specification (TS) TS 102 250-1, European Telecommunications Standards Institute (ETSI). 2011. Available online: https://www.etsi.org/deliver/etsi_ts/102200_102299/10225001/02.02.01_60/ts_10225001v020201p.pdf (accessed on 15 January 2020).
- Akramullah, S. Digital Video Concepts, Methods, and Metrics: Quality, Compression, Performance, and Power Trade-Off Analysis; Apress: New York, NY, USA, 2014. [Google Scholar]
- Carneiro, G.; Fortuna, P.; Ricardo, M. FlowMonitor: A Network Monitoring Framework for the Network Simulator 3 (NS-3). In Proceedings of the Fourth International ICST Conference on Performance Evaluation Methodologies and Tools, Pisa, Italy, 20–22 October 2009; ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering): Brussels, Belgium, 2009. VALUETOOLS ’09. [Google Scholar] [CrossRef] [Green Version]
- SHI, H.; Prasad, R.V.; Onur, E.; Niemegeers, I.G.M.M. Fairness in Wireless Networks: Issues, Measures and Challenges. IEEE Commun. Surv. Tutor. 2014, 16, 5–24. [Google Scholar]
- Mehrnoush, M.; Roy, S.; Sathya, V.; Ghosh, M. On the Fairness of Wi-Fi and LTE-LAA Coexistence. IEEE Trans. Cogn. Commun. Netw. 2018, 4, 735–748. [Google Scholar] [CrossRef] [Green Version]
- Ali, Z.; Bojovic, B.; Giupponi, L.; Bafalluy, J.M. On Fairness Evaluation: LTE-U vs. LAA. In Proceedings of the 14th ACM International Symposium on Mobility Management and Wireless Access, Malta, 13–17 November 2016; Association for Computing Machinery: New York, NY, USA, 2016; MobiWac 16, pp. 163–168. [Google Scholar] [CrossRef]
- Hossfeld, T.; Skorin-Kapov, L.; Heegaard, P.E.; Varela, M. Definition of QoE Fairness in Shared Systems. IEEE Commun. Lett. 2017, 21, 184–187. [Google Scholar]
- Kim, C.; Yang, C.; Kang, C. Adaptive Listen-Before-Talk (LBT) scheme for LTE and Wi-Fi systems coexisting in unlicensed band. In Proceedings of the 2016 13th IEEE Annual Consumer Communications and Networking Conference, Las Vegas, NA, USA, 9–12 January 2016; pp. 589–594. [Google Scholar] [CrossRef]
- Mehrnoush, M.; Sathya, V.; Roy, S.; Ghosh, M. Analytical Modeling of Wi-Fi and LTE-LAA Coexistence: Throughput and Impact of Energy Detection Threshold. IEEE ACM Trans. Netw. 2018, 26, 1990–2003. [Google Scholar] [CrossRef] [Green Version]
- Xia, P.; Teng, Z.; Wu, J. How loud to talk and how hard to listen-before-talk in unlicensed LTE. In Proceedings of the 2015 IEEE International Conference on Communication Workshop (ICCW), London, UK, 8–12 June 2015; pp. 2314–2319. [Google Scholar] [CrossRef]
Priority Class (p) | CWmin | CWmax | MCOT |
---|---|---|---|
1 | 3 | 7 | 2 ms |
2 | 7 | 15 | 3 ms |
3 | 15 | 63 | 8 ms |
4 | 15 | 1023 | 8 ms |
Service | Category | Parameter | Unit | Reference |
---|---|---|---|---|
Real Time Video Streaming | KQI-Integrity | Frame Loss Ratio | (%) | [27] |
Cumulative Jitter | (ms) | [28] | ||
Frame end-to-end delay | (ms) | [28] | ||
Peak signal-to-noise ratio (PSNR) | 0–5 | [29] | ||
File Transfer Protocol (FTP) | KQI-Integrity | File Transfer average throughput | (Mbps) | [26] |
File Transfer Delay | (s) | [26] |
Parameter | 3GPP LBT | WiFi |
---|---|---|
Standard version | Rel.13 | 802.11ac |
MCS selection Scheme | Adaptive based on SINR (AMC) with BER= 1 × 10-5 | |
Frequency | 5180 MHz | 5180 MHz |
Bandwidth | 20 MHz | 20 MHz |
Max power TX (dBm) | 18 dBm | 18 dBm |
Antenna gain (dBi) | 5 dBi base stations | |
Antenna type | Omnidirectional | Omnidirectional |
Thresholds CCA (dBm) | ED (−72 dBm) | (PD, ED) = (−82, −72) dBm |
Antenna configuration | MIMO 2 × 2 | MIMO 2 × 2 |
Minimum duration of sensing period | 34 us | 43 us |
Channel model | ITU InH IEEE | |
User distribution | Uniform random distribution | |
Noise figure in UE | 9 dB (−104 dBm noise floor) | |
DRS, Packet Scheduler | 80 ms, Proportional Fair | N/A |
CW Updating Rule | “any NACK” (to detect collisions) | N/A |
3GPP LBT p(1) | 3GPP LBT p(2) | 3GPP LBT p(3) | 3GPP LBT p(4) | D | |||||
---|---|---|---|---|---|---|---|---|---|
D-max | p-Value | D-max | p-Value | D-max | p-Value | D-max | p-Value | ||
Throughput | 0.32860 | 5.73e-98 | 0.31439 | 1.03 e-98 | 0.292340 | 1.25 e-78 | 0.294113 | 1.44e-77 | 0.02371 |
Latency | 0.28093 | 1.01e-71 | 0.25849 | 8.68 e-61 | 0.24505 | 1.13e-54 | 0.24682 | 1.85e-55 | 0.02371 |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Baena, E.; Fortes, S.; Barco, R. KQI Performance Evaluation of 3GPP LBT Priorities for Indoor Unlicensed Coexistence Scenarios. Electronics 2020, 9, 1701. https://doi.org/10.3390/electronics9101701
Baena E, Fortes S, Barco R. KQI Performance Evaluation of 3GPP LBT Priorities for Indoor Unlicensed Coexistence Scenarios. Electronics. 2020; 9(10):1701. https://doi.org/10.3390/electronics9101701
Chicago/Turabian StyleBaena, Eduardo, Sergio Fortes, and Raquel Barco. 2020. "KQI Performance Evaluation of 3GPP LBT Priorities for Indoor Unlicensed Coexistence Scenarios" Electronics 9, no. 10: 1701. https://doi.org/10.3390/electronics9101701
APA StyleBaena, E., Fortes, S., & Barco, R. (2020). KQI Performance Evaluation of 3GPP LBT Priorities for Indoor Unlicensed Coexistence Scenarios. Electronics, 9(10), 1701. https://doi.org/10.3390/electronics9101701