research-article

The First 5G-LTE Comparative Study in Extreme Mobility

Authors:

Chenren XuAuthors Info & Claims

Proceedings of the ACM on Measurement and Analysis of Computing Systems, Volume 6, Issue 1

Article No.: 20, Pages 1 - 22

https://doi.org/10.1145/3508040

Published: 28 February 2022 Publication History

Abstract

5G claims to support mobility up to 500 km/h according to the 3GPP standard. However, its field performance under high-speed scenes remains in mystery. In this paper, we conduct the first large-scale measurement campaign on a high-speed railway route operating at the maximum speed of 350 km/h, with full coverage of LTE and 5G (NSA and SA) along the track. Our study consumed 1788.8 GiB of cellular data in six months, covering the three major carriers in China and the recent standardized QUIC protocol. Based on our dataset, we reveal the key characteristics of 5G and LTE in extreme mobility in terms of throughput, RTT, loss rate, signal quality, and physical resource utilization. We further develop a taxonomy of handovers in both LTE and 5G and carry out the link-layer latency breakdown analysis. Our study pinpoints the deficiencies in the user equipment, radio access network, and core network which hinder seamless connectivity and better utilization of 5G's high bandwidth. Our findings highlight the directions of the next step in the 5G evolution.

References

[1]

5GAA. 2019. C-v2x use cases methodology, examples and service level requirements. https://5gaa.org/wp-content/uploads/2019/07/5GAA_191906_WP_CV2X_UCs_v1--3--1.pdf

[2]

The California High-Speed Rail Authority. 2021. 2021 sustainability report . https://hsr.ca.gov/wp-content/uploads/2021/09/Sustainability_Report_2021.pdf

[3]

Abdelhak Bentaleb, Mehmet N Akcay, May Lim, Ali C Begen, and Roger Zimmermann. 2021. Catching the Moment with LoL

[4]

in Twitch-Like Low-Latency Live Streaming Platforms. IEEE Transactions on Multimedia (2021).

[5]

China.org. 2021. Over 100 5G base stations installed for 2022 Winter Olympics . http://www.china.org.cn/business/2021-06/18/content_77575629.htm

[6]

Dash-Industry-Forum. 2022. DASH.js . https://github.com/Dash-Industry-Forum/dash.js?

[7]

Korian Edeline, Mirja Kühlewind, Brian Trammell, and Benoit Donnet. 2017. copycat: Testing differential treatment of new transport protocols in the wild. In ACM/IRTF ANRW .

[8]

ffmpeg team. 2022. FFmpeg project . https://ffmpeg.org/

[9]

Google. 2016. BBR Congestion Control Algorithm . https://github.com/google/bbr

[10]

Google. 2021. QUICHE, quic_protocol_flags_list.h . https://quiche.googlesource.com/quiche/

[11]

/2403dac9448364d083c36bf9f0045d4accfae3de/quic/core/quic_protocol_flags_list.h#240

[12]

Google. 2022. ChromeDriver . https://chromium.googlesource.com/chromium/src/

[13]

/refs/heads/main/chrome/test/chromedriver

[14]

Z. Hrebicek, Y. Crozet, C. Cheze, L. Guihery, M. Reichenbach, C. Desmaris, K. Anderton, and L. Krejci. 2014. RANSFORuM Roadmap High-speed Rail. Cologne / Koln: Rupprecht Consult . http://www.rupprecht-consult.eu/uploads/tx_rupprecht/TRANSFORuM_D7--7_Roadmap_HSR.pdf

[15]

F5 Inc. 2022. Nginx . https://www.nginx.com/

[16]

Theo Karagkioules, Rufael Mekuria, Dirk Griffioen, and Arjen Wagenaar. 2020. Online learning for low-latency adaptive streaming. In ACM MMSys .

[17]

Li Li, Ke Xu, Tong Li, Kai Zheng, Chunyi Peng, Dan Wang, Xiangxiang Wang, Meng Shen, and Rashid Mijumbi. 2018. A measurement study on multi-path TCP with multiple cellular carriers on high speed rails. In ACM SIGCOMM .

[18]

Yang Li, Hao Lin, Zhenhua Li, Yunhao Liu, Feng Qian, Liangyi Gong, Xianlong Xin, and Tianyin Xu. 2021. A nationwide study on cellular reliability: measurement, analysis, and enhancements. In ACM SIGCOMM .

[19]

Yuanjie Li, Chunyi Peng, Zengwen Yuan, Jiayao Li, Haotian Deng, and Tao Wang. 2016. Mobileinsight: Extracting and analyzing cellular network information on smartphones. In ACM MobiCom .

Digital Library

[20]

LSQUIC. 2021. lsquic_bbr.c . https://github.com/litespeedtech/lsquic/blob/082507cd1032c90cefc0a9cad845c5fdeae53f86/src/liblsquic/lsquic_bbr.c#L73-L74

[21]

China Mobile. 2021. Small classroom for 5G common questions . https://www.10086.cn/5G/qna/?headrndnum=0.09984317695903178

[22]

Arvind Narayanan, Eman Ramadan, Jason Carpenter, Qingxu Liu, Yu Liu, Feng Qian, and Zhi-Li Zhang. 2020. A first look at commercial 5G performance on smartphones. In ACM WWW .

[23]

Arvind Narayanan, Xumiao Zhang, Ruiyang Zhu, Ahmad Hassan, Shuowei Jin, Xiao Zhu, Xiaoxuan Zhang, Denis Rybkin, Zhengxuan Yang, Zhuoqing Morley Mao, et almbox. 2021. A variegated look at 5G in the wild: performance, power, and QoE implications. In ACM SIGCOMM .

[24]

Jakob Nielsen. 1994. Usability engineering .Morgan Kaufmann.

[25]

The State Council of the People's Republic of China. 2016. Medium- and Long-Term Railway Network Plan . https://www.gov.cn/xinwen/2016-07/20/5093165/files/1ebe946db2aa47248b799a1deed88144.pdf

[26]

Kevin Spiteri, Ramesh Sitaraman, and Daniel Sparacio. 2019. From theory to practice: Improving bitrate adaptation in the DASH reference player. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Vol. 15, 2s (2019).

[27]

Kevin Spiteri, Rahul Urgaonkar, and Ramesh K Sitaraman. 2020. BOLA: Near-optimal bitrate adaptation for online videos. IEEE/ACM Transactions on Networking, Vol. 28, 4 (2020).

Digital Library

[28]

Statista. 2021. Share of telecommunication 4G mobile users among all mobile internet users in China . https://www.statista.com/statistics/1109550/china-number-of-4g-mobile-subscirbers-share/

[29]

VentureBeat. 2021. Comcast: Pandemic drove peak internet traffic up 32% in 2020 . https://venturebeat.com/2021/03/02/comcast-peak-internet-traffic-rose-32-in-pandemic-in-2020/

[30]

Jing Wang, Yufan Zheng, Yunzhe Ni, Chenren Xu, Feng Qian, Wangyang Li, Wantong Jiang, Yihua Cheng, Zhuo Cheng, Yuanjie Li, et almbox. 2019. An active-passive measurement study of tcp performance over lte on high-speed rails. In ACM MobiCom .

[31]

Wikipeida. 2021. IMT-2020 . https://en.wikipedia.org/wiki/IMT-2020

[32]

Chenren Xu, Jing Wang, Zhiyao Ma, Yihua Cheng, Yunzhe Ni, Wangyang Li, Feng Qian, and Yuanjie Li. 2020 a. A first look at disconnection-centric TCP performance on high-speed railways. IEEE Journal on Selected Areas in Communications, Vol. 38, 12 (2020).

[33]

Dongzhu Xu, Anfu Zhou, Xinyu Zhang, Guixian Wang, Xi Liu, Congkai An, Yiming Shi, Liang Liu, and Huadong Ma. 2020 b. Understanding operational 5g: A first measurement study on its coverage, performance and energy consumption. In ACM SIGCOMM .

[34]

Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A control-theoretic approach for dynamic adaptive video streaming over HTTP. In ACM SIGCOMM .

[35]

Youtube. 2022. Recommended upload encoding settings . https://support.google.com/youtube/answer/1722171#zippy=%2Cbitrate

Cited By

Olliaro DMancuso VCastagno PSereno MMarsan M(2024)Gaming on the Edge: Performance Issues of Distributed Online Gaming2024 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking62109.2024.10619768(259-267)Online publication date: 3-Jun-2024
https://doi.org/10.23919/IFIPNetworking62109.2024.10619768
Mustafa RBarakat CRothenberg C(2024)YouTube goes 5G: QoE Benchmarking and ML-based Stall Prediction2024 IEEE Wireless Communications and Networking Conference (WCNC)10.1109/WCNC57260.2024.10571175(01-06)Online publication date: 21-Apr-2024
https://doi.org/10.1109/WCNC57260.2024.10571175
Mishra SZanella AMartínez-Durive OMadariaga DZiemlicki CFiore M(2024)Characterizing 5G Adoption and its Impact on Network Traffic and Mobile Service ConsumptionIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621344(1531-1540)Online publication date: 20-May-2024
https://doi.org/10.1109/INFOCOM52122.2024.10621344
Show More Cited By

Index Terms

The First 5G-LTE Comparative Study in Extreme Mobility
1. Networks
  1. Network performance evaluation
    1. Network measurement
    2. Network performance analysis

Recommendations

Vivisecting mobility management in 5G cellular networks
SIGCOMM '22: Proceedings of the ACM SIGCOMM 2022 Conference

With 5G's support for diverse radio bands and different deployment modes, e.g., standalone (SA) vs. non-standalone (NSA), mobility management - especially the handover process - becomes far more complex. Measurement studies have shown that frequent ...
The First 5G-LTE Comparative Study in Extreme Mobility
SIGMETRICS/PERFORMANCE '22: Abstract Proceedings of the 2022 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems

5G claims to support mobility up to 500 km/h according to the 3GPP standard. However, its field performance under high-speed scenes remains in mystery. In this paper, we conduct the first large-scale measurement campaign on a high-speed railway route ...
The First 5G-LTE Comparative Study in Extreme Mobility
SIGMETRICS '22

5G claims to support mobility up to 500 km/h according to the 3GPP standard. However, its field performance under high-speed scenes remains in mystery. In this paper, we conduct the first large-scale measurement campaign on a high-speed railway route ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Measurement and Analysis of Computing Systems

Proceedings of the ACM on Measurement and Analysis of Computing Systems Volume 6, Issue 1

POMACS

March 2022

695 pages

EISSN:2476-1249

DOI:10.1145/3522731

Editors:
Augustin Chaintreau
Columbia University
,
Leana Golubchik
University of Southern California
,
Zhi-Li Zhang
University of Minnesota

Issue’s Table of Contents

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 February 2022

Published in POMACS Volume 6, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Key Research and Development Plan China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
759
Total Downloads

Downloads (Last 12 months)168
Downloads (Last 6 weeks)15

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Olliaro DMancuso VCastagno PSereno MMarsan M(2024)Gaming on the Edge: Performance Issues of Distributed Online Gaming2024 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking62109.2024.10619768(259-267)Online publication date: 3-Jun-2024
https://doi.org/10.23919/IFIPNetworking62109.2024.10619768
Mustafa RBarakat CRothenberg C(2024)YouTube goes 5G: QoE Benchmarking and ML-based Stall Prediction2024 IEEE Wireless Communications and Networking Conference (WCNC)10.1109/WCNC57260.2024.10571175(01-06)Online publication date: 21-Apr-2024
https://doi.org/10.1109/WCNC57260.2024.10571175
Mishra SZanella AMartínez-Durive OMadariaga DZiemlicki CFiore M(2024)Characterizing 5G Adoption and its Impact on Network Traffic and Mobile Service ConsumptionIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621344(1531-1540)Online publication date: 20-May-2024
https://doi.org/10.1109/INFOCOM52122.2024.10621344
Pan WLiu Z(2023)Switching Constrained Online Convex Optimization with Predictions and Feedback DelaysACM SIGMETRICS Performance Evaluation Review10.1145/3626570.362657351:2(3-5)Online publication date: 2-Oct-2023
https://dl.acm.org/doi/10.1145/3626570.3626573
Arnab AMa KShuvro ALeung H(2023)Comparison of 4G LTE and 5G NR in UAV Networks: A Simu5G-Based Performance Evaluation2023 IEEE 9th World Forum on Internet of Things (WF-IoT)10.1109/WF-IoT58464.2023.10539559(1-6)Online publication date: 12-Oct-2023
https://doi.org/10.1109/WF-IoT58464.2023.10539559
Annam SMithillesh Kumar P(2023)Clustering-Based Analysis on 5G Networks: A Comparison2023 4th International Conference on Electronics and Sustainable Communication Systems (ICESC)10.1109/ICESC57686.2023.10193024(589-593)Online publication date: 6-Jul-2023
https://doi.org/10.1109/ICESC57686.2023.10193024
Li RPan YMa XXu HXu C(2023)TCP-LTE/5 G Cross-layer performance analysis tool for high mobility data networking and a case study on high-speed railwayHigh-speed Railway10.1016/j.hspr.2023.05.0021:2(141-146)Online publication date: Jun-2023
https://doi.org/10.1016/j.hspr.2023.05.002
Fiandrino CMartínez-Villanueva DWidmer J(2023)A study on 5G performance and fast conditional handover for public transit systemsComputer Communications10.1016/j.comcom.2023.07.020209:C(499-512)Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.1016/j.comcom.2023.07.020
Nakazato JNakagawa KItoh KFontugne RTsukada MEsaki H(2023)WebRTC over 5 G: A Study of Remote Collaboration QoS in Mobile EnvironmentJournal of Network and Systems Management10.1007/s10922-023-09778-532:1Online publication date: 24-Oct-2023
https://dl.acm.org/doi/10.1007/s10922-023-09778-5
Pan WShi GLin YWierman A(2022)Online Optimization with Feedback Delay and Nonlinear Switching CostACM SIGMETRICS Performance Evaluation Review10.1145/3547353.352265750:1(81-82)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3547353.3522657

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents