Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3503161.3548436acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article
Open access

Learned Internet Congestion Control for Short Video Uploading

Published: 10 October 2022 Publication History

Abstract

Short video uploading service has become increasingly important, as at least 30 million videos are uploaded per day. However, we find that existing congestion control (CC) algorithms, either heuristics or learning-based, are not applicable for video uploading -- i.e., lacking in the design of the fundamental mechanism and being short of leveraging network modeling. We present DuGu, a novel learning-based CC algorithm designed by considering the unique proprieties of video uploading via the probing phase and internet networking via the control phase. During the probing phase, DuGu leverages the transmission gap of uploading short videos to actively detect the network metrics to better understand network dynamics. DuGu uses a neural network~(NN) to avoid congestion during the control phase. Here, instead of using handcrafted reward functions, the NN is learned by imitating the expert policy given by the optimal solver, improving both performance and learning efficiency. To build this system, we construct an omniscient-like network emulator, implement an optimal solver and collect a large corpus of real-world network traces to learn expert strategies. Trace-driven and real-world A/B tests reveal that DuGu supports multi-objective and rivals or outperforms existing CC algorithms across all considered scenarios.

Supplementary Material

MP4 File (mm222-fp3267.mp4)
Presentation Video for "learned internet congestion control for short video uploading".

References

[1]
2022. Kuaishou. https://kuaishou.com.
[2]
2022. Tiktok Technology. https://tiktok.com.
[3]
Soheil Abbasloo, Chen-Yu Yen, and H Jonathan Chao. 2020. Classic meets modern: A pragmatic learning-based congestion control for the Internet. In Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication. 632--647.
[4]
Soheil Abbasloo, Chen-Yu Yen, and H Jonathan Chao. 2020. Wanna Make Your TCP Scheme Great for Cellular Networks? Let Machines Do It for You! IEEE Journal on Selected Areas in Communications 39, 1 (2020), 265--279.
[5]
Ahmad Alhilal, Tristan Braud, Bo Han, and Pan Hui. 2022. Nebula: Reliable Low-latency Video Transmission for Mobile Cloud Gaming. arXiv preprint arXiv:2201.07738 (2022).
[6]
Abdullah Alomar, Pouya Hamadanian, Arash Nasr-Esfahany, Anish Agarwal, Mohammad Alizadeh, and Devavrat Shah. 2022. CausalSim: Toward a Causal Data-Driven Simulator for Network Protocols. arXiv preprint arXiv:2201.01811 (2022).
[7]
Venkat Arun, Mina Tahmasbi Arashloo, Ahmed Saeed, Mohammad Alizadeh, and Hari Balakrishnan. 2021. Toward Formally Verifying Congestion Control Behavior. Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication (2021).
[8]
Venkat Arun and Hari Balakrishnan. 2018. Copa: Practical delay-based congestion control for the internet. In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18). 329--342.
[9]
Chadi Barakat, Eitan Altman, and Walid Dabbous. 2000. On TCP performance in a heterogeneous network: a survey. IEEE Communications Magazine 38, 1 (2000), 40--46.
[10]
Neal Cardwell, Yuchung Cheng, C Stephen Gunn, Soheil Hassas Yeganeh, and Van Jacobson. 2016. BBR: Congestion-Based Congestion Control: Measuring bottleneck bandwidth and round-trip propagation time. Queue 14, 5 (2016), 20--53.
[11]
Neal Cardwell, Yuchung Cheng, S Hassas Yeganeh, Ian Swett, Victor Vasiliev, Priyaranjan Jha, Yousuk Seung, Matt Mathis, and Van Jacobson. 2019. BBRv2: A model-based congestion control. In Presentation in ICCRG at IETF 104th meeting.
[12]
Ying Chen, Qing Li, Aoyang Zhang, Longhao Zou, Yong Jiang, Zhimin Xu, Junlin Li, and Zhenhui Yuan. 2021. Higher quality live streaming under lower uplink bandwidth: an approach of super-resolution based video coding. In Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. 74--81.
[13]
Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014).
[14]
Mo Dong, Qingxi Li, Doron Zarchy, P Brighten Godfrey, and Michael Schapira. 2015. {PCC}: Re-architecting congestion control for consistent high performance. In 12th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 15). 395--408.
[15]
Mo Dong, Tong Meng, Doron Zarchy, Engin Arslan, Yossi Gilad, Brighten Godfrey, and Michael Schapira. 2018. {PCC} vivace: Online-learning congestion control. In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18). 343--356.
[16]
Salma Emara, Baochun Li, and Yanjiao Chen. 2020. Eagle: Refining congestion control by learning from the experts. In IEEE INFOCOM 2020-IEEE Conference on Computer Communications. IEEE, 676--685.
[17]
Prateesh Goyal, Mohammad Alizadeh, and Thomas E Anderson. 2022. Op- timal Congestion Control for Time-varying Wireless Links. arXiv preprint arXiv:2202.04321 (2022).
[18]
Sangtae Ha, Injong Rhee, and Lisong Xu. 2008. CUBIC: a new TCP-friendly high-speed TCP variant. ACM SIGOPS operating systems review 42, 5 (2008), 64--74.
[19]
Tianchi Huang, Ruixiao Zhang, and Lifeng Sun. 2021. Zwei: A Self-play Reinforce- ment Learning Framework for Video Transmission Services. IEEE Transactions on Multimedia (2021).
[20]
Tianchi Huang, Chao Zhou, Xin Yao, Rui-Xiao Zhang, Chenglei Wu, Bing Yu, and Lifeng Sun. 2020. Quality-aware neural adaptive video streaming with lifelong imitation learning. IEEE Journal on Selected Areas in Communications 38, 10 (2020), 2324--2342.
[21]
Tianchi Huang, Chao Zhou, Rui-Xiao Zhang, Chenglei Wu, Xin Yao, and Lifeng Sun. 2019. Comyco: Quality-aware adaptive video streaming via imitation learning. In ACM Multimedia 2019.
[22]
Nathan Jay, Noga Rotman, Brighten Godfrey, Michael Schapira, and Aviv Tamar. 2019. A deep reinforcement learning perspective on internet congestion control. In International Conference on Machine Learning. PMLR, 3050--3059.
[23]
Jaehong Kim, Youngmok Jung, Hyunho Yeo, Juncheol Ye, and Dongsu Han. 2020. Neural-enhanced live streaming: Improving live video ingest via online learning. In Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication. 107--125.
[24]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[25]
Leonard Kleinrock. 1979. Power and deterministic rules of thumb for probabilistic problems in computer communications. In Proceedings of the International Conference on Communications, Vol. 43. 1--43.
[26]
Tong Li, Kai Zheng, Ke Xu, Rahul Arvind Jadhav, Tao Xiong, Keith Winstein, and Kun Tan. 2020. Tack: Improving wireless transport performance by taming acknowledgments. In Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication. 15--30.
[27]
Xu Li, Feilong Tang, Jiacheng Liu, Laurence T Yang, Luoyi Fu, and Long Chen. 2021. {AUTO}: Adaptive Congestion Control Based on Multi-Objective Reinforcement Learning for the Satellite-Ground Integrated Network. In 2021 {USENIX} Annual Technical Conference ({USENIX}ATC 21). 611--624.
[28]
Yiqing Ma, Han Tian, Xudong Liao, Junxue Zhang, Weiyan Wang, Kai Chen, and Xin Jin. 2021. Multi-Objective Congestion Control. arXiv preprint arXiv:2107.01427 (2021).
[29]
Hongzi Mao, Shannon Chen, Drew Dimmery, Shaun Singh, Drew Blaisdell, Yuan-dong Tian, Mohammad Alizadeh, and Eytan Bakshy. 2020. Real-world video adaptation with reinforcement learning. arXiv preprint arXiv:2008.12858 (2020).
[30]
Tong Meng, Neta Rozen Schiff, P Brighten Godfrey, and Michael Schapira. 2020. PCC Proteus: scavenger transport and beyond. In Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication. 615--631.
[31]
Zili Meng, Yaning Guo, Yixin Shen, Jing Chen, Chao Zhou, Minhu Wang, Jia Zhang, Mingwei Xu, Chen Sun, and Hongxin Hu. 2021. Practically deploying heavyweight adaptive bitrate algorithms with teacher-student learning. IEEE/ACM Transactions on Networking 29, 2 (2021), 723--736.
[32]
Ravi Netravali, Anirudh Sivaraman, Somak Das, Ameesh Goyal, Keith Winstein, James Mickens, and Hari Balakrishnan. 2015. Mahimahi: Accurate record-and-replay for {HTTP}. In 2015 {USENIX} Annual Technical Conference (ATC 15). 417--429.
[33]
Takayuki Osa, Joni Pajarinen, Gerhard Neumann, J Andrew Bagnell, Pieter Abbeel, and Jan Peters. 2018. An algorithmic perspective on imitation learning. arXiv preprint arXiv:1811.06711 (2018).
[34]
Measuring Fixed Broadband Report. 2016. Raw Data Measuring Broadband America 2016. https://www.fcc.gov/reports-research/reports/measuring-broadband-america/raw-data-measuring-broadband-america-2016. [Online; accessed 19- July-2016].
[35]
Haakon Riiser, Paul Vigmostad, Carsten Griwodz, and Pål Halvorsen. 2013. Commute path bandwidth traces from 3G networks: analysis and applications. In Proceedings of the 4th ACM Multimedia Systems Conference. ACM, 114--118.
[36]
Stéphane Ross, Geoffrey Gordon, and Drew Bagnell. 2011. A reduction of imitation learning and structured prediction to no-regret online learning. In Proceedings of the fourteenth international conference on artificial intelligence and statistics. JMLR Workshop and Conference Proceedings, 627--635.
[37]
John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017).
[38]
Sea Shalunov, Greg Hazel, Janardhan Iyengar, Mirja Kuehlewind, et al. 2012. Low extra delay background transport (LEDBAT). In RFC 6817.
[39]
Anirudh Sivaraman, Keith Winstein, Pratiksha Thaker, and Hari Balakrishnan. 2014. An experimental study of the learnability of congestion control. ACM SIGCOMM Computer Communication Review 44, 4 (2014), 479--490.
[40]
Daniel Smilkov, Nikhil Thorat, Yannick Assogba, Ann Yuan, Nick Kreeger, Ping Yu, Kangyi Zhang, Shanqing Cai, Eric Nielsen, David Soergel, et al. 2019. Tensorflow. js: Machine learning for the web and beyond. arXiv preprint arXiv:1901.05350 (2019).
[41]
Kuaishou Technology. 2022. ANNOUNCEMENT OF THE RESULTS FOR THE YEAR ENDED DECEMBER 31, 2021. https://ir.kuaishou.com/system/files-encrypted/nasdaq_kms/assets/2022/03/29/0-05-35/E_887559_KUAISHOU-W_0325_1941_ESS.pdf.
[42]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998--6008.
[43]
Wenting Wei, Huaxi Gu, and Baochun Li. 2021. Congestion Control: A Renaissance with Machine Learning. IEEE Network (2021).
[44]
Keith Winstein and Hari Balakrishnan. 2013. Tcp ex machina: Computer-generated congestion control. ACM SIGCOMM Computer Communication Review 43, 4 (2013), 123--134.
[45]
Keith Winstein, Anirudh Sivaraman, and Hari Balakrishnan. 2013. Stochastic forecasts achieve high throughput and low delay over cellular networks. In 10th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI}. 459--471.
[46]
Zhenchang Xia, Yanjiao Chen, Libing Wu, Yu-Cheng Chou, Zhicong Zheng, Haoyang Li, and Baochun Li. 2021. A Multi-objective Reinforcement Learning Perspective on Internet Congestion Control. In IWQOS2021. 0-0.
[47]
Francis Y Yan, Hudson Ayers, Chenzhi Zhu, Sadjad Fouladi, James Hong, Keyi Zhang, Philip Levis, and Keith Winstein. 2020. Learning in situ: a randomized experiment in video streaming. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20). 495--511.
[48]
Francis Y Yan, Jestin Ma, Greg D Hill, Deepti Raghavan, Riad S Wahby, Philip Levis, and Keith Winstein. 2018. Pantheon: the training ground for Internet congestion-control research. In 2018 {USENIX} Annual Technical Conference (USENISATC 18). 731--743.
[49]
Jin Yong. 1967. The Smiling, Proud Wanderer. https://en.wikipedia.org/wiki/ The_Smiling,_Proud_Wanderer.
[50]
Lei Zhang, Yong Cui, Mowei Wang, Zhenjie Yang, and Yong Jiang. 2019. Machine learning for internet congestion control: Techniques and challenges. IEEE Internet Computing 23, 5 (2019), 59--64.
[51]
Lei Zhang, Yong Cui, Mowei Wang, Kewei Zhu, Yibo Zhu, and Yong Jiang. 2021. DeepCC: Bridging the Gap Between Congestion Control and Applications via Multi-Objective Optimization. arXiv preprint arXiv:2107.08617 (2021).
[52]
Lei Zhang, Kewei Zhu, Junchen Pan, Hang Shi, Yong Jiang, and Yong Cui. 2020. Reinforcement Learning Based Congestion Control in a Real Environment. In 2020 29th International Conference on Computer Communications and Networks (ICCCN). IEEE, 1--9.
[53]
Boyuan Zheng, Sunny Verma, Jianlong Zhou, Ivor Tsang, and Fang Chen. 2021. Imitation Learning: Progress, Taxonomies and Opportunities. arXiv preprint arXiv:2106.12177 (2021).
[54]
Zhiren Zhong, Wei Wang, Yiyang Shao, Zhenyu Li, Heng Pan, Hongtao Guan, Gareth Tyson, Gaogang Xie, and Kai Zheng. 2022. Muses: Enabling Lightweight Learning-Based Congestion Control for Mobile Devices. In IEEE INFOCOM 2022-IEEE Conference on Computer Communications. IEEE, 1--10.
[55]
Chao Zhou, Shucheng Zhong, Yufeng Geng, and Bing Yu. 2018. A Statistical-based Rate Adaptation Approach for Short Video Service. In 2018 IEEE Visual Communications and Image Processing (VCIP). IEEE, 1--4.

Cited By

View all
  • (2024)AraLive: Automatic Reward Adaption for Learning-based Live Video StreamingProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681499(11099-11108)Online publication date: 28-Oct-2024
  • (2024)Short Video Ordering via Position Decoding and Successor PredictionProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657795(2167-2176)Online publication date: 10-Jul-2024
  • (2024)Meet Challenges of RTT Jitter, A Hybrid Internet Congestion Control AlgorithmProceedings of the ACM Web Conference 202410.1145/3589334.3645338(2768-2776)Online publication date: 13-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '22: Proceedings of the 30th ACM International Conference on Multimedia
October 2022
7537 pages
ISBN:9781450392037
DOI:10.1145/3503161
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. congestion control
  2. imitation learning
  3. video uploading

Qualifiers

  • Research-article

Funding Sources

  • National Science Foundation of China
  • Beijing Key Lab of Networked Multimedia
  • Kuaishou-Tsinghua Joint Project

Conference

MM '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)352
  • Downloads (Last 6 weeks)43
Reflects downloads up to 13 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)AraLive: Automatic Reward Adaption for Learning-based Live Video StreamingProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681499(11099-11108)Online publication date: 28-Oct-2024
  • (2024)Short Video Ordering via Position Decoding and Successor PredictionProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657795(2167-2176)Online publication date: 10-Jul-2024
  • (2024)Meet Challenges of RTT Jitter, A Hybrid Internet Congestion Control AlgorithmProceedings of the ACM Web Conference 202410.1145/3589334.3645338(2768-2776)Online publication date: 13-May-2024
  • (2024)Context-Aware Cross-Layer Congestion Control for Large-Scale Live StreamingIEEE/ACM Transactions on Networking10.1109/TNET.2024.339767132:5(3743-3759)Online publication date: Oct-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media