research-article

Twist: A Multi-site Transmission Solution for On-demand Video Streaming

Authors:

Shu ShiAuthors Info & Claims

Proceedings of the ACM on Networking, Volume 2, Issue CoNEXT2

Article No.: 8, Pages 1 - 19

https://doi.org/10.1145/3656297

Published: 13 June 2024 Publication History

Abstract

Video traffic has witnessed exponential growth in recent years. As the cost optimization space of Content Delivery Network (CDN) has reached a plateau, content providers are expanding their network infrastructure to accommodate this surge. To address the cost issue, content providers have turned to cost-effective Peer-to-Peer Content Delivery Network (PCDN) solutions. However, the utilization of limited-capability PCDN nodes may lead to a decline in overall streaming performance compared to powerful CDN servers. To bridge this performance gap, we present Twist. Twist is a receiver-driven multi-site transport that leverages multiple cost-effective PCDN nodes to achieve performance equivalent to traditional CDN solutions. It incorporates a joint flow control to prevent throughput drops that can occur when using multiple content sources, and a proactive retransmission algorithm to handle frequent packet loss. Our evaluations demonstrate that Twist improves download speed on PCDN nodes by 1.71x-2.09x compared to traditional PCDN streaming solutions. Furthermore, extensive A/B testing verifies that Twist enables PCDN to achieve comparable download performance and Quality of Experience (QoE) as CDN. Over three years of commercial deployment, Twist has already served over 300 million users and has handled 35% of the video traffic, resulting in substantial cost savings for a world-leading content provider.

References

[1]

2023. Alibaba Cloud CDN. https://www.alibabacloud.com/product/content-delivery-network/pricing

[2]

2023. High Efficiency Video Coding and ITUT Rec. H. 265 and iso.

[3]

2023. PPIOCloud. https://www.ppio.cn/

[4]

2023. StellarCloud. https://www.xycloud.com/

[5]

2023. Versatile Video Coding and ITUT Rec. H. 266 and iso.

[6]

Vijay Kumar Adhikari, Yang Guo, Fang Hao, Matteo Varvello, Volker Hilt, Moritz Steiner, and Zhi-Li Zhang. 2012. Unreeling netflix: Understanding and improving multi-CDN movie delivery. In 2012 Proceedings IEEE INFOCOM. 1620--1628. https://doi.org/10.1109/INFCOM.2012.6195531

[7]

Nasreen Anjum, Dmytro Karamshuk, Mohammad Shikh-Bahaei, and Nishanth Sastry. 2017. Survey on peer-assisted content delivery networks. Computer Networks 116 (2017), 79--95. https://doi.org/10.1016/j.comnet.2017.02.008

Digital Library

[8]

Venkat Arun and Hari Balakrishnan. 2018. Copa: Practical Delay-Based Congestion Control for the Internet. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18). USENIX Association, Renton, WA, 329--342. https://www.usenix.org/conference/nsdi18/presentation/arun

Digital Library

[9]

Athula Balachandran, Vyas Sekar, Aditya Akella, Srinivasan Seshan, Ion Stoica, and Hui Zhang. 2013. Developing a Predictive Model of Quality of Experience for Internet Video. 43, 4 (aug 2013), 339--350. https://doi.org/10.1145/ 2534169.2486025

[10]

Abdelhak Bentaleb, Bayan Taani, Ali C. Begen, Christian Timmerer, and Roger Zimmermann. 2019. A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTP. IEEE Communications Surveys Tutorials 21, 1 (2019), 562--585. https://doi.org/10.1109/COMST.2018.2862938

[11]

Research Report by Huatai Securities. 2020. Leading CDN companies benefit from the accelerated deployment of edge computing. Technical Report.

[12]

Chunlei Cai, Li Chen, Xiaoyun Zhang, and Zhiyong Gao. 2020. End-to-End Optimized ROI Image Compression. IEEE Transactions on Image Processing 29 (2020), 3442--3457. https://doi.org/10.1109/TIP.2019.2960869

Digital Library

[13]

Jiayi Chen, Nihal Sharma, Tarannum Khan, Shu Liu, Brian Chang, Aditya Akella, Sanjay Shakkottai, and Ramesh K Sitaraman. 2023. Darwin: Flexible Learning-Based CDN Caching. In Proceedings of the ACM SIGCOMM 2023 Conference (New York, NY, USA) (ACM SIGCOMM '23). Association for Computing Machinery, New York, NY, USA, 981--999. https://doi.org/10.1145/3603269.3604863

Digital Library

[14]

Zhenzhong Chen, Junwei Han, and King Ngi Ngan. 2006. Dynamic Bit Allocation for Multiple Video Object Coding. IEEE Transactions on Multimedia 8, 6 (2006), 1117--1124. https://doi.org/10.1109/TMM.2006.884633

Digital Library

[15]

Cisco. 2019. Cisco Visual Networking Index: Forecast and Trends, 2017--2022. Technical Report. https://twiki.cern.ch/ twiki/pub/HEPIX/TechwatchNetwork/HtwNetworkDocuments/white-paper-c11--741490.pdf

[16]

Bram Cohen. 2008. The BitTorrent Protocol Specification.

[17]

QD Coninck and Olivier Bonaventure. 2020. Multipath Extensions for QUIC (MP-QUIC). IETF, Individual Submission, Internet Draft draftdeconinck-quic-multipath-04 (2020).

[18]

Quentin De Coninck and Olivier Bonaventure. 2017. Multipath QUIC: Design and Evaluation. In Proceedings of the 13th International Conference on Emerging Networking EXperiments and Technologies (Incheon, Republic of Korea) (CoNEXT '17). Association for Computing Machinery, New York, NY, USA, 160--166. https://doi.org/10.1145/3143361.3143370

Digital Library

[19]

Sandesh Dhawaskar Sathyanarayana, Kyunghan Lee, Dirk Grunwald, and Sangtae Ha. 2023. Converge: QoE-driven Multipath Video Conferencing over WebRTC. In Proceedings of the ACM SIGCOMM 2023 Conference (ACM SIGCOMM '23). Association for Computing Machinery, New York, NY, USA, 637--653. https://doi.org/10.1145/3603269.3604822

Digital Library

[20]

Mo Dong, Qingxi Li, Doron Zarchy, P. Brighten Godfrey, and Michael Schapira. 2015. PCC: Re-architecting Congestion Control for Consistent High Performance. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15). USENIX Association, Oakland, CA, 395--408. https://www.usenix.org/conference/nsdi15/technical-sessions/ presentation/dong

[21]

Alan Ford, Costin Raiciu, Mark Handley, and Olivier Bonaventure. 2013. TCP extensions for multipath operation with multiple addresses. Technical Report.

[22]

Prateesh Goyal, Akshay Narayan, Frank Cangialosi, Srinivas Narayana, Mohammad Alizadeh, and Hari Balakrishnan. 2022. Elasticity Detection: A Building Block for Internet Congestion Control. In Proceedings of the ACM SIGCOMM 2022 Conference (Amsterdam, Netherlands) (SIGCOMM '22). Association for Computing Machinery, New York, NY, USA, 158--176. https://doi.org/10.1145/3544216.3544221

Digital Library

[23]

Yihua Ethan Guo, Ashkan Nikravesh, Z. Morley Mao, Feng Qian, and Subhabrata Sen. 2017. Accelerating Multipath Transport Through Balanced Subflow Completion. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking (Snowbird, Utah, USA) (MobiCom '17). Association for Computing Machinery, New York, NY, USA, 141--153. https://doi.org/10.1145/3117811.3117829

Digital Library

[24]

Sangtae Ha, Injong Rhee, and Lisong Xu. 2008. CUBIC: A New TCP-Friendly High-Speed TCP Variant. SIGOPS Oper. Syst. Rev. 42, 5 (jul 2008), 64--74. https://doi.org/10.1145/1400097.1400105

Digital Library

[25]

Dongsu Han, David Andersen, Michael Kaminsky, Dina Papagiannaki, and Srinivasan Seshan. 2011. Hulu in the neighborhood. In 2011 Third International Conference on Communication Systems and Networks (COMSNETS 2011). 1--10. https://doi.org/10.1109/COMSNETS.2011.5716501

[26]

Syed Hasan, Sergey Gorinsky, Constantine Dovrolis, and Ramesh K. Sitaraman. 2014. Trade-offs in optimizing the cache deployments of CDNs. In IEEE INFOCOM 2014 - IEEE Conference on Computer Communications. 460--468. https://doi.org/10.1109/INFOCOM.2014.6847969

[27]

Yan Huang, Tom Z.J. Fu, Dah-Ming Chiu, John C.S. Lui, and Cheng Huang. 2008. Challenges, Design and Analysis of a Large-Scale P2p-Vod System. SIGCOMM Comput. Commun. Rev. 38, 4 (aug 2008), 375--388. https://doi.org/10.1145/ 1402946.1403001

Digital Library

[28]

Junchen Jiang, Vyas Sekar, Henry Milner, Davis Shepherd, Ion Stoica, and Hui Zhang. 2016. CFA: A Practical Prediction System for Video QoE Optimization. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16). USENIX Association, Santa Clara, CA, 137--150. https://www.usenix.org/conference/nsdi16/technicalsessions/ presentation/jiang

Digital Library

[29]

Jinsung Lee, Sungyong Lee, Jongyun Lee, Sandesh Dhawaskar Sathyanarayana, Hyoyoung Lim, Jihoon Lee, Xiaoqing Zhu, Sangeeta Ramakrishnan, Dirk Grunwald, Kyunghan Lee, and Sangtae Ha. 2020. PERCEIVE: deep learning-based cellular uplink prediction using real-time scheduling patterns. In Proceedings of the 18th International Conference on Mobile Systems, Applications, and Services (Toronto, Ontario, Canada) (MobiSys '20). Association for Computing Machinery, New York, NY, USA, 377--390. https://doi.org/10.1145/3386901.3388911

Digital Library

[30]

Zhuqi Li, Yaxiong Xie, Ravi Netravali, and Kyle Jamieson. 2023. Dashlet: Taming Swipe Uncertainty for Robust Short Video Streaming. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23). USENIX Association, Boston, MA, 1583--1599. https://www.usenix.org/conference/nsdi23/presentation/li-zhuqi

[31]

Hongqiang Harry Liu, YeWang, Yang Richard Yang, HaoWang, and Chen Tian. 2012. Optimizing Cost and Performance for Content Multihoming. SIGCOMM Comput. Commun. Rev. 42, 4 (aug 2012), 371--382. https://doi.org/10.1145/ 2377677.2377753

Digital Library

[32]

Ming Ma, Zhi Wang, Ke Su, and Lifeng Sun. 2016. Understanding the Power of Smartrouter-Based Peer CDN for Video Streaming. In 2016 25th International Conference on Computer Communication and Networks (ICCCN). 1--9. https://doi.org/10.1109/ICCCN.2016.7568594

[33]

Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural Adaptive Video Streaming with Pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (Los Angeles, CA, USA) (SIGCOMM '17). Association for Computing Machinery, New York, NY, USA, 197--210. https://doi.org/10.1145/3098822. 3098843

Digital Library

[34]

David McGrew and Eric Rescorla. 2010. Datagram Transport Layer Security (DTLS) Extension to Establish Keys for the Secure Real-time Transport Protocol (SRTP). RFC 5764. https://doi.org/10.17487/RFC5764

Digital Library

[35]

Usama Naseer and Theophilus A. Benson. 2022. Configanator: A Data-driven Approach to Improving CDN Performance. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22). USENIX Association, Renton, WA, 1135--1158. https://www.usenix.org/conference/nsdi22/presentation/naseer

[36]

Vikram Nathan, Vibhaalakshmi Sivaraman, Ravichandra Addanki, Mehrdad Khani, Prateesh Goyal, and Mohammad Alizadeh. 2019. End-to-End Transport for Video QoE Fairness. In Proceedings of the ACM Special Interest Group on Data Communication (Beijing, China) (SIGCOMM '19). Association for Computing Machinery, New York, NY, USA, 408--423. https://doi.org/10.1145/3341302.3342077

Digital Library

[37]

Netflix. 2021. A cooperative approach to content delivery. Technical Report.

[38]

Marc Petit-Huguenin, Gonzalo Salgueiro, Jonathan Rosenberg, Dan Wing, Rohan Mahy, and Philip Matthews. 2020. Session Traversal Utilities for NAT (STUN). RFC 8489. https://doi.org/10.17487/RFC8489

Digital Library

[39]

Johan Pouwelse, Pawel Garbacki, Dick Epema, and Henk Sips. 2005. The Bittorrent P2P File-Sharing System: Measurements and Analysis. In Peer-to-Peer Systems IV, Miguel Castro and Robbert van Renesse (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 205--216.

[40]

Costin Raiciu, Christoph Paasch, Sebastien Barre, Alan Ford, Michio Honda, Fabien Duchene, Olivier Bonaventure, and Mark Handley. 2012. How Hard Can It Be? Designing and Implementing a Deployable Multipath TCP. In 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12). USENIX Association, San Jose, CA, 399--412. https://www.usenix.org/conference/nsdi12/technical-sessions/presentation/raiciu

Digital Library

[41]

Eric Rescorla and Nagendra Modadugu. 2012. Datagram Transport Layer Security Version 1.2. RFC 6347. https://doi.org/10.17487/RFC6347

Digital Library

[42]

Hidenari Sawashima. [n. d.]. Characteristics of UDP Packet Loss: Effect of TCP Traffic. https://web.archive.org/web/ 20160103125117/https://www.isoc.org/inet97/proceedings/F3/F3_1.HTM

[43]

Varun Singh, Saba Ahsan, and Jörg Ott. 2013. MPRTP: multipath considerations for real-time media. In Proceedings of the 4th ACM Multimedia Systems Conference. 190--201.

Digital Library

[44]

Kevin Spiteri, Rahul Urgaonkar, and Ramesh K. Sitaraman. 2020. BOLA: Near-Optimal Bitrate Adaptation for Online Videos. IEEE/ACM Transactions on Networking 28, 4 (2020), 1698--1711. https://doi.org/10.1109/TNET.2020.2996964

Digital Library

[45]

Yi Sun, Xiaoqi Yin, Junchen Jiang, Vyas Sekar, Fuyuan Lin, Nanshu Wang, Tao Liu, and Bruno Sinopoli. 2016. CS2P: Improving Video Bitrate Selection and Adaptation with Data-Driven Throughput Prediction. In Proceedings of the 2016 ACM SIGCOMM Conference (Florianopolis, Brazil) (SIGCOMM '16). Association for Computing Machinery, New York, NY, USA, 272--285. https://doi.org/10.1145/2934872.2934898

Digital Library

[46]

Haiping Wang, Zhenhua Yu, Ruixiao Zhang, Siping Tao, Hebin Yu, and Shu Shi. 2023. TwinStar: A Practical Multi- Path Transmission Framework for Ultra-Low Latency Video Delivery. In Proceedings of the 31st ACM International Conference on Multimedia (MM '23). Association for Computing Machinery, New York, NY, USA, 9234--9242. https: //doi.org/10.1145/3581783.3613443

Digital Library

[47]

WEKIPEDIA. [n. d.]. TCP global synchronization. https://en.wikipedia.org/wiki/TCP_global_synchronization

[48]

Francis Y. Yan, Hudson Ayers, Chenzhi Zhu, Sadjad Fouladi, James Hong, Keyi Zhang, Philip Levis, and Keith Winstein. 2020. Learning in situ: a randomized experiment in video streaming. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20). USENIX Association, Santa Clara, CA, 495--511. https://www.usenix.org/ conference/nsdi20/presentation/yan

[49]

Hyunho Yeo, Chan Ju Chong, Youngmok Jung, Juncheol Ye, and Dongsu Han. 2020. NEMO: Enabling Neural-Enhanced Video Streaming on Commodity Mobile Devices. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking (London, United Kingdom) (MobiCom '20). Association for Computing Machinery, New York, NY, USA, Article 28, 14 pages. https://doi.org/10.1145/3372224.3419185

Digital Library

[50]

Hao Yin, Xuening Liu, Tongyu Zhan, Vyas Sekar, Feng Qiu, Chuang Lin, Hui Zhang, and Bo Li. 2010. LiveSky: Enhancing CDN with P2P. ACM Trans. Multimedia Comput. Commun. Appl. 6, 3, Article 16 (aug 2010), 19 pages. https://doi.org/10.1145/1823746.1823750

Digital Library

[51]

Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. SIGCOMM Comput. Commun. Rev. 45, 4 (aug 2015), 325--338. https://doi.org/ 10.1145/2829988.2787486

Digital Library

[52]

Ge Zhang,Wei Liu, Xiaojun Hei, andWenqing Cheng. 2015. Unreeling Xunlei Kankan: Understanding Hybrid CDN-P2P Video-on-Demand Streaming. IEEE Transactions on Multimedia 17, 2 (2015), 229--242. https://doi.org/10.1109/TMM. 2014.2383617

Digital Library

[53]

Xu Zhang, Yiyang Ou, Siddhartha Sen, and Junchen Jiang. 2021. SENSEI: Aligning Video Streaming Quality with Dynamic User Sensitivity. In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21). USENIX Association, 303--320. https://www.usenix.org/conference/nsdi21/presentation/zhang-xu

[54]

Zhilong Zheng, Yunfei Ma, Yanmei Liu, Furong Yang, Zhenyu Li, Yuanbo Zhang, Jiuhai Zhang, Wei Shi, Wentao Chen, Ding Li, Qing An, Hai Hong, Hongqiang Harry Liu, and Ming Zhang. 2021. XLINK: QoE-Driven Multi- Path QUIC Transport in Large-Scale Video Services. In Proceedings of the 2021 ACM SIGCOMM 2021 Conference (Virtual Event, USA) (SIGCOMM '21). Association for Computing Machinery, New York, NY, USA, 418--432. https://doi.org/10.1145/3452296.3472893

Digital Library

Cited By

Wang JWang KLin XZhang WZhang Y(2024)Efficient Unsupervised Community Search with Pre-Trained Graph TransformerProceedings of the VLDB Endowment10.14778/3665844.366585317:9(2227-2240)Online publication date: 6-Aug-2024
https://dl.acm.org/doi/10.14778/3665844.3665853
Wang YOthman MChoo WLiu RWang X(2024)DFRDRL: a dynamic fuzzy routing algorithm based on deep reinforcement learning with guaranteed latency and bandwidth for software-defined networksJournal of Big Data10.1186/s40537-024-01029-x11:1Online publication date: 28-Oct-2024
https://doi.org/10.1186/s40537-024-01029-x
Yu HWang HTian CSathyanarayana SShi SXue ZYu SLi HPeng YPang XZhang RVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)Magpie: Improving the Efficiency of A/B Tests for Large Scale Video-on-Demand SystemsProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3689019(588-594)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3689019
Show More Cited By

Index Terms

Twist: A Multi-site Transmission Solution for On-demand Video Streaming
1. Networks
  1. Network protocols
    1. Transport protocols
  2. Network types
    1. Overlay and other logical network structures
      1. Peer-to-peer networks

Recommendations

Secure content delivery in information-centric networks: design, implementation, and analyses
ICN '13: Proceedings of the 3rd ACM SIGCOMM workshop on Information-centric networking

In this paper, we propose a novel secure content delivery framework, for an information-centric network, which will enable content providers (e.g., Netflix and Youtube) to securely disseminate their content to legitimate users via content distribution ...
LoICen: A novel location-based and information-centric architecture for content distribution in vehicular networks
Abstract
The information-centric networking (ICN) paradigm has gained increasing attention as a solution for boosting content delivery in vehicular network applications. The content-naming oriented search and in-network data caching procedures ...
A cooperative content delivery scheme for multimedia services in contents delivery networks
ICUIMC '08: Proceedings of the 2nd international conference on Ubiquitous information management and communication

Contents Delivery Networks (CDNs) have been introduced to deliver efficiently very large content to user with low cost. For this, various content delivery schemes such as the uncooperative pull-based scheme, the cooperative push-based scheme, and the ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Networking

Proceedings of the ACM on Networking Volume 2, Issue CoNEXT2

PACMNET

June 2024

109 pages

EISSN:2834-5509

DOI:10.1145/3673253

Editors:
Marco Mellia
Politecnico di Torino, Italy
,
Peter Steenkiste
Carnegie Mellon University, United States

Issue’s Table of Contents

Copyright © 2024 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2024

Published in PACMNET Volume 2, Issue CoNEXT2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
213
Total Downloads

Downloads (Last 12 months)213
Downloads (Last 6 weeks)23

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang JWang KLin XZhang WZhang Y(2024)Efficient Unsupervised Community Search with Pre-Trained Graph TransformerProceedings of the VLDB Endowment10.14778/3665844.366585317:9(2227-2240)Online publication date: 6-Aug-2024
https://dl.acm.org/doi/10.14778/3665844.3665853
Wang YOthman MChoo WLiu RWang X(2024)DFRDRL: a dynamic fuzzy routing algorithm based on deep reinforcement learning with guaranteed latency and bandwidth for software-defined networksJournal of Big Data10.1186/s40537-024-01029-x11:1Online publication date: 28-Oct-2024
https://doi.org/10.1186/s40537-024-01029-x
Yu HWang HTian CSathyanarayana SShi SXue ZYu SLi HPeng YPang XZhang RVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)Magpie: Improving the Efficiency of A/B Tests for Large Scale Video-on-Demand SystemsProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3689019(588-594)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3689019
Pan JWang JLi G(2024)Survey of vector database management systemsThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-024-00864-x33:5(1591-1615)Online publication date: 15-Jul-2024
https://dl.acm.org/doi/10.1007/s00778-024-00864-x

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents