Elephants Sharing the Highway: Studying TCP Fairness in Large Transfers over High Throughput Links
Authors: 
Imtiaz Mahmud, George Papadimitriou, Cong Wang, Mariam Kiran, Anirban Mandal, Ewa DeelmanAuthors Info & Claims
Imtiaz Mahmud, George Papadimitriou, Cong Wang, Mariam Kiran, Anirban Mandal, Ewa DeelmanAuthors Info & ClaimsPages 806 - 818
Abstract
Escalating bandwidth demand strains high-performance data networks, posing potential performance risks. TCP congestion control algorithms enhance reliability and optimize bandwidth usage. Network performance is influenced by factors such as AQM algorithms and router buffer size. In the context of constrained network resources, understanding how TCP flows share networks and the resulting performance impact is essential.
This paper introduces insights into TCP fairness and performance involving a comparison of TCP CUBIC, Reno, Hamilton, and BBR versions 1 and 2 across real-world networks supporting high bandwidths of up to 25 Gbps. The research explores TCP behaviors with AQM algorithms like FIFO, FQ_CODEL, and RED, alongside diverse buffer sizes. Notably, findings reveal that manipulating buffers and queuing methods yields contrasting outcomes based on bandwidth. BBRv2 emerges as a superior fair algorithm, pivotal for swift transfers, particularly in scientific data scenarios. These results provide crucial guidance for future network design, ensuring equitable performance optimization.
References
[1]
Richelle Adams. 2012. Active queue management: A survey. IEEE communications surveys & tutorials 15, 3 (2012), 1425–1476.
[2]
Mark Allman, Vern Paxson, and Ethan Blanton. 2009. RFC 5681: TCP congestion control.
[3]
Subramanian Balaji, Karan Nathani, and Rathnasamy Santhakumar. 2019. IoT technology, applications and challenges: a contemporary survey. Wireless personal communications 108 (2019), 363–388.
[4]
Ilya Baldin, Anita Nikolich, James Griffioen, Indermohan Inder S. Monga, Kuang-Ching Wang, Tom Lehman, Paul Ruth, and Ewa Deelman. 2019. FABRIC: A National-Scale Programmable Experimental Network Infrastructure. IEEE Internet Computing 23, 6 (nov 2019), 38–47. https://doi.org/10.1109/MIC.2019.2958545
[5]
Sumitha Bhandarkar, Saurabh Jain, and AL Narasimha Reddy. 2006. LTCP: improving the performance of TCP in highspeed networks. ACM SIGCOMM Computer Communication Review 36, 1 (2006), 41–50.
[6]
Yi Cao, Arpit Jain, Kriti Sharma, Aruna Balasubramanian, and Anshul Gandhi. 2019. When to use and when not to use BBR: An empirical analysis and evaluation study. In Proceedings of the Internet Measurement Conference. 130–136.
[7]
Neal Cardwell, Yuchung Cheng, C Stephen Gunn, Soheil Hassas Yeganeh, and Van Jacobson. 2017. BBR: congestion-based congestion control. Commun. ACM 60, 2 (2017), 58–66.
[8]
Neal Cardwell, Yuchung Cheng, Soheil Hassas Yeganeh, Priyaranjan Jha, Yousuk Seung, Kevin Yang, Ian Swett, Victor Vasiliev, Bin Wu, Luke Hsiao, 2019. BBRv2: A model-based congestion control performance optimization. In Proc. IETF 106th Meeting. 1–32.
[9]
Eli Dart, Lauren Rotman, Brian Tierney, Mary Hester, and Jason Zurawski. 2013. The Science DMZ: A network design pattern for data-intensive science. In SC ’13: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis. 1–10. https://doi.org/10.1145/2503210.2503245
[10]
Amogh Dhamdhere and Constantine Dovrolis. 2006. Open issues in router buffer sizing. ACM SIGCOMM Computer Communication Review 36, 1 (2006), 87–92.
[11]
Nandita Dukkipati and Nick McKeown. 2006. Why Flow-Completion Time is the Right Metric for Congestion Control. SIGCOMM Comput. Commun. Rev. 36, 1 (jan 2006), 59–62. https://doi.org/10.1145/1111322.1111336
[12]
Mulalo Dzivhani and Khmaies Ouahada. 2019. Performance evaluation of TCP congestion control algorithms for wired networks using NS-3 simulator. In 2019 IEEE AFRICON. IEEE, 1–7.
[13]
W-C Feng, Dilip D Kandlur, Debanjan Saha, and Kang G Shin. 1999. A self-configuring RED gateway. In IEEE INFOCOM’99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No. 99CH36320), Vol. 3. IEEE, 1320–1328.
[14]
Niroshinie Fernando, Seng W Loke, and Wenny Rahayu. 2013. Mobile cloud computing: A survey. Future generation computer systems 29, 1 (2013), 84–106.
[15]
Victor Firoiu and Marty Borden. 2000. A study of active queue management for congestion control. In Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No. 00CH37064), Vol. 3. IEEE, 1435–1444.
[16]
Sally Floyd. 1994. TCP and explicit congestion notification. ACM SIGCOMM Computer Communication Review 24, 5 (1994), 8–23.
[17]
Sally Floyd and Van Jacobson. 1993. Random early detection gateways for congestion avoidance. IEEE/ACM Transactions on networking 1, 4 (1993), 397–413.
[18]
Sally Floyd and Van Jacobson. 1995. Link-sharing and resource management models for packet networks. IEEE/ACM transactions on Networking 3, 4 (1995), 365–386.
[19]
Google. 2022. Linux kernel with BBRv2 support. https://github.com/google/bbr/tree/v2alpha.
[20]
Sangtae Ha, Injong Rhee, and Lisong Xu. 2008. CUBIC: a new TCP-friendly high-speed TCP variant. ACM SIGOPS operating systems review 42, 5 (2008), 64–74.
[21]
Mario Hock, Roland Bless, and Martina Zitterbart. 2017. Experimental evaluation of BBR congestion control. In 2017 IEEE 25th international conference on network protocols (ICNP). IEEE, 1–10.
[22]
Mario Hock, Maxime Veit, Felix Neumeister, Roland Bless, and Martina Zitterbart. 2019. Tcp at 100 gbit/s–tuning, limitations, congestion control. In 2019 IEEE 44th Conference on Local Computer Networks (LCN). IEEE, 1–9.
[23]
Sami Iren, Paul D Amer, and Phillip T Conrad. 1999. The transport layer: tutorial and survey. ACM Computing Surveys (CSUR) 31, 4 (1999), 360–404.
[24]
Van Jacobson. 1988. Congestion avoidance and control. ACM SIGCOMM computer communication review 18, 4 (1988), 314–329.
[25]
Raj Jain, Arjan Durresi, and Gojko Babic. 1999. Throughput fairness index: An explanation. In ATM Forum contribution, Vol. 99.
[26]
Rajendra K Jain, Dah-Ming W Chiu, William R Hawe, 1984. A quantitative measure of fairness and discrimination. Eastern Research Laboratory, Digital Equipment Corporation, Hudson, MA 21 (1984).
[27]
Douglas Leith and Robert Shorten. 2004. H-TCP: TCP for high-speed and long-distance networks. In Proceedings of PFLDnet, Vol. 2004. Citeseer.
[28]
Douglas Leith, R Shorten, and Y Lee. 2005. H-TCP: A framework for congestion control in high-speed and long-distance networks. In PFLDnet Workshop.
[29]
Josip Lorincz, Zvonimir Klarin, and Julije Ožegović. 2021. A comprehensive overview of TCP congestion control in 5G networks: Research challenges and future perspectives. Sensors 21, 13 (2021), 4510.
[30]
Sándor Molnár, Balázs Sonkoly, and Tuan Anh Trinh. 2009. A comprehensive TCP fairness analysis in high speed networks. Computer Communications 32, 13 (2009), 1460–1484. https://doi.org/10.1016/j.comcom.2009.05.003
[31]
Kathleen Nichols and Van Jacobson. 2012. Controlling queue delay. Commun. ACM 55, 7 (2012), 42–50.
[32]
Rong Pan and Balaji Prabhakar. 2001. CHOKe, a Simple Approach for Providing Quality of Service Through Stateless Approximation of Fair Queueing. Stanford University.
[33]
Adithya Abraham Philip, Ranysha Ware, Rukshani Athapathu, Justine Sherry, and Vyas Sekar. 2021. Revisiting TCP Congestion Control Throughput Models & Fairness Properties at Scale. In Proceedings of the 21st ACM Internet Measurement Conference. New York, NY, USA, 96–103. https://doi.org/10.1145/3487552.3487834
[34]
PoSeiDon Workflows. 2023. GitHub Repository. https://github.com/PoSeiDon-Workflows/tcp-conflict-study. Accessed Aug 18, 2023.
[35]
K Ramakrishnan and Sally Floyd. 1999. RFC2481: A Proposal to add Explicit Congestion Notification (ECN) to IP.
[36]
Kun Tan Jingmin Song, Qian Zhang, and Murari Sridharan. 2006. Compound TCP: A scalable and TCP-friendly congestion control for high-speed networks. Proceedings of PFLDnet 2006 (2006).
[37]
Yeong-Jun Song, Geon-Hwan Kim, Imtiaz Mahmud, Won-Kyeong Seo, and You-Ze Cho. 2021. Understanding of bbrv2: Evaluation and comparison with bbrv1 congestion control algorithm. IEEE Access 9 (2021), 37131–37145.
[38]
Milan P Stanic. 2001. Tc–traffic control. Linux QOS Control Tool (2001).
[39]
Dave Taht, Jim Gettys, T Hoeiland-Joergensen, Toke Hoeiland-Joergensen, Eric Dumazet, J Gettys, P McKenney, E Dumazet, and P McKenney. 2018. The flow queue codel packet scheduler and active queue management algorithm.
[40]
Brian Tierney, Eli Dart, Ezra Kissel, and Eashan Adhikarla. 2021. Exploring the BBRv2 Congestion Control Algorithm for use on Data Transfer Nodes. In 2021 IEEE Workshop on Innovating the Network for Data-Intensive Science (INDIS). 23–33. https://doi.org/10.1109/INDIS54524.2021.00008
[41]
Belma Turkovic, Fernando A Kuipers, and Steve Uhlig. 2019. Interactions between congestion control algorithms. In 2019 Network Traffic Measurement and Analysis Conference (TMA). IEEE, 161–168.
[42]
Jingyuan Wang, Jiangtao Wen, Jun Zhang, Zhang Xiong, and Yuxing Han. 2016. TCP-FIT: An improved TCP algorithm for heterogeneous networks. Journal of Network and Computer Applications 71 (2016), 167–180.
Index Terms
- Elephants Sharing the Highway: Studying TCP Fairness in Large Transfers over High Throughput Links
Index terms have been assigned to the content through auto-classification.
Recommendations
Achieving high throughput and TCP Reno fairness in delay-based TCP over large networks
The transport control protocol (TCP) has been widely used in wired and wireless Internet applications such as FTP, email and http. Numerous congestion avoidance algorithms have been proposed to improve the performance of TCP in various scenarios, ...
Can high-speed networks survive with DropTail queues management?
It has been observed that TCP connections that go through multiple congested links (MCL) have a smaller transmission rate than the other connections. Such TCP behavior is a result of two components (i) the cumulative packet losses that a flow ...
On TCP reaction to Explicit Congestion Notification
We investigate the behavior of a new response strategy to TCP Explicit Congestion Notification (ECN). The new strategy is more aggressive in the short term, but preserves TCP long term behavior - without modifying the router ECN marking rate. A more ...
Comments
Information & Contributors
Information
Published In
November 2023
2180 pages
ISBN:9798400707858
DOI:10.1145/3624062
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 November 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Department of Energy under the Integrated Computational and Data Infrastructure (ICDI) for Scientific Discovery
Conference
SC-W 2023
SC-W 2023: Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis
November 12 - 17, 2023
CO, Denver, USA
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 288Total Downloads
- Downloads (Last 12 months)288
- Downloads (Last 6 weeks)37
Reflects downloads up to 22 Sep 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in