research-article

Low Latency Software Rate Limiters for Cloud Networks

Authors:

Brent Stephens,

Aditya Akella, and

Ying ZhangAuthors Info & Claims

APNet '17: Proceedings of the First Asia-Pacific Workshop on Networking

August 2017

Pages 78 - 84

https://doi.org/10.1145/3106989.3107005

Published: 03 August 2017 Publication History

Abstract

A lot of recent work has focused on reducing in network queueing latency in datacenter networks. In this paper, we focus on a less explored topic --- latency increases caused by queueing in rate limiters on the end-host. First, we show that latency can be increased by an order of magnitude by rate limiters in cloud networks. To solve this problem, we extend ECN marking into rate limiters and use a datacenter congestion control algorithm --- DCTCP. Unfortunately, while this reduces latency, it also leads to throughput oscillation. Thus, this solution is not sufficient. In this paper, we also analyze the specific reasons that ECN marking in software rate limiters leads to the throughput oscillation problem. Finally, we propose two potential solutions to design software rate limiters that can achieve stable high throughput and low latency.

References

[1]

CloudLab. https://www.cloudlab.us/.

[2]

HTB Linux queuing discipline manual - user guide. http://luxik.cdi.cz/~devik/qos/htb/manual/userg.htm.

[3]

Offloading the Segmentation of Large TCP Packets. https://msdn.microsoft.com/en-us/windows/hardware/drivers/network/offloading-the-segmentation-of-large-tcp-packets.

[4]

OpenvSwitch QoS. http://docs.openvswitch.org/en/latest/faq/qos/.

[5]

Mohammad Al-Fares, Sivasankar Radhakrishnan, Barath Raghavan, Nelson Huang, and Amin Vahdat. 2010. Hedera: Dynamic Flow Scheduling for Data Center Networks. In NSDI, Vol. 10. 19--19.

Digital Library

[6]

Mohammad Alizadeh, Albert Greenberg, David A Maltz, Jitendra Padhye, Parveen Patel, Balaji Prabhakar, Sudipta Sengupta, and Murari Sridharan. 2010. Data center tcp (dctcp). In ACM SIGCOMM computer communication review, Vol. 40. ACM, 63--74.

Digital Library

[7]

Mohammad Alizadeh, Shuang Yang, Milad Sharif, Sachin Katti, Nick McKeown, Balaji Prabhakar, and Scott Shenker. 2013. pfabric: Minimal near-optimal datacenter transport. In ACM SIGCOMM Computer Communication Review, Vol. 43. ACM, 435--446.

Digital Library

[8]

Wei Bai, Li Chen, Kai Chen, Dongsu Han, Chen Tian, and Hao Wang. 2015. Information-agnostic flow scheduling for commodity data centers. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15). 455--468.

Digital Library

[9]

Hitesh Ballani, Paolo Costa, Thomas Karagiannis, and Ant Rowstron. 2011. Towards predictable datacenter networks. In ACM SIGCOMM Computer Communication Review, Vol. 41. ACM, 242--253.

Digital Library

[10]

Adrian M. Caulfield, Eric S. Chung, Andrew Putnam, Hari Angepat, Jeremy Fowers, Michael Haselman, Stephen Heil, Matt Humphrey, Puneet Kaur, Joo-Young Kim, Daniel Lo, Todd Massengill, Kalin Ovtcharov, Michael Papamichael, Lisa Woods, Sitaram Lanka, Derek Chiou, and Doug Burger. 2016. A cloud-scale acceleration architecture. In Microarchitecture (MICRO), 2016 49th Annual IEEE/ACM International Symposium on. IEEE.

[11]

Daniel Crisan, Robert Birke, Gilles Cressier, Cyriel Minkenberg, and Mitch Gusat. 2013. Got loss? get zovn! ACM SIGCOMM Computer Communication Review 43, 4 (2013), 423--434.

Digital Library

[12]

Bryce Cronkite-Ratcliff, Aran Bergman, Shay Vargaftik, Madhusudhan Ravi, Nick McKeown, Ittai Abraham, and Isaac Keslassy. 2016. Virtualized Congestion Control. In Proceedings of the 2016 conference on ACM SIGCOMM 2016 Conference. ACM, 230--243.

Digital Library

[13]

Matthew P Grosvenor, Malte Schwarzkopf, Ionel Gog, Robert NM Watson, Andrew W Moore, Steven Hand, and Jon Crowcroft. 2015. Queues don't matter when you can jump them!. In NSDI. 1--14.

Digital Library

[14]

Chuanxiong Guo, Lihua Yuan, Dong Xiang, Yingnong Dang, Ray Huang, Dave Maltz, Zhaoyi Liu, Vin Wang, Bin Pang, Hua Chen, and others. 2015. Pingmesh: A large-scale system for data center network latency measurement and analysis. In SIGCOMM. ACM.

Digital Library

[15]

Keqiang He, Eric Rozner, Kanak Agarwal, Yu Jason Gu, Wes Felter, John Carter, and Aditya Akella. 2016. AC/DC TCP: Virtual Congestion Control Enforcement for Datacenter Networks. In Proceedings of the 2016 conference on ACM SIGCOMM 2016 Conference. ACM, 244--257.

Digital Library

[16]

Chi-Yao Hong, Matthew Caesar, and P Godfrey. 2012. Finishing flows quickly with preemptive scheduling. ACM SIGCOMM Computer Communication Review 42, 4 (2012), 127--138.

Digital Library

[17]

Keon Jang, Justine Sherry, Hitesh Ballani, and Toby Moncaster. 2015. Silo: Predictable message latency in the cloud. ACM SIGCOMM Computer Communication Review 45, 4 (2015), 435--448.

Digital Library

[18]

Vimalkumar Jeyakumar, Mohammad Alizadeh, David Mazières, Balaji Prabhakar, Albert Greenberg, and Changhoon Kim. 2013. EyeQ: practical network performance isolation at the edge. In Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). 297--311.

Digital Library

[19]

Radhika Mittal, Nandita Dukkipati, Emily Blem, Hassan Wassel, Monia Ghobadi, Amin Vahdat, Yaogong Wang, David Wetherall, David Zats, and others. 2015. TIMELY: RTT-based Congestion Control for the Datacenter. In ACM SIGCOMM Computer Communication Review, Vol. 45. ACM, 537--550.

Digital Library

[20]

Sivasankar Radhakrishnan, Yilong Geng, Vimalkumar Jeyakumar, Abdul Kabbani, George Porter, and Amin Vahdat. 2014. SENIC: Scalable NIC for End-Host Rate Limiting. In NSDI, Vol. 14. 475--488.

Digital Library

[21]

Henrique Rodrigues, Jose Renato Santos, Yoshio Turner, Paolo Soares, and Dorgival O Guedes. 2011. Gatekeeper: Supporting Bandwidth Guarantees for Multi-tenant Datacenter Networks. In WIOV.

Digital Library

[22]

Alan Shieh, Srikanth Kandula, Albert G Greenberg, Changhoon Kim, and Bikas Saha. 2011. Sharing the Data Center Network. In NSDI, Vol. 11. 23--23.

Digital Library

[23]

Arjun Singh, Joon Ong, Amit Agarwal, Glen Anderson, Ashby Armistead, Roy Bannon, Seb Boving, Gaurav Desai, Bob Felderman, Paulie Germano, and others. 2015. Jupiter rising: A decade of clos topologies and centralized control in google's datacenter network. ACM SIGCOMM Computer Communication Review 45, 4 (2015), 183--197.

Digital Library

[24]

Balajee Vamanan, Jahangir Hasan, and TN Vijaykumar. 2012. Deadline-aware datacenter tcp (d2tcp). ACM SIGCOMM Computer Communication Review 42, 4 (2012), 115--126.

Digital Library

[25]

Christo Wilson, Hitesh Ballani, Thomas Karagiannis, and Ant Rowtron. 2011. Better never than late: Meeting deadlines in datacenter networks. In ACM SIGCOMM Computer Communication Review, Vol. 41. ACM, 50--61.

Digital Library

[26]

David Zats, Tathagata Das, Prashanth Mohan, Dhruba Borthakur, and Randy Katz. 2012. DeTail: reducing the flow completion time tail in datacenter networks. ACM SIGCOMM Computer Communication Review 42, 4 (2012), 139--150.

Digital Library

[27]

Yibo Zhu, Haggai Eran, Daniel Firestone, Chuanxiong Guo, Marina Lipshteyn, Yehonatan Liron, Jitendra Padhye, Shachar Raindel, Mohamad Haj Yahia, and Ming Zhang. 2015. Congestion control for large-scale RDMA deployments. In ACM SIGCOMM Computer Communication Review, Vol. 45. ACM, 523--536.

Digital Library

Cited By

Tivig PBorcoci EVochin MBalapuwaduge ILi F(2023)Slicing 5G Core Network Based on the Ryu SDN Controller for Everything as a Service2023 26th International Symposium on Wireless Personal Multimedia Communications (WPMC)10.1109/WPMC59531.2023.10338844(1-6)Online publication date: 19-Nov-2023
https://doi.org/10.1109/WPMC59531.2023.10338844
Luo SFan PXing HYu H(2022)Meeting Coflow Deadlines in Data Center Networks With Policy-Based Selective CompletionIEEE/ACM Transactions on Networking10.1109/TNET.2022.318782131:1(178-191)Online publication date: 12-Jul-2022
https://dl.acm.org/doi/10.1109/TNET.2022.3187821
Guo ZWang JLiu SRen JXu YYao C(2022)Congestion-aware Critical Gradient Scheduling for Distributed Machine Learning in Data Center NetworksIEEE Transactions on Cloud Computing10.1109/TCC.2022.3197350(1-17)Online publication date: 2022
https://doi.org/10.1109/TCC.2022.3197350
Show More Cited By

Index Terms

Low Latency Software Rate Limiters for Cloud Networks
1. Networks
  1. Network protocols
    1. Transport protocols

Recommendations

Performance of Asynchronous, Variable Bit Rate Communications over ATM: A Comparison with FDDI
LCN '97: Proceedings of the 22nd Annual IEEE Conference on Local Computer Networks

Asynchronous Transfer Mode (ATM) technology performance is evaluated for Class C (variable bit rate, asynchronous) data transfer, as would be typically found when migrating legacy applications to an ATM environment. Of particular interest are the end-to-...
Read More
Runge-Kutta discontinuous Galerkin method using WENO limiters II

In J. Qiu, C.-W. Shu, Runge-Kutta discontinuous Galerkin method using WENO limiters, SIAM Journal on Scientific Computing 26 (2005) 907-929], Qiu and Shu investigated using weighted essentially non-oscillatory (WENO) finite volume methodology as ...
Read More
Runge--Kutta Discontinuous Galerkin Method Using WENO Limiters

The Runge--Kutta discontinuous Galerkin (RKDG) method is a high order finite element method for solving hyperbolic conservation laws. It uses ideas from high resolution finite volume schemes, such as the exact or approximate Riemann solvers, total ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

APNet '17: Proceedings of the First Asia-Pacific Workshop on Networking

August 2017

127 pages

ISBN:9781450352444

DOI:10.1145/3106989

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 August 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

APNet'17

APNet'17: First Asia-Pacific Workshop on Networking

August 3 - 4, 2017

Hong Kong, China

Acceptance Rates

Overall Acceptance Rate 50 of 118 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
204
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)3

Other Metrics

View Author Metrics

Citations

Cited By

Tivig PBorcoci EVochin MBalapuwaduge ILi F(2023)Slicing 5G Core Network Based on the Ryu SDN Controller for Everything as a Service2023 26th International Symposium on Wireless Personal Multimedia Communications (WPMC)10.1109/WPMC59531.2023.10338844(1-6)Online publication date: 19-Nov-2023
https://doi.org/10.1109/WPMC59531.2023.10338844
Luo SFan PXing HYu H(2022)Meeting Coflow Deadlines in Data Center Networks With Policy-Based Selective CompletionIEEE/ACM Transactions on Networking10.1109/TNET.2022.318782131:1(178-191)Online publication date: 12-Jul-2022
https://dl.acm.org/doi/10.1109/TNET.2022.3187821
Guo ZWang JLiu SRen JXu YYao C(2022)Congestion-aware Critical Gradient Scheduling for Distributed Machine Learning in Data Center NetworksIEEE Transactions on Cloud Computing10.1109/TCC.2022.3197350(1-17)Online publication date: 2022
https://doi.org/10.1109/TCC.2022.3197350
He YWu W(2022)Consistent and Fine-Grained Rule Update with In-Network Control for Distributed Rate Limiting2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS)10.1109/IWQoS54832.2022.9812884(1-10)Online publication date: 10-Jun-2022
https://doi.org/10.1109/IWQoS54832.2022.9812884
Thapeta VShinde KMalekpourshahraki MGrassi DVamanan BStephens B(2021)NimbleProceedings of the ACM SIGCOMM Symposium on SDN Research (SOSR)10.1145/3482898.3483361(27-40)Online publication date: 11-Oct-2021
https://dl.acm.org/doi/10.1145/3482898.3483361
He YWu WWen XLi HYang Y(2021)Scalable On-Switch Rate Limiters for the CloudIEEE INFOCOM 2021 - IEEE Conference on Computer Communications10.1109/INFOCOM42981.2021.9488773(1-10)Online publication date: 10-May-2021
https://dl.acm.org/doi/10.1109/INFOCOM42981.2021.9488773
Chen JDezfouli B(2021)Predictable Bandwidth Slicing with Open vSwitch2021 IEEE Global Communications Conference (GLOBECOM)10.1109/GLOBECOM46510.2021.9685751(1-6)Online publication date: 7-Dec-2021
https://dl.acm.org/doi/10.1109/GLOBECOM46510.2021.9685751
Lee KHong CHwang JYoo C(2020)Dynamic Network Scheduling for Virtual RoutersIEEE Systems Journal10.1109/JSYST.2019.293940914:3(3618-3629)Online publication date: Sep-2020
https://doi.org/10.1109/JSYST.2019.2939409
Zhao YSaeed AZegura EAmmar MMohaisen AZhang Z(2019)zDProceedings of the 15th International Conference on Emerging Networking Experiments And Technologies10.1145/3359989.3365425(220-232)Online publication date: 3-Dec-2019
https://dl.acm.org/doi/10.1145/3359989.3365425
Nasrallah AThyagaturu AAlharbi ZWang CShao XReisslein MElBakoury H(2019)Ultra-Low Latency (ULL) Networks: The IEEE TSN and IETF DetNet Standards and Related 5G ULL ResearchIEEE Communications Surveys & Tutorials10.1109/COMST.2018.286935021:1(88-145)Online publication date: Sep-2020
https://doi.org/10.1109/COMST.2018.2869350
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents