research-article

Free access

Enabling End-Host Network Functions

Authors:

Hitesh Ballani,

Christos Gkantsidis,

Matthew P. Grosvenor,

Thomas Karagiannis,

Lazaros Koromilas, and

Greg O'SheaAuthors Info & Claims

SIGCOMM '15: Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication

August 2015

Pages 493 - 507

https://doi.org/10.1145/2785956.2787493

Published: 17 August 2015 Publication History

Abstract

Many network functions executed in modern datacenters, e.g., load balancing, application-level QoS, and congestion control, exhibit three common properties at the data-plane: they need to access and modify state, to perform computations, and to access application semantics -- this is critical since many network functions are best expressed in terms of application-level messages. In this paper, we argue that the end hosts are a natural enforcement point for these functions and we present Eden, an architecture for implementing network functions at datacenter end hosts with minimal network support. Eden comprises three components, a centralized controller, an enclave at each end host, and Eden-compliant applications called stages. To implement network functions, the controller configures stages to classify their data into messages and the enclaves to apply action functions based on a packet's class. Our Eden prototype includes enclaves implemented both in the OS kernel and on programmable NICs. Through case studies, we show how application-level classification and the ability to run actual programs on the data-path allows Eden to efficiently support a broad range of network functions at the network's edge.

Supplementary Material

WEBM File (p493-ballani.webm)

Download
136.84 MB

References

[1]

M. Alizadeh, T. Edsall, S. Dharmapurikar, R. Vaidyanathan, K. Chu, A. Fingerhut, V. T. Lam, F. Matus, R. Pan, N. Yadav, and G. Varghese CONGA: Distributed Congestion-aware Load Balancing for Datacenters. In: SIGCOMM. ACM, 2014.

Digital Library

[2]

M. Alizadeh, A. Greenberg, D. A. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, and M. Sridharan Data Center TCP (DCTCP). In: SIGCOMM. ACM, 2010.

Digital Library

[3]

K. G. Anagnostakis, M. W. Hicks, S. Ioannidis, A. D. Keromytis, and J. M. Smith Scalable Resource Control in Active Networks. In: IWAN. Springer-Verlag, 2000.

Digital Library

[4]

G. Ananthanarayanan, S. Kandula, A. Greenberg, I. Stoica, Y. Lu, B. Saha, and E. Harris Reining in the Outliers in Map-reduce Clusters Using Mantri. In: OSDI. USENIX, 2010.

Digital Library

[5]

L. Andersson, P. Doolan, N. Feldman, A. Fredette, and B. Thomas LDP Specification. RFC 3036. 2001.

Digital Library

[6]

S. Angel, H. Ballani, T. Karagiannis, G. O 0 Shea, and E. Thereska End-to-end Performance Isolation Through Virtual Datacenters. In: OSDI. USENIX, 2014.

Digital Library

[7]

M. B. Anwer, M. Motiwala, M. b. Tariq, and N. Feamster SwitchBlade: A Platform for Rapid Deployment of Network Protocols on Programmable Hardware. In: SIGCOMM. ACM, 2010.

Digital Library

[8]

W. Bai, K. Chen, H. Wang, L. Chen, D. Han, and C. Tian Information-Agnostic Flow Scheduling for Commodity Data Centers. In: NSDI. USENIX, 2015.

Digital Library

[9]

H. Ballani, P. Costa, T. Karagiannis, and A. Rowstron Towards Predictable Datacenter Networks. In: SIGCOMM. ACM, 2011.

Digital Library

[10]

H. Ballani, K. Jang, T. Karagiannis, C. Kim, D. Gunawardena, and G. O'Shea Chatty Tenants and the Cloud Network Sharing Problem. In: NSDI. USENIX, 2013.

Digital Library

[11]

P. Barham, A. Donnelly, R. Isaacs, and R. Mortier Using Magpie for Request Extraction and Workload Modelling. In: OSDI. USENIX, 2004.

Digital Library

[12]

S. Bhattacharjee, K. L. Calvert, and E. W. Zegura An Architecture for Active Networking. In: HPN. Chapman & Hall, Ltd., 1997.

Digital Library

[13]

G. Bianchi, M. Bonola, A. Capone, and C. Cascone OpenState: Programming Platform-independent Stateful Open flow Applications Inside the Switch. SIGCOMM Comput. Commun. Rev. 44, 2 (2014).

Digital Library

[14]

P. Bosshart, D. Daly, G. Gibb, M. Izzard, N. McKeown, J. Rexford, C. Schlesinger, D. Talayco, A. Vahdat, G. Varghese, and D. Walker P4: Programming Protocol-independent Packet Processors. SIGCOMM Comput. Commun. Rev. 44, 3 (2014).

Digital Library

[15]

P. Bosshart, G. Gibb, H.-S. Kim, G. Varghese, N. McKeown, M. Izzard, F. Mujica, and M. Horowitz Forwarding Metamorphosis: Fast Programmable Match-action Processing in Hardware for SDN. In: SIGCOMM. ACM, 2013.

Digital Library

[16]

M. Casado, T. Koponen, S. Shenker, and A. Tootoonchian Fabric: A Retrospective on Evolving SDN. In: HotSDN. ACM, 2012.

Digital Library

[17]

M. Chowdhury, S. Kandula, and I. Stoica Leveraging Endpoint Flexibility in Data-intensive Clusters. In: SIGCOMM. ACM, 2013.

Digital Library

[18]

M. Chowdhury, Y. Zhong, and I. Stoica Efficient Co flow Scheduling with Varys. In: SIGCOMM. ACM, 2014.

Digital Library

[19]

Cisco Snort. 2015. url: https://www.snort.org/ (visited on 06/03/2015).

[20]

L. De Carli, Y. Pan, A. Kumar, C. Estan, and K. Sankaralingam PLUG: Flexible Lookup Modules for Rapid Deployment of New Protocols in High-speed Routers. In: SIGCOMM. ACM, 2009.

Digital Library

[21]

C. Dixon, H. Uppal, V. Brajkovic, D. Brandon, T. Anderson, and A. Krishnamurthy ETTM: A Scalable Fault Tolerant Network Manager. In: NSDI. USENIX, 2011.

Digital Library

[22]

F. R. Dogar, T. Karagiannis, H. Ballani, and A. Rowstron Decentralized Task-aware Scheduling for Data Center Networks. In: SIGCOMM. 2014.

Digital Library

[23]

N. Feamster, J. Rexford, and E. Zegura The Road to SDN: An Intellectual History of Programmable Networks. SIGCOMM Comput. Commun. Rev. 44, 2 (2014).

Digital Library

[24]

A. D. Ferguson, A. Guha, C. Liang, R. Fonseca, and S. Krishnamurthi Participatory Networking: An API for Application Control of SDNs. In: SIGCOMM. ACM, 2013.

Digital Library

[25]

N. Foster, R. Harrison, M. J. Freedman, C. Monsanto, J. Rexford, A. Story, and D. Walker Frenetic: A Network Programming Language. In: ICFP. ACM, 2011.

Digital Library

[26]

R. Gandhi, H. H. Liu, Y. C. Hu, G. Lu, J. Padhye, L. Yuan, and M. Zhang Duet: Cloud Scale Load Balancing with Hardware and Software. In: SIGCOMM. ACM, 2014.

Digital Library

[27]

C. Gkantsidis, T. Karagiannis, P. Key, B. Radunovic, E. Raftopoulos, and D. Manjunath Traffic Management and Resource Allocation in Small Wired/Wireless Networks. In: CoNEXT. ACM, 2009.

Digital Library

[28]

M. P. Grosvenor, M. Schwarzkopf, I. Gog, R. N. M. Watson, A. W. Moore, S. Hand, and J. Crowcroft Queues Don't Matter When You Can JUMP Them! In: NSDI. USENIX Association, 2015.

Digital Library

[29]

H. Han, S. Shakkottai, C. V. Hollot, R. Srikant, and D. Towsley Multi-path TCP: A Joint Congestion Control and Routing Scheme to Exploit Path Diversity in the Internet. IEEE/ACM Trans. Netw. 14, 6 (2006).

Digital Library

[30]

C.-Y. Hong, M. Caesar, and P. B. Godfrey Finishing Flows Quickly with Preemptive Scheduling. In: SIGCOMM. ACM, 2012.

Digital Library

[31]

D. F. Hooper Using IXP2400/2800 Development Tools. A Hands-on Approach to Network Processor Software Design. 1st ed. Intel Press, 2005.

[32]

V. Jeyakumar, M. Alizadeh, C. Kim, and D. Mazieres Tiny Packet Programs for Low-latency Network Control and Monitoring. In: HotNets-XII. ACM, 2013.

Digital Library

[33]

V. Jeyakumar, M. Alizadeh, D. Mazieres, B. Prabhakar, C. Kim, and A. Greenberg EyeQ: Practical Network Performance Isolation at the Edge. In: NSDI. USENIX, 2013.

Digital Library

[34]

T. Karagiannis, R. Mortier, and A. Rowstron Network Exception Handlers: Host-network Control in Enterprise Networks. In: SIGCOMM. ACM, 2008.

Digital Library

[35]

A. D. Keromytis Tagging Data in the Network Stack: Mbuf Tags. In: BSDC'03. USENIX Association, 2003.

Digital Library

[36]

E. Kohler, R. Morris, B. Chen, J. Jannotti, and M. F. Kaashoek The Click Modular Router. ACM Trans. Comput. Syst. 18, 3 (2000).

Digital Library

[37]

D. Kreutz, F. Ramos, P. Esteves Verissimo, C. Esteve Rothenberg, S. Azodolmolky, and S. Uhlig Software-Defined Networking: A Comprehensive Survey. Proceedings of the IEEE 103, 1 (2015).

[38]

V. T. Lam, S. Radhakrishnan, R. Pan, A. Vahdat, and G. Varghese Netshare and Stochastic Netshare: Predictable Bandwidth Allocation for Data Centers. SIGCOMM Comput. Commun. Rev. 42, 3 (2012).

Digital Library

[39]

J. Lee, Y. Turner, M. Lee, L. Popa, S. Banerjee, J.-M. Kang, and P. Sharma Application-driven Bandwidth Guarantees in Datacenters. In: SIGCOMM. 2014.

Digital Library

[40]

A. Likhtarov, R. Nishtala, R. McElroy, H. Fugal, A. Grynenko, and V. Venkataramani Introducing mcrouter: A memcached protocol router for scaling memcached deployments. Facebook. 2014. url: http://bit.ly/1TpNKo0 (visited on 06/16/2015).

[41]

S. McCanne, and V. Jacobson The BSD Packet Filter: A New Architecture for User-level Packet Capture. In: USENIX Winter Conf. USENIX, 1993.

Digital Library

[42]

N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner OpenFlow: Enabling Innovation in Campus Networks. SIGCOMM Comput. Commun. Rev. 38, 2 (2008).

Digital Library

[43]

J. Mogul, R. Rashid, and M. Accetta The Packer Filter: An Efficient Mechanism for User-level Network Code. In: SOSP '87. ACM, 1987.

Digital Library

[44]

J. Mudigonda, P. Yalagandula, M. Al-Fares, and J. C. Mogul SPAIN: COTS Data-center Ethernet for Multipathing over Arbitrary Topologies. In: NSDI. USENIX, 2010.

Digital Library

[45]

A. Munir, G. Baig, S. M. Irteza, I. A. Qazi, A. X. Liu, and F. R. Dogar Friends, Not Foes: Synthesizing Existing Transport Strategies for Data Center Networks. In: SIGCOMM. ACM, 2014.

Digital Library

[46]

Netronome Netronome FlowNICs. 2015. url: http://netronome.com/product/ownics/ (visited on 06/03/2015).

[47]

P. Patel, D. Bansal, L. Yuan, A. Murthy, A. Greenberg, D. A. Maltz, R. Kern, H. Kumar, M. Zikos, H. Wu, C. Kim, and N. Karri Ananta: Cloud Scale Load Balancing. In: SIGCOMM. ACM, 2013.

Digital Library

[48]

J. Perry, A. Ousterhout, H. Balakrishnan, D. Shah, and H. Fugal Fastpass: A Centralized "Zero-queue" Datacenter Network. In: SIGCOMM. ACM, 2014.

Digital Library

[49]

B. Pfaff, J. Pettit, T. Koponen, K. Amidon, M. Casado, and S. Shenker Extending Networking into the Virtualization Layer. In: HotNets-VIII. ACM, 2009.

[50]

B. Pfaff, J. Pettit, T. Koponen, E. Jackson, A. Zhou, J. Rajahalme, J. Gross, A. Wang, J. Stringer, P. Shelar, K. Amidon, and M. Casado The Design and Implementation of Open vSwitch. In: NSDI. USENIX, 2015.

Digital Library

[51]

L. Popa, A. Krishnamurthy, S. Ratnasamy, and I. Stoica FairCloud: Sharing the Network in Cloud Computing. In: HotNets-X. ACM, 2011.

Digital Library

[52]

L. Popa, P. Yalagandula, S. Banerjee, J. C. Mogul, Y. Turner, and J. R. Santos ElasticSwitch: Practical Work-conserving Bandwidth Guarantees for Cloud Computing. In: SIGCOMM. ACM, 2013.

Digital Library

[53]

C. Raiciu, C. Paasch, S. Barre, A. Ford, M. Honda, F. Duchene, O. Bonaventure, and M. Handley How Hard Can It Be? Designing and Implementing a Deployable Multipath TCP. In: NSDI. USENIX, 2012.

Digital Library

[54]

M. Reitblatt, M. Canini, A. Guha, and N. Foster FatTire: Declarative Fault Tolerance for Software-Defined Networks. In: HotSDN. ACM, 2013.

Digital Library

[55]

M. Reitblatt, N. Foster, J. Rexford, C. Schlesinger, and D. Walker Abstractions for Network Update. In: SIGCOMM. ACM, 2012.

Digital Library

[56]

B. Schwartz, A. W. Jackson, W. T. Strayer, W. Zhou, R. D. Rockwell, and C. Partridge Smart Packets: Applying Active Networks to Network Management. ACM Trans. Comput. Syst. 18, 1 (2000).

Digital Library

[57]

A. Shieh, S. Kandula, and E. G. Sirer SideCar: Building Programmable Datacenter Networks Without Programmable Switches. In: Hotnets-IX. ACM, 2010.

Digital Library

[58]

D. Shue, M. J. Freedman, and A. Shaikh Performance Isolation and Fairness for Multi-tenant Cloud Storage. In: OSDI. USENIX, 2012.

Digital Library

[59]

R. Soule, S. Basu, R. Kleinberg, E. G. Sirer, and N. Foster Managing the Network with Merlin. In: HotNets-XII. ACM, 2013.

Digital Library

[60]

D. L. Tennenhouse, and D. J. Wetherall Towards an Active Network Architecture. SIGCOMM Comput. Commun. Rev. 26, 2 (1996).

Digital Library

[61]

E. Thereska, H. Ballani, G. O'Shea, T. Karagiannis, A. Rowstron, T. Talpey, R. Black, and T. Zhu IOFlow: A Software-defined Storage Architecture. In: SOSP. ACM, 2013.

Digital Library

[62]

A. Voellmy, J. Wang, Y. R. Yang, B. Ford, and P. Hudak Maple: Simplifying SDN Programming Using Algorithmic Policies. SIGCOMM Comput. Commun. Rev. 43, 4 (2013).

Digital Library

[63]

D. Wetherall, J. V. Guttag, and D. Tennenhouse ANTS: a toolkit for building and dynamically deploying network protocols. In: OPENARCH. IEEE, 1998.

[64]

C. Wilson, H. Ballani, T. Karagiannis, and A. Rowtron Better Never Than Late: Meeting Deadlines in Datacenter Networks. In: SIGCOMM. ACM, 2011.

Digital Library

[65]

J. Zhou, M. Tewari, M. Zhu, A. Kabbani, L. Poutievski, A. Singh, and A. Vahdat WCMP: Weighted Cost Multipathing for Improved Fairness in Data Centers. In: EuroSys. ACM, 2014.

Digital Library

Cited By

Miano SSanaee ARisso FRétvári GAntichi G(2024)Morpheus: A Run Time Compiler and Optimizer for Software Data PlanesIEEE/ACM Transactions on Networking10.1109/TNET.2023.334628632:3(2269-2284)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1109/TNET.2023.3346286
Chang HKodialam MLakshman TMukherjee SVan der Merwe JZaheer Z(2023)MAGNet: Machine Learning Guided Application-Aware Networking for Data CentersIEEE Transactions on Cloud Computing10.1109/TCC.2021.308744711:1(291-307)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TCC.2021.3087447
Miano SSanaee ARisso FRétvári GAntichi GFalsafi BFerdman MLu SWenisch T(2022)Domain specific run time optimization for software data planesProceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3503222.3507769(1148-1164)Online publication date: 28-Feb-2022
https://dl.acm.org/doi/10.1145/3503222.3507769
Show More Cited By

Index Terms

Enabling End-Host Network Functions
1. Networks
  1. Network services
  2. Network types
    1. Data center networks

Recommendations

Enabling End-Host Network Functions
SIGCOMM'15

Many network functions executed in modern datacenters, e.g., load balancing, application-level QoS, and congestion control, exhibit three common properties at the data-plane: they need to access and modify state, to perform computations, and to access ...
Read More
Enabling fast, dynamic network processing with clickOS
HotSDN '13: Proceedings of the second ACM SIGCOMM workshop on Hot topics in software defined networking

Middleboxes are both crucial to today's networks and ubiquitous, but embed knowledge of today's protocols and applications to the detriment of those of tomorrow, making the network harder to evolve. SDNs seek to make it easier to extend the network with ...
Read More
Trends on virtualisation with software defined networking and network function virtualisation

Software defined networking (SDN) and network function virtualisation (NFV) have become hot topics in recent years. On one hand, SDN decouples the control plane from the data plane allowing the rapid innovation and the introduction of new services in an ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCOMM '15: Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication

August 2015

684 pages

ISBN:9781450335423

DOI:10.1145/2785956

General Chairs:
Steve Uhlig
Queen Mary University of London, UK
,
Olaf Maennel
Tallinn U. of Technology in Estonia, Estonia
,
Program Chairs:
Brad Karp
University College London, UK
,
Jitendra Padhye
Microsoft, USA

ACM SIGCOMM Computer Communication Review Volume 45, Issue 4
SIGCOMM'15
October 2015
659 pages
ISSN:0146-4833
DOI:10.1145/2829988
Editors:
Konstantina Papagiannaki
Telefonica Research, Barcelona, Spain
,
Katerina Argyraki
EPFL, Switzerland
,
Hitesh Ballani
Microsoft Research Cambridge, UK
,
Fabián Bustamante
Northwestern University, USA
,
Joseph Camp
SMU, USA
,
Augustin Chaintreau
Columbia University, USA
,
Phillipa Gill
Stony Brook University, USA
,
Marco Mellia
Politecnico di Torino, Italy
,
Bhaskaran Raman
IIT Bombay, India
,
Joel Sommers
Colgate University, USA
,
Aline Carneiro Viana
INRIA, France
Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 August 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGCOMM '15

Sponsor:

SIGCOMM

SIGCOMM '15: ACM SIGCOMM 2015 Conference

August 17 - 21, 2015

London, United Kingdom

Acceptance Rates

SIGCOMM '15 Paper Acceptance Rate 40 of 242 submissions, 17%;

Overall Acceptance Rate 554 of 3,547 submissions, 16%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

64
Total Citations
View Citations
799
Total Downloads

Downloads (Last 12 months)65
Downloads (Last 6 weeks)11

Other Metrics

View Author Metrics

Citations

Cited By

Miano SSanaee ARisso FRétvári GAntichi G(2024)Morpheus: A Run Time Compiler and Optimizer for Software Data PlanesIEEE/ACM Transactions on Networking10.1109/TNET.2023.334628632:3(2269-2284)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1109/TNET.2023.3346286
Chang HKodialam MLakshman TMukherjee SVan der Merwe JZaheer Z(2023)MAGNet: Machine Learning Guided Application-Aware Networking for Data CentersIEEE Transactions on Cloud Computing10.1109/TCC.2021.308744711:1(291-307)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TCC.2021.3087447
Miano SSanaee ARisso FRétvári GAntichi GFalsafi BFerdman MLu SWenisch T(2022)Domain specific run time optimization for software data planesProceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3503222.3507769(1148-1164)Online publication date: 28-Feb-2022
https://dl.acm.org/doi/10.1145/3503222.3507769
Zuo PShu Y(2021)An Elephant Flows Scheduling Method Based on Feedforward Neural Network2021 World Conference on Computing and Communication Technologies (WCCCT)10.1109/WCCCT52091.2021.00011(16-20)Online publication date: Jan-2021
https://doi.org/10.1109/WCCCT52091.2021.00011
Khan TKhan MAbbas SJanjua JMuhammad SAsif M(2021)Topology-Aware Load Balancing in Datacenter Networks2021 IEEE Asia Pacific Conference on Wireless and Mobile (APWiMob)10.1109/APWiMob51111.2021.9435218(220-225)Online publication date: 8-Apr-2021
https://doi.org/10.1109/APWiMob51111.2021.9435218
Katsikas GBarbette TChiesa MKostić DMaguire G(2021)What You Need to Know About (Smart) Network Interface CardsPassive and Active Measurement10.1007/978-3-030-72582-2_19(319-336)Online publication date: 30-Mar-2021
https://doi.org/10.1007/978-3-030-72582-2_19
Eran HZeno LTork MMalka GSilberstein MDan TDahlia M(2019)NICAProceedings of the 2019 USENIX Conference on Usenix Annual Technical Conference10.5555/3358807.3358838(345-361)Online publication date: 10-Jul-2019
https://dl.acm.org/doi/10.5555/3358807.3358838
Duan JYi XZhao SWu CCui HLe F(2019)NFVactor: A Resilient NFV System Using the Distributed Actor ModelIEEE Journal on Selected Areas in Communications10.1109/JSAC.2019.289428737:3(586-599)Online publication date: Mar-2019
https://doi.org/10.1109/JSAC.2019.2894287
Miano SDoriguzzi-Corin RRisso FSiracusa DSommese R(2019)Introducing SmartNICs in Server-Based Data Plane Processing: The DDoS Mitigation Use CaseIEEE Access10.1109/ACCESS.2019.29334917(107161-107170)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2933491
Neugebauer RAntichi GZazo JAudzevich YLópez-Buedo SMoore AGorinsky STapolcai J(2018)Understanding PCIe performance for end host networkingProceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication10.1145/3230543.3230560(327-341)Online publication date: 7-Aug-2018
https://dl.acm.org/doi/10.1145/3230543.3230560
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents