research-article

Open access

Bertha: Tunneling through the Network API

Authors:

Akshay Narayan,

Mohammad Alizadeh,

Hari Balakrishnan,

Arvind Krishnamurthy,

Scott ShenkerAuthors Info & Claims

HotNets '20: Proceedings of the 19th ACM Workshop on Hot Topics in Networks

Pages 53 - 59

https://doi.org/10.1145/3422604.3425927

Published: 04 November 2020 Publication History

Abstract

Network APIs such as UNIX sockets, DPDK, Netmap, etc. assume that networks provide only end-to-end connectivity. However, networks increasingly include smart NICs and programmable switches that can implement both network and application functions. Several recent works have shown the benefit of offloading application functionality to the network, but using these approaches requires changing not just the applications, but also network and system configuration. In this paper we propose Bertha, a network API that provides a uniform abstraction for offloads, aiming to simplify their use.

References

[1]

M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, M. Devin, S. Ghemawat, G. Irving, M. Isard, et al. Tensorflow: A System for Large-Scale Machine Learning. In OSDI, 2016.

Digital Library

[2]

Amazon. Elastic Load Balancing. https://aws.amazon.com/elasticloadbalancing/.

[3]

Andrew Morgan. How MySQL is able to scale to 200 Million QPS - MySQL Cluster. http://highscalability.com/blog/2015/5/18/how-mysql-is-able-to-scale-to-200-million-qps-mysql-cluster.html.

[4]

Apache. Arrow. https://arrow.apache.org/.

[5]

Apache. Thrift. https://thrift.apache.org/.

[6]

M. T. Arashloo, A. Lavrov, M. Ghobadi, J. Rexford, D. Walker, and D. Wentzlaff. Enabling Programmable Transport Protocols in High-Speed NICs. In NSDI, 2020.

[7]

C. P. Authors. Cap'n Proto Cerealization Protocol. https://capnproto.org/.

[8]

T. Ball, N. Bjørner, A. Gember, S. Itzhaky, A. Karbyshev, M. Sagiv, M. Schapira, and A. Valadarsky. VeriCon: Towards Verifying Controller Programs in Software-Defined Networks. In PLDI, 2014.

Digital Library

[9]

A. Baumann, M. Peinado, and G. C. Hunt. Shielding applications from an untrusted cloud with haven. In TOCS, 2015.

Digital Library

[10]

P. Bosshart, G. Gibb, H.-S. Kim, G. Varghese, N. McKeown, M. Izzard, F. Mujica, and M. Horowitz. Forwarding Metamorphosis: Fast Programmable Match-Action Processing in Hardware for SDN. In SIGCOMM, 2013.

Digital Library

[11]

Bruce Curtis. net-tcp: TCP/IP stack bypass for loopback connections. https://www.spinics.net/lists/netdev/msg210741.html.

[12]

Chelsio Communications. TCP Offload Engine (TOE). http://www.chelsio.com/nic/tcp-offload-engine/.

[13]

B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking Cloud Serving Systems with YCSB. In SoCC, 2010.

Digital Library

[14]

W. J. Dally, Y. Turakhia, and S. Han. Domain-specific hardware accelerators. CACM, July 2020.

[15]

DPDK Authors. DPDK. https://www.dpdk.org/.

[16]

ETSI. Network Functions Virtualisation. http://portal.etsi.org/NFV/NFV_White_Paper.pdf.

[17]

N. Foster, R. Harrison, M. J. Freedman, C. Monsanto, J. Rexford, A. Story, and D. Walker. Frenetic: A Network Programming Language. In ICFP, 2011.

Digital Library

[18]

A. Ghodsi, M. Zaharia, B. Hindman, A. Konwinski, S. Shenker, and I. Stoica. Dominant Resource Fairness: Fair Allocation of Multiple Resource Types. In NSDI, 2011.

Digital Library

[19]

I. Gog, M. Schwarzkopf, A. Gleave, R. N. M. Watson, and S. Hand. Firmament: Fast, Centralized Cluster Scheduling at Scale. In OSDI, 2016.

Digital Library

[20]

Google. Flatbuffers. https://google.github.io/flatbuffers/.

[21]

Google. gRPC. https://grpc.io/.

[22]

Google. Protocol Buffers. https://developers.google.com/protocol-buffers/.

[23]

Google. XLA: Optimizing Compiler for Machine Learning. https://www.tensorflow.org/xla/.

[24]

D. Hancock and J. E. van der Merwe. HyPer4: Using P4 to Virtualize the Programmable Data Plane. CoNEXT, 2016.

Digital Library

[25]

T. Høiland-Jørgensen, J. D. Brouer, D. Borkmann, J. Fastabend, T. Herbert, D. Ahern, and D. Miller. The EXpress Data Path: Fast Programmable Packet Processing in the Operating System Kernel. In CoNEXT, 2018.

Digital Library

[26]

M. Jakobsson. Secure remote attestation. IACR Cryptol. ePrint Arch., 2018:31, 2018.

[27]

J. Jang, S. J. Jung, S. Jeong, J. Heo, H. Shin, T. J. Ham, and J. W. Lee. A specialized architecture for object serialization with applications to big data analytics. In ISCA, 2020.

[28]

Jeff Barr. New -- Advanced Request Routing for AWS Application Load Balancers. https://aws.amazon.com/blogs/aws/new-advanced-request-routing-for-aws-application-load-balancers/.

[29]

E. Y. Jeong, S. Woo, M. Jamshed, H. Jeong, S. Ihm, D. Han, and K. Park. MTCP: A Highly Scalable User-Level TCP Stack for Multicore Systems. In NSDI, 2014.

Digital Library

[30]

X. Jin, X. Li, H. Zhang, R. Soulé, J. Lee, N. Foster, C. Kim, and I. Stoica. NetCache: Balancing Key-Value Stores with Fast In-Network Caching. In SOSP, 2017.

Digital Library

[31]

A. Khawaja, J. Landgraf, R. Prakash, M. Wei, E. Schkufza, and C. J. Rossbach. Sharing, Protection, and Compatibility for Reconfigurable Fabric with AmorphOS. In OSDI, 2018.

[32]

D. Kim, T. Yu, H. H. Liu, Y. Zhu, J. Padhye, S. Raindel, C. Guo, V. Sekar, and S. Seshan. FreeFlow: Software-based Virtual RDMA Networking for Containerized Clouds. In NSDI, 2019.

[33]

P. Kumar, N. Dukkipati, N. Lewis, Y. Cui, Y. Wang, C. Li, V. Valancius, J. Adriaens, S. Gribble, N. Foster, and A. Vahdat. PicNIC: Predictable Virtualized NIC. In SIGCOMM, 2019.

Digital Library

[34]

F. Labs. Intelligent Application traffic Management. https://www.f5.com/products/big-ip-services/local-traffic-manager.

[35]

A. Langley, A. Riddoch, A. Wilk, A. Vicente, C. Krasic, D. Zhang, F. Yang, F. Kouranov, I. Swett, J. Iyengar, J. Bailey, J. Dorfman, J. Roskind, J. Kulik, P. Westin, R. Tenneti, R. Shade, R. Hamilton, V. Vasiliev, W.-T. Chang, and Z. Shi. The QUIC Transport Protocol: Design and Internet-Scale Deployment. In SIGCOMM, 2017.

Digital Library

[36]

D. Lee, D. Kohlbrenner, S. Shinde, K. Asanovic, and D. Song. Keystone: An Open Framework for Architecting Trusted Execution Environments. In EuroSys, 2020.

Digital Library

[37]

J. Li, E. Michael, N. K. Sharma, A. Szekeres, and D. R. K. Ports. Just Say NO to Paxos Overhead: Replacing Consensus with Network Ordering. In OSDI, 2016.

Digital Library

[38]

B. M. Maggs and R. K. Sitaraman. Algorithmic nuggets in content delivery. SIGCOMM CCR, July 2015.

Digital Library

[39]

H. Mao, M. Schwarzkopf, S. B. Venkatakrishnan, Z. Meng, and M. Alizadeh. Learning Scheduling Algorithms for Data Processing Clusters. In SIGCOMM, 2019.

Digital Library

[40]

N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner. OpenFlow: Enabling Innovation in Campus Networks. SIGCOMM CCR, Mar. 2008.

Digital Library

[41]

Microsoft. Fast TCP Loopback Performance and Low Latency with Windows Server 2012 TCP Loopback Fast Path. https://docs.microsoft.com/en-us/archive/blogs/wincat/fast-tcp-loopback-performance-and-low-latency-with-windows-server-2012-tcp-loopback-fast-path.

[42]

Microsoft. Introduction to Hyper-V on Windows 10. https://docs.microsoft.com/en-us/virtualization/hyper-v-on-windows/about/.

[43]

G. C. Necula. Proof-carrying code. In POPL, 1997.

[44]

G. C. Necula and P. Lee. Safe Kernel Extensions without Run-Time Checking. In OSDI, 1996.

Digital Library

[45]

T. Nelson, A. D. Ferguson, M. J. Scheer, and S. Krishnamurthi. Tierless Programming and Reasoning for Software-Defined Networks. In NSDI, 2014.

Digital Library

[46]

R. Nishtala, H. Fugal, S. Grimm, M. Kwiatkowski, H. Lee, H. C. Li, R. McElroy, M. Paleczny, D. Peek, P. Saab, D. Stafford, T. Tung, and V. Venkataramani. Scaling Memcache at Facebook. In NSDI, 2013.

Digital Library

[47]

E. Nordström, D. Shue, P. Gopalan, R. Kiefer, M. Arye, S. Y. Ko, J. Rexford, and M. J. Freedman. Serval: An end-host stack for service-centric networking. In NSDI, 2012.

[48]

E. Nygren, R. K. Sitaraman, and J. Sun. The Akamai Network: A Platform for High-Performance Internet Applications. SIGOPS Oper. Syst. Rev., August 2010.

[49]

ONNX. Open Neural Network Exchange. https://onnx.ai/.

[50]

S. Palkar, J. Thomas, D. Narayanan, P. Thaker, R. Palamuttam, P. Negi, A. Shanbhag, M. Schwarzkopf, H. Pirk, S. Amarasinghe, S. Madden, and M. Zaharia. Evaluating End-to-End Optimization for Data Analytics Applications in Weld. In VLDB, 2018.

Digital Library

[51]

P. M. Phothilimthana, M. Liu, A. Kaufmann, S. Peter, R. Bodik, and T. Anderson. Floem: A Programming System for NIC-Accelerated Network Applications. In OSDI, 2018.

[52]

D. R. K. Ports, J. Li, V. Liu, N. K. Sharma, and A. Krishnamurthy. Designing Distributed Systems Using Approximate Synchrony in Data Center Networks. In NSDI, 2015.

Digital Library

[53]

D. R. K. Ports and J. Nelson. When Should the Network be the Computer? In HotOS, 2019.

Digital Library

[54]

ProxySQL. ProxySQL: A High Performance Open Source MySQL Proxy. https://proxysql.com/.

[55]

L. Rizzo. netmap: A Novel Framework for Fast Packet I/O. In USENIX ATC, 2012.

Digital Library

[56]

J. H. Saltzer, D. P. Reed, and D. D. Clark. End-to-End Arguments in System Design. ACM ToCS, Nov. 1984.

Digital Library

[57]

J. Sherry, D. Kim, S. Mahalingam, A. Tang, S. Wang, and S. Ratnasamy. Netcalls: End Host Function Calls to Network Traffic Processing Services. UC Berkeley Technical Report No. UCB/EECS-2012--175. http://www.eecs.berkeley.edu/Pubs/TechRpts/2012/EECS-2012--175.html, 2012.

[58]

A. Sivaraman, A. Cheung, M. Budiu, C. Kim, M. Alizadeh, H. Balakrishnan, G. Varghese, N. McKeown, and S. Licking. Packet Transactions: High-Level Programming for Line-Rate Switches. In SIGCOMM, 2016.

Digital Library

[59]

R. Soulé, S. Basu, P. J. Marandi, F. Pedone, R. Kleinberg, E. G. Sirer, and N. Foster. Merlin: A Language for Provisioning Network Resources. In CoNEXT, 2014.

Digital Library

[60]

D. L. Tennenhouse and D. J. Wetherall. Towards an Active Network Architecture. SIGCOMM CCR, October 2007.

Digital Library

[61]

M. Walfish, J. Stribling, M. N. Krohn, H. Balakrishnan, R. T. Morris, and S. Shenker. Middleboxes no longer considered harmful. In OSDI, 2004.

Digital Library

[62]

T. Wang, H. Zhu, F. Ruffy, X. Jin, A. Sivaraman, D. Ports, and A. Panda. Multitenancy for Fast and Programmable Networks in the Cloud. In HotCloud, 2020.

[63]

H. Yu, A. M. Peters, A. Akshintala, and C. J. Rossbach. AvA: Accelerated Virtualization of Accelerators. ASPLOS, 2020.

Digital Library

[64]

P. Zheng, T. Benson, and C. Hu. P4Visor: Lightweight Virtualization and Composition Primitives for Building and Testing Modular Programs. In CoNEXT, 2018.

Digital Library

[65]

P. Zheng, T. Benson, and C. Hu. P4Visor: lightweight virtualization and composition primitives for building and testing modular programs. CoNEXT, 2018.

Digital Library

[66]

D. Zhuo, K. Zhang, Y. Zhu, H. H. Liu, M. Rockett, A. Krishnamurthy, and T. Anderson. Slim: OS Kernel Support for a Low-Overhead Container Overlay Network. In NSDI, 2019.

Cited By

Bonelli NVigna FFais ALettieri GProcissi G(2022)Programming socket-independent network functions with nethunsACM SIGCOMM Computer Communication Review10.1145/3544912.354491752:2(35-48)Online publication date: 30-Apr-2022
https://dl.acm.org/doi/10.1145/3544912.3544917
Chung JZacherek WWisniewski ALiu ZBicer TKettimuthu RFoster IWeissman JChandra AGavrilovska ATiwari D(2022)SciStreamProceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing10.1145/3502181.3531475(185-198)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3502181.3531475
Raghavan DLevis PZaharia MZhang IAngel SKasikci BKohler E(2021)Breakfast of championsProceedings of the Workshop on Hot Topics in Operating Systems10.1145/3458336.3465287(199-205)Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1145/3458336.3465287

Index Terms

Bertha: Tunneling through the Network API
1. Networks
  1. Network architectures
    1. Programming interfaces

Recommendations

A Lightweight Network Slicing Orchestration Architecture (poster)
MobiSys '19: Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services

With the explosive growth of large scale services, traditional mobile networks have become increasingly unable to guarantee the efficient operation of services. However in the fifth generation (5G), supported by Software Defined Network (SDN) and ...
Design of NIC Redundancy under Bottom-Layer Driver in VxWorks System
IMCCC '13: Proceedings of the 2013 Third International Conference on Instrumentation, Measurement, Computer, Communication and Control

The requirements of common network communication for the reliability of network transmission are low. It can not meet the requirements of real time and high reliability in the industrial control network traffic. For needs of high reliability in ...
REST API Design Patterns for SDN Northbound API
WAINA '14: Proceedings of the 2014 28th International Conference on Advanced Information Networking and Applications Workshops

REST architectural style gains increasing popularity in the networking protocol design, and it has become a prevalent choice for northbound API of Software-Defined Networking (SDN). This paper addresses many critical issues in RESTful networking ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HotNets '20: Proceedings of the 19th ACM Workshop on Hot Topics in Networks

November 2020

228 pages

ISBN:9781450381451

DOI:10.1145/3422604

General Chairs:
Ben Zhao
University of Chicago
,
Heather Zheng
University of Chicago
,
Program Chairs:
Harsha V. Madhyastha
University of Michigan
,
Venkat Padmanabhan
Microsoft Research India

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2020

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NSF

Conference

HotNets '20

Sponsor:

SIGCOMM

HotNets '20: The 19th ACM Workshop on Hot Topics in Networks

November 4 - 6, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 110 of 460 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
1,036
Total Downloads

Downloads (Last 12 months)148
Downloads (Last 6 weeks)13

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bonelli NVigna FFais ALettieri GProcissi G(2022)Programming socket-independent network functions with nethunsACM SIGCOMM Computer Communication Review10.1145/3544912.354491752:2(35-48)Online publication date: 30-Apr-2022
https://dl.acm.org/doi/10.1145/3544912.3544917
Chung JZacherek WWisniewski ALiu ZBicer TKettimuthu RFoster IWeissman JChandra AGavrilovska ATiwari D(2022)SciStreamProceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing10.1145/3502181.3531475(185-198)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3502181.3531475
Raghavan DLevis PZaharia MZhang IAngel SKasikci BKohler E(2021)Breakfast of championsProceedings of the Workshop on Hot Topics in Operating Systems10.1145/3458336.3465287(199-205)Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1145/3458336.3465287

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents