Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3322798.3329257acmconferencesArticle/Chapter ViewAbstractPublication PageshpdcConference Proceedingsconference-collections
short-paper

A Software Defined Network Design for Analyzing Streaming Data in Transit

Published: 17 June 2019 Publication History

Abstract

Year after year, network traffic keeps reaching new highs as unprecedented volumes of data flow between an ever-increasing number of sources and destinations. As part of the Analysis on the Wire project, we aim to develop a network-centric approach for streaming data processing to facilitate scientific data analysis and reduce the overhead in sending big data to a data center. This work discusses our design for programmable network devices to augment network capabilities for streaming data processing, including efforts in progress at Brookhaven National Laboratory and the challenges faced to date.

References

[1]
Daniel Firestone, Andrew Putnam, Sambhrama Mundkur, Derek Chiou, Alireza Dabagh, Mike Andrewartha, Hari Angepat, Vivek Bhanu, Adrian Caulfield, Eric Chung, et al. 2018. Azure accelerated networking: SmartNICs in the public cloud. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18). 51--66.
[2]
Richard L. Graham, Devendar Bureddy, Pak Lui, Hal Rosenstock, Gilad Shainer, Gil Bloch, et al. 2016. Scalable Hierarchical Aggregation Protocol (SHArP): A Hardware Architecture for Efficient Data Reduction. In Proceedings of the First Workshop on Optimization of Communication in HPC (COM-HPC '16). IEEE Press, Piscataway, NJ, USA, 1--10.
[3]
Joel M. Halpern and Carlos Pignataro. 2015. Service Function Chaining (SFC) Architecture. RFC 7665.
[4]
Sushant Jain, Alok Kumar, Subhasree Mandal, Joon Ong, Leon Poutievski, Arjun Singh, Subbaiah Venkata, Jim Wanderer, Junlan Zhou, Min Zhu, Jon Zolla, Urs Hölzle, Stephen Stuart, and Amin Vahdat. 2013. B4: Experience with a Globally-deployed Software Defined Wan. SIGCOMM Comput. Commun. Rev., Vol. 43, 4 (Aug. 2013), 3--14.
[5]
Diego Kreutz, Fernando MV Ramos, Paulo Verissimo, Christian Esteve Rothenberg, Siamak Azodolmolky, and Steve Uhlig. 2015. Software-Defined Networking: A Comprehensive Survey. Proc. IEEE, Vol. 103, 1 (Jan 2015), 14--76.
[6]
Nick McKeown, Tom Anderson, Hari Balakrishnan, Guru Parulkar, Larry Peterson, Jennifer Rexford, Scott Shenker, and Jonathan Turner. 2008. OpenFlow: enabling innovation in campus networks. ACM SIGCOMM Computer Communication Review, Vol. 38, 2 (2008), 69--74.
[7]
Barefoot Networks and P4.org Applications Working Group. 2018. Barefoot Deep Insight Monitoring System Enabled by DataPlane Telemetry. https://p4.org/assets/P4WS_2018/9_Daniel_Alvarez_DI.pdf
[8]
Andrew Putnam, Adrian M Caulfield, Eric S Chung, Derek Chiou, Kypros Constantinides, John Demme, Hadi Esmaeilzadeh, et al. 2015. A Reconfigurable Fabric for Accelerating Large-Scale Datacenter Services., Vol. 35, 3 (May 2015), 10--22.
[9]
Paul Quinn, Uri Elzur, and Carlos Pignataro. 2018. Network Service Header (NSH). RFC 8300.
[10]
Michael Stonebraker, Uvgur Cetintemel, and Stan Zdonik. 2005. The 8 Requirements of Real-time Stream Processing. SIGMOD Rec., Vol. 34, 4 (Dec. 2005), 42--47.
[11]
Amazon Kinesis Data Streams. 2016. Real-Time Analytics with Amazon Kinesis. https://aws.amazon.com/solutions/streaming-analytics-pipeline
[12]
Cisco white paper. 2017. Cisco Visual Networking Index: Forecast and Trends, 2017--2022. https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/white-paper-c11--741490.pdf
[13]
Hui Yang, Jie Zhang, Yongli Zhao, Jianrui Han, Yi Lin, and Young Lee. 2016. SUDOI: software defined networking for ubiquitous data center optical interconnection. IEEE Communications Magazine, Vol. 54, 2 (2016), 86--95.
[14]
Noa Zilberman, Yury Audzevich, G Adam Covington, and Andrew W Moore. 2014. NetFPGA SUME: Toward 100 Gbps as Research Commodity. IEEE Micro, Vol. 34, 5 (Sep. 2014), 32--41.

Cited By

View all
  • (2020)Electricity Load Forecasting with Collective Echo State Networks2020 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)10.1109/SmartGridComm47815.2020.9302985(1-6)Online publication date: 11-Nov-2020

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SNTA '19: Proceedings of the ACM Workshop on Systems and Network Telemetry and Analytics
June 2019
58 pages
ISBN:9781450367615
DOI:10.1145/3322798
  • General Chairs:
  • Jinoh Kim,
  • Alex Sim
© 2019 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the United States Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 June 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. in-network computation
  2. process data on the wire
  3. programmable switch
  4. software defined network

Qualifiers

  • Short-paper

Funding Sources

  • US Department of Energy Brookhaven National Laboratory

Conference

HPDC '19
Sponsor:

Acceptance Rates

SNTA '19 Paper Acceptance Rate 22 of 106 submissions, 21%;
Overall Acceptance Rate 22 of 106 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2020)Electricity Load Forecasting with Collective Echo State Networks2020 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)10.1109/SmartGridComm47815.2020.9302985(1-6)Online publication date: 11-Nov-2020

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media