research-article

PortLand: a scalable fault-tolerant layer 2 data center network fabric

Authors:

Radhika Niranjan Mysore,

Andreas Pamboris,

Nathan Farrington,

Sivasankar Radhakrishnan,

Vikram Subramanya, and

Amin VahdatAuthors Info & Claims

ACM SIGCOMM Computer Communication Review, Volume 39, Issue 4

Pages 39 - 50

https://doi.org/10.1145/1594977.1592575

Published: 16 August 2009 Publication History

Abstract

This paper considers the requirements for a scalable, easily manageable, fault-tolerant, and efficient data center network fabric. Trends in multi-core processors, end-host virtualization, and commodities of scale are pointing to future single-site data centers with millions of virtual end points. Existing layer 2 and layer 3 network protocols face some combination of limitations in such a setting: lack of scalability, difficult management, inflexible communication, or limited support for virtual machine migration. To some extent, these limitations may be inherent for Ethernet/IP style protocols when trying to support arbitrary topologies. We observe that data center networks are often managed as a single logical network fabric with a known baseline topology and growth model. We leverage this observation in the design and implementation of PortLand, a scalable, fault tolerant layer 2 routing and forwarding protocol for data center environments. Through our implementation and evaluation, we show that PortLand holds promise for supporting a ``plug-and-play" large-scale, data center network.

References

[1]

Cisco Data Center Infrastructure 2.5 Design Guide. www.cisco.com/application/pdf/en/us/guest/netsol/ns107/c649/ccmigration_09186a008073377d.pdf.

[2]

Configuring IP Unicast Layer 3 Switching on Supervisor Engine 2. www.cisco.com/en/US/docs/routers/7600/ios/12.1E/configuration/guide/cef.html.

[3]

Inside Microsoft's $550 Million Mega Data Centers. www.informationweek.com/news/hardware/data_centers/showArticle.jhtml?articleID=208403723.

[4]

OpenFlow. www.openflowswitch.org/ .

[5]

OSPF Design Guide. www.ciscosystems.com/en/US/tech/tk365/technologies_white_paper09186a0080094e9e.shtml.

[6]

M. Al-Fares, A. Loukissas, and A. Vahdat. A Scalable, Commodity Data Center Network Architecture. In SIGCOMM '08: Proceedings of the ACM SIGCOMM 2008 conference on Data communication, pages 63--74, New York, NY, USA, 2008. ACM.

Digital Library

[7]

M. Caesar, D. Caldwell, N. Feamster, J. Rexford, A. Shaikh, and J. van der Merwe. Design and Implementation of a Routing Control Platform. In USENIX Symposium on Networked Systems Design & Implementation, 2005.

Digital Library

[8]

M. Caesar, M. Castro, E. B. Nightingale, G. O, and A. Rowstron. Virtual Ring Routing: Network Routing Inspired by DHTs. In Proceedings of ACM SIGCOMM,2006.

Digital Library

[9]

M. Caesar, T. Condie, J. Kannan, K. Lakshminarayanan, I. Stoica, and S. Shenker. ROFL: Routing on Flat Labels. In Proceedings of ACM SIGCOMM, 2006.

Digital Library

[10]

M. C. Changhoon Kim and J. Rexford. Floodless in SEATTLE: A Scalable Ethernet Architecture for Large Enterprises. In SIGCOMM '08: Proceedings of the ACM SIGCOMM 2008 conference on Data communication, 2008.

Digital Library

[11]

C. Clark, K. Fraser, S. Hand, J. G. H. E. J. C. Limpach, I. Pratt, and A. Warfield. Live Migration of Virtual Machines. In USENIX Symposium on Networked Systems Design & Implementation, 2005.

Digital Library

[12]

J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI'04: Proceedings of the 6th conference on Symposium on Operating Systems Design & Implementation, pages 10--10, Berkeley, CA, USA, 2004. USENIX Association.

Digital Library

[13]

S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google File System. ACM SIGOPS Operating Systems Review, 37(5), 2003.

Digital Library

[14]

A. Greenberg, P. Lahiri, D. A. Maltz, P. Patel, and S. Sengupta. Towards a Next Generation Data Center Architecture: Scalability and Commoditization. In PRESTO '08: Proceedings of the ACM Workshop on Programmable Routers for Extensible Services of Tomorrow, pages 57--62, New York, NY, USA, 2008. ACM.

Digital Library

[15]

C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu. DCell: A Scalable and Fault-tolerant Network Structure for Data Centers. In Proceedings of the ACM SIGCOMM 2008 conference on Data communication, pages 75--86, New York, NY, USA, 2008. ACM.

Digital Library

[16]

C. Hopps. Analysis of an Equal-Cost Multi-Path Algorithm. RFC 2992, Internet Engineering Task Force, 2000.

Digital Library

[17]

V. Kashyap. Dynamic Host Configuration Protocol (DHCP) over InfiniBand. RFC 4390 (Proposed Standard), 2006.

[18]

K. Lakshminarayanan, M. Caesar, M. Rangan, T. Anderson, S. Shenker, I. Stoica, and H. Luo. Achieving Convergence-Free Routing Using Failure--Carrying Packets. In Proceedings of ACM SIGCOMM, 2007.

Digital Library

[19]

C. E. Leiserson. Fat-Trees: Universal Networks for Hardware-Efficient Supercomputing. IEEE Transactions on Computers, 34(10):892--901, 1985.

Digital Library

[20]

J. W. Lockwood, N. McKeown, G. Watson, G. Gibb, P. Hartke, J. Naous, R. Raghuraman, and J. Luo. NetFPGA-An Open Platform for Gigabit-Rate Network Switching and Routing. In Proceedings of the 2007 IEEE International Conference on Microelectronic Systems Education, pages 160--161, Washington, DC, USA, 2007. IEEE Computer Society.

Digital Library

[21]

R. Moskowitz and P. Nikander. Host Identity Protocol (HIP) Architecture. RFC 4423 (Proposed Standard), 2006.

[22]

J. Moy. OSPF Version 2. RFC 2328, Internet Engineering Task Force, 1998.

[23]

A. Myers, T. S. E. Ng, and H. Zhang. Rethinking the Service Model: Scaling Ethernet to a Million Nodes. In ACM HotNets-III, 2004.

[24]

L. S. C. of the IEEE Computer Society. IEEE Standard for Local and Metropolitan Area Networks, Common Specifications Part 3: Media Access Control (MAC), Bridges Ammendment 2: Rapid Reconfiguration, June 2001.

[25]

R. Perlman, D. Eastlake, D. G. Dutt, S. Gai, and A. Ghanwani. Rbridges: Base Protocol Specification. Technical report, Internet Engineering Task Force, 2009.

[26]

T. L. Rodeheffer, C. A. Thekkath, and D. C. Anderson. SmartBridge: A Scalable Bridge Architecture. In Proceedings of ACM SIGCOMM, 2001.

Digital Library

[27]

M. D. Schroeder, A. D. Birrell, M. Burrows, H. Murray, R. M. Needham, T. L. Rodeheffer, E. H. Satterthwaite, and C. P. Thacker. Autonet: A High-Speed, Self-Configuring Local Area Network Using Point-to-Point Links. In IEEE Journal On Selected Areas in Communications, 1991.

[28]

M. Scott and J. Crowcroft. MOOSE: Addressing the Scalability of Ethernet. In EuroSys Poster session, 2008.

Cited By

Lin WLi XChang JWang X(2024)An Improved Fault Diagnosis Algorithm for Highly Scalable Data Center NetworksMathematics10.3390/math1204059712:4(597)Online publication date: 17-Feb-2024
https://doi.org/10.3390/math12040597
Willis PShenoy NPan YStackpole B(2024)Investigating Data Center Network ProtocolsProceedings of the 2024 Applied Networking Research Workshop10.1145/3673422.3674897(91-93)Online publication date: 23-Jul-2024
https://dl.acm.org/doi/10.1145/3673422.3674897
Vatsal SVerma D(2023)Data Centre Efficiency Enhancement by Metrics Oriented Approach to Revamp Green Cloud Computing ConceptInternational Journal of Innovative Technology and Exploring Engineering10.35940/ijitee.F9532.071282312:8(1-14)Online publication date: 30-Jul-2023
https://doi.org/10.35940/ijitee.F9532.0712823
Show More Cited By

Index Terms

PortLand: a scalable fault-tolerant layer 2 data center network fabric
1. Networks
  1. Network protocols
    1. Network layer protocols
      1. Routing protocols

Recommendations

PortLand: a scalable fault-tolerant layer 2 data center network fabric
SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communication

This paper considers the requirements for a scalable, easily manageable, fault-tolerant, and efficient data center network fabric. Trends in multi-core processors, end-host virtualization, and commodities of scale are pointing to future single-site data ...
Read More
SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices
VEE '16

Single-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (ysical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly assigned ...
Read More
SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices
VEE '16: Proceedings of the12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments

Single-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (ysical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly assigned ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM SIGCOMM Computer Communication Review

ACM SIGCOMM Computer Communication Review Volume 39, Issue 4

SIGCOMM '09

October 2009

325 pages

ISSN:0146-4833

DOI:10.1145/1594977

Issue’s Table of Contents

SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communication
August 2009
340 pages
ISBN:9781605585949
DOI:10.1145/1592568
General Chairs:
Pablo Rodriguez
Telefonica Research, Spain
,
Ernst Biersack
Eurecom, France
,
Program Chairs:
Konstantina Papagiannaki
Intel Labs Pittsburgh, USA
,
Luigi Rizzo
Università di Pisa, Italy

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 August 2009

Published in SIGCOMM-CCR Volume 39, Issue 4

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

771
Total Citations
View Citations
6,314
Total Downloads

Downloads (Last 12 months)303
Downloads (Last 6 weeks)30

Other Metrics

View Author Metrics

Citations

Cited By

Lin WLi XChang JWang X(2024)An Improved Fault Diagnosis Algorithm for Highly Scalable Data Center NetworksMathematics10.3390/math1204059712:4(597)Online publication date: 17-Feb-2024
https://doi.org/10.3390/math12040597
Willis PShenoy NPan YStackpole B(2024)Investigating Data Center Network ProtocolsProceedings of the 2024 Applied Networking Research Workshop10.1145/3673422.3674897(91-93)Online publication date: 23-Jul-2024
https://dl.acm.org/doi/10.1145/3673422.3674897
Vatsal SVerma D(2023)Data Centre Efficiency Enhancement by Metrics Oriented Approach to Revamp Green Cloud Computing ConceptInternational Journal of Innovative Technology and Exploring Engineering10.35940/ijitee.F9532.071282312:8(1-14)Online publication date: 30-Jul-2023
https://doi.org/10.35940/ijitee.F9532.0712823
Han XHuangpeng QGao QFu YDuan X(2023)Study of data center communication network topologies using complex network propagation modelFrontiers in Physics10.3389/fphy.2023.117409911Online publication date: 9-May-2023
https://doi.org/10.3389/fphy.2023.1174099
Willis PLi MShenoy N(2023)Performance of Meshed Tree Protocol in Data Center NetworksProceedings of the 2nd ACM SIGCOMM Workshop on Future of Internet Routing & Addressing10.1145/3607504.3609290(15-22)Online publication date: 10-Sep-2023
https://dl.acm.org/doi/10.1145/3607504.3609290
Lin FWang HChen GZhou GXu TWei DChen LLu YQu AShao HJiang H(2023)Fast, Scalable and Robust Centralized Routing for Data Center NetworksIEEE/ACM Transactions on Networking10.1109/TNET.2023.325954131:6(2624-2639)Online publication date: Dec-2023
https://doi.org/10.1109/TNET.2023.3259541
Saleh FKarmoshi SChen SYang FYang J(2023)vTopology: Virtual MAC Address Aided Network Slicing in Multi-Tenant Data CentersIEEE Network: The Magazine of Global Internetworking10.1109/MNET.106.210061737:2(214-221)Online publication date: 5-Sep-2023
https://dl.acm.org/doi/10.1109/MNET.106.2100617
Nguyen DLien YLiu BChu SNguyen T(2023)Virtual Network Function Placement for Serving Weighted Services in NFV-Enabled NetworksIEEE Systems Journal10.1109/JSYST.2023.325777617:4(5648-5659)Online publication date: Dec-2023
https://doi.org/10.1109/JSYST.2023.3257776
Roy SPani CBera S(2023)Design and Performance Analysis of Electro Optic ToR(EO-ToR) for Low Latency Data Center Network2023 5th International Conference on Energy, Power and Environment: Towards Flexible Green Energy Technologies (ICEPE)10.1109/ICEPE57949.2023.10201600(1-6)Online publication date: 15-Jun-2023
https://doi.org/10.1109/ICEPE57949.2023.10201600
Miguel-Alonso J(2023)A Research Review of OpenFlow for Datacenter NetworkingIEEE Access10.1109/ACCESS.2022.323346611(770-786)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2022.3233466
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents