Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2670979.2670982acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
tutorial

Transparent, Live Migration of a Software-Defined Network

Published: 03 November 2014 Publication History

Abstract

Increasingly, datacenters are virtualized and software-defined. Live virtual machine (VM) migration is becoming an indispensable management tool in such environments. However, VMs often have a tight coupling with the underlying network. Hence, cloud providers are beginning to offer tenants more control over their virtual networks. Seamless migration of all (or part) of a virtual network greatly simplifies management tasks like planned maintenance, optimizing resource usage, and cloud bursting. Our LIME architecture efficiently migrates an ensemble, a collection of virtual machines and virtual switches, for any arbitrary controller and end-host applications. To minimize performance disruptions, during the migration, LIME temporarily runs all or part of a virtual switch on multiple physical switches. Running a virtual switch on multiple physical switches must be done carefully to avoid compromising application correctness. To that end, LIME merges events, combines traffic statistics, and preserves consistency among multiple physical switches even across changes to the packet-handling rules. Using a formal model, we prove that migration under LIME is transparent to applications, i.e., any execution of the controller and end-host applications during migration is a completely valid execution that could have taken place in a migration-free setting. Experiments with our prototype, built on the Floodlight controller, show that ensemble migration can be an efficient tool for network management.

References

[1]
cbench OpenFlow controller benchmark. See http://www.openflow.org/wk/index.php/Oflops.
[2]
Emulab - Network Emulation Testbed. http://www.emulab.net/.
[3]
FutureGrid. https://portal.futuregrid.org/.
[4]
Kernel Based Virtual Machine (KVM). http://www.linux-kvm.org/.
[5]
Ocean cluster for experimental architectures in networks (ocean). http://ocean.cs.illinois.edu/.
[6]
OpenFlow. http://www.openflow.org.
[7]
Open vswitch. openvswitch.org/.
[8]
NTT, in collaboration with Nicira Networks, succeeds in remote datacenter live migration, August 2011. http://www.ntt.co.jp/news2011/1108e/110802a.html.
[9]
Microsoft Research Faculty Summit Keynote: L. Lamport, 2014. URL https://www.youtube.com/watch?v=n4gOZrUwWmc.
[10]
G. S. Akula and A. Potluri. Heuristics for migration with consolidation of ensembles of virtual machines. In COMSNETS, 2014.
[11]
S. Al-Kiswany, D. Subhraveti, P. Sarkar, and M. Ripeanu. VMFlock: Virtual machine co-migration for the cloud. In High Performance Distributed Computing, 2011.
[12]
A. Al-Shabibi, M. D. Leenheer, M. Gerola, A. Koshibe, E. Salvadori, G. Parulkar, and B. Snow. OpenVirteX: Make Your Virtual SDNs Programmable. In HotSDN, 2014.
[13]
M. Alizadeh, A. Greenberg, D. A. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, M. Sridharan, C. Faster, and D. Maltz. DCTCP: Efficient packet transport for the commoditized data center. In SIGCOMM, 2010.
[14]
H. Ballani, P. Costa, T. Karagiannis, and A. Rowstron. Towards predictable datacenter networks. In ACM SIGCOMM, 2011.
[15]
T. Benson, A. Anand, A. Akella, and M. Zhang. MicroTE: Fine grained traffic engineering for data centers. In CoNEXT, 2011.
[16]
P. Bodik, I. Menache, M. Chowdhury, P. Mani, D. A. Maltz, and I. Stoica. Surviving failures in bandwidth-constrained datacenters. In SIGCOMM, 2012.
[17]
R. Bradford, E. Kotsovinos, A. Feldmann, and H. Schioberg. Live wide-area migration of virtual machines including local persistent state. In Virtual Execution Environments, pages 169--179, 2007.
[18]
N. F. Butt, M. Chowdhury, and R. Boutaba. Topology-awareness and Reoptimization Mechanism for Virtual Network Embedding. Springer, 2010.
[19]
M. Casado, T. Koponen, R. Ramanathan, and S. Shenker. Virtualizing the network forwarding plane. In PRESTO, 2010.
[20]
Cisco and VMWare. Virtual machine mobility with VMware VMotion and Cisco data center interconnect technologies, 2009.
[21]
C. Clark, K. Fraser, S. Hand, J. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In NSDI, 2005.
[22]
B. Cully, G. Lefebvre, D. Meyer, M. Feeley, N. Hutchinson, and A. Warfield. Remus: High availability via asynchronous virtual machine replication. In NSDI, 2008.
[23]
U. Deshpande, X. Wang, and K. Gopalan. Live gang migration of virtual machines. In HDPC, 2011.
[24]
floodlight. Floodlight OpenFlow Controller. http://floodlight.openflowhub.org/.
[25]
A. Gember, P. Prabhu, Z. Ghadiyali, and A. Akella. OpenNF: Enabling Innovation in Network Function Control. In SIGCOMM, 2014.
[26]
S. Ghorbani and M. Caesar. Walk the line: Consistent network updates with bandwidth guarantees. In HotSDN, 2012.
[27]
S. Ghorbani and B. Godfrey. Towards Correct Network Virtualization. In HotSDN, 2014.
[28]
S. Ghorbani, M. Overholt, and M. Caesar. Virtual Data Centers. Technical report, CS UIUC, 2013. www.cs.illinois.edu/~ghorban2/papers/vdc.
[29]
S. Ghorbani, C. Schlesinger, M. Monaco, E. Keller, M. Caesar, J. Rexford, and D. Walker. Transparent, Live Migration of a Software-Defined Network. Technical report, CS UIUC, 2013. www.cs.illinois.edu/~ghorban2/papers/lime.
[30]
P. Gill, N. Jain, and N. Nagappan. Understanding network failures in data centers: Measurement, analysis, and implications. In SIGCOMM, 2011.
[31]
A. Greenberg, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. Maltz, P. Patel, and S. Sengupta. VL2: A scalable and flexible data center network. In SIGCOMM, 2009.
[32]
C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu. DCell: A scalable and fault-tolerant network structure for data centers. In SIGCOMM Computer Communication Review, volume 38, 2008.
[33]
C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu. BCube: A high performance, server-centric network architecture for modular data centers. In SIGCOMM, 2009.
[34]
C. Guo, G. Lu, H. J. Wang, S. Yang, C. Kong, P. Sun, W. Wu, and Y. Zhang. SecondNet: A data center network virtualization architecture with bandwidth guarantees. CoNEXT, 2010.
[35]
N. Handigol, B. Heller, V. Jeyakumar, B. Lantz, and N. McKeown. Reproducible network experiments using container-based emulation. In CoNEXT, 2012.
[36]
S. Hanks, T. Li, D. Farinacci, and P. Traina. Generic Routing Encapsulation (GRE), RFC 1701, 1994.
[37]
F. Hao, T. Lakshman, S. Mukherjee, and H. Song. Enhancing dynamic cloud-based services using network virtualization. In ACM Workshop on Virtualized infrastructure systems and architectures, 2009.
[38]
C.-Y. Hong, S. Kandula, R. Mahajan, M. Zhang, V. Gill, M. Nanduri, and R. Wattenhofer. Achieving high utilization with software-driven WAN. In SIGCOMM, 2013.
[39]
X. Jiang and D. Xu. Violin: Virtual internetworking on overlay infrastructure. In Parallel and Distributed Processing and Applications, 2005.
[40]
A. Kangarlou, P. Eugster, and D. Xu. VNsnap: Taking snapshots of virtual networked infrastructures in the cloud. In IEEE Transactions on Services Computing (TSC), October 2011.
[41]
E. Keller, J. Rexford, and J. van der Merwe. Seamless BGP Migration with Router Grafting. In NSDI, 2010.
[42]
E. Keller, S. Ghorbani, M. Caesar, and J. Rexford. Live migration of an entire network (and its hosts). In HotNets, 2012.
[43]
T. Koponen, M. Casado, N. Gude, J. Stribling, L. Poutievski, M. Zhu, R. Ramanathan, Y. Iwata, H. Inoue, T. Hama, and S. Shenker. Onix: A distributed control platform for large-scale production networks. In OSDI, 2010.
[44]
T. Koponen, K. Amidon, P. Balland, M. Casado, A. Chanda, B. Fulton, I. Ganichev, J. Gross, N. Gude, P. Ingram, E. Jackson, A. Lambeth, R. Lenglet, S.-H. Li, A. Padmanabhan, J. Pettit, B. Pfaff, R. Ramanathan, S. Shenker, A. Shieh, J. Stribling, P. Thakkar, D. Wendlandt, A. Yip, and R. Zhang. Network Virtualization in Multi-tenant Datacenters. In NSDI, 2014.
[45]
H. H. Liu, X. Wu, M. Zhang, L. Yuan, R. Wattenhofer, and D. Maltz. zUpdate: Updating data center networks with zero loss. In SIGCOMM, 2013.
[46]
S. Lo, M. Ammar, and E. Zegura. Design and analysis of schedules for virtual network migration. In IFIP Networking, 2013.
[47]
D. M. F. Mattos and O. C. M. B. Duarte. XenFlow: Seamless Migration Primitive and Quality of Service for Virtual Networks. Technical report, COPPE/UFRJ, 2014. http://www.gta.ufrj.br/ftp/gta/TechReports/MaDu14.pdf.
[48]
N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner. OpenFlow: Enabling innovation in campus networks. SIGCOMM Computer Communications Review, 38(2), 2008.
[49]
R. Milner. A Calculus of Communicating Systems. Lecture Notes in Computer Science. Springer, 1980.
[50]
S. Rajagopalan, D. Williams, H. Jamjoom, and A. Warfield. Split/Merge: System Support for Elastic Execution in Virtual Middleboxes. In NSDI, 2013.
[51]
M. Reitblatt, N. Foster, J. Rexford, C. Schlesinger, and D. Walker. Abstractions for network update. In SIGCOMM, 2012.
[52]
VMWare. VMware vNetwork Distributed Switch: Migration and Configuration. http://www.vmware.com/files/pdf/vsphere-vnetwork-ds-migration-configuration-wp.pdf.
[53]
VMWare. vsphere. http://www.vmware.com/products/datacenter-virtualization/vsphere/vmotion.html.
[54]
Y. Wang, E. Keller, B. Biskeborn, J. van der Merwe, and J. Rexford. Virtual routers on the move: Live router migration as a network-management primitive. In SIGCOMM, 2008.
[55]
D. Williams, H. Jamjoom, and H. Weatherspoon. The Xen-blanket: Virtualize once, run everywhere. In EuroSys, 2012.
[56]
D. Williams, H. Jamjoom, Z. Jiang, and H. Weatherspoon. VirtualWires for Live Migrating Virtual Networks across Clouds. Technical Report RC25378, IBM, 2013.
[57]
T. Wood and J. van der Merwe. CloudNet: A platform for optimized WAN migration of virtual machines. In International Conference on Virtual Execution Environments, 2011.
[58]
K. Ye, X. Jiang, R. Ma, and F. Yan. VC-Migration: Live migration of virtual clusters in the cloud. In Grid Computing, 2012.
[59]
Y. Zhu and M. H. Ammar. Algorithms for assigning substrate network resources to virtual network components. In INFOCOM, 2006.

Cited By

View all
  • (2024)DBMS-Assisted Live Migration of Virtual MachinesIEEE Transactions on Computers10.1109/TC.2023.332994373:2(380-393)Online publication date: Feb-2024
  • (2023)Live Stateful Migration of a Virtual Sub-NetworkNOMS 2023-2023 IEEE/IFIP Network Operations and Management Symposium10.1109/NOMS56928.2023.10154281(1-9)Online publication date: 8-May-2023
  • (2023)Nimble: Fast and Safe Migration of Network FunctionsIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10228977(1-10)Online publication date: 17-May-2023
  • Show More Cited By

Index Terms

  1. Transparent, Live Migration of a Software-Defined Network

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SOCC '14: Proceedings of the ACM Symposium on Cloud Computing
    November 2014
    383 pages
    ISBN:9781450332521
    DOI:10.1145/2670979
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 November 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Consistency
    2. Correctness
    3. Migration
    4. Software-defined networks
    5. Transparency
    6. Virtualization

    Qualifiers

    • Tutorial
    • Research
    • Refereed limited

    Funding Sources

    Conference

    SOCC '14
    Sponsor:
    SOCC '14: ACM Symposium on Cloud Computing
    November 3 - 5, 2014
    WA, Seattle, USA

    Acceptance Rates

    Overall Acceptance Rate 169 of 722 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)11
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 16 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)DBMS-Assisted Live Migration of Virtual MachinesIEEE Transactions on Computers10.1109/TC.2023.332994373:2(380-393)Online publication date: Feb-2024
    • (2023)Live Stateful Migration of a Virtual Sub-NetworkNOMS 2023-2023 IEEE/IFIP Network Operations and Management Symposium10.1109/NOMS56928.2023.10154281(1-9)Online publication date: 8-May-2023
    • (2023)Nimble: Fast and Safe Migration of Network FunctionsIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10228977(1-10)Online publication date: 17-May-2023
    • (2022)DC-CAMP: Dynamic Controller Creation, Allocation and Management Protocol in SDNWireless Personal Communications10.1007/s11277-022-09563-8125:1(531-558)Online publication date: 16-Feb-2022
    • (2020)Liveness verification of stateful network functionsProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388260(257-272)Online publication date: 25-Feb-2020
    • (2020)A Synchronous Multi-Step Algorithm for Flexible and Efficient Virtual Network Reconfiguration2020 16th International Conference on Network and Service Management (CNSM)10.23919/CNSM50824.2020.9269060(1-7)Online publication date: 2-Nov-2020
    • (2020)Secure State Migration in the Data PlaneProceedings of the Workshop on Secure Programmable Network Infrastructure10.1145/3405669.3405822(28-34)Online publication date: 10-Aug-2020
    • (2020)Coordination Algorithm for Migration of Shared VNFs in Federated Environments2020 6th IEEE Conference on Network Softwarization (NetSoft)10.1109/NetSoft48620.2020.9165333(252-256)Online publication date: Jun-2020
    • (2020)An architecture for enabling VNF auto-scaling with flow migration2020 International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC49870.2020.9289507(624-627)Online publication date: 21-Oct-2020
    • (2019)Exposing End-to-End Delay in Software-Defined NetworkingInternational Journal of Reconfigurable Computing10.1155/2019/73639012019Online publication date: 1-Jan-2019
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media