short-paper

Characterizing the Performance of Concurrent Virtualized Network Functions with OVS-DPDK, FD.IO VPP and SR-IOV

Authors:

Nikolai Pitaev,

Matthias Falkner,

Aris Leivadeas,

Ioannis LambadarisAuthors Info & Claims

ICPE '18: Proceedings of the 2018 ACM/SPEC International Conference on Performance Engineering

Pages 285 - 292

https://doi.org/10.1145/3184407.3184437

Published: 30 March 2018 Publication History

Abstract

The virtualization of network functions is promising significant cost reductions for network operators. Running multiple network functions on a standard x86 server instead of dedicated appliances can increase the utilization of the underlying hardware,while reducing the maintenance and management costs of such functions. However, total cost of ownership calculations are typically a function of the attainable network throughput, which in a virtualized system is highly dependent on the overall system architecture - in particular the input/output (I/O) path. In this paper we investigate the attainable performance of an x86 host running multiple virtualized network functions (VNFs) under different I/O architectures: OVS-DPDK, SR-IOV, and FD.io VPP. Running multiple VNFs in parallel on a standard x86 host is a common use-case for cloud-based networking services. We show that the system throughput in a multi-VNF environment differs significantly from deployments where only a single VNF is running on a server.

References

[1]

R. Bonafiglia, I. Cerrato, F. Ciaccia, M. Nemirovsky, and F. Risso. 2015. Assessing the Performance of Virtualization Technologies for NFV: a Preliminary Benchmarking. In Proc. of the 4th IEEE Eur. Wrkshp on Software Defined Networks (EWSDN), IEEE (Ed.). 67--72.

Digital Library

[2]

S. Bradner and J. McQuaid. 1999. Benchmarking Methodology for Network Interconnect Devices. Technical Report RFC2544. Internet Engineering Task Force (IETF).

Digital Library

[3]

F. Callegati, W. Cerroni, and C. Contoli. 2016. Virtual Networking Performance in Openstack Platform for Network Function Virtualization. J. of Electrical and Computer Engineering Vol. 2016 (March. 2016), 1--15.

Digital Library

[4]

Cisco. {n. d.}. Cisco ucs c240 m4 rack server. (. {n. d.}). http://www.cisco.com/c/en/us/products/servers-unified-computing/ucs-c240-m4-rack-server/index.html Retrieved October 13, 2017

[5]

Docker Container. {n. d.}. (. {n. d.}). https://www.docker.com/ Retrieved October 10, 2017

[6]

Intel Corporation. 2011. Pci-sig SR-IOV Primer: An Introduction to SR-IOV Technology. (2011). http://www.intel.com/content/www/us/en/pci-express/pci-sig-sr-iov-primer-sr-iov-technology-paper.html Retrieved October 10, 2017

[7]

Intel Corporation. 2014. Intel DPDK vSwitch: Performance Report. (2014). https://01.org/sites/default/files/page/intel_dpdk_vswitch_performance_figures_0.10.0_0.pdf Retrieved October 10, 2017

[8]

Intel Corporation. 2016. Open vSwitch* with DPDK Overview. (2016). https://software.intel.com/en-us/articles/open-vswitch-with-dpdk-overview Retrieved October 13, 2017

[9]

Y. Dong, X. Yang, X. Li, J. Li, K. Tian, and H. Guan. 2016. High Performance Network Virtualization with SR-IOV Proc. of the 16th IEEE Int. Symp. on High Performance Computer Architecture (HPCA), IEEE (Ed.). 1--10.

[10]

P. Emmerich, D. Raumer, F. Wohlfart, and G. Carle. 2014. Performance Characteristics of Virtual Switching. In Proc. of the 3rd IEEE Int. Conf. on Cloud Networking (CloudNet), IEEE (Ed.). 120--125.

[11]

P. Emmerich, D. Raumer, F. Wohlfart, and G. Carle. 2015. Assessing Soft and Hardware Bottlenecks in Pc-based Packet Forwarding Systems Proc. of the 14th Int. Conf. on Networks (ICN). 78--83.

[12]

B Pfaff et al. 2015. The Design and Implementation of Open vSwitch. In In Proc. of the 12th USENIX Symp. on Networked Systems Design and Implementation, USENIX (Ed.). 117--130.

Digital Library

[13]

FD.io. 2016. Fd.io /dev/boot. (2016). https://docs.google.com/presentation/d/1JL5O_ZkRUXVaY4ZuKaMj13jEGv90eanOYAB7mHfmPK4/pub'start=false&loop=false&delayms=3000#slide=id.p4 Retrieved October 13, 2017

[14]

Z. Huang, J. Li, Z. Chang, and H. Guan. 2012. Adaptive and Scalable Optimizations for High Performance SR-IOV Proc. of the IEEE Int. Conf. on Cluster Computing, IEEE (Ed.). 459--467.

Digital Library

[15]

C. Kim and K. Park. 2015. Credit-based Runtime Placement of Virtual Machines on a Single NUMA System for QoS of data access performance. IEEE Trans. on Computers Vol. 64, 6 (June. 2015), 1633--1646.

[16]

M. Konstantynowicz. {n. d.}. FD.io - How to Push Extreme Limits of Performance and Scale with Vector Packet Processing Technology. (. {n. d.}). https://www.ietf.org/proceedings/96/slides/slides-96-bmwg-10.pdf Retrieved October 10, 2017

[17]

KVM. {n. d.}. Kernel virtual machine. (. {n. d.}). https://www.linux-kvm.org/ Retrieved October 13, 2017

[18]

Lightreading Ray Le Maistre. 2015. Validating Cisco's NFV Infrastructure Part 1. (2015). http://www.lightreading.com/nfv/nfv-tests-and-trials/validating-ciscos-nfv-infrastructure-pt-1/d/d-id/718684 Retrieved October 13, 2017

[19]

M. Paolino, N. Nikolaev, J. Fanguede, and D. Raho. 2015. SnabbSwitch User Space Virtual Switch Benchmark and Performance Optimization for NFV Proc. of the IEEE Conf. on Network Function Virtualization and Software Defined Networking (NFV-SDN), IEEE (Ed.). 86--92.

[20]

N. Pitaev. {n. d.}. Cisco CSR 1000v Multi VM / Multi IO Test Report. (. {n. d.}). Available upon demand

[21]

N. Pitaev, M. Falkner, A. Leivadeas, and I. Lambadaris. 2017. Multi-VNF Performance Characterization for Virtualized Network Functions Proc. of the IEEE Conf. on Network Softwarization (Netsoft), IEEE (Ed.). 1--5.

[22]

R. Rahimi, M. Veeraraghavan, Y. Hakajima, H. Takahashi, S. Okamoto, and N. Yamanaka. 2016. A High-Performance Openflow Software Switch. In Proc. of the 17th IEEE Int. Conf. on High Performance Switching and Routing (HPSR), IEEE (Ed.). 93--99.

[23]

R. Rojas-Cessa, K. Salehin, and K. Egoh. 2015. Evaluation of Switching Performance of a Virtual Software Router Proc. of the 35th IEEE Sarnoff Symp., IEEE (Ed.). 1--5.

[24]

V. Sankaran and D. Darde. 2015. Performance Analysis of Intel DPDK on Physical and Virtual Machines. (2015). http://www.cs.cornell.edu/courses/cs5413/2014fa/projects/group_of_dsd96_vs444/final_pres.pdf Retrieved October 13, 2017

[25]

H. Shimamoto. 2016. SR-IOV ixgbe driver limitations and improvement. (2016). http://events.linuxfoundation.org/sites/events/files/slides/20160715_LinuxCon_sriov_final.pdf Retrieved October 13, 2017

[26]

M. A. Tahhan and J. M. Morgan. {n. d.}. Vsperf Deep Dive: Virtual Switch Performance in OPNFV. (. {n. d.}). deftempurl%https://wiki.opnfv.org/display/vsperf/?preview=/2926262/6818343/VSPERF%20Golden.pptx Retrieved October 13, 2017 from tempurl

[27]

VMware. {n. d.}. VMware vSphere 5.1 Documentation Center. SR-IOV Support. ({n. d.}). https://pubs.vmware.com/vsphere-51/index.jsp?topic=%2Fcom.vmware.vsphere.networking.doc%2FGUID-E8E8D7B2-FE67--4B4F-921F-C3D6D7223869.html Retrieved October 13, 2017

[28]

Open vSwitch. {n. d.}. ({n. d.}). deftempurl%http://openvswitch.org Retrieved October 10, 2017 from tempurl

Cited By

Ben Salah TAvgeris MLeivadeas ALambadaris I(2024)VNF Placement and Dynamic NUMA Node Selection Through Core Consolidation at the Edge and CloudIEEE Transactions on Network and Service Management10.1109/TNSM.2024.338727521:4(4655-4668)Online publication date: Aug-2024
https://doi.org/10.1109/TNSM.2024.3387275
Umrao BYadav D(2023)APVNFC: Adaptive Placement of Virtual Network Function ChainsCybernetics and Information Technologies10.2478/cait-2023-000323:1(59-74)Online publication date: 25-Mar-2023
https://doi.org/10.2478/cait-2023-0003
Hasenoot JRellermeyer JUta AVieira MCardellini VDi Marco ATuma P(2023)The Performance of Distributed Applications: A Traffic Shaping PerspectiveProceedings of the 2023 ACM/SPEC International Conference on Performance Engineering10.1145/3578244.3583733(207-220)Online publication date: 15-Apr-2023
https://dl.acm.org/doi/10.1145/3578244.3583733
Show More Cited By

Index Terms

Characterizing the Performance of Concurrent Virtualized Network Functions with OVS-DPDK, FD.IO VPP and SR-IOV
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Buses and high-speed links
    2. Networking hardware
2. Networks

Recommendations

A Hypervisor Approach to Enable Live Migration with Passthrough SR-IOV Network Devices
Special Topics

Single-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (physical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly ...
High performance network virtualization with SR-IOV

Virtualization poses new challenges to I/O performance. The single-root I/O virtualization (SR-IOV) standard allows an I/O device to be shared by multiple Virtual Machines (VMs), without losing performance. We propose a generic virtualization ...
A Hardware/Software Approach for Mitigating Performance Interference Effects in Virtualized Environments Using SR-IOV
CLOUD '15: Proceedings of the 2015 IEEE 8th International Conference on Cloud Computing

Single Root I/O Virtualization (SR-IOV) is an extension to the PCI Express (PCIe) standard that allows virtual machines (VMs) to directly access shared I/O devices without host involvement. This enabled SR-IOV to become the best-performing solution for ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '18: Proceedings of the 2018 ACM/SPEC International Conference on Performance Engineering

March 2018

328 pages

ISBN:9781450350952

DOI:10.1145/3184407

General Chairs:
Katinka Wolter
Free University of Berlin, Germany
,
Will Knottenbelt
Imperial College London, UK
,
Program Chairs:
André van Hoorn
University of Stuttgart, Germany
,
Manoj Nambiar
Tata Consultancy Services, India
,
Heiko Koziolek
ABB, Germany

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 March 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

ICPE '18

Sponsor:

ICPE '18: ACM/SPEC International Conference on Performance Engineering

April 9 - 13, 2018

Berlin, Germany

Acceptance Rates

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
897
Total Downloads

Downloads (Last 12 months)63
Downloads (Last 6 weeks)11

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ben Salah TAvgeris MLeivadeas ALambadaris I(2024)VNF Placement and Dynamic NUMA Node Selection Through Core Consolidation at the Edge and CloudIEEE Transactions on Network and Service Management10.1109/TNSM.2024.338727521:4(4655-4668)Online publication date: Aug-2024
https://doi.org/10.1109/TNSM.2024.3387275
Umrao BYadav D(2023)APVNFC: Adaptive Placement of Virtual Network Function ChainsCybernetics and Information Technologies10.2478/cait-2023-000323:1(59-74)Online publication date: 25-Mar-2023
https://doi.org/10.2478/cait-2023-0003
Hasenoot JRellermeyer JUta AVieira MCardellini VDi Marco ATuma P(2023)The Performance of Distributed Applications: A Traffic Shaping PerspectiveProceedings of the 2023 ACM/SPEC International Conference on Performance Engineering10.1145/3578244.3583733(207-220)Online publication date: 15-Apr-2023
https://dl.acm.org/doi/10.1145/3578244.3583733
Leivadeas APitaev NFalkner MVieira MCardellini VDi Marco ATuma P(2023)Analyzing the Performance of SD-WAN Enabled Service Function Chains Across the Globe with AWSProceedings of the 2023 ACM/SPEC International Conference on Performance Engineering10.1145/3578244.3583722(125-135)Online publication date: 15-Apr-2023
https://dl.acm.org/doi/10.1145/3578244.3583722
Veitch PBroadbent AFarshad A(2023)Comparison of Virtual Machines and Bare Metal for CNFs at Resource-Constrained Network Edge2023 IEEE 9th International Conference on Network Softwarization (NetSoft)10.1109/NetSoft57336.2023.10175415(192-196)Online publication date: 19-Jun-2023
https://doi.org/10.1109/NetSoft57336.2023.10175415
de Oliveira Filho AFreitas ECarmo PSadok DKelner J(2023)Measuring the impact of SR-IOV and virtualization on packet round-trip timeComputer Communications10.1016/j.comcom.2023.09.013211:C(193-215)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1016/j.comcom.2023.09.013
Freitas Ede Oliveira Filho Ado Carmo PSadok DKelner J(2023)A survey on accelerating technologies for fast network packet processing in Linux environmentsComputer Communications10.1016/j.comcom.2022.10.003196:C(148-166)Online publication date: 20-Jan-2023
https://dl.acm.org/doi/10.1016/j.comcom.2022.10.003
Chung WWang Y(2022)The Effects of High-Performance Cloud System for Network Function VirtualizationApplied Sciences10.3390/app12201031512:20(10315)Online publication date: 13-Oct-2022
https://doi.org/10.3390/app122010315
Liu CWang PZhang YZhang Z(2022)Design of Bare Metal Network Architecture Based on Smart NICProceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering10.1145/3573428.3573635(1153-1158)Online publication date: 21-Oct-2022
https://dl.acm.org/doi/10.1145/3573428.3573635
Rafique YLeivadeas AIbnkahla M(2022)An IoT-Aware VNF Placement Proof of Concept in a Hybrid Edge-Cloud Smart City Environment2022 IEEE Wireless Communications and Networking Conference (WCNC)10.1109/WCNC51071.2022.9772004(1395-1400)Online publication date: 10-Apr-2022
https://doi.org/10.1109/WCNC51071.2022.9772004
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents