Article

vTurbo: accelerating virtual machine I/O processing using designated turbo-sliced core

Authors:

Ramana Kompella,

Dongyan XuAuthors Info & Claims

USENIX ATC'13: Proceedings of the 2013 USENIX conference on Annual Technical Conference

Pages 243 - 254

Published: 26 June 2013 Publication History

Abstract

In a virtual machine (VM) consolidation environment, it has been observed that CPU sharing among multiple VMs will lead to I/O processing latency because of the CPU access latency experienced by each VM. In this paper, we present vTurbo, a system that accelerates I/O processing for VMs by offloading I/O processing to a designated core. More specifically, the designated core - called turbo core - runs with a much smaller time slice (e.g., 0.1ms) than the cores shared by production VMs. Most of the I/O IRQs for the production VMs will be delegated to the turbo core for more timely processing, hence accelerating the I/O processing for the production VMs. Our experiments show that vTurbo significantly improves the VMs' network and disk I/O throughput, which consequently translates into application-level performance improvement.

References

[1]

Amazon Elastic Compute Cloud (Amazon EC2). http://aws.amazon.com/ec2/.

[2]

Apache Olio. http://http://incubator.apache.org/olio/.

[3]

CPU isolation extensions. http://lwn.net/Articles/270623/.

[4]

IOzone Filesystem Benchmark. http://www.iozone.org/.

[5]

The Iperf Benchmark. http://www.noc.ucf.edu/Tools/Iperf/.

[6]

J. McCalpin. The STREAM benchmark. http://www.cs.virginia.edu/stream/.

[7]

Lookbusy-a synthetic load generator. http://www.devin.com/lookbusy/.

[8]

Microsoft Cloud Platform (Microsoft Azure). http://www.windowsazure.com/.

[9]

The Netperf Benchmark. http://www.netperf.org.

[10]

CHENG, L., AND WANG, C.-L. vbalance: Using interrupt load balance to improve i/o performance for smp virtual machines. In ACM SoCC (2012).

[11]

DONG, Y., YU, Z., AND ROSE, G. SR-IOV networking in Xen: architecture, design and implementation. In WIOV (2008).

[12]

GAMAGE, S., KANGARLOU, A., KOMPELLA, R. R., AND XU, D. Opportunistic flooding to improve TCP transmit performance in virtualized clouds. In ACM SoCC (2011).

[13]

GORDON, A., AMIT, N., HAR'EL, N., BEN-YEHUDA, M., LANDAU, A., SCHUSTER, A., AND TSAFRIR, D. ELI: baremetal performance for I/O virtualization. In ACM ASPLOS (2012).

[14]

HIREMANE, R. Intel virtualization technology for directed I/O (Intel VT-d). Technology @ Intel Magazine 4, 10 (2007).

[15]

HU, Y., LONG, X., ZHANG, J., HE, J., AND XIA, L. I/o scheduling model of virtual machine based on multi-core dynamical partitioning. In ACM HPDC (2010).

[16]

KANG, H., CHEN, Y., WONG, J. L., SION, R., AND WU, J. Enhancement of Xen's scheduler for MapReduce workloads. In ACM HPDC'11 (2011).

[17]

KANGARLOU, A., GAMAGE, S., KOMPELLA, R. R., AND XU, D. vSnoop: Improving TCP throughput in virtualized environments via acknowledgement offload. In ACM/IEEE SC (2010).

[18]

KAPOOR, R., PORTER, G., TEWARI, M., VOELKER, G. M., AND VAHDAT, A. Chronos: predictable low latency for data center applications. In ACM SoCC (2012).

[19]

KESAVAN, M., GAVRILOVSKA, A., AND SCHWAN, K. Differential Virtual Time (DVT): Rethinking I/O service differentiation for virtual machines. In ACM SoCC (2010).

[20]

LARSEN, S., SARANGAM, P., HUGGAHALLI, R., AND KULKARNI, S. Architectural breakdown of end-to-end latency in a tcp/ip network. International Journal of Parallel Programming 37, 6 (2009), 556-571.

[21]

LEE, M., KRISHNAKUMAR, A. S., KRISHNAN, P., SINGH, N., AND YAJNIK, S. Supporting soft real-time tasks in the Xen hypervisor. In ACM VEE (2010).

[22]

MENON, A., COX, A. L., AND ZWAENEPOEL, W. Optimizing network virtualization in Xen. In USENIX ATC (2006).

[23]

MENON, A., SCHUBERT, S., AND ZWAENEPOEL, W. Twin-Drivers: semi-automatic derivation of fast and safe hypervisor network drivers from guest OS drivers. In ACM ASPLOS (2009).

[24]

MENON, A., AND ZWAENEPOEL, W. Optimizing TCP receive performance. In USENIX ATC (2008).

[25]

PATNAIK, D., KRISHNAKUMAR, A., KRISHNAN, P., SINGH, N., AND YAJNIK, S. Performance implications of hosting enterprise telephony applications on virtualized multi-core platforms. Tech. rep., IPTComm, 2009.

[26]

PESTEREV, A., STRAUSS, J., ZELDOVICH, N., AND MORRIS, R. T. Improving network connection locality on multicore systems. In ACM EuroSys (2012).

[27]

SHALEV, L., SATRAN, J., BOROVIK, E., AND BEN-YEHUDA, M. IsoStack: Highly efficient network processing on dedicated cores. In USENIX ATC (2010).

[28]

WALDSPURGER, C., AND ROSENBLUM, M. I/O virtulization. In Communications of the ACM (2012).

[29]

WALDSPURGER, C. A. Memory resource management in VMware ESX server. In USENIX OSDI (2002).

[30]

XU, C., GAMAGE, S., RAO, P. N., KANGARLOU, A., KOMPELLA, R. R., AND XU, D. vslicer: Latency-aware virtual machine scheduling via differentiated-frequency cpu slicing. In ACM HPDC (2012).

Cited By

Jia WWang CChen XShan JShang XCui HDing XCheng LLau FWang YWang YGunawi HReed B(2018)Effectively mitigating I/O inactivity in vCPU schedulingProceedings of the 2018 USENIX Conference on Usenix Annual Technical Conference10.5555/3277355.3277382(267-279)Online publication date: 11-Jul-2018
https://dl.acm.org/doi/10.5555/3277355.3277382
Ahn JPark CHeo THuh JOliveira RFelber PHu Y(2018)Accelerating critical OS services in virtualized systems with flexible micro-sliced coresProceedings of the Thirteenth EuroSys Conference10.1145/3190508.3190521(1-14)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3190508.3190521
Lu HSaltaformaggio BXu CBellur UXu D(2016)BASSProceedings of the Seventh ACM Symposium on Cloud Computing10.1145/2987550.2987557(169-181)Online publication date: 5-Oct-2016
https://dl.acm.org/doi/10.1145/2987550.2987557
Show More Cited By

vTurbo: accelerating virtual machine I/O processing using designated turbo-sliced core
1. General and reference
  1. Cross-computing tools and techniques
2. Social and professional topics
  1. Professional topics
    1. Computing profession

Recommendations

SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices
VEE '16

Single-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (ysical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly assigned ...
SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices
VEE '16: Proceedings of the12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments

Single-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (ysical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly assigned ...
Nosv

nOSV can provide a bare-metal like performance for HPC applications on Cloud.The CPU cores and main memory are not shared among guest VMs of nOSV.Dedicated I/O resources are allocated to I/O sensitive HPC guests.Other virtualization environments can run ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

USENIX ATC'13: Proceedings of the 2013 USENIX conference on Annual Technical Conference

June 2013

364 pages

Program Chairs:
Andrew Birrell
Microsoft Research Silicon Valley
,
Emin Gün Sirer

Sponsors

VMware
Akamai: Akamai
Google Inc.
EMC2: EMC2
Facebook: Facebook

Publisher

USENIX Association

United States

Publication History

Published: 26 June 2013

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jia WWang CChen XShan JShang XCui HDing XCheng LLau FWang YWang YGunawi HReed B(2018)Effectively mitigating I/O inactivity in vCPU schedulingProceedings of the 2018 USENIX Conference on Usenix Annual Technical Conference10.5555/3277355.3277382(267-279)Online publication date: 11-Jul-2018
https://dl.acm.org/doi/10.5555/3277355.3277382
Ahn JPark CHeo THuh JOliveira RFelber PHu Y(2018)Accelerating critical OS services in virtualized systems with flexible micro-sliced coresProceedings of the Thirteenth EuroSys Conference10.1145/3190508.3190521(1-14)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3190508.3190521
Lu HSaltaformaggio BXu CBellur UXu D(2016)BASSProceedings of the Seventh ACM Symposium on Cloud Computing10.1145/2987550.2987557(169-181)Online publication date: 5-Oct-2016
https://dl.acm.org/doi/10.1145/2987550.2987557
Lee EBahn HJeong MKim SYeon JYoo SNoh SShin K(2016)Reducing Journaling Harm on Virtualized I/O SystemsProceedings of the 9th ACM International on Systems and Storage Conference10.1145/2928275.2928289(1-6)Online publication date: 6-Jun-2016
https://dl.acm.org/doi/10.1145/2928275.2928289
Teabe BTchana AHagimont DCadar CPietzuch PKeeton KRodrigues R(2016)Application-specific quantum for multi-core platform schedulerProceedings of the Eleventh European Conference on Computer Systems10.1145/2901318.2901340(1-14)Online publication date: 18-Apr-2016
https://dl.acm.org/doi/10.1145/2901318.2901340
Cheng LRao JLau FCadar CPietzuch PKeeton KRodrigues R(2016)vScaleProceedings of the Eleventh European Conference on Computer Systems10.1145/2901318.2901321(1-14)Online publication date: 18-Apr-2016
https://dl.acm.org/doi/10.1145/2901318.2901321
Cheng LLau F(2016)Offloading Interrupt Load Balancing from SMP Virtual Machines to the HypervisorIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.253780427:11(3298-3310)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1109/TPDS.2016.2537804
Cheng LLau FLuwei Cheng Lau F(2016)Revisiting TCP Congestion Control in a Virtual Cluster EnvironmentIEEE/ACM Transactions on Networking10.1109/TNET.2015.245116124:4(2154-2167)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1109/TNET.2015.2451161
Asyabi EAzhdari ADehsangi MKhan MSharifi MAzhari S(2016)KaniCluster Computing10.1007/s10586-016-0541-519:2(567-583)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1007/s10586-016-0541-5
Lu HSaltaformaggio BKompella RXu DGhandeharizadeh SBalazinska MFreedman MBarahmand S(2015)vFairProceedings of the Sixth ACM Symposium on Cloud Computing10.1145/2806777.2806943(125-138)Online publication date: 27-Aug-2015
https://dl.acm.org/doi/10.1145/2806777.2806943
Show More Cited By

View Options

View options

Figures

Tables

Media

View Table of Conten