research-article

Fast restore of checkpointed memory using working set estimation

Authors:

Alex Garthwaite,

Kenneth C. BarrAuthors Info & Claims

VEE '11: Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

Pages 87 - 98

https://doi.org/10.1145/1952682.1952695

Published: 09 March 2011 Publication History

Abstract

In order to make save and restore features practical, saved virtual machines (VMs) must be able to quickly restore to normal operation. Unfortunately, fetching a saved memory image from persistent storage can be slow, especially as VMs grow in memory size. One possible solution for reducing this time is to lazily restore memory after the VM starts. However, accesses to unrestored memory after the VM starts can degrade performance, sometimes rendering the VM unusable for even longer. Existing performance metrics do not account for performance degradation after the VM starts, making it difficult to compare lazily restoring memory against other approaches. In this paper, we propose both a better metric for evaluating the performance of different restore techniques and a better scheme for restoring saved VMs.

Existing performance metrics do not reflect what is really important to the user -- the time until the VM returns to normal operation. We introduce the time-to-responsiveness metric, which better characterizes user experience while restoring a saved VM by measuring the time until there is no longer a noticeable performance impact on the restoring VM. We propose a new lazy restore technique, called working set restore, that minimizes performance degradation after the VM starts by prefetching the working set. We also introduce a novel working set estimator based on memory tracing that we use to test working set restore, along with an estimator that uses access-bit scanning. We show that working set restore can improve the performance of restoring a saved VM by more than 89% for some workloads.

References

[1]

μswsusp. http://suspend.sourceforge.net/.

[2]

AMD64 virtualization codenamed "pacifica" technology: Secure virtual machine architecture reference manual, May 2005. http://enterprise.amd.com/downloadables/Pacifica_Spec.pdf.

[3]

D. F. Bacon, P. Cheng, and V. Rajan. A real-time garbage collector with low overhead and consistent utilization. In Proc. POPL '03, New Orleans, LA, USA, Jan. 2003.

Digital Library

[4]

D. F. Bacon, P. Cheng, and V. Rajan. The Metronome, a simpler approach to garbage collection in real-time systems. In Proc. OTM 2003 Workshops, 2003.

[5]

S. Bansal and D. S. Modha. CAR: Clock with adaptive replacement. In Proc. FAST '04, 2004.

Digital Library

[6]

G. E. Blelloch and P. Cheng. On bounding time and space for multiprocessor garbage collection. In Proc. PLDI '99, Atlanta, GA, USA, May 1999.

Digital Library

[7]

C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proc. NSDI '05, 2005.

Digital Library

[8]

F. J. Corbato. A paging experiment with the Multics system. Technical report, MIT Project MAC, May 1969.

[9]

P. J. Denning. The working set model for program behaviour. Commun. ACM, 11 (5), 1968.

Digital Library

[10]

M. R. Hines and K. Gopalan. Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In Proc. VEE 2009, Washington, DC, USA, 2009.

Digital Library

[11]

T. Holwerda. SuperFetch: How it works & myths, May 2009. http://www.osnews.com/story/21471/SuperFetch_How_it_Works_Myths.

[12]

S. Jiang and X. Zhang. LIRS: an efficient low inter-reference recency set replacement policy to improve buffer cache performance. In Proc. SIGMETRICS '02, Marina del Rey, California, USA, 2002.

Digital Library

[13]

S. Jiang, F. Chen, and X. Zhang. CLOCK-Pro: An effective improvement of the CLOCK replacement. In Proc. USENIX '05, 2005.

Digital Library

[14]

R. E. Jones. Garbage Collection: Algorithms for Automatic Dynamic Memory Management. Wiley, Chichester, July 1996. URL http://www.cs.ukc.ac.uk/people/staff/rej/gcbook/gcbook.html.

Digital Library

[15]

kernel-enhancements-xp. Kernel enhancements for Windows XP, jan 2003. http://www.microsoft.com/whdc/archive/XP_kernel.mspx.

[16]

H. A. Lagar-Cavilla, J. A. Whitney, A. M. Scannell, P. Patchin, S. M. Rumble, E. de Lara, M. Brudno, and M. Satyanarayanan. SnowFlock: rapid virtual machine cloning for cloud computing. In Proc. Eurosys '09, Nuremberg, Germany, 2009.

Digital Library

[17]

R. B. Miller. Response time in man-computer conversational transactions. In Proceedings of the fall joint computer conference, part I, AFIPS '68 (Fall, part I), pages 267--277, New York, NY, USA, 1968. ACM.

Digital Library

[18]

E. J. O'Neil, P. E. O'Neil, and G. Weikum. The LRU-K page replacement algorithm for database disk buffering. In P. Buneman and S. Jajodia, editors, Proc. SIGMOD '93, 1993.

Digital Library

[19]

C. P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S. Lam, and M. Rosenblum. Optimizing the migration of virtual computers. SIGOPS Operating Systems Review, 36, 2002.

Digital Library

[20]

Seagate. Product Manual. Barracuda 7200.11 Serial ATA. http://www.seagate.com/staticfiles/support/disc/manuals/desktop/Barracuda 7200.11/100452348g.pdf, Jan. 2009.

[21]

Standard Performance Evaluation Corporation. SPECjbb2005 User's Guide. http://www.spec.org/jbb2005/docs/UserGuide.html, April 2006.

[22]

J. Sugerman, G. Venkitachalam, and B.-H. Lim. Virtualizing I/O devices on VMware Workstation's hosted virtual machine monitor. In Proceedings of the 2001 USENIX Annual Technical Conference, Boston, MA, USA, June 2001.

Digital Library

[23]

N. Tolia, D. G. Andersen, and M. Satyanarayanan. Quantifying interactive user experience on thin clients. IEEE Computer, 39 (3), Mar. 2006.

Digital Library

[24]

VMware. Timekeeping in VMware virtual machines. http://www.vmware.com/vmtn/resources/238, Aug. 2008.

Cited By

Li BCui LHao ZLi LLiu YLi Y(2023)eHotSnap: An Efficient and Hot Distributed Snapshots System for Virtual Machine ClusterIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.327201434:8(2433-2447)Online publication date: Aug-2023
https://doi.org/10.1109/TPDS.2023.3272014
Shaikh SKumar SMishra D(2023)KalpaVriksh: Efficient and Cost-effective GUI Application Hosting using Singleton Snapshots2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing (CCGrid)10.1109/CCGrid57682.2023.00026(180-190)Online publication date: May-2023
https://doi.org/10.1109/CCGrid57682.2023.00026
Ao LPorter GVoelker GBromberg YKermarrec AKozyrakis C(2022)FaaSnapProceedings of the Seventeenth European Conference on Computer Systems10.1145/3492321.3524270(730-746)Online publication date: 28-Mar-2022
https://dl.acm.org/doi/10.1145/3492321.3524270
Show More Cited By

Index Terms

Fast restore of checkpointed memory using working set estimation
1. Software and its engineering
  1. Software organization and properties
    1. Extra-functional properties
      1. Software fault tolerance
        Checkpoint / restart

Recommendations

Working Set Size Estimation Techniques in Virtualized Environments: One Size Does not Fit All

Energy consumption is a primary concern for datacenters? management. Numerous datacenters are relying on virtualization, as it provides flexible resource management means such as virtual machine (VM) checkpoint/restart, migration and consolidation. ...
Fast restore of checkpointed memory using working set estimation
VEE '11

In order to make save and restore features practical, saved virtual machines (VMs) must be able to quickly restore to normal operation. Unfortunately, fetching a saved memory image from persistent storage can be slow, especially as VMs grow in memory ...
Working Set Size Estimation Techniques in Virtualized Environments: One Size Does not Fit All
SIGMETRICS '18

Energy consumption is a primary concern for datacenters' management. Numerous datacenters are relying on virtualization, as it provides flexible resource management means such as virtual machine (VM) checkpoint/restart, migration and consolidation. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VEE '11: Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

March 2011

250 pages

ISBN:9781450306874

DOI:10.1145/1952682

General Chair:
Erez Petrank
The Technion, Israel
,
Program Chair:
Doug Lea
SUNY Oswego, USA

ACM SIGPLAN Notices Volume 46, Issue 7
VEE '11
July 2011
231 pages
ISSN:0362-1340
EISSN:1558-1160
DOI:10.1145/2007477
Issue’s Table of Contents

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 March 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VEE '11

Sponsor:

VEE '11: ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments

March 9 - 11, 2011

California, Newport Beach, USA

Acceptance Rates

Overall Acceptance Rate 80 of 235 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

52
Total Citations
View Citations
562
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)3

Reflects downloads up to 12 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li BCui LHao ZLi LLiu YLi Y(2023)eHotSnap: An Efficient and Hot Distributed Snapshots System for Virtual Machine ClusterIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2023.327201434:8(2433-2447)Online publication date: Aug-2023
https://doi.org/10.1109/TPDS.2023.3272014
Shaikh SKumar SMishra D(2023)KalpaVriksh: Efficient and Cost-effective GUI Application Hosting using Singleton Snapshots2023 IEEE/ACM 23rd International Symposium on Cluster, Cloud and Internet Computing (CCGrid)10.1109/CCGrid57682.2023.00026(180-190)Online publication date: May-2023
https://doi.org/10.1109/CCGrid57682.2023.00026
Ao LPorter GVoelker GBromberg YKermarrec AKozyrakis C(2022)FaaSnapProceedings of the Seventeenth European Conference on Computer Systems10.1145/3492321.3524270(730-746)Online publication date: 28-Mar-2022
https://dl.acm.org/doi/10.1145/3492321.3524270
Bitchebe SMvondo DRéveillère Lde Palma NTchana ATitzer BXu HZhang I(2021)Extending Intel PML for hardware-assisted working set size estimation of VMsProceedings of the 17th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments10.1145/3453933.3454018(111-124)Online publication date: 7-Apr-2021
https://dl.acm.org/doi/10.1145/3453933.3454018
Schodde THoffmann LStange SKopp S(2019)Adapt, Explain, Engage—A Study on How Social Robots Can Scaffold Second-language Learning of ChildrenACM Transactions on Human-Robot Interaction10.1145/33664229:1(1-27)Online publication date: 11-Dec-2019
https://dl.acm.org/doi/10.1145/3366422
Zhong KLiu DWu YLong LLiu WRen JLiu RLiang LShao ZLi T(2019)Towards Fast and Lightweight Checkpointing for Mobile Virtualization Using NVRAMIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2018.288690630:6(1421-1433)Online publication date: 1-Jun-2019
https://doi.org/10.1109/TPDS.2018.2886906
Mvondo DTeabe BTchana AHagimont DDe Palma N(2019)Closer: A New Design Principle for the Privileged Virtual Machine OS2019 IEEE 27th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS)10.1109/MASCOTS.2019.00016(49-60)Online publication date: Oct-2019
https://doi.org/10.1109/MASCOTS.2019.00016
Mukherjee DShekhar DMall R(2018)Proposal for A Structural Integration Test Coverage Metric for Object-Oriented ProgramsACM SIGSOFT Software Engineering Notes10.1145/3178315.317833043:1(1-4)Online publication date: 28-Mar-2018
https://dl.acm.org/doi/10.1145/3178315.3178330
Jain RSuman U(2018)A Project Management Framework for Global Software DevelopmentACM SIGSOFT Software Engineering Notes10.1145/3178315.317832943:1(1-10)Online publication date: 28-Mar-2018
https://dl.acm.org/doi/10.1145/3178315.3178329
Garg AMishra DKulkarni P(2017)CatalystACM SIGPLAN Notices10.1145/3140607.305076052:7(44-59)Online publication date: 8-Apr-2017
https://dl.acm.org/doi/10.1145/3140607.3050760
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents