Article

SSDAlloc: hybrid SSD/RAM memory management made easy

Authors:

Vivek S. PaiAuthors Info & Claims

NSDI'11: Proceedings of the 8th USENIX conference on Networked systems design and implementation

Pages 211 - 224

Published: 30 March 2011 Publication History

Abstract

We introduce SSDAlloc, a hybrid main memory management system that allows developers to treat solid-state disk (SSD) as an extension of the RAM in a system. SSDAlloc moves the SSD upward in the memory hierarchy, usable as a larger, slower form of RAM instead of just a cache for the hard drive. Using SSDAlloc, applications can nearly transparently extend their memory footprints to hundreds of gigabytes and beyond without restructuring, well beyond the RAM capacities of most servers. Additionally, SSDAlloc can extract 90% of the SSD's raw performance while increasing the lifetime of the SSD by up to 32 times. Other approaches either require intrusive application changes or deliver only 6- 30% of the SSD's raw performance.

References

[1]

Boost, http://www.boost.org/.

[2]

Calibrator, http://homepages.cwi.nl/~manegold/Calibrator/#6.

[3]

Scaling Memcaced at Facebook, http://www.facebook.com/note.php?note_id=39391378919.

[4]

Memcached, http://www.danga.com/memcached/.

[5]

ptmalloc, http://www.malloc.de/en/.

[6]

A. Anand, C. Muthukrishnan, S. Kappes, A. Akella, and S. Nath. Cheap and Large CAMs for High Performance Data-Intensive Networked Systems. In Proc. 7th USENIX NSDI, San Jose, CA, Apr. 2010.

Digital Library

[7]

D. G. Andersen, J. Franklin, M. Kaminsky, A. Phanishayee, L. Tan, and V. Vasudevan. FAWN: A fast array of wimpy nodes. In Proc. 22nd ACM Symposium on Operating Systems Principles (SOSP), Big Sky, MT, Oct. 2009.

Digital Library

[8]

A. Badam and V. S. Pai. Beating Netbooks into Servers: Making Some Computers More Equal Than Others. In Proc. 3rd ACM Workshop on Networked Systems for Developing Regions (NSDR), BigSky, MO, 2009.

[9]

A. Badam, K. Park, V. S. Pai, and L. L. Peterson. Hashcache: Cache storage for the next billion. In Proc. 6th USENIX NSDI, Boston, MA, Apr. 2009.

Digital Library

[10]

M. Baker, S. Asami, E. Deprit, J. Ousterhout, and M. Seltzer. Non-volatile memory for fast, reliable file systems. In Proc. ASPLOS'92, 1992.

Digital Library

[11]

A. Birrell, M. Isard, C. Thacker, and T. Wobber. A design for high-performance flash disks. Operating Systems Review, 42(2): 88-93, 2007.

Digital Library

[12]

M. Castro, A. Adya, B. Liskov, and A. C. Myers. Hac: Hybrid adaptive caching for distributed storage systems. In Proc. 16th ACM Symposium on Operating Systems Principles (SOSP), Saint-Malô, France, Oct. 1997.

Digital Library

[13]

J. Condit, E. B. Nightingale, C. Frost, E. Ipek, D. Burger, B. Lee, and D. Coetzee. Better I/O Through Byte-Addressable, Persistent Memory. In Proc. 22nd ACM Symposium on Operating Systems Principles (SOSP), Big Sky, MT, Oct. 2009.

Digital Library

[14]

B. Debnath, S. Sengupta, and J. Li. Chunkstash: Speeding up inline storage deduplication using flash memory. In Proc. USENIX Annual Technical Conference, Boston, MA, June 2010.

Digital Library

[15]

P. V. der Linder. Expert C Programming: Deep C Secrets. Prentice Hall, Englewood Cliffs, N.J, 1994.

Digital Library

[16]

S. Ihm, K. Park, and V. S. Pai. Wide-area Network Acceleration for the Developing World. In Proc. USENIX Annual Technical Conference, Boston, MA, June 2010.

Digital Library

[17]

T. Kgil and T. N. Mudge. Flashcache: A NAND flash memory file cache for low power web servers. In Proc. of CASES'06, 2006.

Digital Library

[18]

S. Ko, S. Jun, Y. Ryu, O. Kwon, and K. Koh. A New Linux Swap System for Flash Memory Storage Devices. In In ICCSA'09, 2008.

Digital Library

[19]

S.-W. Lee, B. Moon, C. Park, J.-M. Kim, and S.-W. Kim. A case for flash memory SSD in enterprise database applications. In Proc. ACM SIGMOD, Vancouver, BC, Canada, June 2008.

Digital Library

[20]

J. C. Mogul, E. Argollo, M. Shah, and P. Faraboschi. Operating system support for NVM+DRAM hybrind main memory. In Proc. HotOS XII, Monte Verita, Switzerland, May 2009.

Digital Library

[21]

D. Narayanan, E. Thereska, A. Donelly, S. Elnikety, and A. Rowstron. Migrating server storage to ssds, analysis of tradeoffs. In Proceedings of EuroSys'09, 2009.

Digital Library

[22]

M. Rosenblum and J. K. Ousterhout. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems, 10(1):26-52, 1992.

Digital Library

[23]

M. Saxena and M. M. Swift. Flashvm: Virtual memory management on flash. In Proc. USENIX Annual Technical Conference, Boston, MA, June 2010.

Digital Library

[24]

C.-H. Wu, L.-P. Chang, and T.-W. Kuo. An efficient b-tree layer for flash-memory storage systems. In Proccedings of RTCSA'04, 2004.

[25]

M. Wu and W. Zwaenepoel. eNVy: A non-volatile, main memory storage system. In Proc. 6th International Conf. on Architectural Support for Programming Languages and Operating Systems (ASPLOS), San Jose, CA, Oct. 1994.

Digital Library

Cited By

Gogte VWang WDiestelhorst SKolli AChen PNarayanasamy SWenisch TMerchant AWeatherspoon H(2019)Software wear management for persistent memoriesProceedings of the 17th USENIX Conference on File and Storage Technologies10.5555/3323298.3323303(45-63)Online publication date: 25-Feb-2019
https://dl.acm.org/doi/10.5555/3323298.3323303
Abulila AMailthody VQureshi ZHuang JKim NXiong JHwu WBahar IHerlihy MWitchel ELebeck A(2019)FlatFlashProceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3297858.3304061(971-985)Online publication date: 4-Apr-2019
https://dl.acm.org/doi/10.1145/3297858.3304061
Rellermeyer JAmer MSmutzer RRajamani K(2018)Container Density Improvements with Dynamic Memory Extension using NAND FlashProceedings of the 9th Asia-Pacific Workshop on Systems10.1145/3265723.3265740(1-7)Online publication date: 27-Aug-2018
https://dl.acm.org/doi/10.1145/3265723.3265740
Show More Cited By

Recommendations

WOM-Code Solutions for Low Latency and High Endurance in Phase Change Memory
This paper describes a write-once-memory-code phase change memory (WOM-code PCM) architecture for next-generation non-volatile memory applications. Specifically, we address the long latency of the write operation in PCM—attributed to PCM SET—...
FlexFS: a flexible flash file system for MLC NAND flash memory
USENIX'09: Proceedings of the 2009 conference on USENIX Annual technical conference

The multi-level cell (MLC) NAND flash memory technology enables multiple bits of information to be stored on a single cell, thus making it possible to increase the density of the memory without increasing the die size. For most MLC flash memories, each ...
FRASH: hierarchical file system for FRAM and flash
ICCSA'07: Proceedings of the 2007 international conference on Computational science and its applications - Volume Part I

In this work, we develop novel file system, FRASH, for byte-addressable NVRAM (FRAM[1]) and NAND Flash device. Byte addressable NVRAM and NAND Flash is typified by the DRAM-like fast access latency and high storage density, respectively. Hierarchical ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

NSDI'11: Proceedings of the 8th USENIX conference on Networked systems design and implementation

March 2011

27 pages

Program Chairs:
David G. Andersen
Carnegie Mellon University
,
Sylvia Ratnasamy
Intel Labs Berkeley

Sponsors

VMware
NSF: National Science Foundation
Google Inc.
Infosys
USENIX Assoc: USENIX Assoc

In-Cooperation

Publisher

USENIX Association

United States

Publication History

Published: 30 March 2011

Check for updates

Qualifiers

Article

Conference

NSDI '11

Sponsor:

NSF
USENIX Assoc

NSDI '11: 8th USENIX Symposium on Networked Systems Design and Implementation

March 30 - April 1, 2011

MA, Boston

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gogte VWang WDiestelhorst SKolli AChen PNarayanasamy SWenisch TMerchant AWeatherspoon H(2019)Software wear management for persistent memoriesProceedings of the 17th USENIX Conference on File and Storage Technologies10.5555/3323298.3323303(45-63)Online publication date: 25-Feb-2019
https://dl.acm.org/doi/10.5555/3323298.3323303
Abulila AMailthody VQureshi ZHuang JKim NXiong JHwu WBahar IHerlihy MWitchel ELebeck A(2019)FlatFlashProceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3297858.3304061(971-985)Online publication date: 4-Apr-2019
https://dl.acm.org/doi/10.1145/3297858.3304061
Rellermeyer JAmer MSmutzer RRajamani K(2018)Container Density Improvements with Dynamic Memory Extension using NAND FlashProceedings of the 9th Asia-Pacific Workshop on Systems10.1145/3265723.3265740(1-7)Online publication date: 27-Aug-2018
https://dl.acm.org/doi/10.1145/3265723.3265740
Wylot MHauswirth MCudré-Mauroux PSakr S(2018)RDF Data Storage and Query Processing SchemesACM Computing Surveys10.1145/317785051:4(1-36)Online publication date: 6-Sep-2018
https://dl.acm.org/doi/10.1145/3177850
Cho SSuresh APalit TFerdman MHonarmand NOskin MInoue K(2018)Taming the killer microsecondProceedings of the 51st Annual IEEE/ACM International Symposium on Microarchitecture10.1109/MICRO.2018.00057(627-640)Online publication date: 20-Oct-2018
https://dl.acm.org/doi/10.1109/MICRO.2018.00057
Wang YKim KLee BYoun H(2018)A novel buffer management scheme based on particle swarm optimization for SSDThe Journal of Supercomputing10.1007/s11227-017-2119-274:1(141-159)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s11227-017-2119-2
Knyaginin DStenstrom PJacob B(2017)RockProceedings of the International Symposium on Memory Systems10.1145/3132402.3132412(337-347)Online publication date: 2-Oct-2017
https://dl.acm.org/doi/10.1145/3132402.3132412
Arulraj JPavlo AChirkova RYang JSuciu D(2017)How to Build a Non-Volatile Memory Database Management SystemProceedings of the 2017 ACM International Conference on Management of Data10.1145/3035918.3054780(1753-1758)Online publication date: 9-May-2017
https://dl.acm.org/doi/10.1145/3035918.3054780
Shin JBalakrishnan MMarian TWeatherspoon H(2017)IsotopeACM Transactions on Storage10.1145/303296713:1(1-25)Online publication date: 16-Feb-2017
https://dl.acm.org/doi/10.1145/3032967
Park JMin CYeom H(2017)A New File System I/O Mode for Efficient User-level CachingProceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing10.1109/CCGRID.2017.75(649-658)Online publication date: 14-May-2017
https://dl.acm.org/doi/10.1109/CCGRID.2017.75
Show More Cited By

View Options

View options

Figures

Tables

Media

View Table of Conten