research-article

On the Trade-Offs among Performance, Energy, and Endurance in a Versatile Hybrid Drive

Authors:

Amanpreet Mukker,

Erez ZadokAuthors Info & Claims

ACM Transactions on Storage (TOS), Volume 11, Issue 3

Article No.: 13, Pages 1 - 27

https://doi.org/10.1145/2700312

Published: 24 July 2015 Publication History

Abstract

There are trade-offs among performance, energy, and device endurance for storage systems. Designs optimized for one dimension or workload often suffer in another. Therefore, it is important to study the trade-offs to enable adaptation to workloads and dimensions. As Flash SSD has emerged, hybrid drives have been studied more closely. However, hybrids are mainly designed for high throughput, efficient energy consumption, or improving endurance—leaving quantitative study on the trade-offs unexplored. Past endurance studies also lack a concrete model to help study the trade-offs. Last, previous designs are often based on inflexible policies that cannot adapt easily to changing conditions.

We designed and developed GreenDM, a versatile hybrid drive that combines Flash-based SSDs with traditional HDDs. The SSD can be used as cache or as primary storage for hot data. We present our endurance model together with GreenDM to study these trade-offs. GreenDM presents a block interface and requires no modifications to existing software. GreenDM offers tunable parameters to enable the system to adapt to many workloads. We have designed, developed, and carefully evaluated GreenDM with a variety of workloads using commodity SSD and HDD drives. We demonstrate the importance of versatility to enable adaptation to various workloads and dimensions.

References

[1]

D. G. Andersen, J. Franklin, M. Kaminsky, A. Phanishayee, L. Tan, and V. Vasudevan. 2009. FAWN: A fast array of wimpy nodes. In Proceedings of the 22nd ACM Symposium on Operating Systems Principles (SOSP’2009). ACM SIGOPS, New York, NY, 1--14.

Digital Library

[2]

L. A. Barroso and U. Hölzle. 2009. The datacenter as a computer: An introduction to the design of warehouse-scale machines. Synthesis Lectures on Computer Architecture 4, 1, 1--108.

[3]

bcache 2015. Bcache. Retrieved July 5, 2015 from http://bcache.evilpiepirate.org/.

[4]

T. Bisson, S. A. Brandt, and D. D. E. Long. 2007. A hybrid disk-aware spin-down algorithm with I/O subsystem support. In Proceedings of the 26th IEEE International Performance, Computing and Communications Conference. IEEE Computer Society, Los Alamitos, CA, 236--245.

[5]

A. Brown and M. Seltzer. 1997. Operating system benchmarking in the wake of Lmbench: A case study of the performance of NetBSD on the Intel x86 architecture. In Proceedings of the 1997 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems. ACM Press, New York, NY, 214--224.

Digital Library

[6]

F. Chen, D. A. Koufaty, and X. Zhang. 2011. Hystor: Making the best use of solid state drives in high performance storage systems. In Proceedings of the International Conference on Supercomputing. ACM, New York, NY, 22--32.

Digital Library

[7]

D. Colarelli and D. Grunwald. 2002. Massive arrays of idle disks for storage archives. In Proceedings of the 2002 ACM/IEEE conference on Supercomputing. ACM, New York, NY, USA, 1--11.

Digital Library

[8]

V. Delaluz, A. Sivasubramaniam, M. Kandemir, N. Vijaykrishnan, and M. J. Irwin. 2002. Scheduler-based DRAM energy management. In Proceedings of the 39th annual Design Automation Conference. ACM, New York, NY, USA, 697--702.

Digital Library

[9]

Dell Flash Array. 2015. Compellent Flash Optimized Solutions. http://www.dell.com/us/business/p/dell-compellent-flash-optimized/pd.

[10]

P. Desnoyers. 2013. What systems researchers need to know about NAND flash. In HotStorage’13: Proceedings of the 5th USENIX Workshop on Hot Topics in Storage. USENIX Association, Berkeley, CA, 1--5.

Digital Library

[11]

Filebench. 2014. Filebench. http://filebench.sourceforge.net/.

[12]

R. Freitas. 2009. Storage class memory: Technology, systems and applications. In Proceedings of the 2009 ACM SIGMOD International Conference on Management of Data (SIGMOD’09). ACM, New York, NY, 985--986.

Digital Library

[13]

J. Gantz and D. Reinsel. 2010. The Digital Universe Decade—Are You Ready? http://www.emc.com/collateral/analyst-reports/idc-digital-universe-are-you-ready.pdf.

[14]

GitHub 2015. facebook/flashcache. Retrieved July 5, 2015 from https://github.com/facebook/flashcache/.

[15]

B. Guenter, N. Jain, and C. Williams. 2011. Managing cost, performance, and reliability tradeoffs for energy-aware server provisioning. In INFOCOM 2011. 30th IEEE International Conference on Computer Communications, Joint Conference of the IEEE Computer and Communications Societies. IEEE, Los Alamitos, CA, 1332--1340.

[16]

J. Guerra, H. Pucha, J. Glider, W. Belluomini, and R. Rangaswami. 2011. Cost effective storage using extent based dynamic tiering. In USENIX FAST. USENIX Association, Berkeley, CA, 20--34.

Digital Library

[17]

S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke. 2003. DRPM: Dynamic speed control for power management in server class disks. In Proceedings of the 30th International Symposium on Computer Architecture. ACM Press, New York, NY, 169--179.

Digital Library

[18]

W. Jiang, C. Hu, Y. Zhou, and A. Kanevsky. 2008. Are disks the dominant contributor for storage failures? A comprehensive study of storage subsystem failure characteristics. In Proceedings of the 5th UNENIX Conference on File and Storage Technologies (FAST’08). USENIX Association, San Jose, CA. 111--125.

Digital Library

[19]

N. Joukov and J. Sipek. 2008. GreenFS: Making enterprise computers greener by protecting them better. In Proceedings of the 3rd ACM SIGOPS/EuroSys European Conference on Computer Systems 2008 (EuroSys’08). ACM, Glasgow, Scotland, 1--14.

Digital Library

[20]

N. Joukov, A. Traeger, R. Iyer, C. P. Wright, and E. Zadok. 2006. Operating system profiling via latency analysis. In Proceedings of the 7th Symposium on Operating Systems Design and Implementation (OSDI’06). ACM SIGOPS, Seattle, WA, 89--102.

Digital Library

[21]

M. Jung and M. Kandemir. 2013. Revisiting widely held SSD expectations and rethinking system-level implications. In Proceedings of the ACM SIGMETRICS/International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS’13). ACM, New York, NY, USA, 203--216.

Digital Library

[22]

Asim Kadav, Mahesh Balakrishnan, Vijayan Prabhakaran, and Dahlia Malkhi. 2009. Differential RAID: Rethinking RAID for SSD reliability. In HotStorage’09: Proceedings of the 1st Workshop on Hot Topics in Storage. ACM, New York, NY, 4:1--4:22.

[23]

R. T. Kaushik and M. Bhandarkar. 2010. GreenHDFS: Towards an energy-conserving, storage-efficient, hybrid Hadoop compute cluster. In Proceedings of the 2010 International Conference on Power Aware Computing and Systems (HotPower’10). USENIX Association, Berkeley, CA, 1--9.

Digital Library

[24]

Y. Kim, A. Gupta, B. Urgaonkar, P. Berman, and A. Sivasubramaniam. 2011. HybridStore: A cost-efficient, high-performance storage system combining SSDs and HDDs. In IEEE MASCOTS. IEEE Computer Society, Washington, DC, 227--236.

Digital Library

[25]

H. Kim, S. Seshadri, C. L. Dickey, and L. Chiu. 2014. Evaluating phase change memory for enterprise storage systems: A study of caching and tiering approaches. In Proceedings of the 12th USENIX Conference on File and Storage Technologies. USENIX, Berkeley, CA, 33--45.

Digital Library

[26]

J. G. Koomey. 2011. Growth in Data Center Electricity Use 2005 to 2010. Technical Report. Stanford University, Stanford, CA.

[27]

R. Kothiyal, V. Tarasov, P. Sehgal, and E. Zadok. 2009. Energy and performance evaluation of lossless file data compression on server systems. In Proceedings of the Second ACM Israeli Experimental Systems Conference (SYSTOR’09). ACM, Haifa, Israel, 4:1--4:12.

Digital Library

[28]

S. Lee, T. Kim, K. Kim, and J. Kim. 2012. Lifetime management of flash-based SSDs using recovery-aware dynamic throttling. In Proceedings of the 10th UNENIX Conference on File and Storage Technologies (FAST’12). USENIX Association, San Jose, CA, 26--26.

Digital Library

[29]

S. Li and A. Belay. 2007. cpuidle — do nothing, efficiently.... In Proceedings of the Linux Symposium, Vol. 2. Linux Symposium, Ottawa, Ontario, Canada, 1--10.

[30]

Z. Li, A. Desai, C. Bhatt, and E. Zadok. 2012a. vATM: vSphere adaptive task management. In Proceedings of the 7th International Workshop on Feedback Computing (FC’12). ACM, New York, NY, 1--7.

[31]

Z. Li, K. M. Greenan, A. W. Leung, and E. Zadok. 2012b. Power consumption in enterprise-scale backup storage systems. In Proceedings of the 10th UNENIX Conference on File and Storage Technologies (FAST’12). USENIX Association, San Jose, CA, 6--13.

Digital Library

[32]

Z. Li, R. Grosu, K. Muppalla, S. A. Smolka, S. D. Stoller, and E. Zadok. 2011a. Model discovery for energy-aware computing systems: An experimental evaluation. In Proceedings of the 1st Workshop on Energy Consumption and Reliability of Storage Systems (ERSS’11). IEEE Computer Society, Los Alamitos, CA, 1--6.

Digital Library

[33]

Z. Li, R. Grosu, P. Sehgal, S. A. Smolka, S. D. Stoller, and E. Zadok. 2011b. On the energy consumption and performance of systems software. In Proceedings of the 4th Israeli Experimental Systems Conference (ACM SYSTOR’11). ACM, Haifa, Israel, 8:1--8:12.

Digital Library

[34]

Z. Li, A. Mukker, and E. Zadok. 2014. On the importance of evaluating storage systems’ &dollar;costs. In Proceedings of the 6th USENIX Conference on Hot Topics in Storage and File Systems (HotStorage’14). USENIX, Berkeley, CA, 1--5. to appear.

Digital Library

[35]

T. Luo, R. Lee, M. Mesnier, F. Chen, and X. Zhang. 2012. hStorage-DB: Heterogeneity-aware data management to exploit the full capability of hybrid storage systems. Proceedings of the VLDB Endowment 5, 10, 1076--1087.

Digital Library

[36]

V. Mohan, T. Siddiqua, S. Gurumurthi, and M. R. Stan. 2010. How I learned to stop worrying and love Flash endurance. In Proceedings of the 2nd USENIX Conference on Hot Topics in Storage and File Systems (HotStorage’10). USENIX Association, Berkeley, CA, 8--13.

Digital Library

[37]

NetApp. 2015. NetApp Data Ontap 8.3: Flash optimization features. Retrieved July 5, 2015 from http://www.netapp.com/us/products/platform-os/flashpool.aspx.

[38]

nimblestorage 2015. Driving storage lifecycle efficiency with data science. Retrieved July 5, 2015 from www.nimblestorage.com/products/architecture.php.

[39]

R. Panabaker. 2006. Hybrid Hard Disk and Ready-Drive Technology: Improving Performance and Power for Windows Vista Mobile PCs. Retrieved July 6, 2015 from http://www.microsoft.com/whdc/winhec/pres06.mspx.

[40]

E. Pinheiro and R. Bianchini. 2004. Energy conservation techniques for disk array-based servers. In Proceedings of the 18th International Conference on Supercomputing (ICS’04). ACM, New York, NY, 68--78.

Digital Library

[41]

E. Pinheiro, W. Weber, and L. A. Barroso. 2007. Failure trends in a large disk drive population. In Proceedings of the 4th UNENIX Conference on File and Storage Technologies (FAST’07). USENIX Association, San Jose, CA, 17--28.

Digital Library

[42]

SNIA Iotta Repository. 2011. FIU SRCMap Trace Repository. Retrieved July 5, 2015 from http://iotta. snia.org/traces/414.

[43]

G. Soundararajan, V. Prabhakaran, M. Balakrishnan, and T. Wobber. 2010. Extending SSD lifetimes with disk-based write caches. In Proceedings of the 8th USENIX Conference on File and Storage Technologies (FAST’10). USENIX Association, Berkeley, CA, 8--20.

Digital Library

[44]

Sourceforge. 2015. btier beta. Retrieved July 5, 2015 from http://sourceforge.net/projects/tier/.

[45]

M. W. Storer, K. M. Greenan, E. L. Miller, and K. Voruganti. 2008. Pergamum: Replacing tape with energy efficient, reliable, disk-based archival storage. In Proceedings of the 5th UNENIX Conference on File and Storage Technologies (FAST’08). USENIX Association, San Jose, CA, 1:1--1:16.

Digital Library

[46]

J. D. Strunk. 2012. Hybrid aggregates: Combining SSDs and HDDs in a single storage pool. SIGOPS Operating Systems Review 46, 3, 50--56.

Digital Library

[47]

V. Tarasov, S. Bhanage, E. Zadok, and M. Seltzer. 2011. Benchmarking file system benchmarking: It &ast;IS&ast; rocket science. In Proceedings of HotOS XIII: The 13th USENIX Workshop on Hot Topics in Operating Systems. USENIX Association, Napa, CA, 8--13.

Digital Library

[48]

Tintri. 2013. Tintri VMStore. Retrieved July 5, 2015 from www.tintri.com/resources/videos/introduction-to- tintri/.

[49]

UMassTraceRepository. 2009. UMass Trace Repository. http://traces.cs.umass.edu.

[50]

A. Verma, R. Koller, L. Useche, and R. Rangaswami. 2010. SRCMap: Energy proportional storage using dynamic consolidation. In Proceedings of the 8th USENIX Conference on File and Storage Technologies (FAST’10). USENIX Association, Berkeley, CA, USA, 8--20.

Digital Library

[51]

vFlash 2012. Virtual Flash Tech Preview. Retrieved July 5, 2015 from http://blogs.vmware.com/vsphere/2012/12/virtual-flash-vflash-te ch-preview.html.

[52]

Watts up. 2010. Smart Circuit Controllers. Retrieved July 5, 2015 from www.wattsupmeters.com/secure/products.php.

[53]

C. Weddle, M. Oldham, J. Qian, A. A. Wang, P. Reiher, and G. Kuenning. 2007. PARAID: A gear-shifting power-aware RAID, See FAST 2007 {2007}, 245--260.

Digital Library

[54]

Western Digital. 2013. WD Blue. Retrieved July 5, 2015 from http://www.wd.com/en/products/products.aspx?id=800#tab11.

[55]

M. Wei, L. M. Grupp, F. E. Spada, and S. Swanson. 2011. Reliably erasing data from flash-based solid state drives. In Proceedings of the 9th USENIX Conference on File and Stroage Technologies (FAST’11). USENIX Association, Berkeley, CA, USA, 8--22.

Digital Library

[56]

Wikipedia. 2014. ZCAV. Retrieved July 5, 2015 from https://en.wikipedia.org/wiki/Zone_bit_recording.

[57]

Wikipedia. 2015a. Device Mapper. Retrieved July 5, 2015 from http://en.wikipedia.org/wiki/Device_mapper.

[58]

Wikipedia 2015b. Fusion Drive. Retrieved July 5, 2015 from http://en.wikipedia.org/wiki/Fusion_Drive.

[59]

Wikipedia. 2015c. Gamma distribution. Retrieved July 5, 2015 from http://en.wikipedia.org/wiki/Gamma_distribution.

[60]

A. W. Wilson. 2008. Operation and implementation of random variables in Filebench. White Paper, Sun Microsystems.

[61]

C. P. Wright, N. Joukov, D. Kulkarni, Y. Miretskiy, and E. Zadok. 2005. Auto-pilot: A platform for system software benchmarking. In Proceedings of the Annual USENIX Technical Conference, FREENIX Track. USENIX Association, Anaheim, CA, 175--187.

Digital Library

[62]

T. Xie and Y. Sun. 2008. PEARL: Performance, energy, and reliability balanced dynamic data redistribution for next generation disk arrays. In IEEE MASCOTS. IEEE Computer Society, Washington, DC, 8--16.

[63]

Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wilkes. 2005. Hibernator: Helping disk arrays sleep through the winter. In Proceedings of the 20th ACM Symposium on Operating Systems Principles (SOSP’05). ACM Press, Brighton, UK, 177--190.

Digital Library

[64]

X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, P. Padala, and K. Shin. 2009. What does control theory bring to systems research? SIGOPS Operating Systems Review 43, 1, 62--69.

Digital Library

[65]

Y. Zhu and F. Mueller. 2004. Feedback EDF scheduling exploiting dynamic voltage scaling. In Proceedings of the 10th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS’04). IEEE Computer Society, Washington, DC, 33--63.

Digital Library

Cited By

Zhang JChen JLiu KZhuo YYuan P(2023)HyF2FS: A Filesystem to Fully Exploit the Parallelism of Hybrid Storage2023 IEEE 41st International Conference on Computer Design (ICCD)10.1109/ICCD58817.2023.00049(267-274)Online publication date: 6-Nov-2023
https://doi.org/10.1109/ICCD58817.2023.00049
Borba ETavares EMaciel P(2022)A modeling approach for estimating performance and energy consumption of storage systemsJournal of Computer and System Sciences10.1016/j.jcss.2022.04.001128:C(86-106)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1016/j.jcss.2022.04.001
Chikhaoui ALemarchand LBoukhalfa KBoukhobza J(2021)Multi-objective Optimization of Data Placement in a Storage-as-a-Service Federated CloudACM Transactions on Storage10.1145/345274117:3(1-32)Online publication date: 16-Aug-2021
https://dl.acm.org/doi/10.1145/3452741
Show More Cited By

Index Terms

On the Trade-Offs among Performance, Energy, and Endurance in a Versatile Hybrid Drive
1. Information systems
  1. Information retrieval
  2. Information storage systems

Recommendations

Read-Performance Optimization for Deduplication-Based Storage Systems in the Cloud

Data deduplication has been demonstrated to be an effective technique in reducing the total data transferred over the network and the storage space in cloud backup, archiving, and primary storage systems, such as VM (virtual machine) platforms. However, ...
Efficient journaling writeback schemes for reliable and high-performance storage systems

We propose a efficient writeback scheme that enables guaranteeing throughput in high-performance storage systems. The proposed scheme, called de-fragmented writeback (DFW), reduces positioning time of storage devices in writing workloads, and thus ...
Enhancing hybrid parallel file system through performance and space-aware data layout

Hybrid parallel file systems PFSs, which consist of solid-state drive servers SServer and hard disk drive servers HServer, have recently attracted growing attention. Compared to a traditional HServer, an SServer consistently provides improved storage ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Storage

ACM Transactions on Storage Volume 11, Issue 3

July 2015

117 pages

ISSN:1553-3077

EISSN:1553-3093

DOI:10.1145/2809503

Editor:
Darrell D. E. Long
University of California Santa Cruz, USA

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 July 2015

Accepted: 01 December 2014

Revised: 01 December 2014

Received: 01 May 2014

Published in TOS Volume 11, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
287
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)1

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang JChen JLiu KZhuo YYuan P(2023)HyF2FS: A Filesystem to Fully Exploit the Parallelism of Hybrid Storage2023 IEEE 41st International Conference on Computer Design (ICCD)10.1109/ICCD58817.2023.00049(267-274)Online publication date: 6-Nov-2023
https://doi.org/10.1109/ICCD58817.2023.00049
Borba ETavares EMaciel P(2022)A modeling approach for estimating performance and energy consumption of storage systemsJournal of Computer and System Sciences10.1016/j.jcss.2022.04.001128:C(86-106)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1016/j.jcss.2022.04.001
Chikhaoui ALemarchand LBoukhalfa KBoukhobza J(2021)Multi-objective Optimization of Data Placement in a Storage-as-a-Service Federated CloudACM Transactions on Storage10.1145/345274117:3(1-32)Online publication date: 16-Aug-2021
https://dl.acm.org/doi/10.1145/3452741
Chikhaoui ALemarchand LBoukhalfa KBoukhobza JHung CHong JBechini ASong E(2021)StorNIR, a multi-objective replica placement strategy for cloud federationsProceedings of the 36th Annual ACM Symposium on Applied Computing10.1145/3412841.3441886(50-59)Online publication date: 22-Mar-2021
https://dl.acm.org/doi/10.1145/3412841.3441886
Borba ETavares EMaciel PLira VAraujo C(2020)Performance and Energy Consumption Evaluation of Hybrid Storage Systems2020 IEEE International Systems Conference (SysCon)10.1109/SysCon47679.2020.9275913(1-6)Online publication date: 24-Aug-2020
https://doi.org/10.1109/SysCon47679.2020.9275913
Rajkumar KDhanakoti V(2020)Methodological Methods to Improve the Efficiency of Cloud Storage by applying De-duplication Techniques in Cloud Computing2020 2nd International Conference on Advances in Computing, Communication Control and Networking (ICACCCN)10.1109/ICACCCN51052.2020.9362940(876-884)Online publication date: 18-Dec-2020
https://doi.org/10.1109/ICACCCN51052.2020.9362940
Dai HWong RWang HZheng ZVasilakos A(2019)Big Data Analytics for Large-scale Wireless NetworksACM Computing Surveys10.1145/333706552:5(1-36)Online publication date: 13-Sep-2019
https://dl.acm.org/doi/10.1145/3337065
Ekimov KPodryadchikov SPutrolaynen VBelyaev MMaslennikov E(2019)Testing experimental samples of solid state drivesIOP Conference Series: Materials Science and Engineering10.1088/1757-899X/537/3/032042537(032042)Online publication date: 17-Jun-2019
https://doi.org/10.1088/1757-899X/537/3/032042
Li RChen H(2018)DOBBS: A Highly Available Distributed Block Storage Service for Virtual Machines2018 IEEE International Conference of Safety Produce Informatization (IICSPI)10.1109/IICSPI.2018.8690348(685-689)Online publication date: Dec-2018
https://doi.org/10.1109/IICSPI.2018.8690348
Kaur RChana IBhattacharya J(2018)Data deduplication techniques for efficient cloud storage managementThe Journal of Supercomputing10.1007/s11227-017-2210-874:5(2035-2085)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1007/s11227-017-2210-8
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents