research-article

A Universal SMR-aware Cache Framework with Deep Optimization for DM-SMR and HM-SMR Disks

Authors:

Yunpeng ChaiAuthors Info & Claims

ACM Transactions on Storage, Volume 19, Issue 3

Article No.: 26, Pages 1 - 35

https://doi.org/10.1145/3588442

Published: 19 June 2023 Publication History

Abstract

To satisfy the enormous storage capacities required for big data, data centers have been adopting high-density shingled magnetic recording (SMR) disks. However, the weak fine-grained random write performance of SMR disks caused by their inherent write amplification and unbalanced read–write performance poses a severe challenge. Many studies have proposed solid-state drive (SSD) cache systems to address this issue. However, existing cache algorithms, such as the least recently used (LRU) algorithm, which is used to optimize cache popularity, and the MOST algorithm, which is used to optimize the write amplification factor, cannot exploit the full performance of the proposed cache systems because of their inappropriate optimization objectives. This article proposes a new SMR-aware cache framework called SAC+ to improve SMR-based hybrid storage. SAC+ integrates the two dominant types of SMR drives—namely, drive-managed and host-managed SMR drives—and provides a universal framework implementation. In addition, SAC+ integrally combines the drive characteristics to optimize I/O performance. The results of evaluations conducted using real-world traces indicate that SAC+ reduces the I/O time by 36–93% compared with state-of-the-art algorithms.

References

[1]

David Reinsel-John Gantz-John Rydning, J. Reinsel, and J. Gantz. 2018. The digitization of the world from edge to core. Framingham: International Data Corporation, 16 (2018).

[2]

Yuval Cassuto, Marco AA Sanvido, Cyril Guyot, David R Hall, and Zvonimir Z Bandic. 2010. Indirection systems for shingled-recording disk drives. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Tec Hnologies (MSST). IEEE, 1–14.

Digital Library

[3]

Yao Wang and R. H. Victora. 2013. Reader design for bit patterned media recording at 10 Tb/in \(^{2}\) density. IEEE Transactions on Magnetics 49, 10 (2013), 5208–5214.

[4]

Dieter Weller, Gregory Parker, Oleksandr Mosendz, Eric Champion, Barry Stipe, Xiaobin Wang, Timothy Klemmer, Ganping Ju, and Antony Ajan. 2014. A HAMR media technology roadmap to an areal density of 4 Tb/in \(^{2}\) . IEEE Transactions on Magnetics 50, 1 (2014), 1–8.

[5]

Jian-Gang Zhu, Xiaochun Zhu, and Yuhui Tang. 2008. Microwave assisted magnetic recording. IEEE Transactions on Magnetics 44, 1 (2008), 125–131.

[6]

Christoph Vogler, Claas Abert, Florian Bruckner, Dieter Suess, and Dirk Praetorius. 2016. Heat-assisted magnetic recording of bit-patterned media beyond 10 Tb/in \(^{2}\) . Applied Physics Letters 108, 10 (2016), 102406.

[7]

Seagate 2015. Seagate Archive HDD Product Manual: ST5000AS0011,ST5000AS0001. (2015). Retrieved from http://www.seagate.com/files/www-content/support-content/enterprise-servers-storage/nearline-storage/archive-hdd/_shared/masters/archive-sata-hdd-%20100743737-product-manual.pdf.

[8]

Seagate 2016. Seagate Archive HDD Product Manual: ST6000AS0002,ST800AS0002. (2016). Retrieved from http://www.seagate.com/www-content/product-content/hdd-fam/seagate-archive-hdd/en-us/docs/100757960h.pdf.

[9]

HGST 2014. HGST Unveils Intelligent, Dynamic Storage Solutions To Transform The Data Center. (2014). Retrieved from http://www.hgst.com/press-room/.

[10]

Shobana Balakrishnan, Richard Black, Austin Donnelly, Paul England, Adam Glass, David Harper, Sergey Legtchenko, Aaron Ogus, Eric Peterson, and Antony IT Rowstron. 2014. Pelican: A building block for exascale cold data storage. In Proceedings of the OSDI. 351–365.

[11]

Dropbox 2018. Extending Magic Pocket Innovation with the first petabyte scale SMR drive deployment. (2018). Retrieved from https://blogs.dropbox.com/tech/2018/06/extending-magic-pocket-innovation-with-the-first-petabyte-scale-smr-drive-deployment/.

[12]

libzbc 2020. ZBC device manipulation library. (2020). Retrieved from https://github.com/westerndigitalcorporation/libzbc.

[13]

S. Jiang and X. Zhang. 2002. LIRS: An efficient low inter-reference recency set replacement policy to improve buffer cache performance. In Proceeding of the 2002 ACM SIGMETRICS.

Digital Library

[14]

Xuchao Xie, Liquan Xiao, and David Du. 2019. ZoneTier: A zone-based storage tiering and caching co-design to integrate SSDs with SMR drives. ACM Transactions on Storage 15 (2019), 1–25.

Digital Library

[15]

Wenjian Ma, Liuying abd Xiao, Huanqing Dong, Zhenjun Liu, and Qiang Zhang. 2016. MOST: A high performance hybrid shingled write disk system. In Proceedings of the 22nd National Conference of Information Storage. CCF.

[16]

Xuda Zheng, Chi Zhang, Keqiang Duan, Weiguo Wu, and Jie Yan. 2021. SLA: A cache algorithm for SSD-SMR storage system with minimum RMWs. In Proceedings of the ICA3PP.

[17]

Wen-Guo Liu, Ling-Fang Zeng, Dan Feng, and Kenneth B. Kent. 2019. ROCO: Using a solid state drive cache to improve the performance of a host-aware shingled magnetic recording drive. Journal of Computer Science and Technology 34 (2019), 61–76.

[18]

INCITS T10 Technical Committee et al. 2017. Information technology-zoned block commands (zbc). Draft standard t10/bsrincits 550, American National Standards Institute, Inc (2017).

[19]

ITT Committee et al. 2015. Information technology-Zoned-device ATA Command Set (ZAC). In ANSI, Inc., Working Draft American National Standard T13/BSR INCITS 537 Revision 04b.

[20]

Dm-zoned: Zoned block device support. 2016. https://github.com/westerndigitalcorporation/dm-zoned-tools.

[21]

Changman Lee, Dongho Sim, Jooyoung Hwang, and Sangyeun Cho. 2015. F2FS: A new file system for flash storage. In Proceedings of the 13th \(\lbrace\) USENIX \(\rbrace\) Conference on File and Storage Technologies ( \(\lbrace\) FAST \(\rbrace\) 15). 273–286.

[22]

Donghee Lee, Jongmoo Choi, Jong-Hun Kim, Sam H Noh, Sang Lyul Min, Yookun Cho, and Chong Sang Kim. 1999. On the existence of a spectrum of policies that subsumes the least recently used (LRU) and least frequently used (LFU) policies. In Proceedings of the ACM SIGMETRICS Performance Evaluation Review. ACM, 134–143.

Digital Library

[23]

N. Megiddo and D. Modha. 2003. ARC: A self-tuning, low over-head replacement cach. In Proceedings of the 2nd USENIX Symposium on File and Storage Technologies (FAST’03). San Francisco, CA.

Digital Library

[24]

Yuanyuan Zhou, Zhifeng Chen, and Kai Li. 2004. Second-level buffer cache management. IEEE Transactions on Parallel and Distributed Systems 15, 6 (2004), 505–519.

Digital Library

[25]

Dushyanth Narayanan, Austin Donnelly, and Antony Rowstron. 2008. Write off-loading: Practical power management for enterprise storage. ACM Transactions on Storage 4, 3 (2008), 10.

Digital Library

[26]

Chunling Wang, Dandan Wang, Yupeng Chai, Chuanwen Wang, and Diansen Sun. 2017. Larger cheaper but faster: SSD-SMR hybrid storage boosted by a new SMR-oriented cache framework. In Proceedings of the IEEE Symposium on Mass Storage Systems and Technologies..

[27]

Wikipedia contributors. 2019. Pearson correlation coefficient — Wikipedia, The Free Encyclopedia. (2019). Retrieved August 3, 2019 from https://en.wikipedia.org/w/index.php?title=Pearson_correlation_coefficient&oldid=908824482.

[28]

Diansen Sun and Yunpeng Chai. 2020. SAC: A co-design cache algorithm for emerging SMR-based high-density disks. In Proceedings of the 25th International Conference on Architectural Support for Programming Languages and Operating Systems.

Digital Library

[29]

Chunghan Lee, Tatsuo Kumano, Tatsuma Matsuki, Hiroshi Endo, Naoto Fukumoto, and Mariko Sugawara. 2017. Understanding storage traffic characteristics on enterprise virtual desktop infrastructure. In Proceedings of the 10th ACM International Systems and Storage Conference (SYSTOR’17). Association for Computing Machinery, 11 pages. DOI:

Digital Library

[30]

Abutalib Aghayev, Mansour Shafaei, and Peter Desnoyers. 2015. Skylight-a window on shingled disk operation. ACM Transactions on Storage 11, 4 (2015), 16.

Digital Library

[31]

Xuchao Xie, Liquan Xiao, Xiongzi Ge, and Qiong Li. 2018. SMRC: An endurable SSD cache for host-aware shingled magnetic recording drives. IEEE Access 6 (2018), 20916–20928.

[32]

Mendel Rosenblum and John K. Ousterhout. 1992. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems 10, 1 (1992), 26–52.

Digital Library

[33]

Fenggang Wu, Bingzhe Li, Zhichao Cao, Baoquan Zhang, Ming-Hong Yang, Hao Wen, and David Hung-Chang Du. 2019. ZoneAlloy: Elastic data and space management for hybrid SMR drives. In Proceedings of the HotStorage.

[34]

Chenlin Ma, Zhaoyan Shen, Lei Han, and Zili Shao. 2019. RMW-F: A design of RMW-free cache using built-in NAND-flash for SMR storage. ACM Transactions on Embedded Computing Systems 18, 5s (2019), 1–18.

Cited By

Wu YChen SMeng XTong XLiu XXie XQu WOkoshi TKo JLiKamWa R(2024)Enabling 6D Pose Tracking on Your Acoustic DevicesProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661875(15-28)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661875
Chang LYang XLiu RXie GWang FWang J(2024)FSS-TagProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314577:4(1-24)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631457

Index Terms

A Universal SMR-aware Cache Framework with Deep Optimization for DM-SMR and HM-SMR Disks
1. Hardware
  1. Communication hardware, interfaces and storage
    1. External storage
  2. Emerging technologies
    1. Analysis and design of emerging devices and systems
      1. Emerging tools and methodologies
2. Information systems
  1. Information storage systems
    1. Storage management
      1. Hierarchical storage management

Recommendations

Building GC-free Key-value Store on HM-SMR Drives with ZoneFS
Host-managed shingled magnetic recording drives (HM-SMR) are advantageous in capacity to harness the explosive growth of data. For key-value (KV) stores based on log-structured merge trees (LSM-trees), the HM-SMR drive is an ideal solution owning to its ...
SMR Disks for Mass Storage Systems
MASCOTS '15: Proceedings of the 2015 IEEE 23rd International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems

Disk drives have seen a dramatic increase in storage density over the last five decades, but to continue the growth seems difficult because of physical limitations. One promising approach to overcome the impending limit is shingled magnetic recording (...
SLA: A Cache Algorithm for SSD-SMR Storage System with Minimum RMWs
Algorithms and Architectures for Parallel Processing
Abstract
To satisfy the low-cost and massive data storage requirements imposed by data growth, Shingled Magnetic Recording (SMR) disks are extensively employed in the area of high-density storage. The primary drawback of SMR disks is the write ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Storage

ACM Transactions on Storage Volume 19, Issue 3

August 2023

233 pages

ISSN:1553-3077

EISSN:1553-3093

DOI:10.1145/3604654

Editor:
Erez Zadok
Stony Brook University, USA

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2023

Online AM: 21 March 2023

Accepted: 07 March 2023

Revised: 07 February 2023

Received: 29 August 2021

Published in TOS Volume 19, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
308
Total Downloads

Downloads (Last 12 months)209
Downloads (Last 6 weeks)14

Reflects downloads up to 18 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wu YChen SMeng XTong XLiu XXie XQu WOkoshi TKo JLiKamWa R(2024)Enabling 6D Pose Tracking on Your Acoustic DevicesProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661875(15-28)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661875
Chang LYang XLiu RXie GWang FWang J(2024)FSS-TagProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314577:4(1-24)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631457

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents