research-article

Skylight—A Window on Shingled Disk Operation

Authors:

Abutalib Aghayev,

Mansour Shafaei,

Peter DesnoyersAuthors Info & Claims

ACM Transactions on Storage (TOS), Volume 11, Issue 4

Article No.: 16, Pages 1 - 28

https://doi.org/10.1145/2821511

Published: 16 October 2015 Publication History

Abstract

We introduce Skylight, a novel methodology that combines software and hardware techniques to reverse engineer key properties of drive-managed Shingled Magnetic Recording (SMR) drives. The software part of Skylight measures the latency of controlled I/O operations to infer important properties of drive-managed SMR, including type, structure, and size of the persistent cache; type of cleaning algorithm; type of block mapping; and size of bands. The hardware part of Skylight tracks drive head movements during these tests, using a high-speed camera through an observation window drilled through the cover of the drive. These observations not only confirm inferences from measurements, but resolve ambiguities that arise from the use of latency measurements alone. We show the generality and efficacy of our techniques by running them on top of three emulated and two real SMR drives, discovering valuable performance-relevant details of the behavior of the real SMR drives.

References

[1]

Ahmed Amer, Darrell D. E. Long, Ethan L. Miller, Jehan-Francois Paris, and S. J. Thomas Schwarz. 2010. Design issues for a shingled write disk system. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) (MSST’10). IEEE Computer Society, Washington, DC, 1--12.

Digital Library

[2]

Jens Axboe. 2015. Flexible I/O Tester. git://git.kernel.dk/fio.git.

[3]

Lakshmi N. Bairavasundaram, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, Garth R. Goodson, and Bianca Schroeder. 2008. An analysis of data corruption in the storage stack. Trans. Storage 4, 3, Article 8 (Nov. 2008), 28 pages.

Digital Library

[4]

Luc Bouganim, Bjorn Jnsson, and Philippe Bonnet. 2009. uFLIP: Understanding flash IO patterns. In Proceedings of the International Conference on Innovative Data Systems Research (CIDR). Asilomar, California.

[5]

Yuval Cassuto, Marco A. A. Sanvido, Cyril Guyot, David R. Hall, and Zvonimir Z. Bandic. 2010. Indirection systems for shingled-recording disk drives. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) (MSST’10). IEEE Computer Society, Washington, DC, 1--14.

Digital Library

[6]

Feng Chen, David A. Koufaty, and Xiaodong Zhang. 2009. Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In Proceedings of the 11th International Joint Conference on Measurement and Modeling of Computer Systems (SIGMETRICS’09). ACM, New York, NY, 181--192.

Digital Library

[7]

Jonathan Darrel Coker and David Robison Hall. 2013. Indirection memory architecture with reduced memory requirements for shingled magnetic recording devices. (Nov. 5, 2013). US Patent 8,578,122.

[8]

Linux Device-Mapper. 2001. Device-Mapper Resource Page. https://sourceware.org/dm/.

[9]

Elizabeth A. Dobisz, Z. Z. Bandic, Tsai-Wei Wu, and T. Albrecht. 2008. Patterned media: Nanofabrication challenges of future disk drives. Proc. IEEE 96, 11 (Nov. 2008), 1836--1846.

[10]

DRAMeXchange. 2014. NAND Flash Spot Price. (Sept. 2014). http://dramexchange.com.

[11]

Robert M. Fallone and William B. Boyle. 2013. Data storage device employing a run-length mapping table and a single address mapping table. (May 14, 2013). US Patent 8,443,167.

[12]

Tim Feldman. 2014a. Host-aware SMR. OpenZFS Developer Summit. Available from https://www.youtube.com/watch?v=b1yqjV8qemU.

[13]

Tim Feldman. 2014b. Personal communication. (Aug. 2014).

[14]

Tim Feldman and Garth Gibson. 2013. Shingled magnetic recording: Areal density increase requires new data management. USENIX 38, 3 (2013).

[15]

Timothy Richard Feldman. 2011. Dynamic storage regions. (Feb. 14, 2011). US Patent Appl. 13/026,535.

[16]

Garth Gibson and Greg Ganger. 2011. Principles of Operation for Shingled Disk Devices. Technical Report CMU-PDL-11-107. CMU Parallel Data Laboratory. http://repository.cmu.edu/pdl/7.

[17]

Garth Gibson and Milo Polte. 2009. Directions for Shingled-Write and Two-Dimensional Magnetic Recording System Architectures: Synergies with Solid-State Disks. Technical Report CMU-PDL-09-104. CMU Parallel Data Laboratory. http://repository.cmu.edu/pdl/7.

[18]

Jongmin Gim and Youjip Won. 2010. Extract and infer quickly: Obtaining sector geometry of modern hard disk drives. ACM Trans Storage (TOS) 6, 2, Article 6 (July 2010), 26 pages.

Digital Library

[19]

David Hall, John H. Marcos, and Jonathan D. Coker. 2012. Data handling algorithms for autonomous shingled magnetic recording hdds. IEEE Trans Magn 48, 5, 1777--1781.

[20]

David Robison Hall. 2014. Shingle-written magnetic recording (SMR) device with hybrid E-region. (April 1, 2014). US Patent 8,687,303.

[21]

Weiping He and David H. C. Du. 2014. Novel address mappings for shingled write disks. In Proceedings of the 6th USENIX Conference on Hot Topics in Storage and File Systems (HotStorage’14). USENIX Association, Berkeley, CA, 5--5. http://dl.acm.org/citation.cfm?id=2696578.2696583

Digital Library

[22]

HGST. 2014. HGST Unveils Intelligent, Dynamic Storage Solutions to Transform the Data Center. (Sept. 2014). Available from http://www.hgst.com/press-room/.

[23]

INCITS T10 Technical Committee. 2014. Information technology—Zoned Block Commands (ZBC). Draft Standard T10/BSR INCITS 536. American National Standards Institute, Inc. Available from http://www.t10.org/drafts.htm.

[24]

Chao Jin, Wei-Ya Xi, Zhi-Yong Ching, Feng Huo, and Chun-Teck Lim. 2014. HiSMRfs: A high performance file system for shingled storage array. In Proceedings of the 2014 IEEE 30th Symposium on Mass Storage Systems and Technologies (MSST). 1--6.

[25]

Jesung Kim, Jong Min Kim, S. H. Noh, Sang Lyul Min, and Yookun Cho. 2002. A space-efficient flash translation layer for CompactFlash systems. IEEE Trans. Consumer Electron. 48, 2 (May 2002), 366--375.

Digital Library

[26]

Elie Krevat, Joseph Tucek, and Gregory R. Ganger. 2011. Disks are like snowflakes: No two are alike. In Proceedings of the 13th USENIX Conference on Hot Topics in Operating Systems (HotOS’13). USENIX Association, Berkeley, CA, 14--14. http://dl.acm.org/citation.cfm?id=1991596.1991615

Digital Library

[27]

Andrew Krioukov, Lakshmi N. Bairavasundaram, Garth R. Goodson, Kiran Srinivasan, Randy Thelen, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dussea. 2008. Parity lost and parity regained. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST’08). USENIX Association, Berkeley, CA, Article 9, 15 pages. http://dl.acm.org/citation.cfm?id=1364813.1364822

Digital Library

[28]

Mark H. Kryder, Edward C. Gage, Terry W. McDaniel, William A. Challener, Robert E. Rottmayer, Ganping Ju, Yiao-Tee Hsia, and M. Fatih Erden. 2008. Heat assisted magnetic recording. Proc. IEEE 96, 11 (Nov. 2008), 1810--1835.

[29]

Quoc M. Le, Kumar Sathyanarayana Raju, Ahmed Amer, and JoAnne Holliday. 2011. Workload impact on shingled write disks: All-writes can be alright. In Proceedings of the 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS’11). IEEE Computer Society, Washington, DC, 444--446.

Digital Library

[30]

Damien Le Moal, Zvonimir Bandic, and Cyril Guyot. 2012. Shingled file system host-side management of Shingled magnetic recording disks. In Proceedings of the 2012 IEEE International Conference on Consumer Electronics (ICCE). 425--426.

[31]

Libata FAQ. 2011. https://ata.wiki.kernel.org/index.php/Libata_FAQ.

[32]

Chung-I Lin, Dongchul Park, Weiping He, and David H. C. Du. 2012. H-SWD: Incorporating hot data identification into Shingled write disks. In Proceedings of the 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS’12). IEEE Computer Society, Washington, DC, 321--330.

Digital Library

[33]

Chanik Park, Wonmoon Cheon, Jeonguk Kang, Kangho Roh, Wonhee Cho, and Jin-Soo Kim. 2008. A reconfigurable FTL (Flash Translation Layer) architecture for NAND flash-based applications. ACM Trans. Embed. Comput. Syst. 7, 4, Article 38 (Aug. 2008), 23 pages.

Digital Library

[34]

S. N. Piramanayagam. 2007. Perpendicular recording media for hard disk drives. J. Appl. Phys. 102, 1 (July 2007), 011301.

[35]

Rekha Pitchumani, Andy Hospodor, Ahmed Amer, Yangwook Kang, Ethan L. Miller, and Darrell D. E. Long. 2012. Emulating a Shingled write disk. In Proceedings of the 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS’12). IEEE Computer Society, Washington, DC, 339--346.

Digital Library

[36]

Sundar Poudyal. 2013. Partial write system. (March 13, 2013). US Patent Appl. 13/799,827.

[37]

Drew Riley. 2013. Samsung’s SSD Global Summit: Samsung: Flexing Its Dominance In The NAND Market. (Aug. 2013). http://www.tomshardware.com/reviews/samsung-global-ssd-summit-2013,3570.html.

[38]

Mendel Rosenblum and John K. Ousterhout. 1991. The design and implementation of a log-structured file system. In Proceedings of the 13th ACM Symposium on Operating Systems Principles (SOSP’91). ACM, New York, NY, 1--15.

Digital Library

[39]

SATA-IO. 2011. Serial ATA Revision 3.1 Specification. Technical Report. SATA-IO.

[40]

Steven W. Schlosser, Jiri Schindler, Stratos Papadomanolakis, Minglong Shao, Anastassia Ailamaki, Christos Faloutsos, and Gregory R. Ganger. 2005. On multidimensional data and modern disks. In Proceedings of the 4th Conference on USENIX Conference on File and Storage Technologies—Volume 4 (FAST’05). USENIX Association, Berkeley, CA, 17--17. http://dl.acm.org/citation.cfm?id=1251028.1251045

Digital Library

[41]

Seagate 2013a. Seagate Desktop HDD: ST5000DM000, ST4000DM001. Product Manual 100743772. Seagate Technology LLC.

[42]

Seagate 2013b. Seagate Technology PLC Fiscal Fourth Quarter and Year End 2013 Financial Results Supplemental Commentary. (July 2013). Available from http://www.seagate.com/investors.

[43]

Seagate 2013c. Terascale HDD. Data sheet DS1793.1-1306US. Seagate Technology PLC.

[44]

Seagate 2014. Seagate Ships Worlds First 8TB Hard Drives. (Aug. 2014). Available from http://www.seagate.com/about/newsroom/.

[45]

Nisha Talagala, Remzi H. Arpaci-Dusseau, and David Patterson. 1999. Microbenchmark-based Extraction of Local and Global Disk Characteristics. Technical Report UCB/CSD-99-1063. EECS Department, University of California, Berkeley. http://www.eecs.berkeley.edu/Pubs/TechRpts/1999/6275.html.

[46]

Sophia Tan, Weiya Xi, Zhi Yong Ching, Chao Jin, and Chun Teck Lim. 2013. Simulation for a Shingled magnetic recording disk. IEEE Trans. Magn. 49, 6 (June 2013), 2677--2681.

[47]

David A. Thompson and John S. Best. 2000. The future of magnetic data storage techology. IBM J. Res. Dev. 44, 3 (May 2000), 311--322.

Digital Library

[48]

Sumei Wang, Yao Wang, and Randall H. Victora. 2013. Shingled magnetic recording on bit patterned media at 10 Tb/in². IEEE Trans. Magn. 49, 7 (July 2013), 3644--3647.

[49]

R. Wood, Mason Williams, A Kavcic, and Jim Miles. 2009. The feasibility of magnetic recording at 10 terabits per square inch on conventional media. IEEE Trans. Magn. 45, 2 (Feb. 2009), 917--923.

[50]

Bruce L. Worthington, Gregory R. Ganger, Yale N. Patt, and John Wilkes. 1995. On-line extraction of SCSI disk drive parameters. In Proceedings of the 1995 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS’95/PERFORMANCE’95). ACM, New York, NY, 146--156.

Digital Library

Cited By

Zhang CYu FNie STang WLiu FLiu SWu W(2024)Amphisbaena: A Novel Persistent Buffer Management Strategy to Improve SMR Disk PerformanceApplied Sciences10.3390/app1402063014:2(630)Online publication date: 11-Jan-2024
https://doi.org/10.3390/app14020630
Yang CCao ZGuo CZhao MCao Z(2024)Can ZNS SSDs be Better Storage Devices for Persistent Cache?Proceedings of the 16th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3655038.3665946(55-62)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3655038.3665946
Yang CFeng BCao ZCao Z(2024)HyzoneStore: Hybrid Storage with Flexible Logical Interface and Optimized Cache for Zoned DevicesProceedings of the 2024 7th International Conference on Data Storage and Data Engineering10.1145/3653924.3653935(71-77)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1145/3653924.3653935
Show More Cited By

Index Terms

Skylight—A Window on Shingled Disk Operation

Recommendations

Understanding the SWD-based RAID System
CCBD '14: Proceedings of the 2014 International Conference on Cloud Computing and Big Data

The emergence of big data needs more and more storage capacity, and hard disk drive (HDD) plays a very important role in storage supplying. However, because of super paramagnetic effect, the growth of the areal density of HDD will quickly reach the ...
Enabling File-Oriented Fast Secure Deletion on Shingled Magnetic Recording Drives
DAC '19: Proceedings of the 56th Annual Design Automation Conference 2019

Existing secure deletion approaches are inefficient in erasing data permanently because file systems have no knowledge of the data layout on the storage device, nor is the storage device aware of file information within the file systems. This ...
SMRDB: key-value data store for shingled magnetic recording disks
SYSTOR '15: Proceedings of the 8th ACM International Systems and Storage Conference

Shingled Magnetic Recording (SMR) disks employ a shingled write process that overlaps the data tracks on the disk surface like the shingles on a roof, thereby increasing disk areal density with minimal manufacturing changes. While these disks have the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Storage

ACM Transactions on Storage Volume 11, Issue 4

Special Issue USENIX FAST 2015

November 2015

141 pages

ISSN:1553-3077

EISSN:1553-3093

DOI:10.1145/2836327

Editor:
Darrell D. E. Long
University of California Santa Cruz, USA

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2015

Accepted: 01 September 2015

Revised: 01 August 2015

Received: 01 June 2015

Published in TOS Volume 11, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

NetApp Faculty Fellowship
National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

76
Total Citations
View Citations
529
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang CYu FNie STang WLiu FLiu SWu W(2024)Amphisbaena: A Novel Persistent Buffer Management Strategy to Improve SMR Disk PerformanceApplied Sciences10.3390/app1402063014:2(630)Online publication date: 11-Jan-2024
https://doi.org/10.3390/app14020630
Yang CCao ZGuo CZhao MCao Z(2024)Can ZNS SSDs be Better Storage Devices for Persistent Cache?Proceedings of the 16th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3655038.3665946(55-62)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3655038.3665946
Yang CFeng BCao ZCao Z(2024)HyzoneStore: Hybrid Storage with Flexible Logical Interface and Optimized Cache for Zoned DevicesProceedings of the 2024 7th International Conference on Data Storage and Data Engineering10.1145/3653924.3653935(71-77)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1145/3653924.3653935
Wu CLee CTsai YWu C(2024)A Space-Grained Cleaning Method to Reduce Long-Tail Latency of DM-SMR DisksACM Transactions on Embedded Computing Systems10.1145/364382723:2(1-24)Online publication date: 5-Feb-2024
https://dl.acm.org/doi/10.1145/3643827
Zhou SXu EWu HDu YCui JFu WLiu CWang YWang WSun SWang XFeng BZhu BTong XKong WLiu LWu ZWu JLuo QWu JNaor DGoel A(2023)SMRSTOREProceedings of the 21st USENIX Conference on File and Storage Technologies10.5555/3585938.3585963(395-408)Online publication date: 21-Feb-2023
https://dl.acm.org/doi/10.5555/3585938.3585963
Sun DTan RChai Y(2023)A Universal SMR-aware Cache Framework with Deep Optimization for DM-SMR and HM-SMR DisksACM Transactions on Storage10.1145/358844219:3(1-35)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3588442
Chen SHuang K(2023)Leveraging Journaling File System for Prompt Secure Deletion on Interlaced Recording DrivesIEEE Transactions on Emerging Topics in Computing10.1109/TETC.2022.322662011:3(619-634)Online publication date: 1-Jul-2023
https://doi.org/10.1109/TETC.2022.3226620
Shen ZYang YPan YZhang YJia ZCai XLi BShao Z(2023)A Multiagent Reinforcement Learning-Assisted Cache Cleaning Scheme for DM-SMRIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2022.322267042:8(2500-2513)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1109/TCAD.2022.3222670
Lin YLiang YYen YChen YShih WChang Y(2023)Adaptive Mode-Switching for Write-amplification Reduction of SMR Disks2023 20th International SoC Design Conference (ISOCC)10.1109/ISOCC59558.2023.10396126(247-248)Online publication date: 25-Oct-2023
https://doi.org/10.1109/ISOCC59558.2023.10396126
Cao ZWen HWu FDu D(2023)SMRTS: A Performance and Cost-Effectiveness Optimized SSD-SMR Tiered File System with Data Deduplication2023 IEEE 41st International Conference on Computer Design (ICCD)10.1109/ICCD58817.2023.00050(275-282)Online publication date: 6-Nov-2023
https://doi.org/10.1109/ICCD58817.2023.00050
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents