research-article

Rethinking Benchmarking for NVM-based File Systems

Authors:

Binyu ZangAuthors Info & Claims

APSys '16: Proceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems

Article No.: 20, Pages 1 - 7

https://doi.org/10.1145/2967360.2967379

Published: 04 August 2016 Publication History

Abstract

Fast, byte-addressable NVM promises near-cache latency and near memory bus throughput for file systems, which is evident by recent development of a number of NVM file systems (NVMFS). However, a key approach to measuring their performance, file system benchmarks, remains unchanged as those for disk-based file systems (DFS). In this paper, we analyze the pitfalls of using DFS benchmarks to evaluate NVMFS and propose several changes to existing DFS benchmarks to better characterize the performance of NVMFS.

References

[1]

Condit, J., Nightingale, E. B., Frost, C., Ipek, E., Lee, B., Burger, D., and Coetzee, D. Better i/o through byte-addressable, persistent memory. In Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles (2009), ACM, pp. 133--146.

Digital Library

[2]

Dulloor, S. R., Kumar, S., Keshavamurthy, A., Lantz, P., Reddy, D., Sankaran, R., and Jackson, J. System software for persistent memory. In Proceedings of the Ninth European Conference on Computer Systems (2014).

Digital Library

[3]

Filebench-1.4.9.1. https://sourceforge.net/projects/filebench/files/filebench/filebench-1.4.9.1/, 2011.

[4]

Filebench-1.5. https://sourceforge.net/p/filebench/code/ci/filebench-1.5/tree/, 2015.

[5]

Ganger, G. R., McKusick, M. K., Soules, C. A., and Patt, Y. N. Soft updates: a solution to the metadata update problem in file systems. ACM Transactions on Computer Systems (TOCS) 18, 2 (2000), 127--153.

Digital Library

[6]

Ganger, G. R., and Patt, Y. N. Metadata update performance in file systems. In Proceedings of the 1st USENIX conference on Operating Systems Design and Implementation (1994), USENIX Association.

Digital Library

[7]

Ou, J., Shu, J., and Lu, Y. A high performance file system for non-volatile main memory. In European Conference on Computer Systems (2016).

Digital Library

[8]

How to emulate persistent memory. http://pmem.io/2016/02/22/pm-emulation.html, 2016.

[9]

Rodeh, O., Bacik, J., and Mason, C. Btrfs: The linux b-tree filesystem. ACM Transactions on Storage (TOS) 9, 3 (2013), 9.

Digital Library

[10]

Rosenblum, M., and Ousterhout, J. K. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems (TOCS) 10, 1 (1992), 26--52.

Digital Library

[11]

Tang, D., and Seltzer, M. Lies, damned lies, and file system benchmarks. Tech. rep., Technical Report TR-34-94, Harvard University, 1994.

[12]

Tarasov, V., Bhanage, S., Zadok, E., and Seltzer, M. Benchmarking file system benchmarking: It* is* rocket science.

[13]

Traeger, A., Zadok, E., Joukov, N., and Wright, C. P. A nine year study of file system and storage benchmarking. ACM Transactions on Storage (TOS) 4, 2 (2008), 5.

Digital Library

[14]

Traeger, A., Zadok, E., Miller, E. L., and Long, D. D. Findings from the first annual file and storage systems benchmarking workshop. In Initial workshop report (2008), vol. 6, Citeseer.

[15]

Xu, J., and Swanson, S. Nova: A log-structured file system for hybrid volatile/non-volatile main memories. In USENIX Conference on File and Storage Technologies (2016), pp. 323--338.

Digital Library

Cited By

Regassa DYeom HHwang J(2023)ESH: Design and Implementation of an Optimal Hashing Scheme for Persistent MemoryApplied Sciences10.3390/app13201152813:20(11528)Online publication date: 20-Oct-2023
https://doi.org/10.3390/app132011528
Park SKim JLim YSeo E(2022)Analysis and Mitigation of Data Sanitization Overhead in DAX File Systems2022 IEEE 40th International Conference on Computer Design (ICCD)10.1109/ICCD56317.2022.00045(255-258)Online publication date: Oct-2022
https://doi.org/10.1109/ICCD56317.2022.00045
Li XZhai Z(2021)UHNVM: A Universal Heterogeneous Cache Design with Non-Volatile MemoryElectronics10.3390/electronics1015176010:15(1760)Online publication date: 22-Jul-2021
https://doi.org/10.3390/electronics10151760
Show More Cited By

Recommendations

HasFS: optimizing file system consistency mechanism on NVM-based hybrid storage architecture
Abstract
In order to protect the data during system crash, traditional DRAM–DISK architecture file systems (e.g., EXT4) need to synchronize the dirty metadata and data from the memory to disk. At the same time, the disk synchronization may break the ...
Optimizing File Systems with Fine-grained Metadata Journaling on Byte-addressable NVM
Special Issue on MSST 2016 and Regular Papers

Journaling file systems have been widely adopted to support applications that demand data consistency. However, we observed that the overhead of journaling can cause up to 48.2% performance drop under certain kinds of workloads. On the other hand, the ...
A consistency mechanism for NVM-Based in-memory file systems
CF '16: Proceedings of the ACM International Conference on Computing Frontiers

Non-Volatile Memory (NVM) has evolved to achieve non-volatility and byte-addressability with latency comparable to DRAM. This inspires the development of a new generation of file systems, namely NVM-based in-memory file systems, which include NVM on ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

APSys '16: Proceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems

August 2016

169 pages

ISBN:9781450342650

DOI:10.1145/2967360

General Chairs:
Heming Cui,
Francis C.M. Lau,
Program Chairs:
Sorav Bansal,
Lin Zhong

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 August 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Conference

APSys '16

Sponsor:

SIGOPS

APSys '16: 7th ACM SIGOPS Asia-Pacific Workshop on Systems

August 4 - 5, 2016

Hong Kong, Hong Kong

Acceptance Rates

Overall Acceptance Rate 169 of 430 submissions, 39%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
448
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)4

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Regassa DYeom HHwang J(2023)ESH: Design and Implementation of an Optimal Hashing Scheme for Persistent MemoryApplied Sciences10.3390/app13201152813:20(11528)Online publication date: 20-Oct-2023
https://doi.org/10.3390/app132011528
Park SKim JLim YSeo E(2022)Analysis and Mitigation of Data Sanitization Overhead in DAX File Systems2022 IEEE 40th International Conference on Computer Design (ICCD)10.1109/ICCD56317.2022.00045(255-258)Online publication date: Oct-2022
https://doi.org/10.1109/ICCD56317.2022.00045
Li XZhai Z(2021)UHNVM: A Universal Heterogeneous Cache Design with Non-Volatile MemoryElectronics10.3390/electronics1015176010:15(1760)Online publication date: 22-Jul-2021
https://doi.org/10.3390/electronics10151760
Yang JKim JHoseinzadeh MIzraelevitz JSwanson SNoh SWelch B(2020)An empirical guide to the behavior and use of scalable persistent memoryProceedings of the 18th USENIX Conference on File and Storage Technologies10.5555/3386691.3386708(169-182)Online publication date: 24-Feb-2020
https://dl.acm.org/doi/10.5555/3386691.3386708
Xu JKim JMemaripour ASwanson SBahar IHerlihy MWitchel ELebeck A(2019)Finding and Fixing Performance Pathologies in Persistent Memory Software StacksProceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3297858.3304077(427-439)Online publication date: 4-Apr-2019
https://dl.acm.org/doi/10.1145/3297858.3304077
Puglia GZorzo ADe Rose CPerez TMilojicic D(2019)Non-Volatile Memory File Systems: A SurveyIEEE Access10.1109/ACCESS.2019.2899463(1-1)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2899463

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents