research-article

File Defragmentation Scheme for a Log-Structured File System

Authors:

Dong Hyun Kang,

Young Ik EomAuthors Info & Claims

APSys '16: Proceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems

Article No.: 19, Pages 1 - 7

https://doi.org/10.1145/2967360.2967622

Published: 04 August 2016 Publication History

Abstract

In recent years, many researchers have focused on log-structured file systems (LFS), because it gracefully enhances the random write performance and efficiently resolves the consistency issue. However, the write policy of LFS can cause a file fragmentation problem, which degrades sequential read performance of the file system. In this paper, we analyze the relationship between file fragmentation and the sequential read performance, considering the characteristics of underlying storage devices. We also propose a novel file defragmentation scheme on LFS to effectively address the file fragmentation problem. Our scheme reorders the valid data blocks belonging to a victim segment based on the inode numbers during the cleaning process of LFS. In our experiments, our scheme eliminates file fragmentation by up to 98.5% when compared with traditional LFS.

References

[1]

IOzone filesystem benchmark. http://www.iozone.org/.

[2]

T. Blackwell, J. Harris, and M. I. Seltzer. Heuristic cleaning algorithms in log-structured file systems. In Proceedings of USENIX 1995 Technical Conference, pages 277--288, 1995.

Digital Library

[3]

F. Chen, D. A. Koufaty, and X. Zhang. Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In ACM SIGMETRICS Performance Evaluation Review, volume 37, pages 181--192. ACM, 2009.

Digital Library

[4]

J. Engel and R. Mertens. Logfs-finally a scalable flash file system. In Proceedings of International Linux System Technology Conference, pages 135--142, 2005.

[5]

C. Ji, L.-P. Chang, L. Shi, C. Wu, Q. Li, and C. J. Xue. An empirical study of file-system fragmentation in mobile storage systems. In 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 16), Denver, CO, June 2016. USENIX Association.

Digital Library

[6]

A. K. KV, M. Cao, J. R. Santos, and A. Dilger. Ext4 block and inode allocator improvements. In Proceedings of Linux Symposium, pages 179--186, 2008.

[7]

C. Lee, D. Sim, J. Hwang, and S. Cho. F2fs: A new file system for flash storage. In Proceedings of USENIX Conference on File and Storage Technologies, pages 273--286, 2015.

Digital Library

[8]

S.-H. Lim and K.-H. Park. An efficient nand flash file system for flash memory storage. IEEE Transactions on Computers, 55(7):906--912, 2006.

Digital Library

[9]

R. Love. Linux kernel development 3rd edition. Pearson Education, 2010.

Digital Library

[10]

C. Min, K. Kim, H. Cho, S.-W. Lee, and Y. I. Eom. Sfs: random write considered harmful in solid state drives. In Proceedings of USENIX Conference on File and Storage Technologies, pages 139--154, 2012.

Digital Library

[11]

M. Rosenblum and J. K. Ousterhout. The lfs storage manager. In Proceedings of USENIX Summer 1990 Technical Conference, pages 315--324, 1990.

[12]

M. Rosenblum and J. K. Ousterhout. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems, 10(1):26--52, 1992.

Digital Library

[13]

T. Sato. Ext4 online defragmentation. In Proceedings of the Linux Symposium, pages 179--186, 2007.

[14]

A. Schierl, G. Schellhorn, D. Haneberg, and W. Reif. Abstract specification of the ubifs file system for flash memory. In Proceedings of International Symposium on Formal Methods, pages 190--206. 2009.

Digital Library

[15]

K. A. Smith and M. I. Seltzer. File system aging-increasing the relevance of file system benchmarks. In ACM SIGMETRICS Performance Evaluation Review, volume 25, pages 203--213. ACM, 1997.

Digital Library

[16]

S. VanDeBogart, C. Frost, and E. Kohler. Reducing seek overhead with application-directed prefetching. In Proceedings of USENIX Annual Technical Conference, pages 299--312, 2009.

Digital Library

Cited By

Cho MKang D(2023)FragTracer: Real-Time Fragmentation Monitoring Tool for F2FS File SystemSensors10.3390/s2309448823:9(4488)Online publication date: 5-May-2023
https://doi.org/10.3390/s23094488
Lee SNguyen LYeo HKim SCho SSon Y(2023)A Survey on File Defragmentation Techniques on Modern Storage Systems2023 14th International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC58733.2023.10393099(785-787)Online publication date: 11-Oct-2023
https://doi.org/10.1109/ICTC58733.2023.10393099
Lee MPark JEom Y(2023)An Efficient F2FS GC Scheme for Improving I/O Latency of Foreground Applications2023 IEEE International Conference on Consumer Electronics (ICCE)10.1109/ICCE56470.2023.10043469(1-3)Online publication date: 6-Jan-2023
https://doi.org/10.1109/ICCE56470.2023.10043469
Show More Cited By

File Defragmentation Scheme for a Log-Structured File System
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

The design and implementation of a log-structured file system

This paper presents a new technique for disk storage management called a log-structured file system. A log-structured file system writes all modifications to disk sequentially in a log-like structure, thereby speeding up both file writing and crash ...
The design and implementation of a log-structured file system
SOSP '91: Proceedings of the thirteenth ACM symposium on Operating systems principles

This paper presents a new technique for disk storage management called a log-structured file system. A log-structured file system writes all modifications to disk sequentially in a log-like structure, thereby speeding up both file writing and crash ...
The design and implementation of a log-structured file system

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

APSys '16: Proceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems

August 2016

169 pages

ISBN:9781450342650

DOI:10.1145/2967360

General Chairs:
Heming Cui,
Francis C.M. Lau,
Program Chairs:
Sorav Bansal,
Lin Zhong

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 August 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

APSys '16

Sponsor:

SIGOPS

APSys '16: 7th ACM SIGOPS Asia-Pacific Workshop on Systems

August 4 - 5, 2016

Hong Kong, Hong Kong

Acceptance Rates

Overall Acceptance Rate 169 of 430 submissions, 39%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
545
Total Downloads

Downloads (Last 12 months)34
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cho MKang D(2023)FragTracer: Real-Time Fragmentation Monitoring Tool for F2FS File SystemSensors10.3390/s2309448823:9(4488)Online publication date: 5-May-2023
https://doi.org/10.3390/s23094488
Lee SNguyen LYeo HKim SCho SSon Y(2023)A Survey on File Defragmentation Techniques on Modern Storage Systems2023 14th International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC58733.2023.10393099(785-787)Online publication date: 11-Oct-2023
https://doi.org/10.1109/ICTC58733.2023.10393099
Lee MPark JEom Y(2023)An Efficient F2FS GC Scheme for Improving I/O Latency of Foreground Applications2023 IEEE International Conference on Consumer Electronics (ICCE)10.1109/ICCE56470.2023.10043469(1-3)Online publication date: 6-Jan-2023
https://doi.org/10.1109/ICCE56470.2023.10043469
Yang LTan ZWang FFeng DQin HTu SQian JZhao Y(2022)Improving F2FS Performance in Mobile Devices With Adaptive Reserved Space Based on TracebackIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2021.305460641:1(169-182)Online publication date: Jan-2022
https://doi.org/10.1109/TCAD.2021.3054606
Liu JWang S(2022)CFFS: A Persistent Memory File System for Contiguous File Allocation With Fine-Grained MetadataIEEE Access10.1109/ACCESS.2022.320253210(91678-91698)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3202532
Park JEom Y(2021)FragPickerProceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles10.1145/3477132.3483593(280-294)Online publication date: 26-Oct-2021
https://dl.acm.org/doi/10.1145/3477132.3483593
Yang LWang FTan ZFeng DQian JTu S(2020)ARS: Reducing F2FS Fragmentation for Smartphones using Decision Trees2020 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE48585.2020.9116318(1061-1066)Online publication date: Mar-2020
https://doi.org/10.23919/DATE48585.2020.9116318
Park JEom Y(2020)Anti-Aging LFS: Self-Defragmentation With Fragmentation-Aware CleaningIEEE Access10.1109/ACCESS.2020.30172408(151474-151486)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3017240
Li QDeng AGao CLiang YShi LSha EHung CPapadopoulos G(2019)Optimizing fragmentation and segment cleaning for CPS based storage devicesProceedings of the 34th ACM/SIGAPP Symposium on Applied Computing10.1145/3297280.3297306(242-249)Online publication date: 8-Apr-2019
https://dl.acm.org/doi/10.1145/3297280.3297306
Ji CChang LHahn SLee SPan RShi LKim JXue C(2019)File Fragmentation in Mobile Devices: Measurement, Evaluation, and TreatmentIEEE Transactions on Mobile Computing10.1109/TMC.2018.286973718:9(2062-2076)Online publication date: 1-Sep-2019
https://doi.org/10.1109/TMC.2018.2869737
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten