research-article

On Space Utilization Enhancement of File Systems for Embedded Storage Systems

Authors:

Yuan-Hao Chang,

Wei-Kuan ShihAuthors Info & Claims

ACM Transactions on Embedded Computing Systems (TECS), Volume 16, Issue 3

Article No.: 83, Pages 1 - 28

https://doi.org/10.1145/2820488

Published: 11 April 2017 Publication History

Abstract

Since the mid-2000s, mobile/embedded computing systems conventionally have limited computing power, Random Access Memory (RAM) space, and storage capacity due to the consideration of their cost, energy consumption, and physical size. Recently, some of these systems, such as mobile phone and embedded consumer electronics, have more powerful computing capability, so they manage their data in small flash storage devices (e.g., Embedded Multi Media Card (eMMC) and Secure Digital (SD) cards) with a simple file system. However, the existing file systems usually have low space utilization for managing small files and the tail data of large files. In this work, we thus propose a dynamic tail packing scheme to enhance the space utilization of file systems over flash storage devices in embedded computing systems by dynamically aggregating/packing the tail data of (small) files together. To evaluate the benefits and overheads of the proposed scheme, we theoretically formulate analysis equations for obtaining the best settings in the dynamic tail packing scheme. Additionally, the proposed scheme was implemented in the file system of Linux operating systems to evaluate its capability. The results demonstrate that the proposed scheme could significantly improve the space utilization of existing file systems.

References

[1]

Shi Bai and Xue-Liang Liao. 2012. A parallel flash translation layer based on page group-block hybrid-mapping method. IEEE Trans. Consum. Electron. 58, 2 (May 2012), 441--449.

[2]

Brian Carrier. 2005. File System Forensic Analysis. Addison Wesley Professional.

Digital Library

[3]

SNIA Technical Council. 2011. SNIA IOTTA Repository. Retrieved from http://iotta.snia.org/.

[4]

Nien-I Hsu, Tseng-Yi Chen, Yuan-Hao Chang, Hsin-Wen Wei, Wei-Kuan Shih, and Norman Chang. 2014. Dynamic tail packing to optimize space utilization of file systems in embedded computing systems. In Proceedings of the IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA).

[5]

Jeong-Uk Kang, Heeseung Jo, Jin-Soo Kim, and Joonwon Lee. 2006. A superblock-based flash translation layer for NAND flash memory. In Proceedings of the 6th ACM/IEEE International Conference on Embedded Softwar. ACM/IEEE, 161--170.

Digital Library

[6]

Jesung Kim, Jong Min Kim, S. H. Noh, Sang Lyul Min, and Yookun Cho. 2002. A space-efficient flash translation layer for CompactFlash systems. IEEE Trans. Consum. Electron. 48, 2 (May 2002), 366--375.

Digital Library

[7]

Jongmin Lee, Sunghoon Kim, Hunki Kwon, Choulseung Hyun, Seongjun Ahn, Jongmoo Choi, Donghee Lee, and Sam H. Noh. 2007. An adaptive two-level management for the flash translation layer in embedded systems. In Proceedings of the 7th ACM/IEEE International Conference on Embedded Softwar. ACM/IEEE, 174--182.

[8]

Yongmyoung Lee, Taedong Jung, and Ilhoon Shin. 2012. Demand-based flash translation layer considering spatial locality. In Proceedings of the 28th Annual ACM Symposium on Applied Computing. ACM, 1550--1551.

Digital Library

[9]

Seung-Ho Lim and Kyu-Ho Park. 2006. An efficient NAND flash file system for flash memory storage. IEEE Trans. Comput. 55, 7 (July 2006), 906--912.

Digital Library

[10]

Duo Liu, Yi Wang, Zhiwei Qin, Zili Shao, and Yong Guan. 2012. A space reuse strategy for flash translation layers in SLC NAND flash memory storage systems. IEEE Trans. VLSI Syst. 20, 6 (Jun. 2012), 1094--1107.

Digital Library

[11]

Youyou Lu, Jiwu Shu, and Weimin Zheng. 2013. Extending the lifetime of flash-based storage through reducing write amplication from file systems. In Proceedings of the Conference on File and Storage Technologies (FAST13). 257--270.

Digital Library

[12]

Microsoft. 2000. Microsoft Extensible Firmware Initiative FAT32 File System Specification @ONLINE, http://staff.washington.edu/dittrich/misc/fatgen103.pdf. Retrieved from http://staff.washington.edu/dittrich/misc/fatgen103.pdf.

[13]

Dushyanth Narayanan, Austin Donnelly, and Antony Rowstron. 2008. Write off-loading: Practical power management for enterprise storage. ACM Trans. Stor. 4, 3 (Novemeber 2008), 1--23.

Digital Library

[14]

Sunhwa Park and Seong-Young Ohm. 2006. New techniques for real-time FAT file system. IEEE Trans. Consum. Electron. 52, 1 (Feb. 2006), 1--9.

Digital Library

[15]

H. Reiser. 2001. ReiserFS @ONLINE. Retrieved from https://reiser4.wiki.kernel.org/index.php/Main_Page.

[16]

F. Schmuck and R. Haskin. 2002. GPFS: A shared-disk file system for large computing clusters. In Proceedings of the Conference on File and Storage Technologies (FAST’02). 231--244.

Digital Library

[17]

Priya Sehgal, Vasily Tarasov, and Erez Zadok. 2010a. Evaluating performance and energy in file system server workloads. In Proceedings of the Conference on File and Storage Technologies (FAST’10). 253--266.

Digital Library

[18]

Priya Sehgal, Vasily Tarasov, and Erez Zadok. 2010b. Optimizing energy and performance for server-class file system workloads. ACM Trans. Stor. 6, 3 (Sep. 2010), 1--31.

Digital Library

[19]

Kuniyasu Suzaki, Kengo Iijima, Toshiki Yagi, and Cyrille Artho. 2011. Analysis of disk access patterns on file systems for content addressable storage. In 2011 Linux Symposium. 23--36.

[20]

Yi Wang, Duo Liu, Meng Wang, Zhiwei Qin, Zili Shao, and Yong Guan. 2010. RNFTL: A reuse-aware NAND flash translation layer for flash memory. In Proceedings of the ACM SIGPLAN/SIGBED 2010 Conference on Languages, Compilers, and Tools for Embedded Systems (LCTES’10). ACM, 163--172.

Digital Library

[21]

Chin-Hsien Wu and Tei-Wei Kuo. 2006. Block recycling schemes and their cost-based optimization in nand flash memory based storage system. In IEEE/ACM International Conference on Computer-Aided Design. IEEE/ACM, 601--606.

[22]

Xingbo Wu, Zili Shao, and Song Jiang. 2015. Selfie: Co-locating metadata and data to enable fast virtual block devices. In Proceedings of the 8th ACM International Systems and Storage Conference (SYSTOR’15). Article 2, 11 pages.

Digital Library

[23]

Ming-Chang Yang, Yuan-Hao Chang, Po-Chun Huang, and Tei-Wei Kuo. 2012. Working-set-based address mapping for ultra-large-scaled flash devices. In Proceedings of the 8th IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis. IEEE/ACM/IFIP, 493--502.

Digital Library

[24]

Junwei Zhang, Jingliang Zhang, Xiaoming Han, and Lu Xu. 2009. A storage slab allocator for disk storage management in file system. In Proceedings of the IEEE International Conference on Networking, Architecture, and Storage (NAS’09). 295--302.

Digital Library

Cited By

Fan XYan SHuang YWeng CEgger BLee D(2023)LUNAR: A Native Table Engine for Embedded DevicesProceedings of the 24th ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems10.1145/3589610.3596276(122-133)Online publication date: 13-Jun-2023
https://dl.acm.org/doi/10.1145/3589610.3596276
Feng WLiu CGuo ZBaker TCheng BChen J(2019)Data Loss Prevention and Storage Utilization Improvement of the Hidden Volume on Mobile Devices2019 IEEE Symposium on Computers and Communications (ISCC)10.1109/ISCC47284.2019.8969629(1-6)Online publication date: Jun-2019
https://doi.org/10.1109/ISCC47284.2019.8969629

Index Terms

On Space Utilization Enhancement of File Systems for Embedded Storage Systems
1. Information systems
  1. Information storage systems
    1. Storage management
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        File systems management
        Memory management

Recommendations

Research of Massive Small Files Reading Optimization Based on Parallel Network File System
HPCC-CSS-ICESS '15: Proceedings of the 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conf on Embedded Software and Systems

With the rapid development of cloud computing and big data, there are more and more small files. How to manage those massive small files efficiently and provide low-latency service is becoming a hot topic in Parallel Network File System (pNFS). When ...
Storage and file systems for mems-based storage
Storage management in large distributed object-based storage systems

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Embedded Computing Systems

ACM Transactions on Embedded Computing Systems Volume 16, Issue 3

Special Issue on Embedded Computing for IoT, Special Issue on Big Data and Regular Papers

August 2017

610 pages

ISSN:1539-9087

EISSN:1558-3465

DOI:10.1145/3072970

Editor:
Sandeep K. Shukla
Indian Institute of Technology, India

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 11 April 2017

Accepted: 01 August 2016

Revised: 01 April 2016

Received: 01 July 2015

Published in TECS Volume 16, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA)
Ministry of Science and Technology

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
277
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 11 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fan XYan SHuang YWeng CEgger BLee D(2023)LUNAR: A Native Table Engine for Embedded DevicesProceedings of the 24th ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems10.1145/3589610.3596276(122-133)Online publication date: 13-Jun-2023
https://dl.acm.org/doi/10.1145/3589610.3596276
Feng WLiu CGuo ZBaker TCheng BChen J(2019)Data Loss Prevention and Storage Utilization Improvement of the Hidden Volume on Mobile Devices2019 IEEE Symposium on Computers and Communications (ISCC)10.1109/ISCC47284.2019.8969629(1-6)Online publication date: Jun-2019
https://doi.org/10.1109/ISCC47284.2019.8969629

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents