research-article

An Energy-Efficient and Reliable Storage Mechanism for Data-Intensive Academic Archive Systems

Authors:

Tsan-Sheng Hsu,

Wei-Kuan ShihAuthors Info & Claims

ACM Transactions on Storage (TOS), Volume 11, Issue 2

Article No.: 10, Pages 1 - 21

https://doi.org/10.1145/2720021

Published: 20 March 2015 Publication History

Abstract

Previous studies proposed energy-efficient solutions, such as multispeed disks and disk spin-down methods, to conserve power in their respective storage systems. However, in most cases, the authors did not analyze the reliability of their solutions. According to research conducted by Google and the IDEMA standard, frequently setting the disk status to standby mode will increase the disk’s Annual Failure Rate and reduce its lifespan. To resolve the issue, we propose an evaluation function called E³SaRC (Economic Evaluation of Energy Saving with Reliability Constraint), which considers the cost of hardware failure when applying energy-saving schemes. We also present an adaptive write cache mechanism called CacheRAID. The mechanism tries to mitigate the random access problems that implicitly exist in RAID techniques and thereby reduce the energy consumption of RAID disks. CacheRAID also addresses the issue of system reliability by applying a control mechanism to the spin-down algorithm. Our experimental results show that the CacheRAID storage system can reduce the power consumption of the conventional software RAID 5 system by 65% to 80%. Moreover, according to the E³SaRC measurement, the overall saved cost of CacheRAID is the largest among the systems that we compared.

References

[1]

Ian F. Adams, Mark W. Storer, and Ethan L. Miller. 2012. Analysis of workload behavior in scientific and historical long-term data repositories. Trans. Storage 8, 2, Article 6 (May 2012), 27 pages.

Digital Library

[2]

Tseng-Yi Chen, Hsiu-Lien Yeh, Hsin-Wen Wei, Mei-ju Sun, Tsan-sheng Hsu, and Wei-Kuan Shih. 2014. An effective monitoring framework and user interface design. Software: Practice and Experience (2014).

[3]

Tseng-Yi Chen, Tsung-Tai Yeh, Hsin-Wen Wei, Yu-Xun Fang, Wei-Kuan Shih, and Tsan-sheng Hsu. 2012. CacheRAID: An efficient adaptive write cache policy to conserve RAID disk array energy. In Proceedings of the 2012 IEEE/ACM 5th International Conference on Utility and Cloud Computing (UCC’12). IEEE Computer Society, 117--124.

Digital Library

[4]

Dennis Colarelli and Dirk Grunwald. 2002. Massive arrays of idle disks for storage archives. In Proceedings of the 2002 ACM/IEEE Conference on Supercomputing (SC’02). IEEE Computer Society Press, 1--11.

Digital Library

[5]

Gerry Cole. 2000. Estimating Drive Reliability in Desktop Computers and Consumer Electronics. Segate Technical Report TP-338.1. Seagate Personal Storage Group, Longmont, Colorado.

[6]

Seagate Corporation. 2014. Hard Drive Datasheet. Retrieved from http://www.seagate.com/www-content/productcontent/enterprise-hdd-fam/enterprisecapacity-3-5-hdd/constellation-es-4/en-us/docs/enterprise-capacity-3-5-hdd-v4-ds1791-3-1403us.pdf.

[7]

Yuhui Deng. 2011. What is the future of disk drives, death or rebirth&quest; ACM Comput. Surv. 43, 3, Article 23 (April 2011), 27 pages.

Digital Library

[8]

John F. Gantz, Christopher Chute, Alex Manfrediz, Stephen Minton, David Reinsel, Wolfgang Schlichting, and Anna Toncheva. 2008. An updated forecast of worldwide information growth through 2011. Retrieved March 2, 2005, from http://www.cs.rpi.edu/&sim;bermaf/2008-diverse-exploding-digital-universe.pdf.

[9]

Satoshi Hikida, Hieu Hanh Le, and Haruo Yokota. 2012. A power saving storage method that considers individual disk rotation. In Proceedings of the 17th International Conference on Database Systems for Advanced Applications - Volume Part II (DASFAA’12). Springer-Verlag, 138--149.

Digital Library

[10]

International Disk Drive Equipment & Materials Association (IDEMA). 1998. Specification of hard disk drive reliability. IDEMA Standard R2-98 (1998).

[11]

IETF. 2000. Internet Small Computer Systems Interface. Retrieved from http://www.ietf.org/rfc/rfc3720.txt.

[12]

Facebook Inc. 2012. Flashcache. Retrieved Dec. 9, 2013, from https://github.com/facebook/flashcache.

[13]

SanDisk Inc. 2013. Specifications of SanDisk Extreme II SSD. Retrieved from http://www.sandisk.com/products/ssd/sata/extreme-ii/&quest;capacity=480GB.

[14]

IOzone. 2006. IOzone Filesystem Benchmark. Retrieved from http://www.iozone.org/.

[15]

Nikolai Joukov and Josef Sipek. 2008. GreenFS: Making enterprise computers greener by protecting them better. SIGOPS Oper. Syst. Rev. 42, 4 (April 2008), 69--80.

Digital Library

[16]

Rini T. Kaushik and Milind Bhandarkar. 2010. GreenHDFS: Towards an energy-conserving, storage-efficient, hybrid hadoop compute cluster. In Proceedings of the 2010 International Conference on Power Aware Computing and Systems (HotPower’10). USENIX Association, 1--9.

Digital Library

[17]

IXBT Labs. 2005. HDD diet: Power consumption and heat dissipation. Retrieved from http://ixbtlabs.com/articles2/storage/hddpower.html.

[18]

Xiaozhou Li, Mark Lillibridge, and Mustafa Uysal. 2011. Reliability analysis of deduplicated and erasure-coded storage. SIGMETRICS Perform. Eval. Rev. 38, 3 (Jan. 2011), 4--9.

Digital Library

[19]

Dushyanth Narayanan, Austin Donnelly, and Antony Rowstron. 2008. Write off-loading: Practical power management for enterprise storage. Trans. Storage 4, 3, Article 10 (Nov. 2008), 23 pages.

Digital Library

[20]

John Ousterhout, Parag Agrawal, David Erickson, Christos Kozyrakis, Jacob Leverich, David Mazières, Subhasish Mitra, Aravind Narayanan, Guru Parulkar, Mendel Rosenblum, Stephen M. Rumble, Eric Stratmann, and Ryan Stutsman. 2010. The case for RAMClouds: Scalable high-performance storage entirely in DRAM. SIGOPS Oper. Syst. Rev. 43, 4 (Jan. 2010), 92--105.

Digital Library

[21]

Eduardo Pinheiro and Ricardo Bianchini. 2004. Energy conservation techniques for disk array-based servers. In Proceedings of the 18th Annual International Conference on Supercomputing (ICS’04). ACM, 68--78.

Digital Library

[22]

Eduardo Pinheiro, Wolf-Dietrich Weber, and Luiz André Barroso. 2007. Failure trends in a large disk drive population. In Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST’07). USENIX Association, 2--2.

Digital Library

[23]

Bianca Schroeder and Garth A. Gibson. 2007. Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you&quest; In Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST’07). USENIX Association, Article 1.

Digital Library

[24]

Academia Sinica. 2008. Taiwan e-Learning and Digital Archives Program. Retrieved from http://teldap.tw/en/index.html.

[25]

Gokul Soundararajan, Vijayan Prabhakaran, Mahesh Balakrishnan, and Ted Wobber. 2010. Extending SSD lifetimes with disk-based write caches. In Proceedings of the 8th USENIX Conference on File and Storage Technologies (FAST’10). USENIX Association, 8--8.

Digital Library

[26]

Mark W. Storer, Kevin M. Greenan, Ethan L. Miller, and Kaladhar Voruganti. 2008. Pergamum: Replacing tape with energy efficient, reliable, disk-based archival storage. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST’08). 1--16.

Digital Library

[27]

George W. Tyndall. 2010. Role of the head disk interface in HOD reliability. Retrieved from http://www.idema.org/wp-content/downloads/1921.pdf.

[28]

Vijay Vasudevan, David G. Andersen, Michael Kaminsky, Jason Franklin, Michael A. Kozuch, Iulian Moraru, Padmanabhan Pillai, and Lawrence Tan. 2011. Challenges and opportunities for efficient computing with FAWN. SIGOPS Oper. Syst. Rev. 45, 1 (Feb. 2011), 34--44.

Digital Library

[29]

Akshat Verma, Ricardo Koller, Luis Useche, and Raju Rangaswami. 2010. SRCMap: Energy proportional storage using dynamic consolidation. In Proceedings of the 8th USENIX Conference on File and Storage Technologies (FAST’10). USENIX Association, 20--20.

Digital Library

[30]

An-I Andy Wang, Geoff Kuenning, Peter Reiher, and Gerald Popek. 2006. The conquest file system: Better performance through a disk/persistent-RAM hybrid design. Trans. Storage 2, 3 (Aug. 2006), 309--348.

Digital Library

[31]

Jun Wang, Huijun Zhu, and Dong Li. 2008. eRAID: Conserving energy in conventional disk-based RAID system. IEEE Trans. Comput. 57, 3 (March 2008), 359--374.

Digital Library

[32]

Charles Weddle, Mathew Oldham, Jin Qian, An-I Andy Wang, Peter Reiher, and Geoff Kuenning. 2007. PARAID: A gear-shifting power-aware RAID. Trans. Storage 3, 3, Article 13 (Oct. 2007).

Digital Library

[33]

Li Xiao, Tan Yu-An, and Sun Zhizhuo. 2011. Semi-RAID: A reliable energy-aware RAID data layout for sequential data access. In Proceedings of the 2011 IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST’11). IEEE Computer Society, 1--11.

Digital Library

[34]

Tao Xie. 2008. SEA: A striping-based energy-aware strategy for data placement in RAID-structured storage systems. IEEE Trans. Comput. 57, 6 (June 2008), 748--761.

Digital Library

[35]

Tao Xie and Yao Sun. 2011. Understanding the relationship between energy conservation and reliability in parallel disk arrays. J. Parallel Distrib. Comput. 71, 2 (Feb. 2011), 198--210.

Digital Library

[36]

Xin Xu, Kayo Teramoto, Allan Morales, and H. Howie Huang. 2013. DUAL: Reliability-aware power management in data centers. In Proceedings of the 2013 13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid’13). IEEE Computer Society, 530--537.

[37]

Tsung-Tai Yeh, Hsin-Wen Wei, Shin-Hao Liu, Pei-Chi Huang, Tsan sheng Hsu, and Yen-Chiu Chen. 2010. The development of digital archives management tools for iRODS. In Proceedings iRODS User Group Meeting. Retrieved from http://wiki.irods.org/index.php/iRODS_User_Meetings.

[38]

Shu Yin, Xiaojun Ruan, A. Manzanares, and Xiao Qin. 2009. How reliable are parallel disk systems when energy-saving schemes are involved&quest; In Proceedings of the IEEE International Conference on Cluster Computing and Workshops, 2009 (CLUSTER’09). IEEE Computer Society, 1--9.

[39]

Qingbo Zhu, Zhifeng Chen, Lin Tan, Yuanyuan Zhou, Kimberly Keeton, and John Wilkes. 2005. Hibernator: Helping disk arrays sleep through the winter. SIGOPS Oper. Syst. Rev. 39, 5 (Oct. 2005), 177--190.

Digital Library

[40]

Qingbo Zhu, Francis M. David, Christo F. Devaraj, Zhenmin Li, Yuanyuan Zhou, and Pei Cao. 2004. Reducing energy consumption of disk storage using power-aware cache management. In Proceedings of the 10th International Symposium on High Performance Computer Architecture (HPCA’04). IEEE Computer Society, 118--118.

Digital Library

Cited By

Bangash YIqbal WMussiraliyeva SRubab SRauf B(2024)Reliability through an optimal SDS controller’s placement in a SDDC and smart cityCluster Computing10.1007/s10586-024-04325-627:6(7219-7240)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1007/s10586-024-04325-6
(2022)BibliographyStorage Systems10.1016/B978-0-32-390796-5.00023-1(641-693)Online publication date: 2022
https://doi.org/10.1016/B978-0-32-390796-5.00023-1
Thomasian A(2022)Saving power in disks, flash memories, and serversStorage Systems10.1016/B978-0-32-390796-5.00016-4(349-384)Online publication date: 2022
https://doi.org/10.1016/B978-0-32-390796-5.00016-4
Show More Cited By

Index Terms

An Energy-Efficient and Reliable Storage Mechanism for Data-Intensive Academic Archive Systems
1. Information systems
  1. Information storage systems
    1. Storage management
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        File systems management
        Memory management

Recommendations

HPDA: A hybrid parity-based disk array for enhanced performance and reliability

Flash-based Solid State Drive (SSD) has been productively shipped and deployed in large scale storage systems. However, a single flash-based SSD cannot satisfy the capacity, performance and reliability requirements of the modern storage systems that ...
An energy-efficient storage for video surveillance

With the rapid growth of the video surveillance applications, the storage energy consumption of video surveillance is more noticeable, but existed energy-saving methods for massive storage system most concentrate on the data centers mainly with random ...
Lonestar: An Energy-Aware Disk Based Long-Term Archival Storage System
ICPADS '11: Proceedings of the 2011 IEEE 17th International Conference on Parallel and Distributed Systems

We present the architecture for an disk based archival storage system and propose a new RAID scheme that is designed for "write once, read sometimes" workloads. By intertwining parity groups into a multi-dimensional RAID and improving the single disk ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Storage

ACM Transactions on Storage Volume 11, Issue 2

March 2015

123 pages

ISSN:1553-3077

EISSN:1553-3093

DOI:10.1145/2747982

Editor:
Darrell Long
University of California Santa Cruz, USA

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 March 2015

Accepted: 01 January 2015

Revised: 01 December 2014

Received: 01 April 2014

Published in TOS Volume 11, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Ministry of Science and Technology, Taiwan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
391
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bangash YIqbal WMussiraliyeva SRubab SRauf B(2024)Reliability through an optimal SDS controller’s placement in a SDDC and smart cityCluster Computing10.1007/s10586-024-04325-627:6(7219-7240)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1007/s10586-024-04325-6
(2022)BibliographyStorage Systems10.1016/B978-0-32-390796-5.00023-1(641-693)Online publication date: 2022
https://doi.org/10.1016/B978-0-32-390796-5.00023-1
Thomasian A(2022)Saving power in disks, flash memories, and serversStorage Systems10.1016/B978-0-32-390796-5.00016-4(349-384)Online publication date: 2022
https://doi.org/10.1016/B978-0-32-390796-5.00016-4
Chrysanthopoulos CDrivas IKouis DGiannakopoulos G(2021)University archives: the research road travelled and the one aheadGlobal Knowledge, Memory and Communication10.1108/GKMC-08-2021-012872:1/2(44-68)Online publication date: 18-Oct-2021
https://doi.org/10.1108/GKMC-08-2021-0128
Tseng FJheng YChou LChao HLeung V(2020)Link-Aware Virtual Machine Placement for Cloud Services based on Service-Oriented ArchitectureIEEE Transactions on Cloud Computing10.1109/TCC.2017.26622268:4(989-1002)Online publication date: 1-Oct-2020
https://doi.org/10.1109/TCC.2017.2662226
Sun ZZhang QLi YTan Y(2018)DPPDLIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.260504528:1(193-205)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1109/TCSVT.2016.2605045
Wang BHu YGao JAli MTien DSun YYin B(2018)Low Rank Representation on SPD matrices with Log-Euclidean metricPattern Recognition10.1016/j.patcog.2017.07.00976:C(623-634)Online publication date: 1-Apr-2018
https://dl.acm.org/doi/10.1016/j.patcog.2017.07.009
Pan W(2016)A survey of transfer learning for collaborative recommendation with auxiliary dataNeurocomputing10.1016/j.neucom.2015.11.059177:C(447-453)Online publication date: 12-Feb-2016
https://dl.acm.org/doi/10.1016/j.neucom.2015.11.059
Chen SChen TWei HJhang NHsu TShih W(2015)A study of suitable fault tolerance frameworks for an energy-efficient storage system2015 International Conference on Collaboration Technologies and Systems (CTS)10.1109/CTS.2015.7210424(220-225)Online publication date: Jun-2015
https://doi.org/10.1109/CTS.2015.7210424

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents