article

Opportunities and challenges of storage grid enabled by grid service

Authors:

Frank WangAuthors Info & Claims

ACM SIGOPS Operating Systems Review, Volume 41, Issue 4

Pages 79 - 82

https://doi.org/10.1145/1278901.1278915

Published: 01 July 2007 Publication History

Abstract

The explosive growth of data generated worldwide by information digitization has been identified as the key driver of storage system evolution. In this paper, we discuss the existing storage system architectures and pose the challenges they are facing. Drawing inspiration from Grid computing community, we propose to design a storage Grid enabled by Grid service which can solve the scalability and heterogeneity problems. However, the challenging Internet involved in the storage Grid incurs some emerging problems including the limited network performance, the unstable network environment, and etc. The Grid service involved in the storage Grid introduces much larger overhead which may result in low performance and inefficient utilization of storage resources. Because Grid service is designed for loosely coupled systems, we argue that the storage Grid can employ Grid service as a glue to manage, monitor and locate the Internet-scale storage resources which are transparent to users, while still adopting binary code to transfer data to maintain the performance. Some other solutions which may alleviate the performance pressure of Grid service and increase the efficiency of storage resource utilization are discussed as well.

References

[1]

The Expanding Digital Universe: A Forecast of Worldwide Information Growth Through 2010. IDC white paper---Sponsored by EMC. March, 2007. http://www.emc.com/about/destination/digital_universe/.

[2]

Garth A. Gibson, Rodney Van Meter. Network Attached Storage Architecture. Communications of the ACM, Vol. 43, No. 11, 2000, pp. 37--45.

Digital Library

[3]

Erik Riedel. Storage Systems: Not Just a Bunch of Disks Anymore. ACM Queue, Vol. 1, No. 4, 2003, pp. 32--41.

Digital Library

[4]

Jane Shurtleff. IP storage: A review of iSCSI, FCIP, iFCP. http://www.iscsistorage.com/ipstorage.htm.

[5]

Y. Yasuda, S. Kawamoto, A. Ebata, J. Okitsu, T. Higuchi. Concept and evaluation of X-NAS: a highly scalable NAS system. In Proc. of 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST 2003), pp.219--227.

Digital Library

[6]

W. Katsurashima, S. Yamakawa, T. Torii, J. Ishikawa, and etc. NAS switch: a novel CIFS server virtualization. In Proc. of 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST 2003), pp.82--86.

Digital Library

[7]

Ian Foster, Carl Kesselman, Steven Tuecke. The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International Journal of High Performance Computing Applications, Vol.15, No.3, 2001, pp.200--222.

Digital Library

[8]

Ian Foster. Globus Toolkit Version 4: Software for Service-Oriented Systems. IFIP International Conference on Network and Parallel Computing, Springer-Verlag LNCS 3779, 2006, pp.2--13.

Digital Library

[9]

The Open Grid Services Architecture. http://www.globus.org/ogsa/.

[10]

Web Services Resource Framework. http://www.globus.org/wsrf/.

[11]

A short introduction to Web Services. http://gdp.globus.org/gt3-tutorial/multiplehtml/ch01s02.html.

[12]

Yuhui Deng, Frank Wang. A Heterogeneous Storage Grid Enabled by Grid Service. ACM SIGOPS Operating Systems Review, Vol.41, No.1, 2007, pp.7--13.

Digital Library

[13]

Extensible Markup Language. http://www.w3.org/XML/.

[14]

Web Services Description Language. http://www.w3.org/TR/wsdl.

[15]

Simple Object Access Protocol. http://www.w3.org/TR/soap/.

[16]

M. Tian, T. Voigt, T. Naumowicz, H. Ritter, J. Schiller. Performance Considerations for Mobile Web Services. Computer Communications, Vol.27, No.11, 2004, pp.1097--1105.

Digital Library

[17]

A. Mani, A. Nagarajan, Understanding Quality of Service for Web services, January, 2002. http://www-106.ibm.com/developerworks/library/ws-quality.html.

[18]

Iperf. http://www.noc.ucf.edu/Tools/lperf/default.htm.

[19]

Frank Zhigang Wang, Sining Wu, Na Helian, Michael Andrew Parker, Yike Guo, Yuhui Deng, Vineet R. Khare. Grid-Oriented Storage: A Single-Image, Cross-Domain, High-Bandwidth Architecture. IEEE Transactions on Computers, Vol.56, No.4, 2007, pp.474--487.

Digital Library

[20]

Monitoring and Discovery System. http://www.globus.org/toolkit/mds/.

[21]

Micha Hofri. Department of Computer Science, WPI. Private Correspondence.

Cited By

Deng YWang F(2018)Exploring the performance impact of stripe size on network attached storage systemsJournal of Systems Architecture: the EUROMICRO Journal10.1016/j.sysarc.2008.02.00254:8(787-796)Online publication date: 29-Dec-2018
https://dl.acm.org/doi/10.1016/j.sysarc.2008.02.002
Deng YWang FHelian NWu SLiao C(2018)Dynamic and scalable storage management architecture for Grid Oriented Storage devicesParallel Computing10.1016/j.parco.2007.10.00334:1(17-31)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1016/j.parco.2007.10.003
Deng YWang F(2018)LAGFuture Generation Computer Systems10.1016/j.future.2010.07.00427:1(32-39)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1016/j.future.2010.07.004
Show More Cited By

Index Terms

Opportunities and challenges of storage grid enabled by grid service
1. General and reference
  1. Cross-computing tools and techniques
    1. Performance
    2. Reliability
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Communications management
    2. Extra-functional properties
      1. Software performance
      2. Software reliability

Recommendations

A heterogeneous storage grid enabled by grid service

Due to the explosive increase of data, storage Grid is a new model for deploying and managing storage resources distributed across multiple systems and networks, making efficient use of available storage capacity. Building a storage Grid demands ...
Dynamic and scalable storage management architecture for Grid Oriented Storage devices

Most of currently deployed Grid systems employ hierarchical or centralized approaches to simplify system management. However, the approaches cannot satisfy the requirements of complex Grid applications which involve hundreds or thousands of ...
Dynamic testing of legacy code resources on the grid
CF '06: Proceedings of the 3rd conference on Computing frontiers

The Grid Execution Management for Legacy Code Architecture (GEMLCA) enables the exposure of legacy applications as Grid services without code re-engineering and with minimum user effort. GEMLCA is integrated with the P-GRADE Grid portal that provides a ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGOPS Operating Systems Review

ACM SIGOPS Operating Systems Review Volume 41, Issue 4

July 2007

86 pages

ISSN:0163-5980

DOI:10.1145/1278901

Issue’s Table of Contents

Copyright © 2007 Authors.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2007

Published in SIGOPS Volume 41, Issue 4

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
373
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Deng YWang F(2018)Exploring the performance impact of stripe size on network attached storage systemsJournal of Systems Architecture: the EUROMICRO Journal10.1016/j.sysarc.2008.02.00254:8(787-796)Online publication date: 29-Dec-2018
https://dl.acm.org/doi/10.1016/j.sysarc.2008.02.002
Deng YWang FHelian NWu SLiao C(2018)Dynamic and scalable storage management architecture for Grid Oriented Storage devicesParallel Computing10.1016/j.parco.2007.10.00334:1(17-31)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1016/j.parco.2007.10.003
Deng YWang F(2018)LAGFuture Generation Computer Systems10.1016/j.future.2010.07.00427:1(32-39)Online publication date: 30-Dec-2018
https://dl.acm.org/doi/10.1016/j.future.2010.07.004
Bloom LClark NHaber ELutters WLucas WJain JHawkey K(2009)Storage administrationProceedings of the Symposium on Computer Human Interaction for the Management of Information Technology10.1145/1641587.1641595(56-59)Online publication date: 7-Nov-2009
https://dl.acm.org/doi/10.1145/1641587.1641595
Deng YWang FCiura A(2009)Ant colony optimization inspired resource discovery in P2P Grid systemsThe Journal of Supercomputing10.1007/s11227-008-0214-049:1(4-21)Online publication date: 1-Jul-2009
https://dl.acm.org/doi/10.1007/s11227-008-0214-0

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents