Article

NFSv4 replication for grid storage middleware

Authors:

Peter HoneymanAuthors Info & Claims

MCG '06: Proceedings of the 4th international workshop on Middleware for grid computing

Page 8

https://doi.org/10.1145/1186675.1186684

Published: 27 November 2006 Publication History

Abstract

Sharing data in scientific collaborations that involve many institutions around the world demands a large-scale storage system that is reliable and efficient, yet at the same time, convenient to use. This paper presents a replicated file system that supports mutable replication with strong consistency guarantees, high failure resiliency, and good scaling properties. The principal concern with such a system is usually its performance penalty. Using experiment evaluation, we show that in simulated wide area networks, the proposed replicated file system maintains a significant performance advantage over a single server system. At the same time, it provides comparable and often better performance than GridFTP, the de facto standard file transfer application that is often used to manually synchronize shared data.

References

[1]

Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., and Tuecke, S. The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Data Sets. J. Network and Computer Applications (2000).]]

[2]

Foster, I. and Kesselman, C. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann (1998).]]

Digital Library

[3]

Allcock, W., Bresnahan, J., Kettimuthu, R., and Link, M. The Globus Striped GridFTP Framework and Server. Supercomputing (2005).]]

Digital Library

[4]

Frey, J., Tannenbaum, T., Livny, M., Foster, I., and Tuecke, S. Condor-G. A computation management agent for multiinstitutional grids. HPDC (2001).]]

Digital Library

[5]

Shepler, S., Callaghan, B., Robinson, D., Thurlow, R., Beame, C., Eisler, M., and Noveck, D. Network File System (NFS) version 4 Protocol. RFC 3530 (2003).]]

Digital Library

[6]

Mockapetris, P. Domain Names - Concepts and Facilities. RFC 1034 (1987).]]

Digital Library

[7]

Mockapetris, P. Domain Names - Implementation and Specification. RFC 1035 (1987).]]

Digital Library

[8]

Baru, C., Moore, R., Rajasekar, A., and Wan, M. The SDSC Storage Resource Broker. CASCON Conf. (1998).]]

Digital Library

[9]

Bent, J., Venkataramani, V., LeRoy, N., Roy, A., Stanley, J., Arpaci-Dusseau, A. C., Arpaci-Dusseau, R. H., and Livny, M. Flexibility, Manageability, and Performance in a Grid Storage Appliance. HPDC (2002).]]

Digital Library

[10]

Foster, I., Voeckler, J., Wilde, M., and Zhao, Y. Chimera: A Virtual Data System for Representing, Querying, and Automating Data Derivation. Scientific and Statistical Database Management Conf. (2002).]]

Digital Library

[11]

Allcock, W., Bester, J., Bresnahan, J., Chervenak, A., Foster, I., Kesselman, C., Meder, S., Nefedova, V., Quesnel, D., and Tuecke, S. Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing. IEEE Mass Storage (2001).]]

Digital Library

[12]

Satyanarayanan, M., Howard, J. H., Nichols, D. A., Sidebotham, R. N., Spector, A. Z., and West, M. J. The ITC distributed file system: principles and design. Op. Sys. Rev. (1985).]]

Digital Library

[13]

White, B. S., Walker, M., Humphrey, M., and Grimshaw, A. S. Legionfs: a secure and scalable file system supporting crossdomain high-performance applications. Supercomputing (2001).]]

Digital Library

[14]

Kumar, P. and Satyanarayanan, M. Supporting application specific resolution in an optimistically replicated file system. In Workshop on Workstation Op. Sys. (1993).]]

[15]

Satyanarayanan, M., Kistler, J. J., Kumar, P., Okasaki, M. E., Siegel, W. H., and Steere, D. C. Coda: A highly available file system for a distributed workstation environment. IEEE Trans. on Computers (1990).]]

Digital Library

[16]

Zhang, J. and Honeyman, P. Naming, Migration, and Replication for NFSv4. SANE (2006).]]

[17]

Zhang, J. and Honeyman, P. Hierarchical Replication Control. Tech. Rep. CITI-06-03, Center for Information Technology Integration, Ann Arbor (2006).]]

[18]

Pawlowski, B., Shepler, S., Beame, C., Callaghan, B., Eisler, M., Noveck, D., Robinson, D., and Thurlow, R. The NFS version 4 protocol. SANE (2000).]]

[19]

Pawlowski, B, Juszczak, C., Staubach, P., Smith, C., Lebel, D., Hitz, D. NFS Version 3 Design and Implementation. USENIX Summer Tech. Conf. (1994).]]

[20]

Hemminger S. Netem - Emulating Real Networks in the Lab. LCA2005 (2005).]]

[21]

Thain, D., Bent, J., Arpaci-Dusseau, A. C., Arpaci-Dusseau, R. H., and Livny, M. Pipeline and batch sharing in grid workloads. HPDC (2003).]]

Digital Library

[22]

Holtman, H. CMS data grid system overview and requirements. The Compact Muon Solenoid (CMS) Experiment Note 2001/037, CERN, Switzerland (2001).]]

[23]

The Large Hadron Collider (LHC). http://lhc.web.cem.ch/lhc/.]]

[24]

The Educational Global Climate Modeling (EdGCM). http://edgcm.columbia.edu/.]]

[25]

The Basic Local Alignment Search Tool (BLAST). http://www.ncbi.nlm.nih.gov/BLAST/.]]

[26]

Andrews, P., Jordan, C., and Pfeiffer, W. Marching Towards Nirvana: Configurations for Very High Performance Parallel File Systems. HyperIO workshop (2006).]]

[27]

Andrews, P., Jordan C., and Lederer, H. Design, Implementation, and Production Experiences of a Global Storage Grid. IEEE Mass Storage (2006).]]

[28]

TeraGrid. http://www.teragrid.org/]]

Cited By

Chang JChen PShieh CYang JHsieh S(2013)An Adaptive-Grained Consistency Maintenance Scheme for Shared Data on Emergency and Rescue ApplicationsInternational Journal of Grid and High Performance Computing10.4018/jghpc.20130401045:2(54-71)Online publication date: 1-Apr-2013
https://doi.org/10.4018/jghpc.2013040104
Chen PChang JLin YShieh CZhuang Y(2010)Transparent on-demand co-allocation data access for gridsInternational Journal of Ad Hoc and Ubiquitous Computing10.1504/IJAHUC.2010.0329975:4(227-234)Online publication date: 1-May-2010
https://dl.acm.org/doi/10.1504/IJAHUC.2010.032997
Zhang JHoneyman P(2007)Hierarchical Replication Control in a Global File SystemProceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid10.1109/CCGRID.2007.57(155-162)Online publication date: 14-May-2007
https://dl.acm.org/doi/10.1109/CCGRID.2007.57

Index Terms

NFSv4 replication for grid storage middleware

Recommendations

Large files, small writes, and pNFS
ICS '06: Proceedings of the 20th annual international conference on Supercomputing

Workload characterization studies highlight the prevalence of small and sequential data requests in scientific applications. Parallel file systems excel at large data transfers but sometimes at the expense of small I/O performance. pNFS is an NFSv4.1 ...
Grid-Oriented Storage: A Single-Image, Cross-Domain, High-Bandwidth Architecture

This paper describes the Grid-Oriented Storage (GOS) architecture and its implementations. A GOS-specific File System (GOS-FS), the single-purpose intent of a GOS OS, and secure interfaces via Grid Security Infrastructure (GSI) motivate and enable this ...
MGC middleware for grid computing: the Globus Toolkit
ACAI '11: Proceedings of the International Conference on Advances in Computing and Artificial Intelligence

Grid computing has made substantial advances during the last decade. A major concern in Grid environments is dealing with the high degree of heterogeneity of resources that can range from laptops and PCs to supercomputers. The unified virtual view of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MCG '06: Proceedings of the 4th international workshop on Middleware for grid computing

November 2006

109 pages

ISBN:1595935819

DOI:10.1145/1186675

Conference Chairs:
Bruno Schulze
LNCC, Brazil
,
David Abramson
Monash University, Australia
,
Radha Nandkumar
UIUC/NCSA, USA
,
Rajkumar Buyya
University of Melbourne, Australia

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ACM: Association for Computing Machinery

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 November 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

Middleware06

Sponsor:

ACM

Middleware06: 7th International Middleware Conference

November 27 - December 1, 2006

Melbourne, Australia

Acceptance Rates

Overall Acceptance Rate 14 of 36 submissions, 39%

Upcoming Conference

MIDDLEWARE '24

25th International Middleware Conference

December 2 - 6, 2024

Hong Kong , Hong Kong

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
326
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chang JChen PShieh CYang JHsieh S(2013)An Adaptive-Grained Consistency Maintenance Scheme for Shared Data on Emergency and Rescue ApplicationsInternational Journal of Grid and High Performance Computing10.4018/jghpc.20130401045:2(54-71)Online publication date: 1-Apr-2013
https://doi.org/10.4018/jghpc.2013040104
Chen PChang JLin YShieh CZhuang Y(2010)Transparent on-demand co-allocation data access for gridsInternational Journal of Ad Hoc and Ubiquitous Computing10.1504/IJAHUC.2010.0329975:4(227-234)Online publication date: 1-May-2010
https://dl.acm.org/doi/10.1504/IJAHUC.2010.032997
Zhang JHoneyman P(2007)Hierarchical Replication Control in a Global File SystemProceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid10.1109/CCGRID.2007.57(155-162)Online publication date: 14-May-2007
https://dl.acm.org/doi/10.1109/CCGRID.2007.57

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents