Article

The Google file system

Authors:

Sanjay Ghemawat,

Howard Gobioff,

Shun-Tak LeungAuthors Info & Claims

SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles

Pages 29 - 43

https://doi.org/10.1145/945445.945450

Published: 19 October 2003 Publication History

Get Access

References

[1]

Thomas Anderson, Michael Dahlin, Jeanna Neefe, David Patterson, Drew Roselli, and Randolph Wang. Serverless network file systems. In Proceedings of the 15th ACM Symposium on Operating System Principles, pages 109--126, Copper Mountain Resort, Colorado, December 1995.

Digital Library

Google Scholar

[2]

Remzi H. Arpaci-Dusseau, Eric Anderson, Noah Treuhaft, David E. Culler, Joseph M. Hellerstein, David Patterson, and Kathy Yelick. Cluster I/O with River: Making the fast case common. In Proceedings of the Sixth Workshop on Input/Output in Parallel and Distributed Systems (IOPADS '99), pages 10--22, Atlanta, Georgia, May 1999.

Digital Library

Google Scholar

[3]

Luis-Felipe Cabrera and Darrell D. E. Long. Swift: Using distributed disk striping to provide high I/O data rates. Computer Systems, 4(4):405--436, 1991.

Google Scholar

[4]

Garth A. Gibson, David F. Nagle, Khalil Amiri, Jeff Butler, Fay W. Chang, Howard Gobioff, Charles Hardin, Erik Riedel, David Rochberg, and Jim Zelenka. A cost-effective, high-bandwidth storage architecture. In Proceedings of the 8th Architectural Support for Programming Languages and Operating Systems, pages 92--103, San Jose, California, October 1998.

Digital Library

Google Scholar

[5]

John Howard, Michael Kazar, Sherri Menees, David Nichols, Mahadev Satyanarayanan, Robert Sidebotham, and Michael West. Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1):51--81, February 1988.

Digital Library

Google Scholar

[6]

InterMezzo. http://www.inter-mezzo.org, 2003.

Google Scholar

[7]

Barbara Liskov, Sanjay Ghemawat, Robert Gruber, Paul Johnson, Liuba Shrira, and Michael Williams. Replication in the Harp file system. In 13th Symposium on Operating System Principles, pages 226--238, Pacific Grove, CA, October 1991.

Digital Library

Google Scholar

[8]

Lustre. http://www.lustreorg, 2003.

Google Scholar

[9]

David A. Patterson, Garth A. Gibson, and Randy H. Katz. A case for redundant arrays of inexpensive disks (RAID). In Proceedings of the 1988 ACM SIGMOD International Conference on Management of Data, pages 109--116, Chicago, Illinois, September 1988.

Digital Library

Google Scholar

[10]

Frank Schmuck and Roger Haskin. GPFS: A shared-disk file system for large computing clusters. In Proceedings of the First USENIX Conference on File and Storage Technologies, pages 231--244, Monterey, California, January 2002.

Digital Library

Google Scholar

[11]

Steven R. Soltis, Thomas M. Ruwart, and Matthew T. O'Keefe. The Gobal File System. In Proceedings of the Fifth NASA Goddard Space Flight Center Conference on Mass Storage Systems and Technologies, College Park, Maryland, September 1996.

Google Scholar

[12]

Chandramohan A. Thekkath, Timothy Mann, and Edward K. Lee. Frangipani: A scalable distributed file system. In Proceedings of the 16th ACM Symposium on Operating System Principles, pages 224--237, Saint-Malo, France, October 1997.

Digital Library

Google Scholar

Cited By

View all

Ren YRen YLi XHu YLi JLee PMa XWon Y(2024)ELECTProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650715(293-310)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650715
Zhang WXu EWang QZhang XGu YLu ZOuyang TDai GPeng WXu ZZhang SWu DPeng YWang TZhang HWang JYan WDong YYao WWu ZZhu LShi CWang YLiu RWu JZhu JWu JMa XWon Y(2024)What's the story in EBS gloryProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650714(277-292)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650714
Oliveira RPedrosa TRufino JLopes R(2024)Parameterization and Performance Analysis of a Scalable, near Real-Time Packet Capturing PlatformSystems10.3390/systems1204012612:4(126)Online publication date: 7-Apr-2024
https://doi.org/10.3390/systems12040126
Show More Cited By

Index Terms

The Google file system
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Memory management
        Distributed memory
    2. Software system structures
      1. Distributed systems organizing principles

Recommendations

The Google file system
SOSP '03
A Novel Solution of Distributed File Storage for Cloud Service
COMPSACW '12: Proceedings of the 2012 IEEE 36th Annual Computer Software and Applications Conference Workshops

With the rapid development of the Internet application technology, especially Web2.0 and cloud computing, the data content people produced on the network grew in the geometric progression. And one of the fastest growing and the most likely to challenge ...
WORMStore: A Specialized Object Store for Write-Once Read-Many Workloads
MASCOTS '14: Proceedings of the 2014 IEEE 22nd International Symposium on Modelling, Analysis & Simulation of Computer and Telecommunication Systems

The recent increase in interest for batch analytics has resulted in extensive use of distributed frameworks such as Hadoop and Dryad. Batch analytics-as the name suggests, perform many computations on large volumes of data. That is, large quantities of ...

Comments

Information & Contributors

Information

Published In

SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles

October 2003

338 pages

ISBN:1581137575

DOI:10.1145/945445

General Chair:
Michael L. Scott
University of Rochester
,
Program Chair:
Larry Peterson
Princeton University

ACM SIGOPS Operating Systems Review Volume 37, Issue 5
SOSP '03
December 2003
329 pages
ISSN:0163-5980
DOI:10.1145/1165389
Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SOSP03

Sponsor:

SOSP03: ACM Symposium on Operating Systems Principles

October 19 - 22, 2003

NY, Bolton Landing, USA

Acceptance Rates

SOSP '03 Paper Acceptance Rate 22 of 128 submissions, 17%;

Overall Acceptance Rate 131 of 716 submissions, 18%

Upcoming Conference

SOSP '24

Sponsor:
sigops

ACM SIGOPS 30th Symposium on Operating Systems Principles

November 5 - 8, 2024

Austin , TX , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3,360
Total Citations
View Citations
65,763
Total Downloads

Downloads (Last 12 months)3,264
Downloads (Last 6 weeks)171

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ren YRen YLi XHu YLi JLee PMa XWon Y(2024)ELECTProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650715(293-310)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650715
Zhang WXu EWang QZhang XGu YLu ZOuyang TDai GPeng WXu ZZhang SWu DPeng YWang TZhang HWang JYan WDong YYao WWu ZZhu LShi CWang YLiu RWu JZhu JWu JMa XWon Y(2024)What's the story in EBS gloryProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650714(277-292)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650714
Oliveira RPedrosa TRufino JLopes R(2024)Parameterization and Performance Analysis of a Scalable, near Real-Time Packet Capturing PlatformSystems10.3390/systems1204012612:4(126)Online publication date: 7-Apr-2024
https://doi.org/10.3390/systems12040126
Wu ZLv XYun YDuan W(2024)A Parallel Sequential SBAS Processing Framework Based on Hadoop Distributed ComputingRemote Sensing10.3390/rs1603046616:3(466)Online publication date: 25-Jan-2024
https://doi.org/10.3390/rs16030466
Azzabi SAlfughi ZOuda A(2024)Data Lakes: A Survey of Concepts and ArchitecturesComputers10.3390/computers1307018313:7(183)Online publication date: 22-Jul-2024
https://doi.org/10.3390/computers13070183
Azevedo LSouza RSoares EThiago RTesolin JOliveira AMoreno M(2024)HKPoly: A Polystore Architecture to Support Data Linkage and Queries on Distributed and Heterogeneous DataProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658322(1-10)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3658271.3658322
Han RShi CMahmud TYang ZEsaulov VWan LChen YWayda JWolf MZheng M(2024)Revisiting Erasure Codes: A Configuration PerspectiveProceedings of the 16th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3655038.3665951(93-100)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3655038.3665951
Hu JKosaian JRashmi K(2024)Rethinking Erasure-Coding Libraries in the Age of Optimized Machine LearningProceedings of the 16th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3655038.3665943(23-30)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3655038.3665943
Yu QGuo CZhuang JThakkar VWang JCao Z(2024)CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated InfrastructureProceedings of the ACM on Management of Data10.1145/36549272:3(1-28)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3654927
Honoré WQiu LKim YShin JKim JShao Z(2024)AdoB: Bridging Benign and Byzantine Consensus with Atomic Distributed ObjectsProceedings of the ACM on Programming Languages10.1145/36498268:OOPSLA1(419-448)Online publication date: 29-Apr-2024
https://dl.acm.org/doi/10.1145/3649826
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

The Google file system

A Novel Solution of Distributed File Storage for Cloud Service

WORMStore: A Specialized Object Store for Write-Once Read-Many Workloads