Article

SCFS: a shared cloud-backed file system

Authors:

Alysson Bessani,

Ricardo Mendes,

Tiago Oliveira,

Miguel Correia,

Paulo VerissimoAuthors Info & Claims

USENIX ATC'14: Proceedings of the 2014 USENIX conference on USENIX Annual Technical Conference

Pages 169 - 180

Published: 19 June 2014 Publication History

Abstract

Despite of their rising popularity, current cloud storage services and cloud-backed storage systems still have some limitations related to reliability, durability assurances and inefficient file sharing. We present SCFS, a cloud-backed file system that addresses these issues and provides strong consistency and near-POSIX semantics on top of eventually-consistent cloud storage services. SCFS provides a pluggable backplane that allows it to work with various storage clouds or a cloud-of-clouds (for added dependability). It also exploits some design opportunities inherent in the current cloud services through a set of novel ideas for cloud-backed file systems: always write and avoid reading, modular coordination, private name spaces and consistency anchors.

References

[1]

2012 future of cloud computing - 2nd annual survey results. http://goo.gl/fyrZFD.

[2]

Amazon EC2 instance types. http://aws.amazon. com/ec2/instance-types/.

[3]

Filebench webpage. http://sourceforge.net/apps/mediawiki/filebench/.

[4]

Nasuni UniFS. http://www.nasuni.com/.

[5]

Panzura CloudFS. http://panzura.com/.

[6]

S3FS - FUSE-based file system backed by Amazon S3. http://code.google.com/p/s3fs/.

[7]

S3QL - a full-featured file system for online data storage. http://code.google.com/p/s3ql/.

[8]

S3QL 1.13.2 documentation: Known issues. http://www.rath.org/s3ql-docs/issues.html.

[9]

H. Abu-Libdeh, L. Princehouse, and H. Weatherspoon. RACS: A case for cloud storage diversity. SoCC, 2010.

[10]

A. Adya et al. Farsite: Federated, available, and reliable storage for an incompletely trusted environment. In OSDI, 2002.

[11]

N. Agrawal, W. J. Bolosky, J. R. Douceur, and J. R. Lorch. A five-year study o file-system metadata. In FAST, 2007.

[12]

C. Basescu et al. Robust data sharing with key-value stores. In DSN, 2012.

[13]

A. Bessani, E. P. Alchieri, M. Correia, and J. S. Fraga. DepSpace: A Byzantine fault-tolerant coordination service. In EuroSys, 2008.

[14]

A. Bessani and M. Correia. Consistency anchor formalization and correctness proofs. Technical Report DI-FCUL- 2014-02, ULisboa, May 2014.

[15]

A. Bessani, M. Correia, B. Quaresma, F. Andre, and P. Sousa. DepSky: Dependable and secure storage in cloud-of-clouds. ACM Trans. Storage, 9(4), 2013.

[16]

A. Bessani, M. Santos, J. Felix, N. Neves, and M. Correia. On the efficiency of durable state machine replication. In USENIX ATC, 2013.

[17]

A. Bessani, J. Sousa, and E. Alchieri. State machine replication for the masses with BFT-SMaRt. In DSN, 2014.

[18]

M. Castro and B. Liskov. Practical Byzantine fault-tolerance and proactive recovery. ACM Trans. Computer Systems, 20(4):398-461, 2002.

[19]

S. Choney. Amazon Web Services outage takes down Net-flix, other sites. http://goo.gl/t9pRbX, 2012.

[20]

I. Drago et al. Inside Dropbox: Understanding personal cloud storage services. In IMC, 2012.

[21]

G. Gibson et al. A cost-effective, high-bandwidth storage architecture. In ASPLOS, 1998.

[22]

A. Grünbacher. POSIX access control lists on Linux. In USENIX ATC, 2003.

[23]

J. Hamilton. On designing and deploying Internet-scale services. In LISA, 2007.

[24]

J. Hamilton. Observations on errors, corrections, and trust of dependent systems. http://goo.gl/LPTJoO, 2012.

[25]

T. Harter, C. Dragga, M. Vaughn, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. A file is not a file: Understanding the I/O behavior of Apple desktop applications. In SOSP, 2011.

[26]

M. Herlihy. Wait-free synchronization. ACM Trans. Programing Languages and Systems, 13(1):124-149, 1991.

[27]

M. Herlihy and J. M. Wing. Linearizability: A correctness condition for concurrent objects. ACM Trans. on Programing Languages and Systems, 12(3):463-492, 1990.

[28]

J. Howard et al. Scale and performance in a distributed file system. ACM Trans. Computer Systems, 6(1):51-81, 1988.

[29]

P. Hunt, M. Konar, F. Junqueira, and B. Reed. Zookeeper: Wait-free coordination for internet-scale services. In USENIX ATC, 2010.

[30]

F. Junqueira, B. Reed, and M. Serafini. Zab: High-performance broadcast for primary-backup systems. In DSN, 2011.

[31]

R. Kotla, L. Alvisi, and M. Dahlin. SafeStore: A durable and practical storage system. In USENIX ATC, 2007.

[32]

J. Kubiatowicz et al. Oceanstore: An architecture for global-scale persistent storage. In ASPLOS, 2000.

[33]

A. W. Leung, S. Pasupathy, G. Goodson, and E. L. Miller. Measurement and analysis of large-scale network file system workloads. In USENIX ATC, 2008.

[34]

J. Li, M. N. Krohn, D. Mazieres, and D. Shasha. Secure untrusted data repository (SUNDR). In OSDI, 2004.

[35]

Z. Li et al. Efficient batched synchronization in dropbox-like cloud storage services. In Middleware, 2013.

[36]

J. Stribling et al. Flexible, wide-area storage for distributed system with WheelFS. In NSDI, 2009.

[37]

V. Tarasov, S. Bhanage, E. Zadok, and M. Seltzer. Benchmarking file system benchmarking: It *IS* rocket science. In HotOS, 2011.

[38]

W. Vogels. Eventually consistent. Communications of the ACM, 52(1):40-44, 2009.

[39]

M. Vrable, S. Savage, and G. M. Voelker. BlueSky: A cloud-backed file system for the enterprise. In FAST, 2012.

[40]

S. A. Weil, S. A. Brandt, E. L. Miller, D. D. E. Long, and C. Maltzahn. Ceph: A scalable, high-performance distributed file system. In OSDI, 2006.

[41]

Y. Zhang, C. Dragga, A. Arpaci-Dusseau, and R. Arpaci-Dusseau. Viewbox: Integrating local file systems with cloud storage services. In FAST, 2014.

Cited By

Chen JZhao MLi ZZhai EQian FChen HLiu YXu TNoh SWelch B(2020)Lock-free collaboration support for cloud storage services with operation inference and transformationProceedings of the 18th USENIX Conference on File and Storage Technologies10.5555/3386691.3386694(13-28)Online publication date: 24-Feb-2020
https://dl.acm.org/doi/10.5555/3386691.3386694
Lillaney KTarasov VPease DBurns RYadgar GNoh S(2019)The case for dual-access file systems over object storageProceedings of the 11th USENIX Conference on Hot Topics in Storage and File Systems10.5555/3357062.3357080(13-13)Online publication date: 8-Jul-2019
https://dl.acm.org/doi/10.5555/3357062.3357080
Barika MGarg SZomaya AWang LMoorsel ARanjan R(2019)Orchestrating Big Data Analysis Workflows in the CloudACM Computing Surveys10.1145/333230152:5(1-41)Online publication date: 13-Sep-2019
https://dl.acm.org/doi/10.1145/3332301
Show More Cited By

Index Terms

Index terms have been assigned to the content through auto-classification.

Recommendations

SCFS: a UNIX filesystem for smartcards
WOST'99: Proceedings of the USENIX Workshop on Smartcard Technology on USENIX Workshop on Smartcard Technology

Smartcard software developers suffer from the lack of a standard communication framework between a workstation and a smartcard. To address this problem, we extended the UNIX filesystem to provide access to smartcard storage, which enables us to use ...
Higher reliability redundant disk arrays: Organization, operation, and coding

Parity is a popular form of data protection in redundant arrays of inexpensive/independent disks (RAID). RAID5 dedicates one out of N disks to parity to mask single disk failures, that is, the contents of a block on a failed disk can be reconstructed by ...
HPDA: A hybrid parity-based disk array for enhanced performance and reliability

Flash-based Solid State Drive (SSD) has been productively shipped and deployed in large scale storage systems. However, a single flash-based SSD cannot satisfy the capacity, performance and reliability requirements of the modern storage systems that ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

USENIX ATC'14: Proceedings of the 2014 USENIX conference on USENIX Annual Technical Conference

June 2014

512 pages

ISBN:9781931971102

Editors:
Garth Gibson
Carnegie Mellon University
,
Nickolai Zeldovich
Massachusetts Institute of Technology

Sponsors

VMware
NetApp
IBMR: IBM Research
Facebook: Facebook
HP: HP

Publisher

USENIX Association

United States

Publication History

Published: 19 June 2014

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen JZhao MLi ZZhai EQian FChen HLiu YXu TNoh SWelch B(2020)Lock-free collaboration support for cloud storage services with operation inference and transformationProceedings of the 18th USENIX Conference on File and Storage Technologies10.5555/3386691.3386694(13-28)Online publication date: 24-Feb-2020
https://dl.acm.org/doi/10.5555/3386691.3386694
Lillaney KTarasov VPease DBurns RYadgar GNoh S(2019)The case for dual-access file systems over object storageProceedings of the 11th USENIX Conference on Hot Topics in Storage and File Systems10.5555/3357062.3357080(13-13)Online publication date: 8-Jul-2019
https://dl.acm.org/doi/10.5555/3357062.3357080
Barika MGarg SZomaya AWang LMoorsel ARanjan R(2019)Orchestrating Big Data Analysis Workflows in the CloudACM Computing Surveys10.1145/333230152:5(1-41)Online publication date: 13-Sep-2019
https://dl.acm.org/doi/10.1145/3332301
Chen MZadok EHershcovitch MGoel AMorrison A(2019)KurmaProceedings of the 12th ACM International Conference on Systems and Storage10.1145/3319647.3325830(109-120)Online publication date: 22-May-2019
https://dl.acm.org/doi/10.1145/3319647.3325830
Matos DPardal MCarle GCorreia MPierre GFerreira PShrira L(2018)RockFSProceedings of the 19th International Middleware Conference10.1145/3274808.3274817(107-119)Online publication date: 26-Nov-2018
https://dl.acm.org/doi/10.1145/3274808.3274817
Zhao MLi ZZhai ETyson GQian CLi ZZhao L(2018)H2CloudProceedings of the 47th International Conference on Parallel Processing10.1145/3225058.3225083(1-10)Online publication date: 13-Aug-2018
https://dl.acm.org/doi/10.1145/3225058.3225083
Shor RYadgar GHuang WYaakobi EBruck JBreitgand DYadgar GPorter DEyal I(2018)How to Best Share a Big SecretProceedings of the 11th ACM International Systems and Storage Conference10.1145/3211890.3211896(76-88)Online publication date: 4-Jun-2018
https://dl.acm.org/doi/10.1145/3211890.3211896
Hou BChen F(2017)GDS-LCACM Transactions on Storage10.1145/314937413:4(1-33)Online publication date: 24-Nov-2017
https://dl.acm.org/doi/10.1145/3149374
Hatzieleftheriou AAnastasiadis S(2017)Client-Side Journaling for Durable Shared StorageACM Transactions on Storage10.1145/314937213:4(1-34)Online publication date: 17-Nov-2017
https://dl.acm.org/doi/10.1145/3149372
Alcântara JOliveira TBessani AJayaram KGandhi AKemme BPietzuch P(2017)GinjaProceedings of the 18th ACM/IFIP/USENIX Middleware Conference10.1145/3135974.3135985(248-260)Online publication date: 11-Dec-2017
https://dl.acm.org/doi/10.1145/3135974.3135985
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents