Article

Subtleties in tolerating correlated failures in wide-area storage systems

Authors:

Suman Nath,

Haifeng Yu,

Phillip B. Gibbons,

Srinivasan SeshanAuthors Info & Claims

NSDI'06: Proceedings of the 3rd conference on Networked Systems Design & Implementation - Volume 3

Page 17

Published: 08 May 2006 Publication History

Publisher Site

Abstract

High availability is widely accepted as an explicit requirement for distributed storage systems. Tolerating correlated failures is a key issue in achieving high availability in today's wide-area environments. This paper systematically revisits previously proposed techniques for addressing correlated failures. Using several real-world failure traces, we qualitatively answer four important questions regarding how to design systems to tolerate such failures. Based on our results, we identify a set of design principles that system builders can use to tolerate correlated failures. We show how these lessons can be effectively used by incorporating them into IrisStore, a distributed read-write storage layer that provides high availability. Our results using IrisStore on the PlanetLab over an 8-month period demonstrate its ability to withstand large correlated failures and meet preconfigured availability targets.

Cited By

View all

Zhai EChen APiskac RBalakrishnan MTian BSong BZhang HBhagwan RPorter G(2020)Check before you changeProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388285(575-590)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388285
Alagappan RGanesan ALiu JArpaci-Dusseau AArpaci-Dusseau RArpaci-Dusseau AVoelker G(2018)Fault-tolerance, fast and slowProceedings of the 13th USENIX conference on Operating Systems Design and Implementation10.5555/3291168.3291197(391-408)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.5555/3291168.3291197
Alagappan RGanesan APatel YPillai TArpaci-Dusseau AArpaci-Dusseau RKeeton KRoscoe T(2016)Correlated crash vulnerabilitiesProceedings of the 12th USENIX conference on Operating Systems Design and Implementation10.5555/3026877.3026890(151-167)Online publication date: 2-Nov-2016
https://dl.acm.org/doi/10.5555/3026877.3026890
Show More Cited By

Index Terms

Subtleties in tolerating correlated failures in wide-area storage systems
1. General and reference
  1. Cross-computing tools and techniques
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Operational analysis
  2. Software organization and properties

Recommendations

Tolerating Temporal Correlated Failures from Cyclic Dependency in High Performance Computing Systems
ICPADS '08: Proceedings of the 2008 14th IEEE International Conference on Parallel and Distributed Systems

Correlated failures have recently gained more attention in the research of failures in large scale systems. Recent studies have pointed out the negative effect of ignoring such failures when designing a fault tolerant scheme for large scale systems. In ...
Understanding and coping with failures in large-scale storage systems
Reliability Study of Coding Schemes for Wide-Area Distributed Storage Systems
PDP '11: Proceedings of the 2011 19th International Euromicro Conference on Parallel, Distributed and Network-Based Processing

Distributed storage systems comprise a large number of commodity hardware distributed across several data centers. Even in the presence of failures (permanent failures) the system should provide reliable storage. While replication has advantages because ...

Comments

Information & Contributors

Information

Published In

NSDI'06: Proceedings of the 3rd conference on Networked Systems Design & Implementation - Volume 3

May 2006

54 pages

Publisher

USENIX Association

United States

Publication History

Published: 08 May 2006

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
3
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhai EChen APiskac RBalakrishnan MTian BSong BZhang HBhagwan RPorter G(2020)Check before you changeProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388285(575-590)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388285
Alagappan RGanesan ALiu JArpaci-Dusseau AArpaci-Dusseau RArpaci-Dusseau AVoelker G(2018)Fault-tolerance, fast and slowProceedings of the 13th USENIX conference on Operating Systems Design and Implementation10.5555/3291168.3291197(391-408)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.5555/3291168.3291197
Alagappan RGanesan APatel YPillai TArpaci-Dusseau AArpaci-Dusseau RKeeton KRoscoe T(2016)Correlated crash vulnerabilitiesProceedings of the 12th USENIX conference on Operating Systems Design and Implementation10.5555/3026877.3026890(151-167)Online publication date: 2-Nov-2016
https://dl.acm.org/doi/10.5555/3026877.3026890
Zhang YYang JMemaripour ASwanson S(2015)MojimACM SIGARCH Computer Architecture News10.1145/2786763.269437043:1(3-18)Online publication date: 14-Mar-2015
https://dl.acm.org/doi/10.1145/2786763.2694370
Zhang YYang JMemaripour ASwanson S(2015)MojimACM SIGPLAN Notices10.1145/2775054.269437050:4(3-18)Online publication date: 14-Mar-2015
https://dl.acm.org/doi/10.1145/2775054.2694370
Zhang YYang JMemaripour ASwanson SOzturk OEbcioglu KDwarkadas S(2015)MojimProceedings of the Twentieth International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/2694344.2694370(3-18)Online publication date: 14-Mar-2015
https://dl.acm.org/doi/10.1145/2694344.2694370
Mills KChandrasekaran RMittal N(2015)On Replica Placement in High-Availability Storage Under Correlated FailureProceedings of the 9th International Conference on Combinatorial Optimization and Applications - Volume 948610.1007/978-3-319-26626-8_26(348-363)Online publication date: 18-Dec-2015
https://dl.acm.org/doi/10.1007/978-3-319-26626-8_26
Zhai EChen RWolinsky DFord BFlinn JLevy H(2014)Heading off correlated failures through independence-as-a-serviceProceedings of the 11th USENIX conference on Operating Systems Design and Implementation10.5555/2685048.2685073(317-334)Online publication date: 6-Oct-2014
https://dl.acm.org/doi/10.5555/2685048.2685073
Rasmussen ALam VConley MPorter GKapoor RVahdat ACarey MHand S(2012)ThemisProceedings of the Third ACM Symposium on Cloud Computing10.1145/2391229.2391242(1-14)Online publication date: 14-Oct-2012
https://dl.acm.org/doi/10.1145/2391229.2391242
Li YMiller ELong DVinov MTsafrir DZadok E(2012)Understanding data survivability in archival storage systemsProceedings of the 5th Annual International Systems and Storage Conference10.1145/2367589.2367605(1-12)Online publication date: 4-Jun-2012
https://dl.acm.org/doi/10.1145/2367589.2367605
Show More Cited By

Abstract

Cited By

Index Terms

Recommendations

Tolerating Temporal Correlated Failures from Cyclic Dependency in High Performance Computing Systems

Understanding and coping with failures in large-scale storage systems

Reliability Study of Coding Schemes for Wide-Area Distributed Storage Systems

Comments

Information

Published In

Sponsors

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Share

Share this Publication link

Share on social media

Affiliations