Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Eventual Consistency Today: Limitations, Extensions, and Beyond: How can applications be built on eventually consistent infrastructure given no guarantee of safety?

Published: 01 March 2013 Publication History
  • Get Citation Alerts
  • Abstract

    In a July 2000 conference keynote, Eric Brewer, now VP of engineering at Google and a professor at the University of California, Berkeley, publicly postulated the CAP (consistency, availability, and partition tolerance) theorem, which would change the landscape of how distributed storage systems were architected. Brewer’s conjecture--based on his experiences building infrastructure for some of the first Internet search engines at Inktomi--states that distributed systems requiring always-on, highly available operation cannot guarantee the illusion of coherent, consistent single-system operation in the presence of network partitions, which cut communication between active servers. Brewer’s conjecture proved prescient: in the following decade, with the continued rise of large-scale Internet services, distributed-system architects frequently dropped "strong" guarantees in favor of weaker models--the most notable being eventual consistency.

    References

    [1]
    Abadi, D. 2012. Consistency tradeoffs in modern distributed database system design: CAP is onlypart of the story. IEEE Computer (February).
    [2]
    Alpern, B., Schneider, F.B. 1985. Defining liveness. Information Processing Letters 21 (October).
    [3]
    Alvaro, P., Conway, N., Hellerstein, J., Marczak, W. 2011. Consistency analysis in Bloom: a CALMand collected approach. CIDR (Conference on Innovative Data Systems Research).
    [4]
    Bailis, P., Venkataraman, S., Franklin, M., Hellerstein, J., Stoica, I. 2012. Probabilistically bounded staleness for practical partial quorums. VLDB (Very Large Databases). (Demo from text: http://pbs.cs.berkeley.edu/#demo)
    [5]
    Bailis, P., Fekete, A., Ghodsi, A., Hellerstein, J., Stoica, I. 2013. HAT, not CAP: highly availabletransactions. arXiv:1302.0309 {cs.DB} (February).
    [6]
    Bailis, P., Ghodsi, A., Hellerstein, J., Stoica, I. 2013. Bolt-on causal consistency. ACM SIGMOD.
    [7]
    Bermbach, D., Tai, S. 2011. Eventual consistency: how soon is eventual? An evaluation of AmazonS3's consistency behavior. MW4SOC (Workshop on Middleware for Service-oriented Computing).
    [8]
    Brewer, E. 2012. CAP twelve years later: how the "rules" have changed. IEEE Computer (February).
    [9]
    Brown, R., Cribbs, S. 2012. Data structures in Riak; https://speakerdeck.com/basho/datastructures-in-riak. RICON Conference.
    [10]
    Davidson, S., Garcia-Molina, H., Skeen, D. 1985. Consistency in a partitioned network: a survey.ACM Computing Surveys Volume 17, Issue 3.
    [11]
    Gilbert, S., Lynch. N. 2002. Brewer's conjecture and the feasibility of consistent, available,partition-tolerant web services. ACM SIGACT News Volume 33, Issue 2 (June).
    [12]
    Hale, C. 2010. You can't sacrifice partition tolerance. http://codahale.com/you-cant-sacrificepartition-tolerance/
    [13]
    Helland, P., Campbell, D. 2009. Building on quicksand. CIDR (Conference on Innovative DataSystems Research).
    [14]
    Johnson, P. R., Thomas, R. H. 1975. Maintenance of duplicate databases; RFC 677; http://www.faqs.org/rfcs/rfc677.html.
    [15]
    Kawell Jr., L., Beckhardt, S., Halvorsen, T., Ozzie, R., Greif, I. 1988. Replicated document management in a group communication system. Proceedings of the 1988 ACM Conference on Computer-supported Cooperative Work: 395; http://dl.acm.org/citation.cfm?id=1024798.
    [16]
    Lloyd, W., Freedman, M., Kaminsky, M., Andersen, D. 2011. Stronger semantics for low-latency geo-replicated storage. NSDI (Networked Systems Design and Implementation).
    [17]
    Mahajan, P., Alvisi, L., Dahlin, M. 2011. Consistency, availability, convergence. University of Texas at Austin TR-11-22 (May).
    [18]
    Rahman, M., Golab, W., AuYoung, A., Keeton, K., Wylie, J. 2012. Toward a principled frameworkfor benchmarking consistency. HotDep (Workshop on Hot Topics in System Dependability).
    [19]
    Saito, Y., Shapiro, M. 2005. Optimistic replication. ACM Computing Surveys Volume 37 Number1 (March). http://dl.acm.org/citation.cfm?id=1057980
    [20]
    Shapiro, M., Preguiça, N., Baquero, C., Zawirski, M. 2011. A comprehensive study of convergentand commutative replicated data types. INRIA Technical Report RR-7506 (January).
    [21]
    Statebox; https://github.com/mochi/statebox.
    [22]
    Terry, D., Theimer, M., Petersen, K., Demers, A., Spreitzer, M. Hauser, C. 1995. Managing updateconflicts in Bayou, a weakly connected replicated storage system. SOSP (Symposium on OperatingSystems Principles).
    [23]
    Vogels, W. Eventually consistent. 2008. ACM Queue.
    [24]
    Wada, H., Fekete, A., Zhao, L., Lee, K., A. Liu, A. 2011. Data consistency and the tradeoffs incommercial cloud storage: the consumers' perspective. CIDR (Conference on Innovative DataSystems Research).
    [25]
    Yu, H., Vahdat, A. 2002. Design and evaluation of a conit-based continuous consistency model for replicated services. ACM TOCS (Transactions on Computer Systems).

    Cited By

    View all
    • (2024)Deeply Programmable Application Switch for Performance Improvement of KVS in Data CenterIEICE Transactions on Information and Systems10.1587/transinf.2023DAP0009E107.D:5(659-673)Online publication date: 1-May-2024
    • (2023)Rendezvous: Where Serverless Functions Find ConsistencyProceedings of the 4th Workshop on Resource Disaggregation and Serverless10.1145/3605181.3626290(51-57)Online publication date: 23-Oct-2023
    • (2023)Replicated Versioned Data Structures for Wide-Area Distributed SystemsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.321796934:1(207-224)Online publication date: 1-Jan-2023
    • Show More Cited By

    Index Terms

    1. Eventual Consistency Today: Limitations, Extensions, and Beyond: How can applications be built on eventually consistent infrastructure given no guarantee of safety?

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Queue
      Queue  Volume 11, Issue 3
      Storage
      March 2013
      38 pages
      ISSN:1542-7730
      EISSN:1542-7749
      DOI:10.1145/2460276
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 01 March 2013
      Published in QUEUE Volume 11, Issue 3

      Permissions

      Request permissions for this article.

      Check for updates

      Qualifiers

      • Research-article
      • Popular
      • Refereed

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)5,053
      • Downloads (Last 6 weeks)636

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Deeply Programmable Application Switch for Performance Improvement of KVS in Data CenterIEICE Transactions on Information and Systems10.1587/transinf.2023DAP0009E107.D:5(659-673)Online publication date: 1-May-2024
      • (2023)Rendezvous: Where Serverless Functions Find ConsistencyProceedings of the 4th Workshop on Resource Disaggregation and Serverless10.1145/3605181.3626290(51-57)Online publication date: 23-Oct-2023
      • (2023)Replicated Versioned Data Structures for Wide-Area Distributed SystemsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.321796934:1(207-224)Online publication date: 1-Jan-2023
      • (2023)HAPIC: A Scalable, Lightweight and Reactive Cache for Persistent-Memory-Based Index2023 IEEE/ACM International Conference on Computer Aided Design (ICCAD)10.1109/ICCAD57390.2023.10323608(1-7)Online publication date: 28-Oct-2023
      • (2023)Undoing CRDT Operations Automatically2023 IEEE International Conference on Cloud Computing Technology and Science (CloudCom)10.1109/CloudCom59040.2023.00047(246-251)Online publication date: 4-Dec-2023
      • (2023)On the correctness of highly available systems in the presence of failuresJournal of Parallel and Distributed Computing10.1016/j.jpdc.2023.04.008180(104707)Online publication date: Oct-2023
      • (2022)An Intelligent Cluster-Based Routing Scheme in 5G Flying Ad Hoc NetworksApplied Sciences10.3390/app1207366512:7(3665)Online publication date: 6-Apr-2022
      • (2022)A Highly-Available Move Operation for Replicated TreesIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2021.311860333:7(1711-1724)Online publication date: 1-Jul-2022
      • (2022)Coordination-Free Multi-Domain NFV Orchestration for Consistent VNF Forwarding Graph ReconfigurationIEEE Transactions on Network and Service Management10.1109/TNSM.2022.319232819:4(5133-5151)Online publication date: Dec-2022
      • (2022)Croesus: Multi-Stage Processing and Transactions for Video-Analytics in Edge-Cloud Systems2022 IEEE 38th International Conference on Data Engineering (ICDE)10.1109/ICDE53745.2022.00114(1463-1476)Online publication date: May-2022
      • Show More Cited By

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Magazine Site

      View this article on the magazine site (external)

      Magazine Site

      Get Access

      Login options

      Full Access

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media