research-article

Public Access

Generalized Consensus for Practical Fault Tolerance

Authors:

Sebastiano Peluso,

Binoy RavindranAuthors Info & Claims

Middleware '19: Proceedings of the 20th International Middleware Conference

Pages 55 - 67

https://doi.org/10.1145/3361525.3361536

Published: 09 December 2019 Publication History

Abstract

Despite extensive research on Byzantine Fault Tolerant (BFT) systems, overheads associated with such solutions preclude widespread adoption. Past efforts such as the Cross Fault Tolerance (XFT) model address this problem by making a weaker assumption that a majority of nodes are correct and communicate synchronously. Although XPaxos of Liu et al. (applying the XFT model) achieves similar performance as Paxos, it does not scale with the number of faults. Also, its reliance on a single leader introduces considerable downtime in case of failures. We present Elpis, the first multi-leader XFT consensus protocol. By adopting the Generalized Consensus specification, we were able to devise a multi-leader protocol that exploits the commutativity property inherent in the commands ordered by the system. Elpis maps accessed objects to non-faulty replicas during periods of synchrony. Subsequently, these replicas order all commands which access these objects. The experimental evaluation confirms the effectiveness of this approach: Elpis achieves up to 2x speedup over XPaxos and up to 3.5x speedup over state-of-the-art Byzantine Fault-Tolerant Consensus Protocols.

References

[1]

2012. AWS Service Event in the US-East Region: October 22, 2012. (2012). https://aws.amazon.com/message/680342/

[2]

2018. cockroach: CockroachDB - the open source, cloud-native SQL database. https://github.com/cockroachdb/cockroach original-date: 2014-02-06T00:18:47Z.

[3]

2018. etcd: Distributed reliable key-value store for the most critical data of a distributed system. https://github.com/coreos/etcd original-date: 2013-07-06T21:57:21Z.

[4]

2019. Google App Engine: 02 January 2019. (2019). https://status.cloud.google.com/incident/appengine/19001

[5]

2019. Google Compute Engine: November 05, 2018. (2019). https://status.cloud.google.com/incident/compute/18012

[6]

2019. Home | YugaByte DB. https://www.yugabyte.com/. Accessed: 2019-09-04.

[7]

Balaji Arun, Sebastiano Peluso, Roberto Palmieri, Giuliano Losa, and Binoy Ravindran. 2017. Speeding up Consensus by Chasing Fast Decisions. arXiv.1704.03319 [cs] (April 2017). http://arxiv.org/abs/1704.03319 arXiv: 1704.03319.

[8]

Pierre-Louis Aublin, Rachid Guerraoui, Nikola Kneevi, Vivien Quéma, and Marko Vukoli. 2015. The Next 700 BFT Protocols. ACM Trans. Comput. Syst. 32, 4 (Jan. 2015), 12:1--12:45. https://doi.org/10.1145/2658994

Digital Library

[9]

Bela Ban. 2002. JGroups, a toolkit for reliable multicast communication. (2002).

[10]

Alysson Neves Bessani and Marcel Santos. 2011. Bft-smart-high-performance byzantine-faulttolerant state machine replication.

[11]

Eric A Brewer. 2000. Towards robust distributed systems. In PODC, Vol. 7.

Digital Library

[12]

Mike Burrows. 2006. The Chubby lock service for loosely-coupled distributed systems. In Proceedings of the 7th symposium on Operating systems design and implementation. USENIX Association, 335--350.

Digital Library

[13]

Brad Calder, Ju Wang, Aaron Ogus, Niranjan Nilakantan, Arild Skjolsvold, Sam McKelvie, Yikang Xu, Shashwat Srivastav, Jiesheng Wu, Huseyin Simitci, et al. 2011. Windows Azure Storage: a highly available cloud storage service with strong consistency. In Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles. ACM, 143--157.

Digital Library

[14]

Apache Cassandra. 2014. Apache cassandra. Website. Available online at http://planetcassandra.org/what-is-apache-cassandra (2014), 13.

[15]

Miguel Castro and Barbara Liskov. 1999. Practical Byzantine fault tolerance. In OSDI, Vol. 99. 173--186.

Digital Library

[16]

James C. Corbett, Jeffrey Dean, Michael Epstein, Andrew Fikes, Christopher Frost, J. J. Furman, Sanjay Ghemawat, Andrey Gubarev, Christopher Heiser, Peter Hochschild, Wilson Hsieh, Sebastian Kanthak, Eugene Kogan, Hongyi Li, Alexander Lloyd, Sergey Melnik, David Mwaura, David Nagle, Sean Quinlan, Rajesh Rao, Lindsay Rolig, Yasushi Saito, Michal Szymaniak, Christopher Taylor, Ruth Wang, and Dale Woodford. 2013. Spanner: Googles Globally Distributed Database. ACM Trans. Comput. Syst. 31, 3 (Aug. 2013), 8:1--8:22. https://doi.org/10.1145/2491245

[17]

Patrick Hunt, Mahadev Konar, Flavio P Junqueira, and Benjamin Reed. 2010. ZooKeeper: Wait-free coordination for Internet-scale systems. (2010), 14.

[18]

Ramakrishna Kotla, Lorenzo Alvisi, Mike Dahlin, Allen Clement, and Edmund Wong. 2007. Zyzzyva: speculative byzantine fault tolerance. In ACM SIGOPS Operating Systems Review, Vol. 41. ACM, 45--58.

Digital Library

[19]

Leslie Lamport. 2001. Paxos made simple. ACM Sigact News 32, 4 (2001), 18--25.

[20]

Leslie Lamport. 2002. Specifying systems: the TLA+ language and tools for hardware and software engineers. Addison-Wesley Longman Publishing Co., Inc.

Digital Library

[21]

Leslie Lamport. 2005. Generalized Consensus and Paxos. (2005), 63.

[22]

Leslie Lamport. 2006. Fast Paxos. Distributed Computing 19 (Oct. 2006). https://www.microsoft.com/en-us/research/publication/fast-paxos/

[23]

Leslie Lamport, Robert Shostak, and Marshall Pease. 1982. The Byzantine Generals Problem. ACM Transactions on Programming Languages and Systems 4, 3 (July 1982), 382--401. https://doi.org/10.1145/357172.357176

Digital Library

[24]

Shengyun Liu, Paolo Viotti, Christian Cachin, Vivien Quéma, and Marko Vukolic. 2016. XFT: Practical Fault Tolerance beyond Crashes. In OSDI. 485--500.

Digital Library

[25]

J-P Martin and Lorenzo Alvisi. 2006. Fast byzantine consensus. IEEE Transactions on Dependable and Secure Computing 3, 3 (2006), 202--215.

Digital Library

[26]

Iulian Moraru, David G. Andersen, and Michael Kaminsky. 2013. There is more consensus in Egalitarian parliaments. ACM Press, 358--372. https://doi.org/10.1145/2517349.2517350

[27]

Diego Ongaro and John K. Ousterhout. 2014. In search of an understandable consensus algorithm. In USENIX Annual Technical Conference. 305--319.

[28]

S. Peluso, A. Turcu, R. Palmieri, G. Losa, and B. Ravindran. 2016. Making Fast Consensus Generally Faster. In 2016 46th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN). 156--167. https://doi.org/10.1109/DSN.2016.23

[29]

Fred B Schneider. 1993. Replication management using the state-machine approach, Distributed systems. (1993).

[30]

Swaminathan Sivasubramanian. 2012. Amazon dynamoDB: a seamlessly scalable non-relational database service. In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data. ACM, 729--730.

Digital Library

[31]

Mohammad Reza Khalifeh Soltanian and Iraj Sadegh Amiri. 2016. Chapter 1 - Introduction. In Theoretical and Experimental Methods for Defending Against DDOS Attacks, Mohammad Reza Khalifeh Soltanian and Iraj Sadegh Amiri (Eds.). Syngress, 1--5. https://doi.org/10.1016/B978-0-12-805391-1.00001-8

Cited By

Platt MMcBurney P(2023)Sybil in the Haystack: A Comprehensive Review of Blockchain Consensus Mechanisms in Search of Strong Sybil Attack ResistanceAlgorithms10.3390/a1601003416:1(34)Online publication date: 6-Jan-2023
https://doi.org/10.3390/a16010034
Scharf JXavier LMendizabal O(2023)Joining Parallel and Partitioned State Machine Replication Models for Enhanced Shared Logging PerformanceProceedings of the 12th Latin-American Symposium on Dependable and Secure Computing10.1145/3615366.3615422(90-99)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3615366.3615422
Amarasekara DRanasinghe D(2022)ZPaxos: An Asynchronous BFT Paxos with a Leaderless Synchronous Group2022 21st International Symposium on Parallel and Distributed Computing (ISPDC)10.1109/ISPDC55340.2022.00025(114-120)Online publication date: Jul-2022
https://doi.org/10.1109/ISPDC55340.2022.00025
Show More Cited By

Index Terms

Generalized Consensus for Practical Fault Tolerance
1. Security and privacy
  1. Systems security
    1. Distributed systems security
2. Software and its engineering
  1. Software organization and properties
    1. Extra-functional properties
      1. Software fault tolerance

Recommendations

Scaling Byzantine Consensus: A Broad Analysis
SERIAL'18: Proceedings of the 2nd Workshop on Scalable and Resilient Infrastructures for Distributed Ledgers

Blockchains and distributed ledger technology (DLT) that rely on Proof-of-Work (PoW) typically show limited performance. Several recent approaches incorporate Byzantine fault-tolerant (BFT) consensus protocols in their DLT design as Byzantine consensus ...
Multi-Threshold Byzantine Fault Tolerance
CCS '21: Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security

Classic Byzantine fault tolerant (BFT) protocols are designed for a specific timing model, most often one of the following: synchronous, asynchronous or partially synchronous. It is well known that the timing model and fault tolerance threshold present ...
ZK-BFT: A Zero-knowledge and Byzantine Fault Tolerant Consensus for Permissioned Blockchain Networks
ICBTA '23: Proceedings of the 2023 6th International Conference on Blockchain Technology and Applications

Consensus algorithms play an essential role in blockchains, directly impacting their performance. These algorithms involve validating and ordering pending transactions into new blocks, a process that exposes data to consensus nodes, raising privacy ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

Middleware '19: Proceedings of the 20th International Middleware Conference

December 2019

342 pages

ISBN:9781450370097

DOI:10.1145/3361525

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 December 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Conference

Middleware '19

Sponsor:

ACM

Middleware '19: 20th International Middleware Conference

December 9 - 13, 2019

CA, Davis, USA

Acceptance Rates

Overall Acceptance Rate 203 of 948 submissions, 21%

Upcoming Conference

MIDDLEWARE '24

25th International Middleware Conference

December 2 - 6, 2024

Hong Kong , Hong Kong

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
642
Total Downloads

Downloads (Last 12 months)104
Downloads (Last 6 weeks)13

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Platt MMcBurney P(2023)Sybil in the Haystack: A Comprehensive Review of Blockchain Consensus Mechanisms in Search of Strong Sybil Attack ResistanceAlgorithms10.3390/a1601003416:1(34)Online publication date: 6-Jan-2023
https://doi.org/10.3390/a16010034
Scharf JXavier LMendizabal O(2023)Joining Parallel and Partitioned State Machine Replication Models for Enhanced Shared Logging PerformanceProceedings of the 12th Latin-American Symposium on Dependable and Secure Computing10.1145/3615366.3615422(90-99)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3615366.3615422
Amarasekara DRanasinghe D(2022)ZPaxos: An Asynchronous BFT Paxos with a Leaderless Synchronous Group2022 21st International Symposium on Parallel and Distributed Computing (ISPDC)10.1109/ISPDC55340.2022.00025(114-120)Online publication date: Jul-2022
https://doi.org/10.1109/ISPDC55340.2022.00025
Wang QLuo ZLiu KDing TShen XMo XQin JChen L(2021)A Multiblockchain-Oriented Decentralized Market Framework for Frequency Regulation ServiceIEEE Transactions on Industrial Informatics10.1109/TII.2021.306262317:12(8219-8229)Online publication date: Dec-2021
https://doi.org/10.1109/TII.2021.3062623
Lashkari BMusilek P(2021)A Comprehensive Review of Blockchain Consensus MechanismsIEEE Access10.1109/ACCESS.2021.30658809(43620-43652)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3065880

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents