Article

Sinfonia: a new paradigm for building scalable distributed systems

Authors:

Marcos K. Aguilera,

Alistair Veitch, and

Christos KaramanolisAuthors Info & Claims

SOSP '07: Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles

October 2007

Pages 159 - 174

https://doi.org/10.1145/1294261.1294278

Published: 14 October 2007 Publication History

Abstract

We propose a new paradigm for building scalable distributed systems. Our approach does not require dealing with message-passing protocols -- a major complication in existing distributed systems. Instead, developers just design and manipulate data structures within our service called Sinfonia. Sinfonia keeps data for applications on a set of memory nodes, each exporting a linear address space. At the core of Sinfonia is a novel minitransaction primitive that enables efficient and consistent access to data, while hiding the complexities that arise from concurrency and failures. Using Sinfonia, we implemented two very different and complex applications in a few months: a cluster file system and a group communication service. Our implementations perform well and scale to hundreds of machines.

Supplementary Material

index.html (index.html)

Slides from the presentation

Download
.93 KB

ZIP File (p159-slides.zip)

Supplemental material for Sinfonia: a new paradigm for building scalable distributed systems

Download
9.18 MB

Audio only (1294278.mp3)

Download
11.25 MB

Video (1294278.mp4)

Download
155.20 MB

References

[1]

Y. Amir and J. Stanton. The Spread wide area group communication system. Technical Report CNDS-98-4, The Johns Hopkins University, July 1998.

Digital Library

[2]

K. P. Birman and T. A. Joseph. Exploiting virtual synchrony in distributed systems. In Symposium on Operating Systhem Principles, pages 123--138, Nov. 1987.

Digital Library

[3]

N. Budhiraja, K. Marzullo, F. B. Schneider, and S. Toueg. The primary-backup approach. In SJ. Mullender, editor, Distributed Systems, chapter 8. Addison-Wesley, 1993.

Digital Library

[4]

M. Burrows. The Chubby lock service for loosely-coupled distributed systems. In Symposium on Operating Systems Design and Implementation, pages 335--350, Nov. 2006.

Digital Library

[5]

T. D. Chandra and S. Toueg. Unreliable failure detectors for reliable distributed systems. Journal of the ACM, 43(2):225--267, March 1996.

Digital Library

[6]

F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. BigTable: A distributed storage system for structured data. In Symposium on Operating Systems Design and Implementation, pages 205--218, Nov. 2006.

Digital Library

[7]

C. Chao, R. English, D. Jacobson, A. Stepanov, and J. Wilkes. Mime: a high performance storage device with strong recovery guarantees. Technical Report HPL-CSP-92-9, HP Laboratories, Nov. 1992.

[8]

G. V. Chockler, I. Keidar, and R. Vitenberg. Group communication specifications: A comprehensive study. ACM Computing Surveys, 33(4):1--43, December 2001.

Digital Library

[9]

J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In Symposium on Operating Systems Design and Implementation, pages 137--150, Dec. 2004.

Digital Library

[10]

X. Défago, A. Schiper, and P. Urbàn. Total order broadcast and multicast algorithms: Taxonomy and survey. ACM Computing Surveys, 36(4):372--421, Dec. 2004.

Digital Library

[11]

M. Fakler, S. Frenz, R. Goeckelmann, M. Schoettner, and P. Schulthess. Project Tetropolis-application of grid computing to interactive virtual 3D worlds. In International Conference on Hypermedia and Grid Systems, May 2005.

[12]

P. Ferreira et al. Perdis: design, implementation, and use of a persistent distributed store. In Recent Advances in Distributed Systems, volume 1752 of LNCS, chapter 18. Springer-Verlag, Feb. 2000.

Digital Library

[13]

S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google file system. In Symposium on Operating Systems Principles, pages 29--43, Oct. 2003.

Digital Library

[14]

S. D. Gribble, E. A. Brewer, J. M. Hellerstein, and D. Culler. Scalable, distributed data structures for Internet service construction. In Symposium on Operating Systems Design and Implementation, pages 319--332, Oct. 2000.

Digital Library

[15]

T. Harris and K. Fraser. Language support for lightweight transactions. In Conference on Object-Oriented Programming Systems, Languages and Applications, pages 388--402, Oct. 2003.

Digital Library

[16]

M. Herlihy, V. Luchangco, M. Moir, and W. Scherer. Software transactional memory for dynamic--sized data structures. In Symposium on Principles of Distributed Computing, pages 92--101, July 2003.

Digital Library

[17]

M. Herlihy and J. E. B. Moss. Transactional memory: Architectural support for lock-free data structures. In International Symposium on Computer Architecture, pages 289--300, May 1993.

Digital Library

[18]

H.-I. Hsiao and D. DeWitt. Chained declustering: a new availability strategy for multiprocessor database machines. In International Data Engineering Conference, pages 456--465, Feb. 1990.

Digital Library

[19]

L. Lamport. The part-time parliament. ACM Transactions on Computer Systems, 16(2):133--169, May 1998.

Digital Library

[20]

B. Liskov. Distributed programming in Argus. Commununications of the ACM, 31(3):300--312, 1988.

Digital Library

[21]

B. Liskov, M. Castro, L. Shrira, and A. Adya. Providing persistent objects in distributed systems. In European Conference on Object--Oriented Programming, pages 230--257, June 1999.

Digital Library

[22]

J. MacCormick, N. Murphy, M. Najork, C. A. Thekkath, and L. Zhou. Boxwood: Abstractions as the foundation for storage infrastructure. In Symposium on Operating Systems Design and Implementation, pages 105--120, Dec. 2004.

Digital Library

[23]

P. Mehra and S. Fineberg. Fast and flexible persistence: the magic potion for fault-tolerance, scalability and performance in online data stores. In International Parallel and Distributed Processing Symposium -- Workshop 11, page 206a, Apr. 2004.

[24]

M. A. Olson. The design and implementation of the Inversion File System. In USENIX Winter Conference, pages 205--218, Jan. 1993.

[25]

RDMA Consortium. http://www.rdmaconsortium.org.

[26]

M. Satyanarayanan, J. J. Kistler, P. Kumar, M. E. Okasaki, E. H. Siegel, and D. C. Steere. Coda: A highly available file system for a distributed workstation environment. IEEE Transactions on Computers, 39(4):447--459, Apr. 1990.

Digital Library

[27]

M. Satyanarayanan, H. H. Mashburn, P. Kumar, D. C. Steere, and J. J. Kistler. Lightweight recoverable virtual memory. ACM Transactions on Computer Systems, 12(1):33--57, Feb. 1994.

Digital Library

[28]

A. Schiper and S. Toueg. From set membership to group membership: A separation of concerns. IEEE Transactions on Dependable and Secure Computing, 3(1):2--12, Feb. 2006.

Digital Library

[29]

F. B. Schmuck and J. C. Wyllie. Experience with transactions in QuickSilver. In Symposium on Operating Systems Principles, pages 239--253, Oct. 1991.

Digital Library

[30]

R. Sears and E. Brewer. Stasis: Flexible transactional storage. In Symposium on Operating Systems Design and Implementation, pages 29--44, Oct. 2006.

Digital Library

[31]

N. Shavit and D. Touitou. Software transactional memory. In Symposium on Principles of Distributed Computing, pages 204--213, Aug. 1995.

Digital Library

[32]

D. Skeen and M. Stonebraker. A formal model of crash recovery in a distributed system. IEEE Transactions on Software Engineering, 9(3):219--228, May 1983.

Digital Library

[33]

A. Z. Spector et al. Camelot: a distributed transaction facility for Mach and the Internet -- an interim report. Research paper CMU--CS--87--129, Carnegie Mellon University, Computer Science Dept., June 1987.

Cited By

Dong ZWang ZZhang XXu XZhao CChen HPanda ALi J(2023)Fine-Grained Re-Execution for Efficient Batched Commit of Distributed TransactionsProceedings of the VLDB Endowment10.14778/3594512.359452316:8(1930-1943)Online publication date: 22-Jun-2023
https://dl.acm.org/doi/10.14778/3594512.3594523
Yang LYan XWong BIves ZBonifati AEl Abbadi A(2022)Natto: Providing Distributed Transaction Prioritization for High-Contention WorkloadsProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3526161(715-729)Online publication date: 10-Jun-2022
https://dl.acm.org/doi/10.1145/3514221.3526161
Khandelwal ATang YAgarwal RAkella AStoica IBromberg YKermarrec AKozyrakis C(2022)JiffyProceedings of the Seventeenth European Conference on Computer Systems10.1145/3492321.3527539(697-713)Online publication date: 28-Mar-2022
https://dl.acm.org/doi/10.1145/3492321.3527539
Show More Cited By

Index Terms

Sinfonia: a new paradigm for building scalable distributed systems
1. Information systems
  1. Information storage systems
    1. Storage architectures
      1. Distributed storage
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

Sinfonia: A new paradigm for building scalable distributed systems

We propose a new paradigm for building scalable distributed systems. Our approach does not require dealing with message-passing protocols, a major complication in existing distributed systems. Instead, developers just design and manipulate data ...
Read More
Sinfonia: a new paradigm for building scalable distributed systems
SOSP '07

We propose a new paradigm for building scalable distributed systems. Our approach does not require dealing with message-passing protocols -- a major complication in existing distributed systems. Instead, developers just design and manipulate data ...
Read More
An approach to efficient distributed transactions

Most distributed systems proposed on the basis of the concept of atomic action or transaction strongly limit parallelism, thus reducing their level of efficiency. In this paper, features of efficiency in a distributed transaction system are ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '07: Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles

October 2007

378 pages

ISBN:9781595935915

DOI:10.1145/1294261

General Chair:
Thomas C. Bressoud
Denison University, USA
,
Program Chair:
M. Frans Kaashoek
Massachusetts Institute of Technology, USA

ACM SIGOPS Operating Systems Review Volume 41, Issue 6
SOSP '07
December 2007
363 pages
ISSN:0163-5980
DOI:10.1145/1323293
Issue’s Table of Contents

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 October 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SOSP07

Sponsor:

SOSP07: ACM SIGOPS 21st Symposium on Operating Systems Principles 2007

October 14 - 17, 2007

Washington, Stevenson, USA

Acceptance Rates

Overall Acceptance Rate 131 of 716 submissions, 18%

Upcoming Conference

SOSP '24

Sponsor:
sigops

ACM SIGOPS 30th Symposium on Operating Systems Principles

November 5 - 8, 2024

Austin , TX , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

218
Total Citations
View Citations
2,896
Total Downloads

Downloads (Last 12 months)64
Downloads (Last 6 weeks)9

Other Metrics

View Author Metrics

Citations

Cited By

Dong ZWang ZZhang XXu XZhao CChen HPanda ALi J(2023)Fine-Grained Re-Execution for Efficient Batched Commit of Distributed TransactionsProceedings of the VLDB Endowment10.14778/3594512.359452316:8(1930-1943)Online publication date: 22-Jun-2023
https://dl.acm.org/doi/10.14778/3594512.3594523
Yang LYan XWong BIves ZBonifati AEl Abbadi A(2022)Natto: Providing Distributed Transaction Prioritization for High-Contention WorkloadsProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3526161(715-729)Online publication date: 10-Jun-2022
https://dl.acm.org/doi/10.1145/3514221.3526161
Khandelwal ATang YAgarwal RAkella AStoica IBromberg YKermarrec AKozyrakis C(2022)JiffyProceedings of the Seventeenth European Conference on Computer Systems10.1145/3492321.3527539(697-713)Online publication date: 28-Mar-2022
https://dl.acm.org/doi/10.1145/3492321.3527539
Suri-Payer FBurke MWang ZZhang YAlvisi LCrooks N(2021)BasilProceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles10.1145/3477132.3483552(1-17)Online publication date: 26-Oct-2021
https://dl.acm.org/doi/10.1145/3477132.3483552
Katsarakis AMa YTan ZBainbridge ABalkwill MDragojevic AGrot BRadunovic BZhang YBarbalace ABhatotia PAlvisi LCadar C(2021)ZeusProceedings of the Sixteenth European Conference on Computer Systems10.1145/3447786.3456234(145-161)Online publication date: 21-Apr-2021
https://dl.acm.org/doi/10.1145/3447786.3456234
Coelho PPedone F(2021)GeoPaxos+: Practical Geographical State Machine Replication2021 40th International Symposium on Reliable Distributed Systems (SRDS)10.1109/SRDS53918.2021.00031(233-243)Online publication date: Sep-2021
https://doi.org/10.1109/SRDS53918.2021.00031
Lu HSen SLloyd WLu SHowell J(2020)Performance-optimal read-only transactionsProceedings of the 14th USENIX Conference on Operating Systems Design and Implementation10.5555/3488766.3488785(333-349)Online publication date: 4-Nov-2020
https://dl.acm.org/doi/10.5555/3488766.3488785
Burke MCheng ALloyd WBhagwan RPorter G(2020)GryffProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388286(591-618)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388286
Cao WLiu YCheng ZZheng NLi WWu WOuyang LWang PWang YKuan RLiu ZZhu FZhang TNoh SWelch B(2020)POLARDB meets computational storageProceedings of the 18th USENIX Conference on File and Storage Technologies10.5555/3386691.3386695(29-42)Online publication date: 24-Feb-2020
https://dl.acm.org/doi/10.5555/3386691.3386695
Fan PLiu JYin WWang HChen XSun H(2020)2PC*: a distributed transaction concurrency control protocol of multi-microservice based on cloud computing platformJournal of Cloud Computing10.1186/s13677-020-00183-w9:1Online publication date: 23-Jul-2020
https://doi.org/10.1186/s13677-020-00183-w
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents