article

F1: a distributed SQL database that scales

Authors:

Radek Vingralek,

Kyle Littlefield,

David Menestrina,

Stephan Ellner,

John Cieslewicz,

Traian Stancescu,

Himani ApteAuthors Info & Claims

Proceedings of the VLDB Endowment, Volume 6, Issue 11

Pages 1068 - 1079

https://doi.org/10.14778/2536222.2536232

Published: 01 August 2013 Publication History

Abstract

F1 is a distributed relational database system built at Google to support the AdWords business. F1 is a hybrid database that combines high availability, the scalability of NoSQL systems like Bigtable, and the consistency and usability of traditional SQL databases. F1 is built on Spanner, which provides synchronous cross-datacenter replication and strong consistency. Synchronous replication implies higher commit latency, but we mitigate that latency by using a hierarchical schema model with structured data types and through smart application design. F1 also includes a fully functional distributed SQL query engine and automatic change tracking and publishing.

References

[1]

Apache Foundation. Apache HBase. http://hbase.apache.org/.

[2]

M. Atkinson et al. The object-oriented database system manifesto. In F. Bancilhon, C. Delobel, and P. Kanellakis, editors, Building an object-oriented database system, pages 1-20. Morgan Kaufmann, 1992.

[3]

J. Baker et al. Megastore: Providing scalable, highly available storage for interactive services. In CIDR, pages 223-234, 2011.

[4]

H. Berenson et al. A critique of ANSI SQL isolation levels. In SIGMOD, 1995.

[5]

E. A. Brewer. Towards robust distributed systems (abstract). In PODC, 2000.

[6]

F. Chang et al. Bigtable: A distributed storage system for structured data. In OSDI, 2006.

[7]

J. C. Corbett et al. Spanner: Google's globally-distributed database. In OSDI, 2012.

[8]

S. Das et al. ElasTraS: An elastic, scalable, and self-managing transactional database for the cloud. TODS, 38(1):5:1-5:45, Apr. 2013.

[9]

J. Dean. Evolution and future directions of large-scale storage and computation systems at Google. In SOCC, 2010.

[10]

J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. In OSDI, 2004.

[11]

G. DeCandia et al. Dynamo: Amazon's highly available key-value store. In SOSP, 2007.

[12]

D. J. Dewitt et al. The Gamma database machine project. TKDE, 2(1):44-62, Mar. 1990.

[13]

K. P. Eswaran et al. The notions of consistency and predicate locks in a database system. CACM, 19(11):624-633, Nov. 1976.

[14]

A. Fikes. Storage architecture and challenges. Google Faculty Summit, July 2010.

[15]

R. Goldman and J. Widom. WSQ/DSQ: A practical approach for combined querying of databases and the web. In SIGMOD, 2000.

[16]

Google, Inc. Protocol buffers. https://developers.google.com/protocol-buffers/.

[17]

T. Kraska et al. MDCC: Multi-data center consistency. In EuroSys, 2013.

[18]

L. Lamport. The part-time parliament. ACM Trans. Comput. Syst., 16(2):133-169, May 1998.

[19]

D. Peng and F. Dabek. Large-scale incremental processing using distributed transactions and notifications. In OSDI, 2010.

[20]

I. Rae et al. Online, asynchronous schema change in F1. PVLDB, 6(11), 2013.

[21]

M. A. Roth et al. Extended algebra and calculus for nested relational databases. ACM Trans. Database Syst., 13(4):389-417, Oct. 1988.

[22]

J. Shute et al. F1: The fault-tolerant distributed RDBMS supporting Google's ad business. In SIGMOD, 2012.

[23]

M. Stonebraker. SQL databases v. NoSQL databases. CACM, 53(4), 2010.

[24]

G. Weikum and G. Vossen. Transactional Information Systems. Morgan Kaufmann, 2002.

Cited By

Liu SMultazzu LWei HBasin D(2024)NOC-NOC: Towards Performance-optimal Distributed TransactionsProceedings of the ACM on Management of Data10.1145/36392642:1(1-25)Online publication date: 26-Mar-2024
https://dl.acm.org/doi/10.1145/3639264
Ma KLi CZhu EChen RYan FChen K(2024)Noctua: Towards Automated and Practical Fine-grained Consistency AnalysisProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3629570(704-719)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3629570
Aldailamy AMuhammed ALatip RHamid NIsmail W(2024)Online dynamic replication and placement algorithms for cost optimization of online social networks in two-tier multi-cloudJournal of Network and Computer Applications10.1016/j.jnca.2024.103827224:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.jnca.2024.103827
Show More Cited By

F1: a distributed SQL database that scales
1. Information systems
  1. Data management systems
    1. Database management system engines

Recommendations

F1: the fault-tolerant distributed RDBMS supporting google's ad business
SIGMOD '12: Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data

Many of the services that are critical to Google's ad business have historically been backed by MySQL. We have recently migrated several of these services to F1, a new RDBMS developed at Google. F1 implements rich relational database features, including ...
Online, asynchronous schema change in F1

We introduce a protocol for schema evolution in a globally distributed database management system with shared data, stateless servers, and no global membership. Our protocol is asynchronous--it allows different servers in the database system to ...
Confidence interval for micro-averaged F₁ and macro-averaged F₁ scores
Abstract
A binary classification problem is common in medical field, and we often use sensitivity, specificity, accuracy, negative and positive predictive values as measures of performance of a binary predictor. In computer science, a classifier is usually ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the VLDB Endowment

Proceedings of the VLDB Endowment Volume 6, Issue 11

August 2013

237 pages

ISSN:2150-8097

Issue’s Table of Contents

Publisher

VLDB Endowment

Publication History

Published: 01 August 2013

Published in PVLDB Volume 6, Issue 11

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

111
Total Citations
View Citations
1,378
Total Downloads

Downloads (Last 12 months)122
Downloads (Last 6 weeks)28

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu SMultazzu LWei HBasin D(2024)NOC-NOC: Towards Performance-optimal Distributed TransactionsProceedings of the ACM on Management of Data10.1145/36392642:1(1-25)Online publication date: 26-Mar-2024
https://dl.acm.org/doi/10.1145/3639264
Ma KLi CZhu EChen RYan FChen K(2024)Noctua: Towards Automated and Practical Fine-grained Consistency AnalysisProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3629570(704-719)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3629570
Aldailamy AMuhammed ALatip RHamid NIsmail W(2024)Online dynamic replication and placement algorithms for cost optimization of online social networks in two-tier multi-cloudJournal of Network and Computer Applications10.1016/j.jnca.2024.103827224:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.jnca.2024.103827
Zhao HLi JLu WZhang QYang WZhong JZhang MLi HDu XPan A(2024)RCBench: an RDMA-enabled transaction framework for analyzing concurrency control algorithmsThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-023-00821-033:2(543-567)Online publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1007/s00778-023-00821-0
Margara ACugola GFelicioni NCilloni S(2023)A Model and Survey of Distributed Data-Intensive SystemsACM Computing Surveys10.1145/360480156:1(1-69)Online publication date: 26-Aug-2023
https://dl.acm.org/doi/10.1145/3604801
Do TGraefe G(2023)Robust and Efficient Sorting with Offset-value CodingACM Transactions on Database Systems10.1145/357095648:1(1-23)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3570956
Do TGraefe GNaughton J(2023)Efficient Sorting, Duplicate Removal, Grouping, and AggregationACM Transactions on Database Systems10.1145/356802747:4(1-35)Online publication date: 6-Jan-2023
https://dl.acm.org/doi/10.1145/3568027
Sagkriotis SPezaros D(2022)Scalable Data Plane Caching for KubernetesProceedings of the 18th International Conference on Network and Service Management10.5555/3581644.3581727(1-7)Online publication date: 31-Oct-2022
https://dl.acm.org/doi/10.5555/3581644.3581727
Yang ZYang CHan FZhuang MYang BYang ZCheng XZhao YShi WXi HYu HLiu BPan YYin BChen JXu Q(2022)OceanBaseProceedings of the VLDB Endowment10.14778/3554821.355483015:12(3385-3397)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.14778/3554821.3554830
Jindal ALeeka J(2022)Query Optimizer as a ServiceACM SIGMOD Record10.1145/3572751.357276751:3(49-55)Online publication date: 21-Nov-2022
https://dl.acm.org/doi/10.1145/3572751.3572767
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents