research-article

Snowtrail: Testing with Production Queries on a Cloud Database

Authors:

Allison LeeAuthors Info & Claims

DBTest '18: Proceedings of the Workshop on Testing Database Systems

Article No.: 4, Pages 1 - 6

https://doi.org/10.1145/3209950.3209958

Published: 15 June 2018 Publication History

Get Access

Abstract

Database as a service provided on cloud computing platforms has been rapidly gaining popularity in recent years. The Snowflake Elastic Data Warehouse (henceforth referred to as Snowflake) is a cloud database service provided by Snowflake Computing. The cloud native capabilities of new database services such as Snowflake bring exciting new opportunities for database testing. First, Snowflake maintains extensive knowledge of historical customer queries, including both the query text and corresponding system configurations. Second, Snowflake is multi-tenant, which provides easy access to metadata and data that can be used to rerun customer queries from a privileged role. Furthermore, the elastic nature of Snowflake's data warehouse service allows testing with these queries using a separate set of resources without impacting the customer's production workload.

This paper presents Snowtrail, an infrastructure developed within Snowflake for testing using customer production queries with result obfuscation. Running tests with production queries provides us with direct insight into the impact of improvements and new features on customer workloads. It enables testing on queries of more shapes and complexity than can be manually constructed by developers. Snowtrail is also used to help ensure the stability of the online upgrade process of the system.

References

[1]

Benoit Dageville, Thierry Cruanes, Marcin Zukowski, Vadim Antonov, Artin Avanes, Jon Bock, Jonathan Claybaugh, Daniel Engovatov, Martin Hentschel, Jiansheng Huang, Allison W. Lee, Ashish Motivala, Abdul Q. Munir, Steven Pelley, Peter Povinec, Greg Rahn, Spyridon Triantafyllis, and Philipp Unterbrunner. 2016. The Snowflake Elastic Data Warehouse. In Proceedings of the 2016 International Conference on Management of Data (SIGMOD '16). ACM, New York, NY, USA, 215--226.

Digital Library

Google Scholar

[2]

Snowflake Documentation. 2016. Multi-cluster Warehouses. (2016). https://docs.snowflake.net/manuals/user-guide/warehouses-multicluster.html

Google Scholar

[3]

Leonidas Galanis, Supiti Buranawatanachoke, Romain Colle, Benoît Dageville, Karl Dias, Jonathan Klein, Stratos Papadomanolakis, Leng Leng Tan, Venkateshwaran Venkataramani, Yujun Wang, et al. 2008. Oracle database replay. In Proceedings of the 2008 ACM SIGMOD international conference on Management of data. ACM, 1159--1170.

Digital Library

Google Scholar

[4]

S. Jain, B. Howe, J. Yan, and T. Cruanes. 2018. Query2Vec: An Evaluation of NLP Techniques for Generalized Workload Analytics. ArXiv e-prints (Jan. 2018). arXiv:cs.DB/1801.05613

Google Scholar

[5]

Trupti M Kodinariya and Prashant R Makwana. 2013. Review on determining number of Cluster in K-Means Clustering. International Journal 1, 6 (2013), 90--95.

Google Scholar

[6]

Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, Nov (2008), 2579--2605.

Google Scholar

[7]

Ming-Chuan Wu, Jingren Zhou, Nicolas Bruno, Yu Zhang, and Jon Fowler. 2012. Scope Playback: Self-validation in the Cloud. In Proceedings of the Fifth International Workshop on Testing Database Systems (DBTest '12). ACM, New York, NY, USA, Article 3, 6 pages.

Digital Library

Google Scholar

[8]

Khaled Yagoub, Peter Belknap, Benoit Dageville, Karl Dias, Shantanu Joshi, and Hailing Yu. 2008. Oracle's SQL Performance Analyzer. (2008).

Google Scholar

Cited By

View all

Zhuang ZLi PMa PMeng WWang S(2024)Testing Graph Database Systems via Graph-Aware Metamorphic RelationsProceedings of the VLDB Endowment10.14778/3636218.363623617:4(836-848)Online publication date: 5-Mar-2024
https://dl.acm.org/doi/10.14778/3636218.3636236
Ba JRigger M(2024)Keep It Simple: Testing Databases via Differential Query PlansProceedings of the ACM on Management of Data10.1145/36549912:3(1-26)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3654991
Lee WHa JHan WPark CPark MHan JLee J(2024)DoppelGanger++: Towards Fast Dependency Graph Generation for Database ReplayProceedings of the ACM on Management of Data10.1145/36393222:1(1-26)Online publication date: 26-Mar-2024
https://dl.acm.org/doi/10.1145/3639322
Show More Cited By

Index Terms

Snowtrail: Testing with Production Queries on a Cloud Database
1. Information systems
  1. Data management systems
    1. Database administration
      1. Database utilities and tools
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation

Recommendations

Parallel analytics as a service
SIGMOD '13: Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data

Recently, massively parallel processing relational database systems (MPPDBs) have gained much momentum in the big data analytic market. With the advent of hosted cloud computing, we envision that the offering of MPPDB-as-a-Service (MPPDBaaS) will become ...
LAYER

A novel and cost-efficient mechanism is proposed to support multi-tenant database as a service (MTDBaaS) in cloud for small businesses, so that high data consolidation, good system scalability and low operational cost could be achieved by service ...
Thrifty: Offering Parallel Database as a Service using the Shared-Process Approach
SIGMOD '15: Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data

Recently, Amazon has announced Redshift, a Parallel-Database-as-a Service (PDaaS). Redshift adopts the "virtual cluster" approach to implement multitenancy, which has the merit of hard isolation among tenants (i.e., tenants do not interfere even when ...

Comments

Information & Contributors

Information

Published In

DBTest '18: Proceedings of the Workshop on Testing Database Systems

June 2018

49 pages

ISBN:9781450358262

DOI:10.1145/3209950

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

SIGMOD/PODS '18

Sponsor:

SIGMOD

SIGMOD/PODS '18: International Conference on Management of Data

June 15, 2018

TX, Houston, USA

Acceptance Rates

Overall Acceptance Rate 31 of 56 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
380
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)3

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhuang ZLi PMa PMeng WWang S(2024)Testing Graph Database Systems via Graph-Aware Metamorphic RelationsProceedings of the VLDB Endowment10.14778/3636218.363623617:4(836-848)Online publication date: 5-Mar-2024
https://dl.acm.org/doi/10.14778/3636218.3636236
Ba JRigger M(2024)Keep It Simple: Testing Databases via Differential Query PlansProceedings of the ACM on Management of Data10.1145/36549912:3(1-26)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3654991
Lee WHa JHan WPark CPark MHan JLee J(2024)DoppelGanger++: Towards Fast Dependency Graph Generation for Database ReplayProceedings of the ACM on Management of Data10.1145/36393222:1(1-26)Online publication date: 26-Mar-2024
https://dl.acm.org/doi/10.1145/3639322
Ba JRigger MRoychoudhury APaiva AAbreu RStorey M(2024)CERT: Finding Performance Issues in Database Systems Through the Lens of Cardinality EstimationProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639076(1-13)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639076
Tiwari DMonperrus MBaudry B(2024)Mimicking Production Behavior With Generated MocksIEEE Transactions on Software Engineering10.1109/TSE.2024.345844850:11(2921-2946)Online publication date: Nov-2024
https://doi.org/10.1109/TSE.2024.3458448
Shi LLi TWei LTao YLi CGao Y(2023)FASTune: Towards Fast and Stable Database Tuning System with Reinforcement LearningElectronics10.3390/electronics1210216812:10(2168)Online publication date: 10-May-2023
https://doi.org/10.3390/electronics12102168
Ba JRigger MGrundy JPollock LPenta M(2023)Testing Database Engines via Query Plan GuidanceProceedings of the 45th International Conference on Software Engineering10.1109/ICSE48619.2023.00174(2060-2071)Online publication date: 14-May-2023
https://dl.acm.org/doi/10.1109/ICSE48619.2023.00174
Tang JDruckman RMagarshack LMcNamara NAhn JYan J(2023)Smart Query Sampling with Feature Coverage and Unsupervised Machine Learning2023 10th International Conference on Future Internet of Things and Cloud (FiCloud)10.1109/FiCloud58648.2023.00036(193-198)Online publication date: 14-Aug-2023
https://doi.org/10.1109/FiCloud58648.2023.00036
Deep SGruenheid ANagaraj KNaito HNaughton JViglas S(2022)DIAMETRICSCommunications of the ACM10.1145/356746465:12(105-112)Online publication date: 22-Nov-2022
https://dl.acm.org/doi/10.1145/3567464
Saito TTakezoe NOkada YShimamoto TYu DChandrashekharachar SSasaki KOkumiya SWang YKurihara TKobayashi RSuzuki KYang ZOnizuka MRigger MTözün P(2022)Journey of Migrating Millions of Queries on The CloudProceedings of the 2022 workshop on 9th International Workshop of Testing Database Systems10.1145/3531348.3532177(10-16)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3531348.3532177
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Parallel analytics as a service

LAYER

Thrifty: Offering Parallel Database as a Service using the Shared-Process Approach

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations