short-paper

Open access

RASQL: A Powerful Language and its System for Big Data Applications

Authors:

Carlo ZanioloAuthors Info & Claims

SIGMOD '20: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data

Pages 2673 - 2676

https://doi.org/10.1145/3318464.3384677

Published: 31 May 2020 Publication History

PDF eReader

Abstract

There is a growing interest in supporting advanced Big Data applications on distributed data processing platforms. Most of these systems support SQL or its dialect as the query interface due to its portability and declarative nature. However, current SQL standard cannot effectively express advanced analytical queries due to its limitation in supporting recursive queries. In this demonstration, we show that this problem can be resolved via a simple SQL extension that delivers greater expressive power by allowing aggregates in recursion. To this end, we propose the Recursive-aggregate-SQL (RASQL) language and its system on top of Apache Spark to express and execute complex queries and declarative algorithms in many applications, such as graph search and machine learning. With a variety of examples, we will (i) show how complicated analytic queries can be expressed with RASQL; (ii) illustrate formal semantics of the powerful new constructs; and (iii) present a user-friendly interface to interact with the RASQL system and monitor the query results.

References

[1]

M. Armbrust, R. S. Xin, and C. L. et al. Spark SQL: relational data processing in spark. In SIGMOD, pages 1383--1394, 2015.

Digital Library

Google Scholar

[2]

F. Arni, K. Ong, S. Tsur, H. Wang, and C. Zaniolo. The deductive database system LDL+. TPLP, 3(1):61--94, 2003.

Digital Library

Google Scholar

[3]

A. Das, Y. Li, J. Wang, M. Li, and C. Zaniolo. Bigdata applications from graph analytics to machine learning by aggregates in recursion. In ICLP, pages 273--279, 2019.

Crossref

Google Scholar

[4]

J. Gu, Y. Watanabe, W. Mazza, A. Shkapsky, M. Yang, L. Ding, and C. Zaniolo. Rasql: Greater power and performance for big data analytics with recursive-aggregate-sql on spark. In SIGMOD, pages 467--484, 2019.

Digital Library

Google Scholar

[5]

K. W. Ong, Y. Papakonstantinou, and R. Vernoux. The SQL+ semi-structured data model and query language: A capabilities survey of sql-on-hadoop, nosql and newsql databases. CoRR, abs/1405.3631, 2014.

Google Scholar

[6]

M. Stonebraker, D. J. Abadi, D. J. DeWitt, S. Madden, E. Paulson, A. Pavlo, and A. Rasin. Mapreduce and parallel dbmss: friends or foes? Commun. ACM, 53(1):64--71, 2010.

Digital Library

Google Scholar

[7]

C. Zaniolo, A. Das, J. Gu, Y. Li, M. Li, and J. Wang. Monotonic properties of completed aggregates in recursive queries. CoRR, abs/1910.08888, 2019.

Google Scholar

[8]

C. Zaniolo, M. Yang, A. Das, A. Shkapsky, T. Condie, and M. Interlandi. Fixpoint semantics and optimization of recursive datalog programs with aggregates. TPLP, 17(5--6):1048--1065, 2017.

Google Scholar

Cited By

View all

Sahebolamri ABarrett LMoore SMicinski K(2023)Bring Your Own Data Structures to DatalogProceedings of the ACM on Programming Languages10.1145/36228407:OOPSLA2(1198-1223)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3622840
Sun YKumar SGilray TMicinski K(2023)Communication-Avoiding Recursive Aggregation2023 IEEE International Conference on Cluster Computing (CLUSTER)10.1109/CLUSTER52292.2023.00024(197-208)Online publication date: 31-Oct-2023
https://doi.org/10.1109/CLUSTER52292.2023.00024
Li YWang JLi MDas AGu JZaniolo C(2021)KDDLog:Performance and Scalability in Knowledge Discovery by Declarative Queries with Aggregates2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00113(1260-1271)Online publication date: Apr-2021
https://doi.org/10.1109/ICDE51399.2021.00113
Show More Cited By

Index Terms

RASQL: A Powerful Language and its System for Big Data Applications
1. Information systems
  1. Data management systems

Recommendations

RaSQL: Greater Power and Performance for Big Data Analytics with Recursive-aggregate-SQL on Spark
SIGMOD '19: Proceedings of the 2019 International Conference on Management of Data

Thanks to a simple SQL extension, Recursive-aggregate-SQL (RaSQL) can express very powerful queries and declarative algorithms, such as classical graph algorithms and data mining algorithms. A novel compiler implementation allows RaSQL to map ...
HIFUN - a high level functional query language for big data analytics

We present a high level query language, called HIFUN, for defining analytic queries over big datasets, independently of how these queries are evaluated. An analytic query in HIFUN is defined to be a well-formed expression of a functional algebra that we ...
Big data and ICT applications: A study
ICTCS '16: Proceedings of the Second International Conference on Information and Communication Technology for Competitive Strategies

Big Data is used to manage the data due to their large size and complexity, because it can't be handled with the traditional methods and the current technology or tools used for that. Big Data mining is populated with 5 V's volume, variability, velocity,...

Comments

Information & Contributors

Information

Published In

SIGMOD '20: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data

June 2020

2925 pages

ISBN:9781450367356

DOI:10.1145/3318464

General Chairs:
David Maier
Portland State University, USA
,
Rachel Pottinger
University of British Columbia, Canada
,
Program Chairs:
AnHai Doan
University of Wisconsin, USA
,
Wang-Chiew Tan
Megagon Labs, USA
,
Publications Chairs:
Abdussalam Alawini
University of Illinois at Urbana-Champaign, USA
,
Hung Q. Ngo
RelationalAI, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 May 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

SIGMOD/PODS '20

Sponsor:

SIGMOD

SIGMOD/PODS '20: International Conference on Management of Data

June 14 - 19, 2020

OR, Portland, USA

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
625
Total Downloads

Downloads (Last 12 months)121
Downloads (Last 6 weeks)11

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sahebolamri ABarrett LMoore SMicinski K(2023)Bring Your Own Data Structures to DatalogProceedings of the ACM on Programming Languages10.1145/36228407:OOPSLA2(1198-1223)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3622840
Sun YKumar SGilray TMicinski K(2023)Communication-Avoiding Recursive Aggregation2023 IEEE International Conference on Cluster Computing (CLUSTER)10.1109/CLUSTER52292.2023.00024(197-208)Online publication date: 31-Oct-2023
https://doi.org/10.1109/CLUSTER52292.2023.00024
Li YWang JLi MDas AGu JZaniolo C(2021)KDDLog:Performance and Scalability in Knowledge Discovery by Declarative Queries with Aggregates2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00113(1260-1271)Online publication date: Apr-2021
https://doi.org/10.1109/ICDE51399.2021.00113
Wang JWu JLi MGu JDas AZaniolo C(2021)Formal semantics and high performance in declarative machine learning using DatalogThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-021-00665-630:5(859-881)Online publication date: 31-May-2021
https://dl.acm.org/doi/10.1007/s00778-021-00665-6
Zaniolo CDas ALi YLi MWang J(2020)Proceedings 36th International Conference on Logic Programming (Technical Communications)Electronic Proceedings in Theoretical Computer Science10.4204/EPTCS.325.9325(35-37)Online publication date: 19-Sep-2020
https://doi.org/10.4204/EPTCS.325.9

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

RaSQL: Greater Power and Performance for Big Data Analytics with Recursive-aggregate-SQL on Spark

HIFUN - a high level functional query language for big data analytics

Big data and ICT applications: A study

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

PDF

eReader

Login options

Full Access

Abstract

References

Cited By

Index Terms

Recommendations

RaSQL: Greater Power and Performance for Big Data Analytics with Recursive-aggregate-SQL on Spark

HIFUN - a high level functional query language for big data analytics

Big data and ICT applications: A study

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations