Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1807085.1807100acmconferencesArticle/Chapter ViewAbstractPublication PagespodsConference Proceedingsconference-collections
research-article

Incremental query evaluation in a ring of databases

Published: 06 June 2010 Publication History

Abstract

This paper approaches the incremental view maintenance problem from an algebraic perspective. We construct the algebraic structure of a ring of databases and use it as the foundation of the design of a query calculus that allows to express powerful aggregate queries. The query calculus inherits key properties of the ring, such as having a normal form of polynomials and being closed under computing inverses and delta queries. The k-th delta of a polynomial query of degree k without nesting is purely a function of the update, not of the database. This gives rise to a method of eliminating expensive query operators such as joins from programs that perform incremental view maintenance. The main result is that, for non-nested queries, each individual aggregate value can be incrementally maintained using a constant amount of work. This is not possible for nonincremental evaluation.

References

[1]
S. Abiteboul, R. Hull, and V. Vianu. Foundations of Databases. Addison-Wesley, 1995.
[2]
U. A. Acar, G. E. Blelloch, and R. Harper. Adaptive functional programming. ACM Trans. Program. Lang. Syst., 28(6):990--1034, 2006.
[3]
Y. Ahmad and C. Koch. DBToaster: A SQL compiler for high-performance delta processing in main-memory databases. PVLDB, 2(2):1566--1569, 2009.
[4]
D. A. M. Barrington, N. Immerman, and H. Straubing. On uniformity within NC1. J. Comput. Syst. Sci., 41(3):274--306, 1990.
[5]
J. A. Blakeley, P.-Å. Larson, and F. W. Tompa. Efficiently updating materialized views. In Proc. SIGMOD Conference, pages 61--71, 1986.
[6]
R. P. Brent. The parallel evaluation of general arithmetic expressions. J. ACM, 21:201--206, 1974.
[7]
P. Buneman and E. K. Clemons. Efficient monitoring relational databases. ACM Trans. Database Syst., 4(3):368--382, 1979.
[8]
S. Ceri and J. Widom. Deriving production rules for incremental view maintenance. In Proc. VLDB, pages 577--589, 1991.
[9]
L. S. Colby, T. Griffin, L. Libkin, I. S. Mumick, and H. Trickey. Algorithms for deferred view maintenance. In Proc. SIGMOD, pages 469--480, 1996.
[10]
A. J. Demers, T. W. Reps, and T. Teitelbaum. Incremental evaluation for attribute grammars with application to syntax-directed editors. In Proc. POPL, pages 105--116, 1981.
[11]
G. Dong and J. Su. Incremental and decremental evaluation of transitive closure by first-order queries. Inf. Comput., 120(1):101--106, 1995.
[12]
D. S. Dummit and R. M. Foote. Abstract Algebra. John Wiley & Sons, 3rd edition, 2004.
[13]
S. Ghandeharizadeh, R. Hull, and D. Jacobs. Heraclitus: Elevating deltas to be first-class citizens in a database programming language. ACM Transactions on Database Systems, 21(3):370--426, Sept. 1996.
[14]
T. J. Green, Z. Ives, and V. Tannen. Reconcilable differences. In Proc. ICDT, St. Petersburg, Russia, 2009.
[15]
T. J. Green, G. Karvounarakis, and V. Tannen. Provenance semirings. In Proc. PODS, pages 31--40, 2007.
[16]
T. Griffin and L. Libkin. Incremental maintenance of views with duplicates. In Proc. SIGMOD, 1995.
[17]
A. Gupta, D. Katiyar, and I. S. Mumick. Counting solutions to the view maintenance problem. In Proc. Workshop on Deductive Databases, JICSLP, 1992.
[18]
A. Gupta, I. S. Mumick, and V. S. Subrahmanian. Maintaining views incrementally. In Proc. SIGMOD Conference, pages 157--166, 1993.
[19]
L. Henkin, J. Monk, and A. Tarski. Cylindric Algebras, Part I. North-Holland, 1971.
[20]
W. Hesse. The dynamic complexity of transitive closure is in DynTC0. Theor. Comput. Sci., 296(3):473--485, 2003.
[21]
W. Hesse and N. Immerman. Complete problems for dynamic complexity classes. In Proc. LICS, 2002.
[22]
D. S. Johnson. A catalog of complexity classes. In J. van Leeuwen, editor, Handbook of Theoretical Computer Science, volume 1, chapter 2, pages 67--161. Elsevier Science Publishers B.V., 1990.
[23]
Y. Kotidis and N. Roussopoulos. A case for dynamic view management. ACM Transactions on Database Systems, 26(4):388--423, 2001.
[24]
S. Lang. Algebra. Graduate Texts in Mathematics. Springer-Verlag, revised 3rd edition, 2002.
[25]
L. Libkin and L. Wong. Some properties of query languages for bags. In Proc. DBPL, pages 97--114, 1993.
[26]
L. Libkin and L. Wong. Incremental recomputation of recursive queries with nested sets and aggregate functions. In Proc. DBPL, pages 222--238, 1997.
[27]
L. Libkin and L. Wong. On the power of incremental evaluation in SQL-like languages. In Proc. DBPL, pages 17--30, 1999.
[28]
P. B. Miltersen, S. Subramanian, J. S. Vitter, and R. Tamassia. Complexity models for incremental computation. Theor. Comput. Sci., 130(1):203--236, 1994.
[29]
S. Patnaik and N. Immerman. Dyn-FO: A parallel, dynamic complexity class. J. Comput. Syst. Sci., 55(2):199--209, 1997.
[30]
W. Pugh and T. Teitelbaum. Incremental computation via function caching. In Proc. POPL, 1989.
[31]
A. Rajaraman, Y. Sagiv, and J. D. Ullman. Answering queries using templates with binding patterns. In Proc. PODS, pages 105--112, 1995.
[32]
N. Roussopoulos. An incremental access method for viewcache: Concept, algorithms, and cost analysis. ACM Transactions on Database Systems, 16(3):535--563, 1991.
[33]
O. Shmueli and A. Itai. Maintenance of views. In B. Yormark, editor, Proc. SIGMOD, pages 240--255. ACM Press, 1984.
[34]
R. Smolenski. Algebraic methods in the theory of lower bounds for boolean circuit complexity. In Proc. STOC, pages 77--82, 1987.
[35]
M. Y. Vardi. The complexity of relational query languages. In Proc. STOC, pages 137--146, May 1982.
[36]
W. P. Yan and P.-Å. Larson. Eager aggregation and lazy aggregation. In Proc. VLDB, pages 345--357, 1995.

Cited By

View all
  • (2024)Insert-Only versus Insert-Delete in Dynamic Query EvaluationProceedings of the ACM on Management of Data10.1145/36958372:5(1-26)Online publication date: 7-Nov-2024
  • (2024)DBSP: Incremental Computation on Streams and Its Applications to DatabasesACM SIGMOD Record10.1145/3665252.366527153:1(87-95)Online publication date: 14-May-2024
  • (2024)In-depth Analysis of Continuous Subgraph Matching in a Common Delta Query Compilation FrameworkProceedings of the ACM on Management of Data10.1145/36549502:3(1-27)Online publication date: 30-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
PODS '10: Proceedings of the twenty-ninth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
June 2010
350 pages
ISBN:9781450300339
DOI:10.1145/1807085
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. algebra
  2. incremental view maintenance

Qualifiers

  • Research-article

Conference

SIGMOD/PODS '10
Sponsor:
SIGMOD/PODS '10: International Conference on Management of Data
June 6 - 11, 2010
Indiana, Indianapolis, USA

Acceptance Rates

PODS '10 Paper Acceptance Rate 27 of 113 submissions, 24%;
Overall Acceptance Rate 642 of 2,707 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)46
  • Downloads (Last 6 weeks)7
Reflects downloads up to 18 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Insert-Only versus Insert-Delete in Dynamic Query EvaluationProceedings of the ACM on Management of Data10.1145/36958372:5(1-26)Online publication date: 7-Nov-2024
  • (2024)DBSP: Incremental Computation on Streams and Its Applications to DatabasesACM SIGMOD Record10.1145/3665252.366527153:1(87-95)Online publication date: 14-May-2024
  • (2024)In-depth Analysis of Continuous Subgraph Matching in a Common Delta Query Compilation FrameworkProceedings of the ACM on Management of Data10.1145/36549502:3(1-27)Online publication date: 30-May-2024
  • (2024)In-Database Data ImputationProceedings of the ACM on Management of Data10.1145/36393262:1(1-27)Online publication date: 26-Mar-2024
  • (2024)Recent Increments in Incremental View MaintenanceCompanion of the 43rd Symposium on Principles of Database Systems10.1145/3635138.3654763(8-17)Online publication date: 9-Jun-2024
  • (2023)DBSP: Automatic Incremental View Maintenance for Rich Query LanguagesProceedings of the VLDB Endowment10.14778/3587136.358713716:7(1601-1614)Online publication date: 8-May-2023
  • (2023)Scalable Spreadsheet-Driven End-User Applications with Incremental ComputationProceedings of the 2023 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software10.1145/3622758.3622887(1-14)Online publication date: 18-Oct-2023
  • (2023)Hyper-Relations: A Model for Denormalization of Transactional Relational DatabasesIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2021.312413435:4(3979-3990)Online publication date: 1-Apr-2023
  • (2023)F-IVM: analytics over relational databases under updatesThe VLDB Journal10.1007/s00778-023-00817-w33:4(903-929)Online publication date: 14-Nov-2023
  • (2023)Tempura: a general cost-based optimizer framework for incremental data processing (Journal Version)The VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-023-00785-132:6(1315-1342)Online publication date: 20-Mar-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media