article

Free access

An array-based algorithm for simultaneous multidimensional aggregates

Authors:

Prasad M. Deshpande,

Jeffrey F. NaughtonAuthors Info & Claims

ACM SIGMOD Record, Volume 26, Issue 2

Pages 159 - 170

https://doi.org/10.1145/253262.253288

Published: 01 June 1997 Publication History

Abstract

Computing multiple related group-bys and aggregates is one of the core operations of On-Line Analytical Processing (OLAP) applications. Recently, Gray et al. [GBLP95] proposed the “Cube” operator, which computes group-by aggregations over all possible subsets of the specified dimensions. The rapid acceptance of the importance of this operator has led to a variant of the Cube being proposed for the SQL standard. Several efficient algorithms for Relational OLAP (ROLAP) have been developed to compute the Cube. However, to our knowledge there is nothing in the literature on how to compute the Cube for Multidimensional OLAP (MOLAP) systems, which store their data in sparse arrays rather than in tables. In this paper, we present a MOLAP algorithm to compute the Cube, and compare it to a leading ROLAP algorithm. The comparison between the two is interesting, since although they are computing the same function, one is value-based (the ROLAP algorithm) whereas the other is position-based (the MOLAP algorithm). Our tests show that, given appropriate compression techniques, the MOLAP algorithm is significantly faster than the ROLAP algorithm. In fact, the difference is so pronounced that this MOLAP algorithm may be useful for ROLAP systems as well as MOLAP systems, since in many cases, instead of cubing a table directly, it is faster to first convert the table to an array, cube the array, then convert the result back to a table.

References

[1]

S. Agarwal, R. Agrawal, P. Deshpande, J. Naughton, S. Sarawagi and R. Ramakrishnan. "On the Computation of Multidimensional Aggregates'. In Proceedings of the P$nd International Conference on Very Large Databases, Mumbai (Bombay), 1996.

Digital Library

[2]

Arbor Software. "The Role of the Multidimensional Database in a Data Warehousing Solution". White Paper, Arbor Software. http://www.arborsoft.com/papers/wareWOC.html

[3]

E.F. Codd, S.B. Codd, and C.T. Salley. "Providing OLAP (On-line Analytical Processing) to User-Analysts: An IT Mandate", White Paper, E.F. Codd and Associates. ht tp://w w w.arb orsoft .com/ papers / coddWO C. ht m 1

[4]

D. Dewitt, R. Katz, G. Olken, L. Shapiro, M. Stonebraker, D. Wood. "Implementation Techniques for Main Memory Database Systems". In Proceedings of SIGMOD, Boston, 1984.

Digital Library

[5]

J. Gray, A. Bosworth, A.Layman, and H.Pirahesh. "Data Cube: A relational aggregation operator generalizing group-by, cross-tabs and sub-totals. Technical Report MSR-TR-95-22, Microsoft Research, Advance Technology Division, Microsoft Corporation, Redmond, 1995.

[6]

G. Colliad. "OLAP, Relational, and Multidimensional Database Systems". SIGMOD Record, Vol. 25. No. 3, September 1996.

Digital Library

[7]

Information Advantage. "OLAP- Scaling to the Masses". White Paper, Information Advantage. http: / / www. infoad van .com /

[8]

Stanford Technology Group, Inc. "INFORMIX- MetaCube". Product Brochure. http://www.in formlx.com/in formix/products / new.plo / stgbroch / brochure.html

[9]

MicroStrategy Incorporated. "The Case For Relational OLAP". White Paper, MicroStrategy Incorporated. htt p: / / www.strategy.com / dwf/wp.b_al .html

[10]

Oracle Corporation. "Oracle OLAP Products". White Paper, Oracle Corporation. htt p: / / w w w.o racle, corn / prod ucts / collat rl/olapwp.p d f

[11]

Pilot Software. "An Introduction to OLAP'. White Paper, Pilot Software. http://w ww. pilotsw .corn/r .an d_t/wht paper/olap/olap, htm

[12]

Arbor Software Corporation, Robert J. Earle, U.S.Patent # 5359724

[13]

Sunita Sarawagi, Michael Stonebraker, "Efficient Organization of Large Multidimensional Arrays". In Proceedings of the Eleventh International Conference on Data Engineering, Houston, TX, February 1994.

Digital Library

[14]

T.A. Welch. "A Technique for High-Performance Data Compression". IEEE Computer, 17(6), 1984.

[15]

Y.H. Zhao, K. Tufte, and J.F. Naughton. "On the Performance of an Array-Based ADT for OLAP Workloads". Technical Report CS-TR-96- 1313, University of Wisconsin-Madison, CS Department, May 1996.

Cited By

Kuiper LMühleisen H(2023)These Rows Are Made for Sorting and That’s Just What We’ll Do2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00159(2050-2062)Online publication date: Apr-2023
https://doi.org/10.1109/ICDE55515.2023.00159
Rimi RHasan KTsuji T(2023)Multidimensional query processing algorithm by dimension transformationScientific Reports10.1038/s41598-023-31758-713:1Online publication date: 11-Apr-2023
https://doi.org/10.1038/s41598-023-31758-7
Dhana Sree Devi KAshwini PAnil Kumar NSwathy J(2023)Signature Proxy: An Efficient View Management Under Distributed ArchitectureProceedings of the 2nd International Conference on Cognitive and Intelligent Computing10.1007/978-981-99-2746-3_40(389-406)Online publication date: 2-Oct-2023
https://doi.org/10.1007/978-981-99-2746-3_40
Show More Cited By

Index Terms

An array-based algorithm for simultaneous multidimensional aggregates

Recommendations

An array-based algorithm for simultaneous multidimensional aggregates
SIGMOD '97: Proceedings of the 1997 ACM SIGMOD international conference on Management of data

Computing multiple related group-bys and aggregates is one of the core operations of On-Line Analytical Processing (OLAP) applications. Recently, Gray et al. [GBLP95] proposed the “Cube” operator, which computes group-by aggregations over all possible ...
Management of Multidimensional Aggregates for Efficient Online Analytical Processing
IDEAS '99: Proceedings of the 1999 International Symposium on Database Engineering & Applications

Proper management of multidimensional aggregates is a fundamental prerequisite for efficient OLAP. The experimental OLAP server CubeStar, which concepts are described in this paper, was designed exactly for that purpose. All logical query processing is ...
An extendible multidimensional array system for MOLAP
SAC '06: Proceedings of the 2006 ACM symposium on Applied computing

In MOLAP systems, multidimensional arrays are employed to store fact tables dumped from the frontend relational database. On these fact tables, various kinds of statistical computations such as aggregate operations can be performed efficiently by ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGMOD Record

ACM SIGMOD Record Volume 26, Issue 2

June 1997

583 pages

ISSN:0163-5808

DOI:10.1145/253262

Chairman:
Sudha Ram
Univ. of Arizona, Tucson
,
Editor:
Joan M. Peckham
Univ. of Rhode Island, Kingston

Issue’s Table of Contents

SIGMOD '97: Proceedings of the 1997 ACM SIGMOD international conference on Management of data
June 1997
594 pages
ISBN:0897919114
DOI:10.1145/253260
Editors:
Joan M. Peckman
Univ. of Rhode Island, Kingston
,
Sudha Ram
Univ. of Arizona, Tucson
,
Michael Franklin

Copyright © 1997 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 1997

Published in SIGMOD Volume 26, Issue 2

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

304
Total Citations
View Citations
2,464
Total Downloads

Downloads (Last 12 months)305
Downloads (Last 6 weeks)42

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kuiper LMühleisen H(2023)These Rows Are Made for Sorting and That’s Just What We’ll Do2023 IEEE 39th International Conference on Data Engineering (ICDE)10.1109/ICDE55515.2023.00159(2050-2062)Online publication date: Apr-2023
https://doi.org/10.1109/ICDE55515.2023.00159
Rimi RHasan KTsuji T(2023)Multidimensional query processing algorithm by dimension transformationScientific Reports10.1038/s41598-023-31758-713:1Online publication date: 11-Apr-2023
https://doi.org/10.1038/s41598-023-31758-7
Dhana Sree Devi KAshwini PAnil Kumar NSwathy J(2023)Signature Proxy: An Efficient View Management Under Distributed ArchitectureProceedings of the 2nd International Conference on Cognitive and Intelligent Computing10.1007/978-981-99-2746-3_40(389-406)Online publication date: 2-Oct-2023
https://doi.org/10.1007/978-981-99-2746-3_40
Sudhir SCafarella MMadden S(2022)Replicated layout for in-memory database systemsProceedings of the VLDB Endowment10.14778/3503585.350360615:4(984-997)Online publication date: 14-Apr-2022
https://dl.acm.org/doi/10.14778/3503585.3503606
Xu JPei JCong Z(2022)Finding Multidimensional Simpson's ParadoxACM SIGKDD Explorations Newsletter10.1145/3575637.357564524:2(48-60)Online publication date: 8-Dec-2022
https://dl.acm.org/doi/10.1145/3575637.3575645
Song MLi MLi ZE. H(2018)A Distributed Self-adaption Cube Building Model Based on Query LogHuman Centered Computing10.1007/978-3-319-74521-3_41(382-393)Online publication date: 23-Jan-2018
https://doi.org/10.1007/978-3-319-74521-3_41
Morfonios KIoannidis Y(2018)Cube ImplementationsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_91(710-716)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_91
Morfonios KIoannidis Y(2017)Cube ImplementationsEncyclopedia of Database Systems10.1007/978-1-4899-7993-3_91-2(1-7)Online publication date: 4-Jan-2017
https://doi.org/10.1007/978-1-4899-7993-3_91-2
Faridi Masouleh MAfshar Kazemi MAlborzi MToloie Eshlaghy A(2016)A Genetic-Firefly Hybrid Algorithm to Find the Best Data Location in a Data CubeEngineering, Technology & Applied Science Research10.48084/etasr.7026:5(1187-1194)Online publication date: 23-Oct-2016
https://doi.org/10.48084/etasr.702
MAKINO MTSUJI THIGUCHI K(2016)History-Pattern Encoding for Large-Scale Dynamic Multidimensional Datasets and Its EvaluationsIEICE Transactions on Information and Systems10.1587/transinf.2015DAP0025E99.D:4(989-999)Online publication date: 2016
https://doi.org/10.1587/transinf.2015DAP0025
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents