article

Free access

Control strategies for complex relational query processing in shared nothing systems

Authors:

Harald KoschAuthors Info & Claims

ACM SIGMOD Record, Volume 25, Issue 3

Pages 34 - 39

https://doi.org/10.1145/234889.234895

Published: 01 September 1996 Publication History

Abstract

In this paper, we present an original and complete methodology for supervising relational query processing in shared nothing systems. A new control mechanism is introduced which allows the detection and the correction of optimizer estimation errors and load imbalance. We especially focus on the management of intraprocessor communication and on the overlapping of communication and computation. Performance evaluations on an hypercube and a grid interconnection machine show the efficiency and the robustness of the proposed methods.

References

[1]

{BK95} L. Brunie and H. Kosch. A communication-oriented approach to parallel relational query optimization and processing. Research Report 95-32, LIP-ENS Lyon, November 1995.

[2]

{CB91} P. Valduriez M. Couprie and B. Bergstein. Prototyping DBS3, shared-memory parallel database system. In Proceedings of the 1st International Conference on Parallel and Distributed Information System, Miami Beach, Florida, December 1991.

Digital Library

[3]

{HM94} W. Hasan and R. Motwani. Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism. In Proceedings of the International Conference on Very Large Databases, pages 36-47, Santiago, Chile, September 1994.

Digital Library

[4]

{Hon92} Wei Hong. Exploiting Inter-Operation Parallelism in XPRS. In Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 19-28, USA, June 1992.

Digital Library

[5]

{IC91} Y.E. Ioannidis and S. Christodoulakis. On the Propagation of Errors in the Size of Join Results. In Proceedings of the ACM SIGMOD International Conference on Management of Data, Denver, USA, 1991.

Digital Library

[6]

{Inf94} Informix. INFORMIX-OnLine Dynamic Server (TM) - Technical Brief. 1994.

[7]

{JK84} M. Jarke and J. Koch. Query optimization in database systems. ACM Computer Surveys, 16(2), June 1984.

Digital Library

[8]

{LT94} H. Lu and K.L. Tan. Load-Balanced Join Processing in Shared-Nothing Systems. Journal of Parallel and Distributed Computing , 23:382-398, 1994.

Digital Library

[9]

{MD95} M. Mehta and D. DeWitt. Managing Intra-operator Parallelism in Parallel Database Systems. In Proceedings of the International Conference on Very Large Databases, Zurich, Switzerland, September 1995.

Digital Library

[10]

{ME92} P. Mishra and M.H. Eich. Join Processing in relational databases. ACM Computing Surveys , 24(1), March 1992.

Digital Library

[11]

{MR91} S. Miguet and Y. Robert. Elastic load balancing for image processing algorithms. In H.P. Zima, editor, Parallel Computation , Lecture Notes in Computer Science, pages 438-451 Salzburg, Austria, September 1991. 1st International ACPC Conference, Springer Verlag.

Digital Library

[12]

{MW94} G. Graefe R.L. Cole D.L. Davison W.J. McKenna and R.H. Wolniewicz. Extensible Query Optimization and Parallel Execution in Volcano, page 305. Query Processing for Advanced Database Applications. Morgan Kaufman, San Mateo, CA. 1994.

[13]

{NS92} D. Schneider D.J. DeWitt J. Naughton and S. Seshardi. Pratical skew handling in parallel joins. In Proceeding of the International Conference on Very Large Databases, Vancouver, British Columbia, August 1992.

Digital Library

[14]

{PV83} A. Flory C. Paultre and C. Veilleraud. A relational databank to aid in the dispensing of medicines. In Ball Van Bemmel and Wigertz, editors, Proceeding of MEDINFO 83, Amsterdam, North Holland, 1983.

[15]

{RR95} E. Rahm and R. Marek. Dynamic Multi Resource Load Balancing in Parallel Database Systems. In Proceedings of the International Conference on Very Large Databases, Zurich, Switzerland, September 1995.

Digital Library

[16]

{SD90} D. Schneider and D.J. DcWitt. Tradeoffs in processing complex join queries via hashing in multi-processor database machines. In Proceedings of the International Conference on Very Large Databases, Melbourne, Australia, August 1990.

Digital Library

[17]

{TW94} C. Mohan H. Pirahesh W.G. Tang and Y. Wang. Parallelism in relational database management sytems. IBM Systems Journal, 33(2), 1994.

Digital Library

[18]

{Val93} Patrick Valduriez. Parallel database systems: open problems and new issues. Distributed and Parallel Databases - an International Journal, 1(2):137-165, 1993.

Digital Library

[19]

{VZ94} R.S.G. Lanzelotte P. Valduriez and M. Zaït. Industrial-Strength Parallel Query Optimization: Issues and Lessons. Information Systems - An International Journal, 1994.

Digital Library

[20]

{YT91} J. Wolf D. Dias P. Yu and J. Turek. An effective algorithm for parallelizing hash joins in the presence of data skew. In Proceedings of the Seventh International Conference on Data Engineering, pages 200-209, Kobe, Japan, April 1991.

Digital Library

Cited By

Hameurlain AMorvan F(2018)CPU and incremental memory allocation in dynamic parallelization of SQL QueriesParallel Computing10.1016/S0167-8191(02)00074-128:4(525-556)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1016/S0167-8191%2802%2900074-1
Kacsuk PPodhorszki N(2018)Logicflow execution model for parallel databasesFuture Generation Computer Systems10.1016/S0167-739X(99)00079-516:6(677-692)Online publication date: 29-Dec-2018
https://dl.acm.org/doi/10.1016/S0167-739X%2899%2900079-5
Bouganim L(2018)Query Load Balancing in Parallel Database SystemsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_1080(3004-3008)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_1080
Show More Cited By

Index Terms

Control strategies for complex relational query processing in shared nothing systems

Recommendations

Performance analysis of "Groupby-After-Join" query processing in parallel database systems

Queries containing aggregate functions often combine multiple tables through join operations. This query is subsequently called "Groupby-Join". There is a special category of this query whereby the group-by operation can only be performed after the join ...
Dynamic Load Balancing in Very Large Shared-Nothing Hypercube Database Computers

Two relational join strategies, broadcast-based join and bucket-based join, have been recently proposed for the hypercube interconnection topology. The first strategy, however, incurs many unnecessary comparisons of pairs of tuples of the two relations. ...
Load Balancing for Parallel Query Execution on NUMA Multiprocessors

To scale up to high-end configurations, shared-memory multiprocessors are evolving towards Non Uniform Memory Access (NUMA) architectures. In this paper, we address the central problem of load balancing during parallel query execution in NUMA ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGMOD Record

ACM SIGMOD Record Volume 25, Issue 3

Sept. 1996

78 pages

ISSN:0163-5808

DOI:10.1145/234889

Editor:
Jennifer Widom
Stanford Univ., Stanford, CA

Issue’s Table of Contents

Copyright © 1996 Authors.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 1996

Published in SIGMOD Volume 25, Issue 3

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
116
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)2

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hameurlain AMorvan F(2018)CPU and incremental memory allocation in dynamic parallelization of SQL QueriesParallel Computing10.1016/S0167-8191(02)00074-128:4(525-556)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1016/S0167-8191%2802%2900074-1
Kacsuk PPodhorszki N(2018)Logicflow execution model for parallel databasesFuture Generation Computer Systems10.1016/S0167-739X(99)00079-516:6(677-692)Online publication date: 29-Dec-2018
https://dl.acm.org/doi/10.1016/S0167-739X%2899%2900079-5
Bouganim L(2018)Query Load Balancing in Parallel Database SystemsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_1080(3004-3008)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_1080
Bouganim L(2017)Query Load Balancing in Parallel Database SystemsEncyclopedia of Database Systems10.1007/978-1-4899-7993-3_1080-2(1-5)Online publication date: 1-Aug-2017
https://doi.org/10.1007/978-1-4899-7993-3_1080-2
Song HSun XChen Y(2011)A Hybrid Shared-Nothing/Shared-Data Storage Scheme for Large-Scale Data ProcessingProceedings of the 2011 IEEE Ninth International Symposium on Parallel and Distributed Processing with Applications10.1109/ISPA.2011.43(161-166)Online publication date: 26-May-2011
https://dl.acm.org/doi/10.1109/ISPA.2011.43
Song HAn MWang YWang WSun N(2009)Group-by Query Process in Middleware of Large Scale Data Intensive SystemsProceedings of the 2009 IEEE International Conference on Networking, Architecture, and Storage10.1109/NAS.2009.19(82-89)Online publication date: 9-Jul-2009
https://dl.acm.org/doi/10.1109/NAS.2009.19
Hameurlain AMorvan F(2009)Evolution of Query Optimization MethodsTransactions on Large-Scale Data- and Knowledge-Centered Systems I10.1007/978-3-642-03722-1_9(211-242)Online publication date: 25-Aug-2009
https://dl.acm.org/doi/10.1007/978-3-642-03722-1_9
Bouganim L(2009)Query Load Balancing in Parallel Database SystemsEncyclopedia of Database Systems10.1007/978-0-387-39940-9_1080(2268-2272)Online publication date: 2009
https://doi.org/10.1007/978-0-387-39940-9_1080
Barberet CBrunie LDesprez FLebourgeois GRobert YUbéda SVan Heumen K(2005)Technology transfer within the ProHPC TTN at ENS LyonHigh-Performance Computing and Networking10.1007/BFb0037126(1-12)Online publication date: 22-Jun-2005
https://doi.org/10.1007/BFb0037126
Barberet CBrunie LDesprez FLebourgeois GNamyst RRobert YUbéda SHeumen K(1999)Technology transfer within the ProHPC TTN at ENS LyonFuture Generation Computer Systems10.1016/S0167-739X(98)00076-415:3(309-321)Online publication date: Apr-1999
https://doi.org/10.1016/S0167-739X(98)00076-4
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents