article

Free access

Open issues in parallel query optimization

Authors:

Waqar Hasan,

Daniela Florescu,

Patrick ValduriezAuthors Info & Claims

ACM SIGMOD Record, Volume 25, Issue 3

Pages 28 - 33

https://doi.org/10.1145/234889.234894

Published: 01 September 1996 Publication History

PDF eReader

Abstract

We provide an overview of query processing in parallel database systems and discuss several open issues in the optimization of queries for parallel machines.

References

[1]

{1} T. Agerwala, J.L. Martin, J.H. Mirza, D.C. Sadler, D.M. Dias, and M. Snir. SP2 System Architecture. IBM Systems Journal, 34(2):152-184, 1995.

Digital Library

Google Scholar

[2]

{2} P.M.G. Apers, A.R. Hevner, and S.B. Yao. Optimization Algorithms for Distributed Queries. IEEE Transaction on Software Engineering, 9(1), 1983.

Google Scholar

[3]

{3} C.K. Baru, G. Fecteau, A. Goyal, H. Hsiao, A. Jhingran, S. Padmanabhan, G.P. Copeland, and W.G. Wilson. DB2 Parallel Edition. IBM Systems Journal, 34(2):292-322, 1995.

Digital Library

Google Scholar

[4]

{4} B. Bergsten, M. Couprie, and P. Valduriez. Prototyping DBS3, a Shared-Memory Parallel Database System. In First International Conference on Parallel and Distributed Information Systems, Miami Beach, Florida, December 1991.

Digital Library

Google Scholar

[5]

{5} H. Boral, L. Clay, G. Copeland, S. Danforth, M. Franklin, B. Hart, M. Smith, and P. Valduriez. Prototyping Bubba, A Highly Parallel Database System. IEEE Transactions on Knowledge and Data Engineering, 2(1), March 1990.

Digital Library

Google Scholar

[6]

{6} L. Bouganim, D. Florescu, and P. Valduriez. Dynamic Load Balancing in Hierarchical Parallel Database Systems. In Proceedings of the Twenty Second International Conference on Very Large Data Bases, September 1996.

Digital Library

Google Scholar

[7]

{7} F. Carino and P. Kostamaa. Exegesis of DBC/1012 and P- 90-Industrial Supercomputer Database Machines. In Parallel Architectures and Languages Europe, Paris, France, June 1992.

Digital Library

Google Scholar

[8]

{8} C. Chekuri, W. Hasan, and R. Motwani. Scheduling Problems in Parallel Query Optimization. In Proceedings of the Fourteenth ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, 1995.

Digital Library

Google Scholar

[9]

{9} D. DeWitt, J. Naughton, D. Schneider, and S. Seshadri. Practical Skew Handling in Parallel Joins. In Proceedings of the Eighteenth International Conference on Very Large Data Bases, Vancouver, British Columbia, Canada, August 1992.

Digital Library

Google Scholar

[10]

{10} D.J. DeWitt and J. Gray. Parallel Database Systems: The Future of High Performance Database Systems. Communications of the ACM, 35(6):85-98, June 1992.

Digital Library

Google Scholar

[11]

{11} D.J. DeWitt, S. Ghandeharizadeh, D. Schneider, A. Bricker, H.-I. Hsiao, and R. Rasmussen. The Gamma database machine project. IEEE Transactions on Knowledge and Data Engineering, 2(1), March 1990.

Digital Library

Google Scholar

[12]

{12} S. Englert, R. Glasstone, and W. Hasan. Parallelism and its Price: A Case Study of NonStop SQL/MP. 1995. Sigmod Record, Dec. 1995.

Digital Library

Google Scholar

[13]

{13} D. Florescu, J.-R. Gruser, M. Novak, P. Valduriez, and M. Ziane. Design and Implementation of Flora, A Language for Object Algebra. Information Sciences, 1995.

Digital Library

Google Scholar

[14]

{14} S. Ganguly, W. Hasan, and R. Krishnamurthy. Query Optimization for Parallel Execution. In Proceedings of ACM-SIGMOD International Conference on Management of Data, pages 9-18, June 1992.

Digital Library

Google Scholar

[15]

{15} M.R. Garey and D.S. Johnson. Computers and Intractability . W.H. Freeman and Company, 1979.

Google Scholar

[16]

{16} G. Graefe. Encapsulation of Parallelism in the Volcano Query Processing System. In Proceedings of ACM-SIGMOD International Conference on Management of Data, May 1990.

Digital Library

Google Scholar

[17]

{17} G. Graefe and K. Ward. Dynamic Query Optimization Plans. In Proceedings of ACM-SIGMOD International Conference on Management of Data, May 1989.

Digital Library

Google Scholar

[18]

{18} R.L. Graham, E.L. Lawler, J.K. Lenstra, and A.H.G. Rinnooy Kan. Optimization and Approximation in Deterministic Sequencing and Scheduling: A Survey. Annals of Discrete Mathematics, 5:287-326, 1979.

Google Scholar

[19]

{19} L.M. Haas, J.C. Freytag, G.M. Lohman, and H. Pirahesh. Extensible Query Processing in Starburst. In Proceedings of ACM-SIGMOD International Conference on Management of Data, June 1989.

Digital Library

Google Scholar

[20]

{20} A. Hameurlain and F. Morvan. Explciting inter-operation parallelism for sql query optimization. In Proceedings of the International Conference On Database and Expert Systems Applications, Greece, September 1994.

Digital Library

Google Scholar

[21]

{21} W. Hasan. Optimization of SQL Queries for Parallel Machines. PhD thesis, Stanford University, 1995. http://www-db.stanford.edu/pub/hasan/1995/thesis.ps.

Digital Library

Google Scholar

[22]

{22} W. Hasan and R. Motwani. Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism. In Proceedings of the Twentieth International Conference on Very Large Data Bases, pages 36-47, Santiago, Chile, September 1994.

Digital Library

Google Scholar

[23]

{23} W. Hasan and R. Motwani. Coloring Away Communication in Parallel Query Optimization. In Proceedings of the Twenty First International Conference on Very Large Data Bases, Zurich, Switzerland, September 1995.

Digital Library

Google Scholar

[24]

{24} W. Hong. Parallel Query Processing Using Shared Memory Multiprocessors and Disk Arrays. PhD thesis, University of California, Berkeley, August 1992.

Google Scholar

[25]

{25} W. Hong and M. Stonebraker. Optimization of Parallel Query Execution Plans in XPRS. In Proceedings of the First International Conference on Parallel and Distributed Information Systems, December 1991.

Digital Library

Google Scholar

[26]

{26} Informix. INFORMIX-OnLine Extended Parallel Server for Loosely Coupled Cluster and Massively Parallel Processing Architectures, July 1995. http://www.informix.com.

Google Scholar

[27]

{27} G. Lohman, C. Mohan, L. Haas, D. Daniels, B. Lindsay, P. Selinger, and P. Wilms. Query Processing in R^*. In W. Kim, D. Reiner, and D.S. Batory, editors. Query Processing in Database Systems. Springer Verlag, 1985.

Google Scholar

[28]

{28} C. Mohan, H. Pirahesh, W.G. Tang, and Y. Wang. Parallelism in Relational Database Management Systems. IBM Systems Journal, 33(2), 1994.

Digital Library

Google Scholar

[29]

{29} Oracle. Oracle Parallel Server, 1995. http://www.oracle.com.

Google Scholar

[30]

{30} M.T. Ozsu and P. Valduriez. Principles of Distributed Database Systems. Prentice-Hall, 1991.

Digital Library

Google Scholar

[31]

{31} S. Roy. Adaptive Methods in Parallel Databases. PhD thesis, Stanford University, 1991. Stanford CS Report STAN-CS-91-1397.

Digital Library

Google Scholar

[32]

{32} P. Valduriez S. Parker, E. Simon. SVP. a Data Model Capturing Sets, Streams and Parallelism. In Proceedings of the Eighteenth International Conference on Very Large Data Bases, Vancouver, British Columbia, Canada, August 1992.

Digital Library

Google Scholar

[33]

{33} M. Stonebraker, R. Devine, M. Komacker, W. Litwin, A. Pfeffer, A. Sah, and C. Staelin. An Economic Paradigm for Query Processing and Data Migration in Mariposa. In Third International Conference on Parallel and Distributed Information Systems, Austin, Texas, September 1994.

Digital Library

Google Scholar

[34]

{34} Tandem. Query Processing Using NonStop SQL/MP, 1995. http://www.tandem.com.

Google Scholar

[35]

{35} P. Valduriez. Parallel Database Systems: Open Problems and New Issues. Distributed and Parallel Databases: An International Journal, 1(2):137-165, April 1993.

Digital Library

Google Scholar

[36]

{36} C.B. Walton, A.G. Dale, and R.M. Jenevein. A Taxonomy and Performance Model of Data Skew Effects in Parallel Joins. In Proceedings of the Seventeenth International Conference on Very Large Data Bases, Barcelona Spain, September 1991.

Digital Library

Google Scholar

Cited By

View all

Smith JWatson PGounaris APaton NFernandes ASakellariou R(2016)Distributed Query Processing on the GridThe International Journal of High Performance Computing Applications10.1177/1094342003017400217:4(353-367)Online publication date: 26-Jul-2016
https://doi.org/10.1177/10943420030174002
Deepak SKumar SDurgesh MK. P(2012)Query Processing and Optimization of Parallel Database System in Multi Processor EnvironmentsProceedings of the 2012 Sixth Asia Modelling Symposium10.1109/AMS.2012.49(191-194)Online publication date: 29-May-2012
https://dl.acm.org/doi/10.1109/AMS.2012.49
Sabesan MRisch T(2011)Adaptive Parallelization of Queries Calling Dependent Data Providing Web ServicesNew Frontiers in Information and Software as Services10.1007/978-3-642-19294-4_6(132-154)Online publication date: 2011
https://doi.org/10.1007/978-3-642-19294-4_6
Show More Cited By

Index Terms

Open issues in parallel query optimization
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Database query processing
    2. Query languages
2. Theory of computation
  1. Theory and algorithms for application domains
    1. Database theory
      1. Database query processing and optimization (theory)

Recommendations

Open issues in MPI implementation
ACSAC'07: Proceedings of the 12th Asia-Pacific conference on Advances in Computer Systems Architecture

MPI (the Message Passing Interface) continues to be the dominant programming model for parallel machines of all sizes, from small Linux clusters to the largest parallel supercomputers such as IBM Blue Gene/L and Cray XT3. Although the MPI standard was ...
Query optimization for massively parallel data processing
SOCC '11: Proceedings of the 2nd ACM Symposium on Cloud Computing

MapReduce has been widely recognized as an efficient tool for large-scale data analysis. It achieves high performance by exploiting parallelism among processing nodes while providing a simple interface for upper-layer applications. Some vendors have ...
Flow Algorithms for Parallel Query Optimization
ICDE '08: Proceedings of the 2008 IEEE 24th International Conference on Data Engineering

We address the problem of minimizing the response time of a multi-way join query using pipelined (inter-operator) parallelism, in a parallel or a distributed environment. We observe that in order to fully exploit the parallelism in the system, we must ...

Comments

Information & Contributors

Information

Published In

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 1996

Published in SIGMOD Volume 25, Issue 3

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
1,501
Total Downloads

Downloads (Last 12 months)114
Downloads (Last 6 weeks)20

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Smith JWatson PGounaris APaton NFernandes ASakellariou R(2016)Distributed Query Processing on the GridThe International Journal of High Performance Computing Applications10.1177/1094342003017400217:4(353-367)Online publication date: 26-Jul-2016
https://doi.org/10.1177/10943420030174002
Deepak SKumar SDurgesh MK. P(2012)Query Processing and Optimization of Parallel Database System in Multi Processor EnvironmentsProceedings of the 2012 Sixth Asia Modelling Symposium10.1109/AMS.2012.49(191-194)Online publication date: 29-May-2012
https://dl.acm.org/doi/10.1109/AMS.2012.49
Sabesan MRisch T(2011)Adaptive Parallelization of Queries Calling Dependent Data Providing Web ServicesNew Frontiers in Information and Software as Services10.1007/978-3-642-19294-4_6(132-154)Online publication date: 2011
https://doi.org/10.1007/978-3-642-19294-4_6
Safaei AHaghjoo M(2010)Parallel processing of continuous queries over data streamsDistributed and Parallel Databases10.1007/s10619-010-7066-328:2-3(93-118)Online publication date: 1-Dec-2010
https://dl.acm.org/doi/10.1007/s10619-010-7066-3
Sabesan MRisch T(2009)Adaptive Parallelization of Queries over Dependent Web Service CallsProceedings of the 2009 IEEE International Conference on Data Engineering10.1109/ICDE.2009.148(1725-1732)Online publication date: 29-Mar-2009
https://dl.acm.org/doi/10.1109/ICDE.2009.148
Hameurlain AMorvan F(2009)Evolution of Query Optimization MethodsTransactions on Large-Scale Data- and Knowledge-Centered Systems I10.1007/978-3-642-03722-1_9(211-242)Online publication date: 25-Aug-2009
https://dl.acm.org/doi/10.1007/978-3-642-03722-1_9
Hameurlain A(2009)Evolution of Query Optimization MethodsProceedings of the 20th International Conference on Database and Expert Systems Applications10.1007/978-3-642-03573-9_40(460-470)Online publication date: 25-Aug-2009
https://dl.acm.org/doi/10.1007/978-3-642-03573-9_40
Yu YIsard MFetterly DBudiu MErlingsson ÚGunda PCurrey J(2008)DryadLINQProceedings of the 8th USENIX conference on Operating systems design and implementation10.5555/1855741.1855742(1-14)Online publication date: 8-Dec-2008
https://dl.acm.org/doi/10.5555/1855741.1855742
Deshpande AHellerstein L(2008)Flow Algorithms for Parallel Query OptimizationProceedings of the 2008 IEEE 24th International Conference on Data Engineering10.1109/ICDE.2008.4497484(754-763)Online publication date: 7-Apr-2008
https://dl.acm.org/doi/10.1109/ICDE.2008.4497484
Han WNg JMarkl VKache HKandil MZhou LLing TOoi B(2007)Progressive optimization in a shared-nothing parallel databaseProceedings of the 2007 ACM SIGMOD international conference on Management of data10.1145/1247480.1247569(809-820)Online publication date: 11-Jun-2007
https://dl.acm.org/doi/10.1145/1247480.1247569
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Open issues in MPI implementation

Query optimization for massively parallel data processing

Flow Algorithms for Parallel Query Optimization

Comments

Information

Published In

Publisher

Publication History

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations