A framework for scheduling parallel dbms user-defined programs on an attached high-performance computer
Pages 97 - 104
Abstract
We describe a software framework for deploying, scheduling and executing parallel DBMS user-defined programs on an attached high-performance computer (HPC) platform. This framework is advantageous for many DBMS workloads in the following two aspects. First, the long-running user-defined programs can be speeded up by taking advantage of the greater hardware parallel-ism available on the attached HPC platform. Second, the interac-tive response time of the remaining applications on the database server platform is improved by the off-loading of long-running user-defined programs to the attached HPC platform. Our frame-work provides a new approach for integrating high-performance computing into the workflow of query-oriented, computationally-intensive applications.
References
[1]
Becla, J., and Wong, D. L. 2005 Lessons Learned From Man-aging a Petabyte, Second Biennal Conference On Innovative Data Systems Research, pp. 70--83, Asilomar CA.
[2]
Chamberlin, D. 1998 A Complete Guide to DB2 Universal Database, Morgan-Kaufman, San Francisco.
[3]
Lee, K. C., Hickey, T. M. and Mak, V. W. 1991 VLSI Accel-erators for Large Database Systems, IEEE Micro, vol. 11, no. 6, pp. 8--20.
[4]
Faudemay, P. and Mhiri, M. 1991 An Associative Accelerator for Large Databases, IEEE Micro, vol. 11, no. 6, pp. 22--34.
[5]
Abdelguerfi, M. and Sood, A. K. 1991 A Fine-Grain Archi-tecture for Relational Database Aggregation Operations, IEEE Micro, vol. 11, no. 6, pp. 35--43.
[6]
Mak V. W., Lee, K. C., and Frieder, O. 1991 Exploiting Par-allelism in Pattern Matching: An Information Retrieval Ap-plication, ACM Transactions on Information Systems, vol. 9, no. 1, pp. 52--74.
[7]
Riedel, E., Faloutsos, C., Gibson, G. A. and Nagle, D. 2001 Active Disks for Large-Scale Data Processing, IEEE Com-puter, vol. 34, no. 6, pp. 68--74.
[8]
The message passing interface (MPI) standard, http://www-unix.mcs.anl.gov/mpi 2007.
[9]
IBM DB2 Version 9.1, http://www.ibm.com/software/data/db22007.
[10]
Gara, A. et al. 2005 Overview of the Blue Gene/L system architecture, IBM Journal of Research and Development, vol. 49, no. 2/3, pp. 195--212.
[11]
Pearson, R. 2000 Protein Sequence comparison and Protein evolution, Tutorial of Third International Conference on Intel-ligent Systems in Molecular Biology, La Jolla CA.
[12]
Haas, L. M., Schwarz, P. M., Kodali, P., Kotler, E., Rice, J. E., and Swope, W. C. 2001 DiscoveryLink: A System for In-tegrated Accesss to Life Sciences Data Services, IBM Sys-tems Journal, Vol. 40, no. 2, pp. 489--511 .
[13]
Stephens, S. M., Chen, J. Y., Davidson, M. G., Thomas, S. and Trute, B. M. 2005 Oracle Database 10g: a platform for BLAST search and Regular Expression pattern matching in life sciences, Nucleic Acids Research, Vol. 33, Database is-sue, pp. 675--679.
[14]
Eckman, B. and Del Prete, D. 2004 Efficient Access to BLAST Using IBM DB2 Information Integrator, IBM Healthcare and Life Science Publication.
[15]
Chen, Y., Mak, J., Skawratananond, C. and Tzeng, T-H. K. 2004 Scalability Comparison of Bioinformatics for Applica-tions on AIX and Linux on IBM e-server pSeries 690, IBM Redbook, http://www.redbooks.ibm.com/abstracts/redp3803.html 2004.
[16]
Darling, A. E., Carey, L. and Feng, W. 2003 The Design, Implementation and Evaluation of mpiBLAST, Proceedings of the 2003 Clusterworld conference, San Jose CA.
[17]
Lin, H., Ma, X., Chandramohan, P., Geist, A. and Samatova, N. 2005 Efficient data access for parallel blast, Proceedings of the 19th IEEE International Parallel and Distributed Process-ing Symposium, pp. 72--74, Denver CO.
[18]
Braun, R. C., Pedretti, K.T., Casavant, T.L., Scheetz, T.E, Birkett, C.L., and. Roberts, C.A. 1999 Three Complememtary Approaches to Parallelization of Local BLAST Service on Workstation Clusters, Proceedings of the 5th International Conference on Parallel Computing Technologies (PACT), Lecture Notes in Computer Science (LNCS), vol.1662, pp. 271--282.
[19]
Rangwala, H., Lant, E., Musselman, R., Pinnow, K., Smith, B. and Wallenfelt, B. 2005 Massively Parallel BLAST for the Blue Gene/L, High Availability and Performance Computing Workshop, Santa Fe NM.
[20]
SSEARCH documentation, http://helix.nih.gov/docs/gcg/ssearch.html 2007.
[21]
Bairoch, A. 2000 Serendipity in bioinformatics, the tribula-tions of a Swiss bioinformatician through exciting times! Bio-informatics vol. 16, no. 1, pp. 48--64.
[22]
sts database, ftp://ftp.ncbi.nih.gov/blast/db 2008.
[23]
Boguski, M. S. 1995 The turning point in genome research, Trends in Biochemical Sciences, vol. 20, no. 8, pp. 295--296.
[24]
Dean, J. and Ghemawat, S. 2004 MapReduce: Simplified Data Processing on Large Clusters, Proceedinsg of Operating System Design and Implementation, pp. 137--150, San Francisco CA.
[25]
Yom-Tov, E., Aharoni, U., Ghoting, A., Pednault, E., Pelleg, D., Toledano, H. and Natarajan, R. An Introduction to the IBM Parallel Mining Toolkit, http://www.ibm.com/developerworks/grid/library/gr-ipmlt/index.html 2007.
Index Terms
- A framework for scheduling parallel dbms user-defined programs on an attached high-performance computer
Recommendations
High-Performance Computing Education
Many successful efforts are currently addressing the critical shortage of a diverse, well-prepared high-performance computing (HPC) workforce. The guest editors' goal, with this issue, is to stimulate large-scale international discourse to accelerate ...
High-Performance Computing with Accelerators
This issue of CiSE is based on work presented at the US National Science Foundation workshop, Path to Petascale: Adapting Geo/Chem/Astro Applications for Accelerators and Accelerator Clusters, held at the US National Center for Supercomputing ...
A Scalable Runtime Fault Localization Framework for High-Performance Computing Systems
Fault localization has become an increasingly challenging issue in high-performance computing (HPC) systems. Various techniques have been used for HPC systems. However, as the HPC systems scale out, resulting in the rapid deterioration of the existing ...
Comments
Information & Contributors
Information
Published In
May 2008
334 pages
ISBN:9781605580777
DOI:10.1145/1366230
- General Chair:
- Alex Ramirez,
- Program Chairs:
- Gianfranco Biliardi,
- Michael Gschwind
Copyright © 2008 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 May 2008
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
Acceptance Rates
Overall Acceptance Rate 273 of 785 submissions, 35%
Upcoming Conference
CF '25
- Sponsor:
- sigmicro
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 227Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in